2024-04-26T07:47:19.306 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T07:47:19.306 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640 --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} --name gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi --owner scheduled_gsalomon@teuthology -- /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640/orig.config.yaml 2024-04-26T07:47:19.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T07:47:19.407 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640 branch: fix_error_message_flow description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: gsalomon@redhat.com first_in_suite: false job_id: '7674640' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: fix_error_message_flow ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: fix_error_message_flow sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 owner: scheduled_gsalomon@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 8229 sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 sleep_before_teardown: 0 suite: rgw suite_branch: fix_error_message_flow suite_path: /home/teuthworker/src/github.com_galsalomon66_ceph_5bfac0af933f1833ec096c3048e2c80e20507e52/qa suite_relpath: qa suite_repo: https://github.com/galsalomon66/ceph suite_sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOvOaAghTYyI00S0sp3S+uR+6LpYtE8KKSAsDMO8/QHIVl9xf5Ujq6yAf3u6KirxQHWzg2pop8Xb07IHvKz1mw= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHpJJS1HwxmA0PLhh4yvH65eFEcl69taPnALw3oSXzrEMcLAWO1ztf+nKsottz7XPcdsf1RMBBZ9wHI9tg2KgFw= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_07:23:10 tube: smithi user: gsalomon verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T07:47:19.407 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_galsalomon66_ceph_5bfac0af933f1833ec096c3048e2c80e20507e52/qa; will attempt to use it 2024-04-26T07:47:19.408 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_galsalomon66_ceph_5bfac0af933f1833ec096c3048e2c80e20507e52/qa/tasks 2024-04-26T07:47:19.408 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T07:47:19.409 INFO:teuthology.task.internal:Checking packages... 2024-04-26T07:47:19.432 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5bfac0af933f1833ec096c3048e2c80e20507e52' 2024-04-26T07:47:19.432 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:47:19.432 INFO:teuthology.packaging:ref: None 2024-04-26T07:47:19.432 INFO:teuthology.packaging:tag: None 2024-04-26T07:47:19.432 INFO:teuthology.packaging:branch: fix_error_message_flow 2024-04-26T07:47:19.433 INFO:teuthology.packaging:sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:47:19.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=fix_error_message_flow 2024-04-26T07:47:19.706 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3092.g5bfac0af 2024-04-26T07:47:19.707 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T07:47:19.713 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T07:47:19.713 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T07:47:19.750 INFO:teuthology.task.internal:Saving configuration 2024-04-26T07:47:19.763 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T07:47:19.783 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T07:47:19.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 07:42:24.444093', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOvOaAghTYyI00S0sp3S+uR+6LpYtE8KKSAsDMO8/QHIVl9xf5Ujq6yAf3u6KirxQHWzg2pop8Xb07IHvKz1mw='} 2024-04-26T07:47:19.832 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 07:42:24.445652', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHpJJS1HwxmA0PLhh4yvH65eFEcl69taPnALw3oSXzrEMcLAWO1ztf+nKsottz7XPcdsf1RMBBZ9wHI9tg2KgFw='} 2024-04-26T07:47:19.832 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T07:47:19.837 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-04-26T07:47:19.837 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-26T07:47:19.837 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T07:47:19.930 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff9f27e10d0>, signals=[15]) 2024-04-26T07:47:19.930 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T07:47:19.936 INFO:teuthology.task.internal:Opening connections... 2024-04-26T07:47:19.936 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-04-26T07:47:19.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:47:20.014 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:47:20.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:47:20.090 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T07:47:20.096 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-04-26T07:47:20.114 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-04-26T07:47:20.115 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-04-26T07:47:20.171 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-04-26T07:47:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T07:47:20.174 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T07:47:20.174 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T07:47:20.174 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-04-26T07:47:20.192 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-04-26T07:47:20.210 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-04-26T07:47:20.210 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-04-26T07:47:20.268 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-04-26T07:47:20.268 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-04-26T07:47:20.268 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-04-26T07:47:20.268 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-04-26T07:47:20.268 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-04-26T07:47:20.268 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-04-26T07:47:20.268 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T07:47:20.268 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-04-26T07:47:20.269 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-04-26T07:47:20.269 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T07:47:20.269 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-04-26T07:47:20.269 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T07:47:20.269 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T07:47:20.269 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T07:47:20.269 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-04-26T07:47:20.291 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T07:47:20.299 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T07:47:20.326 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T07:47:20.326 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-04-26T07:47:20.329 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-04-26T07:47:20.345 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T07:47:20.350 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T07:47:20.350 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-04-26T07:47:20.385 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-04-26T07:47:20.411 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T07:47:20.465 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T07:47:20.478 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-26T07:47:20.478 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-26T07:47:20.479 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T07:47:20.479 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T07:47:20.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:20.496 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-04-26T07:47:20.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:20.497 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-04-26T07:47:20.554 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-437.el9.x86_64 2024-04-26T07:47:20.555 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.14.0-437.el9.x86_64 2024-04-26T07:47:20.555 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2024-04-26T07:47:20.556 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-437.el9.x86_64 2024-04-26T07:47:20.556 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-437.el9.x86_64 2024-04-26T07:47:20.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-04-26T07:47:22.756 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-26T07:47:23.080 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.0 MB 00:00 2024-04-26T07:47:24.832 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-26T07:47:25.273 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-26T07:47:29.233 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.2 MB 00:00 2024-04-26T07:47:29.565 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-26T07:47:31.022 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-04-26T07:47:31.506 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-04-26T07:47:33.002 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-26T07:47:34.414 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 21 MB 00:03 2024-04-26T07:47:38.224 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-04-26T07:47:39.523 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-04-26T07:47:40.255 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T07:47:40.255 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T07:47:40.350 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:47:40.352 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:47:40.352 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:47:40.471 DEBUG:teuthology.orchestra.run.smithi062:> echo no | sudo yum reinstall kernel || true 2024-04-26T07:47:40.996 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 07:47:38 AM UTC. 2024-04-26T07:47:41.138 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:47:41.153 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout:Reinstalling: 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 255 k 2024-04-26T07:47:41.154 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 0 2024-04-26T07:47:41.155 INFO:teuthology.orchestra.run.smithi062.stderr:Operation aborted. 2024-04-26T07:47:41.214 INFO:teuthology.orchestra.run.smithi062.stdout:Is this ok [y/N]: 2024-04-26T07:47:41.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum reinstall -y kernel || true 2024-04-26T07:47:41.437 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T07:47:41.437 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T07:47:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:47:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:47:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:47:41.652 DEBUG:teuthology.orchestra.run.smithi001:> echo no | sudo yum reinstall kernel || true 2024-04-26T07:47:41.730 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 07:47:38 AM UTC. 2024-04-26T07:47:41.852 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:47:41.853 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:47:41.853 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-26T07:47:41.853 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:47:41.853 INFO:teuthology.orchestra.run.smithi062.stdout:Reinstalling: 2024-04-26T07:47:41.853 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T07:47:41.853 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:47:41.853 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:47:41.853 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:47:41.854 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:47:41.854 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 255 k 2024-04-26T07:47:41.854 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 0 2024-04-26T07:47:41.854 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:47:42.174 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 07:47:39 AM UTC. 2024-04-26T07:47:42.268 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.8 MB/s | 255 kB 00:00 2024-04-26T07:47:42.268 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:47:42.268 INFO:teuthology.orchestra.run.smithi062.stdout:Total 614 kB/s | 255 kB 00:00 2024-04-26T07:47:42.289 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:47:42.299 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:47:42.313 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:47:42.313 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-04-26T07:47:42.313 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:47:42.313 INFO:teuthology.orchestra.run.smithi001.stdout:Reinstalling: 2024-04-26T07:47:42.313 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T07:47:42.313 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:47:42.314 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:47:42.314 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:47:42.314 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:47:42.314 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 255 k 2024-04-26T07:47:42.314 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 0 2024-04-26T07:47:42.314 INFO:teuthology.orchestra.run.smithi001.stderr:Operation aborted. 2024-04-26T07:47:42.374 INFO:teuthology.orchestra.run.smithi001.stdout:Is this ok [y/N]: 2024-04-26T07:47:42.374 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum reinstall -y kernel || true 2024-04-26T07:47:42.477 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:47:42.477 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:47:42.482 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:47:42.483 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:47:42.630 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:47:42.711 INFO:teuthology.orchestra.run.smithi062.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T07:47:42.711 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T07:47:42.891 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 07:47:39 AM UTC. 2024-04-26T07:47:43.012 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:47:43.012 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout:Reinstalling: 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 255 k 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 0 2024-04-26T07:47:43.013 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:47:43.274 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.8 MB/s | 255 kB 00:00 2024-04-26T07:47:43.275 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:47:43.275 INFO:teuthology.orchestra.run.smithi001.stdout:Total 973 kB/s | 255 kB 00:00 2024-04-26T07:47:43.298 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:47:43.444 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T07:47:43.444 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T07:47:43.478 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:47:43.478 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:47:43.483 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:47:43.484 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:47:43.620 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:47:43.693 INFO:teuthology.orchestra.run.smithi001.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T07:47:43.693 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T07:47:44.153 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T07:47:44.153 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:47:44.153 INFO:teuthology.orchestra.run.smithi062.stdout:Reinstalled: 2024-04-26T07:47:44.153 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T07:47:44.154 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:47:44.154 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:47:44.339 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T07:47:44.381 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T07:47:44.381 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T07:47:44.388 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T07:47:44.388 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T07:47:44.388 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T07:47:44.388 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-26T07:47:44.388 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T07:47:44.420 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-04-26T07:47:44.446 DEBUG:teuthology.parallel:result is None 2024-04-26T07:47:45.077 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T07:47:45.077 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:47:45.078 INFO:teuthology.orchestra.run.smithi001.stdout:Reinstalled: 2024-04-26T07:47:45.078 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T07:47:45.078 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:47:45.078 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:47:45.248 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T07:47:45.295 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T07:47:45.295 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T07:47:45.295 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T07:47:45.295 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T07:47:45.295 DEBUG:teuthology.orchestra.run.smithi001:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T07:47:45.323 INFO:teuthology.orchestra.run.smithi001.stdout:ttyS1 2024-04-26T07:47:45.354 DEBUG:teuthology.parallel:result is None 2024-04-26T07:47:45.354 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T07:47:45.362 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T07:47:45.363 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T07:47:45.397 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T07:47:45.415 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T07:47:45.421 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T07:47:45.447 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T07:47:45.447 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T07:47:45.451 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T07:47:45.487 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T07:47:45.493 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T07:47:45.493 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T07:47:45.510 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T07:47:45.542 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:47:45.552 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:47:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:47:45.572 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:47:45.574 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T07:47:45.581 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T07:47:45.582 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T07:47:45.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T07:47:45.643 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T07:47:45.651 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T07:47:45.652 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T07:47:45.660 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T07:47:45.700 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:47:45.757 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:47:45.799 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:47:45.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:47:45.922 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:47:45.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T07:47:45.986 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:47:46.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:47:46.087 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:47:46.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:47:46.216 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:47:46.216 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T07:47:46.284 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-04-26T07:47:46.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-04-26T07:47:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:47:46.363 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:47:46.827 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T07:47:46.835 INFO:teuthology.task.internal:Starting timer... 2024-04-26T07:47:46.835 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T07:47:46.930 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T07:47:46.939 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-26T07:47:46.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-04-26T07:47:47.011 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-04-26T07:47:47.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-04-26T07:47:47.060 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-04-26T07:47:47.062 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T07:47:47.063 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-04-26T07:47:47.096 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-04-26T07:47:47.096 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-04-26T07:47:47.120 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-04-26T07:47:47.120 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi062.front.sepia.ceph.com': 'permissive'} 2024-04-26T07:47:47.120 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T07:47:47.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:47.163 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T07:47:47.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:47.191 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T07:47:47.191 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-04-26T07:47:47.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-04-26T07:47:47.257 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T07:47:47.266 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T07:47:47.281 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T07:47:47.282 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T07:51:22.219 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2024-04-26T07:51:22.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-04-26T07:51:22.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:51:22.299 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-04-26T07:51:22.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-04-26T07:51:22.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-26T07:51:22.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:51:22.459 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-04-26T07:51:22.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-26T07:51:22.544 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T07:51:22.557 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T07:51:22.557 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T07:51:22.557 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:51:22.560 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T07:51:22.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:51:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T07:51:22.602 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T07:51:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T07:51:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-04-26T07:51:22.633 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T07:51:22.637 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-04-26T07:51:22.651 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T07:51:22.659 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-04-26T07:51:22.664 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T07:51:22.670 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-04-26T07:51:22.684 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T07:51:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T07:51:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-04-26T07:51:22.722 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:51:22.722 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-04-26T07:51:22.722 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:51:22.722 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:51:22.722 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:51:22.722 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:51:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-04-26T07:51:22.759 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:51:22.759 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-04-26T07:51:22.759 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:51:22.759 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:51:22.759 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:51:22.759 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:51:22.760 INFO:teuthology.run_tasks:Running task install... 2024-04-26T07:51:22.768 DEBUG:teuthology.task.install:project ceph 2024-04-26T07:51:22.768 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}} 2024-04-26T07:51:22.769 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'} 2024-04-26T07:51:22.769 INFO:teuthology.task.install:Using flavor: default 2024-04-26T07:51:22.775 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T07:51:22.775 INFO:teuthology.task.install:extra packages: [] 2024-04-26T07:51:22.776 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52', 'tag': None, 'wait_for_package': False} 2024-04-26T07:51:22.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:51:22.779 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52', 'tag': None, 'wait_for_package': False} 2024-04-26T07:51:22.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:51:22.923 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/centos/9/flavors/default/ 2024-04-26T07:51:22.923 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3092.g5bfac0af 2024-04-26T07:51:23.093 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/centos/9/flavors/default/ 2024-04-26T07:51:23.094 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3092.g5bfac0af 2024-04-26T07:51:23.162 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T07:51:23.162 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:51:23.162 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T07:51:23.189 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-26T07:51:23.189 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5bfac0af933f1833ec096c3048e2c80e20507e52/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T07:51:23.202 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T07:51:23.203 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:51:23.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T07:51:23.231 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-26T07:51:23.231 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5bfac0af933f1833ec096c3048e2c80e20507e52/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T07:51:23.255 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T07:51:23.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T07:51:23.331 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T07:51:23.376 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T07:51:23.396 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-04-26T07:51:23.398 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-04-26T07:51:23.442 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-04-26T07:51:23.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-04-26T07:51:23.632 INFO:teuthology.orchestra.run.smithi001.stdout:48 files removed 2024-04-26T07:51:23.659 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw 2024-04-26T07:51:23.681 INFO:teuthology.orchestra.run.smithi062.stdout:48 files removed 2024-04-26T07:51:23.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw 2024-04-26T07:51:24.356 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 196 kB/s | 84 kB 00:00 2024-04-26T07:51:24.451 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-04-26T07:51:24.757 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-04-26T07:51:25.160 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 17 kB/s | 12 kB 00:00 2024-04-26T07:51:25.366 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2024-04-26T07:51:25.969 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 2.5 kB/s | 1.9 kB 00:00 2024-04-26T07:51:26.293 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.0 MB 00:00 2024-04-26T07:51:26.896 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.0 MB 00:00 2024-04-26T07:51:28.453 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-26T07:51:28.981 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-26T07:51:32.746 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T07:51:33.407 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.2 MB 00:00 2024-04-26T07:51:34.327 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-26T07:51:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-26T07:51:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-26T07:51:36.890 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 21 MB 00:02 2024-04-26T07:51:41.948 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 50 kB/s | 1.7 kB 00:00 2024-04-26T07:51:42.179 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-04-26T07:51:44.293 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:51:44.295 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:51:44.296 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:51:44.296 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:51:44.296 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:51:44.296 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 11 M 2024-04-26T07:51:44.296 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-04-26T07:51:44.296 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 3.4 M 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 3.1 M 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 5.4 M 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 21 M 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 25 k 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 746 k 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T07:51:44.297 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 501 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 5.4 M 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 45 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 135 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 162 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 321 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 298 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 99 k 2024-04-26T07:51:44.298 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout:Install 30 Packages 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 2 Packages 2024-04-26T07:51:44.299 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:51:44.300 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 60 M 2024-04-26T07:51:44.300 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:51:44.508 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:51:44.510 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:51:44.510 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:51:44.510 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 11 M 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 3.4 M 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 3.1 M 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 5.4 M 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 21 M 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 25 k 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T07:51:44.511 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 746 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 501 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 5.4 M 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 45 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 135 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 162 k 2024-04-26T07:51:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 321 k 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 298 k 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 99 k 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout:Install 30 Packages 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 2 Packages 2024-04-26T07:51:44.513 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:51:44.514 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 60 M 2024-04-26T07:51:44.514 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:51:45.924 INFO:teuthology.orchestra.run.smithi062.stdout:(1/32): ceph-base-19.0.0-3092.g5bfac0af.el9.x86 3.8 MB/s | 5.4 MB 00:01 2024-04-26T07:51:46.132 INFO:teuthology.orchestra.run.smithi062.stdout:(2/32): ceph-common-19.0.0-3092.g5bfac0af.el9.x 13 MB/s | 21 MB 00:01 2024-04-26T07:51:46.158 INFO:teuthology.orchestra.run.smithi062.stdout:(3/32): ceph-selinux-19.0.0-3092.g5bfac0af.el9. 108 kB/s | 25 kB 00:00 2024-04-26T07:51:46.217 INFO:teuthology.orchestra.run.smithi062.stdout:(4/32): libcephfs2-19.0.0-3092.g5bfac0af.el9.x8 8.8 MB/s | 746 kB 00:00 2024-04-26T07:51:46.266 INFO:teuthology.orchestra.run.smithi062.stdout:(5/32): libradosstriper1-19.0.0-3092.g5bfac0af. 4.5 MB/s | 501 kB 00:00 2024-04-26T07:51:46.367 INFO:teuthology.orchestra.run.smithi062.stdout:(6/32): python3-ceph-argparse-19.0.0-3092.g5bfa 451 kB/s | 45 kB 00:00 2024-04-26T07:51:46.475 INFO:teuthology.orchestra.run.smithi062.stdout:(7/32): python3-ceph-common-19.0.0-3092.g5bfac0 1.2 MB/s | 135 kB 00:00 2024-04-26T07:51:46.584 INFO:teuthology.orchestra.run.smithi062.stdout:(8/32): python3-cephfs-19.0.0-3092.g5bfac0af.el 1.5 MB/s | 162 kB 00:00 2024-04-26T07:51:46.684 INFO:teuthology.orchestra.run.smithi062.stdout:(9/32): librgw2-19.0.0-3092.g5bfac0af.el9.x86_6 11 MB/s | 5.4 MB 00:00 2024-04-26T07:51:46.709 INFO:teuthology.orchestra.run.smithi062.stdout:(10/32): python3-rados-19.0.0-3092.g5bfac0af.el 2.5 MB/s | 321 kB 00:00 2024-04-26T07:51:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:(11/32): python3-rgw-19.0.0-3092.g5bfac0af.el9. 1.7 MB/s | 99 kB 00:00 2024-04-26T07:51:46.771 INFO:teuthology.orchestra.run.smithi001.stdout:(1/32): ceph-base-19.0.0-3092.g5bfac0af.el9.x86 2.7 MB/s | 5.4 MB 00:01 2024-04-26T07:51:46.813 INFO:teuthology.orchestra.run.smithi001.stdout:(2/32): ceph-selinux-19.0.0-3092.g5bfac0af.el9. 609 kB/s | 25 kB 00:00 2024-04-26T07:51:46.905 INFO:teuthology.orchestra.run.smithi001.stdout:(3/32): libcephfs2-19.0.0-3092.g5bfac0af.el9.x8 8.0 MB/s | 746 kB 00:00 2024-04-26T07:51:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 755 kB/s | 107 kB 00:00 2024-04-26T07:51:46.972 INFO:teuthology.orchestra.run.smithi001.stdout:(4/32): libradosstriper1-19.0.0-3092.g5bfac0af. 7.4 MB/s | 501 kB 00:00 2024-04-26T07:51:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:(13/32): python3-rbd-19.0.0-3092.g5bfac0af.el9. 990 kB/s | 298 kB 00:00 2024-04-26T07:51:47.011 INFO:teuthology.orchestra.run.smithi062.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-04-26T07:51:47.044 INFO:teuthology.orchestra.run.smithi062.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-04-26T07:51:47.136 INFO:teuthology.orchestra.run.smithi062.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-04-26T07:51:47.170 INFO:teuthology.orchestra.run.smithi062.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-04-26T07:51:47.195 INFO:teuthology.orchestra.run.smithi062.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 725 kB/s | 42 kB 00:00 2024-04-26T07:51:47.228 INFO:teuthology.orchestra.run.smithi062.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-26T07:51:47.254 INFO:teuthology.orchestra.run.smithi062.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 613 kB/s | 36 kB 00:00 2024-04-26T07:51:47.279 INFO:teuthology.orchestra.run.smithi062.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-04-26T07:51:47.531 INFO:teuthology.orchestra.run.smithi001.stdout:(5/32): librgw2-19.0.0-3092.g5bfac0af.el9.x86_6 9.6 MB/s | 5.4 MB 00:00 2024-04-26T07:51:47.538 INFO:teuthology.orchestra.run.smithi062.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-04-26T07:51:47.588 INFO:teuthology.orchestra.run.smithi062.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-04-26T07:51:47.589 INFO:teuthology.orchestra.run.smithi001.stdout:(6/32): python3-ceph-argparse-19.0.0-3092.g5bfa 779 kB/s | 45 kB 00:00 2024-04-26T07:51:47.656 INFO:teuthology.orchestra.run.smithi001.stdout:(7/32): python3-ceph-common-19.0.0-3092.g5bfac0 2.0 MB/s | 135 kB 00:00 2024-04-26T07:51:47.707 INFO:teuthology.orchestra.run.smithi001.stdout:(8/32): python3-cephfs-19.0.0-3092.g5bfac0af.el 3.2 MB/s | 162 kB 00:00 2024-04-26T07:51:47.772 INFO:teuthology.orchestra.run.smithi062.stdout:(24/32): libarrow-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-04-26T07:51:47.774 INFO:teuthology.orchestra.run.smithi001.stdout:(9/32): python3-rados-19.0.0-3092.g5bfac0af.el9 4.7 MB/s | 321 kB 00:00 2024-04-26T07:51:47.789 INFO:teuthology.orchestra.run.smithi062.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 244 kB/s | 49 kB 00:00 2024-04-26T07:51:47.822 INFO:teuthology.orchestra.run.smithi062.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-26T07:51:47.832 INFO:teuthology.orchestra.run.smithi001.stdout:(10/32): python3-rbd-19.0.0-3092.g5bfac0af.el9. 5.0 MB/s | 298 kB 00:00 2024-04-26T07:51:47.873 INFO:teuthology.orchestra.run.smithi062.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-04-26T07:51:47.882 INFO:teuthology.orchestra.run.smithi001.stdout:(11/32): python3-rgw-19.0.0-3092.g5bfac0af.el9. 2.0 MB/s | 99 kB 00:00 2024-04-26T07:51:47.898 INFO:teuthology.orchestra.run.smithi062.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-26T07:51:47.974 INFO:teuthology.orchestra.run.smithi062.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-26T07:51:48.008 INFO:teuthology.orchestra.run.smithi001.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 858 kB/s | 107 kB 00:00 2024-04-26T07:51:48.058 INFO:teuthology.orchestra.run.smithi001.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-26T07:51:48.092 INFO:teuthology.orchestra.run.smithi001.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-26T07:51:48.150 INFO:teuthology.orchestra.run.smithi001.stdout:(15/32): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-26T07:51:48.192 INFO:teuthology.orchestra.run.smithi001.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-04-26T07:51:48.226 INFO:teuthology.orchestra.run.smithi001.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 42 kB 00:00 2024-04-26T07:51:48.268 INFO:teuthology.orchestra.run.smithi001.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-04-26T07:51:48.301 INFO:teuthology.orchestra.run.smithi001.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 1.1 MB/s | 36 kB 00:00 2024-04-26T07:51:48.335 INFO:teuthology.orchestra.run.smithi001.stdout:(20/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-26T07:51:48.507 INFO:teuthology.orchestra.run.smithi062.stdout:(30/32): librbd1-19.0.0-3092.g5bfac0af.el9.x86_ 5.9 MB/s | 3.1 MB 00:00 2024-04-26T07:51:48.610 INFO:teuthology.orchestra.run.smithi001.stdout:(21/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-04-26T07:51:48.657 INFO:teuthology.orchestra.run.smithi062.stdout:(31/32): ceph-radosgw-19.0.0-3092.g5bfac0af.el9 2.6 MB/s | 11 MB 00:04 2024-04-26T07:51:48.724 INFO:teuthology.orchestra.run.smithi062.stdout:(32/32): librados2-19.0.0-3092.g5bfac0af.el9.x8 4.1 MB/s | 3.4 MB 00:00 2024-04-26T07:51:48.730 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:51:48.730 INFO:teuthology.orchestra.run.smithi062.stdout:Total 14 MB/s | 60 MB 00:04 2024-04-26T07:51:48.834 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:51:48.844 INFO:teuthology.orchestra.run.smithi001.stdout:(22/32): ceph-common-19.0.0-3092.g5bfac0af.el9. 5.2 MB/s | 21 MB 00:04 2024-04-26T07:51:48.876 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:51:48.876 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:51:49.019 INFO:teuthology.orchestra.run.smithi001.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 149 kB/s | 26 kB 00:00 2024-04-26T07:51:49.094 INFO:teuthology.orchestra.run.smithi001.stdout:(24/32): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-04-26T07:51:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 485 kB/s | 49 kB 00:00 2024-04-26T07:51:49.145 INFO:teuthology.orchestra.run.smithi001.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-26T07:51:49.195 INFO:teuthology.orchestra.run.smithi001.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-04-26T07:51:49.287 INFO:teuthology.orchestra.run.smithi001.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-04-26T07:51:49.329 INFO:teuthology.orchestra.run.smithi001.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-26T07:51:49.368 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:51:49.369 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:51:49.463 INFO:teuthology.orchestra.run.smithi001.stdout:(30/32): ceph-radosgw-19.0.0-3092.g5bfac0af.el9 2.3 MB/s | 11 MB 00:04 2024-04-26T07:51:49.705 INFO:teuthology.orchestra.run.smithi001.stdout:(31/32): librados2-19.0.0-3092.g5bfac0af.el9.x8 8.1 MB/s | 3.4 MB 00:00 2024-04-26T07:51:49.756 INFO:teuthology.orchestra.run.smithi001.stdout:(32/32): librbd1-19.0.0-3092.g5bfac0af.el9.x86_ 7.4 MB/s | 3.1 MB 00:00 2024-04-26T07:51:49.758 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:51:49.759 INFO:teuthology.orchestra.run.smithi001.stdout:Total 11 MB/s | 60 MB 00:05 2024-04-26T07:51:49.865 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:51:49.906 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:51:49.906 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:51:50.399 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:51:50.399 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:51:50.871 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:51:50.967 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-26T07:51:50.996 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-26T07:51:51.021 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-26T07:51:51.074 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-26T07:51:51.099 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-26T07:51:51.312 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-26T07:51:51.375 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-26T07:51:51.773 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-26T07:51:51.839 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 7/34 2024-04-26T07:51:51.892 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:51:51.915 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 7/34 2024-04-26T07:51:51.973 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-26T07:51:52.004 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.0.0-3092.g5bfac0af.el9.x86_64 8/34 2024-04-26T07:51:52.011 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-26T07:51:52.032 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 9/34 2024-04-26T07:51:52.035 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-26T07:51:52.058 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-26T07:51:52.089 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-26T07:51:52.103 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 9/34 2024-04-26T07:51:52.132 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-26T07:51:52.176 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.0.0-3092.g5bfac0af.el9. 11/34 2024-04-26T07:51:52.254 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.0.0-3092.g5bfac0af.el9.x86_64 12/34 2024-04-26T07:51:52.276 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.0.0-3092.g5bfac0af.el9.x86_6 13/34 2024-04-26T07:51:52.293 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-26T07:51:52.340 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3092.g5bfac0af.el9.x86_6 13/34 2024-04-26T07:51:52.347 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-26T07:51:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-26T07:51:52.485 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-26T07:51:52.517 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-04-26T07:51:52.560 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-26T07:51:52.593 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-26T07:51:52.622 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-04-26T07:51:52.655 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-26T07:51:52.748 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-26T07:51:52.804 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 7/34 2024-04-26T07:51:52.907 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 7/34 2024-04-26T07:51:52.980 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-26T07:51:52.995 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.0.0-3092.g5bfac0af.el9.x86_64 8/34 2024-04-26T07:51:53.022 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 9/34 2024-04-26T07:51:53.025 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 22/34 2024-04-26T07:51:53.085 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 9/34 2024-04-26T07:51:53.114 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-26T07:51:53.117 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 22/34 2024-04-26T07:51:53.147 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 23/34 2024-04-26T07:51:53.158 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.0.0-3092.g5bfac0af.el9. 11/34 2024-04-26T07:51:53.183 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-26T07:51:53.236 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.0.0-3092.g5bfac0af.el9.x86_64 12/34 2024-04-26T07:51:53.257 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.0.0-3092.g5bfac0af.el9.x86_6 13/34 2024-04-26T07:51:53.330 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3092.g5bfac0af.el9.x86_6 13/34 2024-04-26T07:51:53.364 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-26T07:51:53.475 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-26T07:51:53.506 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-04-26T07:51:53.547 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-26T07:51:53.572 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-26T07:51:53.601 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-04-26T07:51:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-26T07:51:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-04-26T07:51:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.0.0-3092.g5bfac0af.el9.x86_64 26/34 2024-04-26T07:51:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.0.0-3092.g5bfac0af.el9.x86_64 26/34 2024-04-26T07:51:53.863 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 27/34 2024-04-26T07:51:53.897 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.0.0-3092.g5bfac0af.el9.x8 28/34 2024-04-26T07:51:53.962 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-26T07:51:54.005 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 22/34 2024-04-26T07:51:54.087 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 22/34 2024-04-26T07:51:54.118 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 23/34 2024-04-26T07:51:54.154 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-26T07:51:54.658 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-04-26T07:51:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.0.0-3092.g5bfac0af.el9.x86_64 26/34 2024-04-26T07:51:54.745 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.0.0-3092.g5bfac0af.el9.x86_64 26/34 2024-04-26T07:51:54.827 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 27/34 2024-04-26T07:51:54.853 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.0.0-3092.g5bfac0af.el9.x8 28/34 2024-04-26T07:51:56.275 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 29/34 2024-04-26T07:51:56.310 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 29/34 2024-04-26T07:51:56.883 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 29/34 2024-04-26T07:51:56.921 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 30/34 2024-04-26T07:51:57.014 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 30/34 2024-04-26T07:51:57.014 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T07:51:57.014 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T07:51:57.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:51:57.048 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.0.0-3092.g5bfac0af.el9.x86_64 31/34 2024-04-26T07:51:57.168 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 29/34 2024-04-26T07:51:57.199 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 29/34 2024-04-26T07:51:57.768 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 29/34 2024-04-26T07:51:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 30/34 2024-04-26T07:51:57.895 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 30/34 2024-04-26T07:51:57.895 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T07:51:57.895 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T07:51:57.895 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:51:57.929 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.0.0-3092.g5bfac0af.el9.x86_64 31/34 2024-04-26T07:52:06.960 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3092.g5bfac0af.el9.x86_64 31/34 2024-04-26T07:52:06.961 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-04-26T07:52:06.961 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-04-26T07:52:06.961 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-04-26T07:52:06.961 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-04-26T07:52:06.961 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-04-26T07:52:06.961 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-04-26T07:52:06.961 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-04-26T07:52:06.961 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:07.753 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3092.g5bfac0af.el9.x86_64 31/34 2024-04-26T07:52:07.753 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-04-26T07:52:07.753 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-04-26T07:52:07.754 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-04-26T07:52:07.754 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-04-26T07:52:07.754 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-04-26T07:52:07.754 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-04-26T07:52:07.754 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-04-26T07:52:07.754 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:07.980 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 32/34 2024-04-26T07:52:08.005 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 32/34 2024-04-26T07:52:08.006 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:08.006 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T07:52:08.006 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T07:52:08.006 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T07:52:08.006 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:08.008 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-26T07:52:08.074 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-26T07:52:08.075 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T07:52:08.753 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 32/34 2024-04-26T07:52:08.778 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 32/34 2024-04-26T07:52:08.779 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:08.779 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T07:52:08.779 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T07:52:08.779 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T07:52:08.779 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:08.781 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-26T07:52:08.856 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-26T07:52:08.856 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T07:52:09.509 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T07:52:09.509 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/34 2024-04-26T07:52:09.509 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/34 2024-04-26T07:52:09.509 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 3/34 2024-04-26T07:52:09.509 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.0.0-3092.g5bfac0af.el9.x86_64 4/34 2024-04-26T07:52:09.509 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 5/34 2024-04-26T07:52:09.509 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.0.0-3092.g5bfac0af.el9.x86_6 6/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.0.0-3092.g5bfac0af.el9.x86_64 7/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3092.g5bfac0af.el9. 8/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.0.0-3092.g5bfac0af.el9.x8 9/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.0.0-3092.g5bfac0af.el9.x86_64 10/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.0.0-3092.g5bfac0af.el9.x86_64 11/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 12/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 13/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-26T07:52:09.510 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 31/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-26T07:52:09.511 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 33/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 3/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.0.0-3092.g5bfac0af.el9.x86_64 4/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 5/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.0.0-3092.g5bfac0af.el9.x86_6 6/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.0.0-3092.g5bfac0af.el9.x86_64 7/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3092.g5bfac0af.el9. 8/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.0.0-3092.g5bfac0af.el9.x8 9/34 2024-04-26T07:52:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.0.0-3092.g5bfac0af.el9.x86_64 10/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.0.0-3092.g5bfac0af.el9.x86_64 11/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 12/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 13/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-04-26T07:52:10.104 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-04-26T07:52:10.105 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-26T07:52:10.105 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-26T07:52:10.105 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-04-26T07:52:10.105 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-26T07:52:10.105 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-26T07:52:10.106 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 31/34 2024-04-26T07:52:10.106 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-26T07:52:10.106 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 33/34 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T07:52:10.235 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:10.236 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:52:10.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-test 2024-04-26T07:52:10.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T07:52:10.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:10.844 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-04-26T07:52:10.844 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T07:52:10.845 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T07:52:10.846 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:10.847 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:52:11.070 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:30 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:52:11.127 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-test 2024-04-26T07:52:11.193 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:52:11.193 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:11.193 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:52:11.193 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:11.193 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:52:11.193 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 49 M 2024-04-26T07:52:11.194 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:52:11.194 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 163 k 2024-04-26T07:52:11.194 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T07:52:11.194 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T07:52:11.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:11.194 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:52:11.194 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:11.194 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-04-26T07:52:11.195 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:11.195 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 50 M 2024-04-26T07:52:11.195 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 211 M 2024-04-26T07:52:11.195 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:52:11.560 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-04-26T07:52:11.606 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.4 MB/s | 64 kB 00:00 2024-04-26T07:52:11.648 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): libcephsqlite-19.0.0-3092.g5bfac0af.el9. 474 kB/s | 163 kB 00:00 2024-04-26T07:52:11.704 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:29 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:52:11.827 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 49 M 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 163 k 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T07:52:11.828 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:11.829 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:52:11.829 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:11.829 INFO:teuthology.orchestra.run.smithi001.stdout:Install 4 Packages 2024-04-26T07:52:11.829 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:11.829 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 50 M 2024-04-26T07:52:11.829 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 211 M 2024-04-26T07:52:11.829 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:52:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-04-26T07:52:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-26T07:52:12.534 INFO:teuthology.orchestra.run.smithi001.stdout:(3/4): libcephsqlite-19.0.0-3092.g5bfac0af.el9. 377 kB/s | 163 kB 00:00 2024-04-26T07:52:15.400 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): ceph-test-19.0.0-3092.g5bfac0af.el9.x86_ 12 MB/s | 49 MB 00:04 2024-04-26T07:52:15.403 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:15.404 INFO:teuthology.orchestra.run.smithi062.stdout:Total 12 MB/s | 50 MB 00:04 2024-04-26T07:52:15.431 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:52:15.454 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:52:15.454 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:52:15.844 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:52:15.845 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:52:16.301 INFO:teuthology.orchestra.run.smithi001.stdout:(4/4): ceph-test-19.0.0-3092.g5bfac0af.el9.x86_ 12 MB/s | 49 MB 00:04 2024-04-26T07:52:16.303 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:16.304 INFO:teuthology.orchestra.run.smithi001.stdout:Total 11 MB/s | 50 MB 00:04 2024-04-26T07:52:16.328 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:52:16.348 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:52:16.348 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:52:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:52:16.478 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-26T07:52:16.525 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-26T07:52:16.552 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.0.0-3092.g5bfac0af.el9.x86_64 3/4 2024-04-26T07:52:16.739 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:52:16.739 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:52:17.276 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:52:17.345 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-26T07:52:17.384 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-26T07:52:17.411 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.0.0-3092.g5bfac0af.el9.x86_64 3/4 2024-04-26T07:52:21.396 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3092.g5bfac0af.el9.x86_64 3/4 2024-04-26T07:52:21.479 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.0.0-3092.g5bfac0af.el9.x86_64 4/4 2024-04-26T07:52:22.288 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3092.g5bfac0af.el9.x86_64 3/4 2024-04-26T07:52:22.368 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.0.0-3092.g5bfac0af.el9.x86_64 4/4 2024-04-26T07:52:23.726 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-test-2:19.0.0-3092.g5bfac0af.el9.x86_64 4/4 2024-04-26T07:52:23.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/4 2024-04-26T07:52:23.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/4 2024-04-26T07:52:23.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-26T07:52:23.997 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-26T07:52:23.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:23.997 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:52:23.998 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:23.998 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:23.998 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T07:52:23.998 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T07:52:23.998 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:23.998 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:52:24.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph 2024-04-26T07:52:24.583 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-test-2:19.0.0-3092.g5bfac0af.el9.x86_64 4/4 2024-04-26T07:52:24.584 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/4 2024-04-26T07:52:24.584 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/4 2024-04-26T07:52:24.584 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-26T07:52:24.866 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-26T07:52:24.866 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:24.866 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:52:24.866 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:24.867 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:24.867 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T07:52:24.867 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T07:52:24.867 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:24.867 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:52:24.924 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:43 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:52:25.051 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:52:25.054 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:25.054 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:52:25.054 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:25.054 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 6.6 k 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 2.4 M 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 1.5 M 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 249 k 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 4.7 M 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 17 M 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T07:52:25.055 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T07:52:25.056 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:25.057 INFO:teuthology.orchestra.run.smithi062.stdout:Install 36 Packages 2024-04-26T07:52:25.058 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:25.058 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 30 M 2024-04-26T07:52:25.058 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 107 M 2024-04-26T07:52:25.058 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:52:25.152 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph 2024-04-26T07:52:25.676 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:43 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:52:25.802 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:52:25.804 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:25.805 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:52:25.805 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:25.805 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:52:25.805 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 6.6 k 2024-04-26T07:52:25.805 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:52:25.805 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 2.4 M 2024-04-26T07:52:25.806 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 1.5 M 2024-04-26T07:52:25.806 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 249 k 2024-04-26T07:52:25.806 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 4.7 M 2024-04-26T07:52:25.806 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 17 M 2024-04-26T07:52:25.806 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T07:52:25.806 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T07:52:25.807 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T07:52:25.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T07:52:25.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T07:52:25.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T07:52:25.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T07:52:25.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T07:52:25.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T07:52:25.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T07:52:25.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections 2024-04-26T07:52:25.808 INFO:teuthology.orchestra.run.smithi001.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-26T07:52:25.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T07:52:25.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T07:52:25.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T07:52:25.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T07:52:25.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T07:52:25.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T07:52:25.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T07:52:25.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T07:52:25.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T07:52:25.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T07:52:25.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T07:52:25.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T07:52:25.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T07:52:25.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T07:52:25.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T07:52:25.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T07:52:25.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T07:52:25.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T07:52:25.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T07:52:25.812 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:25.812 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:52:25.812 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:25.812 INFO:teuthology.orchestra.run.smithi001.stdout:Install 36 Packages 2024-04-26T07:52:25.812 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:25.813 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 30 M 2024-04-26T07:52:25.813 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 107 M 2024-04-26T07:52:25.814 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:52:25.910 INFO:teuthology.orchestra.run.smithi062.stdout:(1/36): ceph-19.0.0-3092.g5bfac0af.el9.x86_64.r 30 kB/s | 6.6 kB 00:00 2024-04-26T07:52:26.243 INFO:teuthology.orchestra.run.smithi062.stdout:(2/36): ceph-mgr-19.0.0-3092.g5bfac0af.el9.x86_ 2.7 MB/s | 1.5 MB 00:00 2024-04-26T07:52:26.285 INFO:teuthology.orchestra.run.smithi062.stdout:(3/36): ceph-mds-19.0.0-3092.g5bfac0af.el9.x86_ 4.0 MB/s | 2.4 MB 00:00 2024-04-26T07:52:26.385 INFO:teuthology.orchestra.run.smithi062.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3092.g5bfa 2.4 MB/s | 249 kB 00:00 2024-04-26T07:52:26.502 INFO:teuthology.orchestra.run.smithi062.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-04-26T07:52:26.569 INFO:teuthology.orchestra.run.smithi062.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 18 MB/s | 1.2 MB 00:00 2024-04-26T07:52:26.603 INFO:teuthology.orchestra.run.smithi062.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-04-26T07:52:26.636 INFO:teuthology.orchestra.run.smithi062.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 3.9 MB/s | 135 kB 00:00 2024-04-26T07:52:26.712 INFO:teuthology.orchestra.run.smithi062.stdout:(9/36): ceph-mon-19.0.0-3092.g5bfac0af.el9.x86_ 5.9 MB/s | 4.7 MB 00:00 2024-04-26T07:52:26.737 INFO:teuthology.orchestra.run.smithi062.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 1.2 MB/s | 125 kB 00:00 2024-04-26T07:52:26.762 INFO:teuthology.orchestra.run.smithi062.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-04-26T07:52:26.788 INFO:teuthology.orchestra.run.smithi062.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-26T07:52:26.813 INFO:teuthology.orchestra.run.smithi062.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T07:52:26.830 INFO:teuthology.orchestra.run.smithi062.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 833 kB/s | 35 kB 00:00 2024-04-26T07:52:26.846 INFO:teuthology.orchestra.run.smithi062.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-04-26T07:52:26.863 INFO:teuthology.orchestra.run.smithi062.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-04-26T07:52:26.880 INFO:teuthology.orchestra.run.smithi062.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 667 kB/s | 22 kB 00:00 2024-04-26T07:52:27.019 INFO:teuthology.orchestra.run.smithi001.stdout:(1/36): ceph-19.0.0-3092.g5bfac0af.el9.x86_64.r 14 kB/s | 6.6 kB 00:00 2024-04-26T07:52:27.286 INFO:teuthology.orchestra.run.smithi001.stdout:(2/36): ceph-mgr-19.0.0-3092.g5bfac0af.el9.x86_ 2.0 MB/s | 1.5 MB 00:00 2024-04-26T07:52:27.289 INFO:teuthology.orchestra.run.smithi062.stdout:(18/36): ceph-osd-19.0.0-3092.g5bfac0af.el9.x86 16 MB/s | 17 MB 00:01 2024-04-26T07:52:27.306 INFO:teuthology.orchestra.run.smithi062.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 102 kB/s | 43 kB 00:00 2024-04-26T07:52:27.436 INFO:teuthology.orchestra.run.smithi001.stdout:(3/36): ceph-mon-19.0.0-3092.g5bfac0af.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-04-26T07:52:27.486 INFO:teuthology.orchestra.run.smithi001.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3092.g5bfa 4.9 MB/s | 249 kB 00:00 2024-04-26T07:52:27.498 INFO:teuthology.orchestra.run.smithi062.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 238 kB/s | 151 kB 00:00 2024-04-26T07:52:27.590 INFO:teuthology.orchestra.run.smithi062.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 572 kB/s | 172 kB 00:00 2024-04-26T07:52:27.607 INFO:teuthology.orchestra.run.smithi062.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2024-04-26T07:52:27.611 INFO:teuthology.orchestra.run.smithi001.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-04-26T07:52:27.686 INFO:teuthology.orchestra.run.smithi001.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 16 MB/s | 1.2 MB 00:00 2024-04-26T07:52:27.690 INFO:teuthology.orchestra.run.smithi062.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 177 kB/s | 18 kB 00:00 2024-04-26T07:52:27.707 INFO:teuthology.orchestra.run.smithi062.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2024-04-26T07:52:27.720 INFO:teuthology.orchestra.run.smithi001.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-04-26T07:52:27.754 INFO:teuthology.orchestra.run.smithi001.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 4.0 MB/s | 135 kB 00:00 2024-04-26T07:52:27.787 INFO:teuthology.orchestra.run.smithi001.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 3.7 MB/s | 125 kB 00:00 2024-04-26T07:52:27.799 INFO:teuthology.orchestra.run.smithi062.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 179 kB/s | 19 kB 00:00 2024-04-26T07:52:27.816 INFO:teuthology.orchestra.run.smithi062.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 181 kB/s | 20 kB 00:00 2024-04-26T07:52:27.821 INFO:teuthology.orchestra.run.smithi001.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 6.3 MB/s | 215 kB 00:00 2024-04-26T07:52:27.863 INFO:teuthology.orchestra.run.smithi001.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-04-26T07:52:27.866 INFO:teuthology.orchestra.run.smithi062.stdout:(27/36): python3-cherrypy-18.6.1-2.el9.noarch.r 640 kB/s | 358 kB 00:00 2024-04-26T07:52:27.897 INFO:teuthology.orchestra.run.smithi001.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 5.1 MB/s | 172 kB 00:00 2024-04-26T07:52:27.922 INFO:teuthology.orchestra.run.smithi001.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 1.4 MB/s | 35 kB 00:00 2024-04-26T07:52:27.925 INFO:teuthology.orchestra.run.smithi062.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 369 kB/s | 46 kB 00:00 2024-04-26T07:52:27.950 INFO:teuthology.orchestra.run.smithi062.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 590 kB/s | 79 kB 00:00 2024-04-26T07:52:27.955 INFO:teuthology.orchestra.run.smithi001.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-04-26T07:52:27.981 INFO:teuthology.orchestra.run.smithi001.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2024-04-26T07:52:28.006 INFO:teuthology.orchestra.run.smithi001.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 896 kB/s | 22 kB 00:00 2024-04-26T07:52:28.009 INFO:teuthology.orchestra.run.smithi062.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-04-26T07:52:28.034 INFO:teuthology.orchestra.run.smithi062.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2024-04-26T07:52:28.076 INFO:teuthology.orchestra.run.smithi062.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 717 kB/s | 90 kB 00:00 2024-04-26T07:52:28.109 INFO:teuthology.orchestra.run.smithi062.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 356 kB/s | 36 kB 00:00 2024-04-26T07:52:28.210 INFO:teuthology.orchestra.run.smithi062.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 199 kB/s | 20 kB 00:00 2024-04-26T07:52:28.260 INFO:teuthology.orchestra.run.smithi062.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-04-26T07:52:28.319 INFO:teuthology.orchestra.run.smithi062.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.7 MB/s | 427 kB 00:00 2024-04-26T07:52:28.322 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:28.322 INFO:teuthology.orchestra.run.smithi062.stdout:Total 9.2 MB/s | 30 MB 00:03 2024-04-26T07:52:28.331 INFO:teuthology.orchestra.run.smithi001.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 465 kB/s | 151 kB 00:00 2024-04-26T07:52:28.463 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:52:28.465 INFO:teuthology.orchestra.run.smithi001.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 326 kB/s | 43 kB 00:00 2024-04-26T07:52:28.507 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:52:28.507 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:52:28.666 INFO:teuthology.orchestra.run.smithi001.stdout:(19/36): ceph-osd-19.0.0-3092.g5bfac0af.el9.x86 12 MB/s | 17 MB 00:01 2024-04-26T07:52:28.690 INFO:teuthology.orchestra.run.smithi001.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 763 kB/s | 172 kB 00:00 2024-04-26T07:52:28.749 INFO:teuthology.orchestra.run.smithi001.stdout:(21/36): ceph-mds-19.0.0-3092.g5bfac0af.el9.x86 1.1 MB/s | 2.4 MB 00:02 2024-04-26T07:52:28.775 INFO:teuthology.orchestra.run.smithi001.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 127 kB/s | 11 kB 00:00 2024-04-26T07:52:28.820 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:52:28.821 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:52:28.825 INFO:teuthology.orchestra.run.smithi001.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-04-26T07:52:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:(24/36): python3-jaraco-functools-3.5.0-2.el9.n 195 kB/s | 19 kB 00:00 2024-04-26T07:52:29.001 INFO:teuthology.orchestra.run.smithi001.stdout:(25/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.0 MB/s | 358 kB 00:00 2024-04-26T07:52:29.042 INFO:teuthology.orchestra.run.smithi001.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 168 kB/s | 20 kB 00:00 2024-04-26T07:52:29.068 INFO:teuthology.orchestra.run.smithi001.stdout:(27/36): python3-jaraco-collections-3.0.0-8.el9 79 kB/s | 23 kB 00:00 2024-04-26T07:52:29.159 INFO:teuthology.orchestra.run.smithi001.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 675 kB/s | 79 kB 00:00 2024-04-26T07:52:29.193 INFO:teuthology.orchestra.run.smithi001.stdout:(29/36): python3-logutils-0.3.5-21.el9.noarch.r 240 kB/s | 46 kB 00:00 2024-04-26T07:52:29.243 INFO:teuthology.orchestra.run.smithi001.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-04-26T07:52:29.285 INFO:teuthology.orchestra.run.smithi001.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-04-26T07:52:29.310 INFO:teuthology.orchestra.run.smithi001.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 768 kB/s | 90 kB 00:00 2024-04-26T07:52:29.336 INFO:teuthology.orchestra.run.smithi001.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 387 kB/s | 36 kB 00:00 2024-04-26T07:52:29.428 INFO:teuthology.orchestra.run.smithi001.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 218 kB/s | 20 kB 00:00 2024-04-26T07:52:29.453 INFO:teuthology.orchestra.run.smithi001.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-04-26T07:52:29.478 INFO:teuthology.orchestra.run.smithi001.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.5 MB/s | 427 kB 00:00 2024-04-26T07:52:29.482 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:29.482 INFO:teuthology.orchestra.run.smithi001.stdout:Total 8.2 MB/s | 30 MB 00:03 2024-04-26T07:52:29.623 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:52:29.667 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:52:29.668 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:52:29.979 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:52:29.979 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:52:30.230 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:52:30.296 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-26T07:52:30.329 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-26T07:52:30.357 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-26T07:52:30.432 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-26T07:52:30.481 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-26T07:52:30.522 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-26T07:52:30.618 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-26T07:52:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-26T07:52:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-26T07:52:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-26T07:52:30.931 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-26T07:52:30.965 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-26T07:52:30.999 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-26T07:52:31.040 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-26T07:52:31.083 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-26T07:52:31.117 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-26T07:52:31.157 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-26T07:52:31.233 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-26T07:52:31.261 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:52:31.331 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-26T07:52:31.384 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-26T07:52:31.389 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-26T07:52:31.416 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-26T07:52:31.475 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-26T07:52:31.492 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-26T07:52:31.534 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-26T07:52:31.541 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-26T07:52:31.572 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-26T07:52:31.574 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-26T07:52:31.630 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-26T07:52:31.670 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-26T07:52:31.694 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-26T07:52:31.747 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-26T07:52:31.794 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-26T07:52:31.828 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-26T07:52:31.858 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-26T07:52:31.892 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-26T07:52:31.899 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-26T07:52:31.926 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-26T07:52:31.951 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-26T07:52:31.958 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-26T07:52:32.002 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-26T07:52:32.032 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-26T07:52:32.035 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-26T07:52:32.074 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-26T07:52:32.130 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-26T07:52:32.150 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-26T07:52:32.166 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-26T07:52:32.288 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-26T07:52:32.301 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-26T07:52:32.386 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-26T07:52:32.436 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-26T07:52:32.455 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3092.g5bfac0af.el9. 31/36 2024-04-26T07:52:32.474 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-26T07:52:32.484 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 32/36 2024-04-26T07:52:32.511 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 32/36 2024-04-26T07:52:32.511 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:32.512 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T07:52:32.512 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T07:52:32.512 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T07:52:32.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-26T07:52:32.595 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-26T07:52:32.790 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-26T07:52:32.844 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-26T07:52:32.925 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-26T07:52:33.023 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-26T07:52:33.060 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-26T07:52:33.181 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-26T07:52:33.348 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3092.g5bfac0af.el9. 31/36 2024-04-26T07:52:33.378 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 32/36 2024-04-26T07:52:33.406 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 32/36 2024-04-26T07:52:33.406 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:33.406 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T07:52:33.406 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T07:52:33.406 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T07:52:33.406 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:34.035 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.0.0-3092.g5bfac0af.el9.x86_64 33/36 2024-04-26T07:52:34.062 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.0.0-3092.g5bfac0af.el9.x86_64 33/36 2024-04-26T07:52:34.062 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:34.063 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T07:52:34.063 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T07:52:34.063 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T07:52:34.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:34.527 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.0.0-3092.g5bfac0af.el9.x86_64 34/36 2024-04-26T07:52:34.552 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.0.0-3092.g5bfac0af.el9.x86_64 34/36 2024-04-26T07:52:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T07:52:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T07:52:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T07:52:34.552 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:34.787 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.0.0-3092.g5bfac0af.el9.x86_64 35/36 2024-04-26T07:52:34.811 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.0.0-3092.g5bfac0af.el9.x86_64 35/36 2024-04-26T07:52:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T07:52:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T07:52:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T07:52:34.812 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:34.877 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.0.0-3092.g5bfac0af.el9.x86_64 36/36 2024-04-26T07:52:34.920 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.0.0-3092.g5bfac0af.el9.x86_64 33/36 2024-04-26T07:52:34.949 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.0.0-3092.g5bfac0af.el9.x86_64 33/36 2024-04-26T07:52:34.949 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:34.949 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T07:52:34.949 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T07:52:34.949 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T07:52:34.949 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:35.413 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.0.0-3092.g5bfac0af.el9.x86_64 34/36 2024-04-26T07:52:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.0.0-3092.g5bfac0af.el9.x86_64 34/36 2024-04-26T07:52:35.437 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:35.438 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T07:52:35.438 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T07:52:35.438 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T07:52:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:35.672 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.0.0-3092.g5bfac0af.el9.x86_64 35/36 2024-04-26T07:52:35.696 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.0.0-3092.g5bfac0af.el9.x86_64 35/36 2024-04-26T07:52:35.696 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:35.696 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T07:52:35.696 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T07:52:35.696 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T07:52:35.697 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:35.762 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.0.0-3092.g5bfac0af.el9.x86_64 36/36 2024-04-26T07:52:36.533 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-2:19.0.0-3092.g5bfac0af.el9.x86_64 36/36 2024-04-26T07:52:36.533 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/36 2024-04-26T07:52:36.533 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/36 2024-04-26T07:52:36.533 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 3/36 2024-04-26T07:52:36.533 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.0.0-3092.g5bfac0af.el9.x86_64 4/36 2024-04-26T07:52:36.533 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.0.0-3092.g5bfac0af.el9.x86_64 5/36 2024-04-26T07:52:36.533 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3092.g5bfac0af.el9. 6/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-26T07:52:36.534 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-26T07:52:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-26T07:52:36.536 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T07:52:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T07:52:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T07:52:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T07:52:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:37.476 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:52:37.501 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-2:19.0.0-3092.g5bfac0af.el9.x86_64 36/36 2024-04-26T07:52:37.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/36 2024-04-26T07:52:37.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/36 2024-04-26T07:52:37.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 3/36 2024-04-26T07:52:37.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.0.0-3092.g5bfac0af.el9.x86_64 4/36 2024-04-26T07:52:37.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.0.0-3092.g5bfac0af.el9.x86_64 5/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3092.g5bfac0af.el9. 6/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-26T07:52:37.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-26T07:52:37.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-26T07:52:37.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-base 2024-04-26T07:52:38.349 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:57 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T07:52:38.366 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T07:52:38.367 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:38.368 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:52:38.433 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:52:38.476 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:52:38.477 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:52:38.477 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:52:38.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install cephadm 2024-04-26T07:52:38.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-base 2024-04-26T07:52:39.080 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:58 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:52:39.207 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:52:39.207 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 762 k 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 762 k 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 768 k 2024-04-26T07:52:39.208 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:52:39.276 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:57 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:52:39.361 INFO:teuthology.orchestra.run.smithi001.stdout:Package ceph-base-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:52:39.403 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:52:39.404 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:52:39.405 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:52:39.481 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install cephadm 2024-04-26T07:52:39.652 INFO:teuthology.orchestra.run.smithi062.stdout:cephadm-19.0.0-3092.g5bfac0af.el9.noarch.rpm 1.7 MB/s | 762 kB 00:00 2024-04-26T07:52:39.652 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:39.652 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.7 MB/s | 762 kB 00:00 2024-04-26T07:52:39.653 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:52:39.658 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:52:39.658 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:52:39.664 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:52:39.665 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:52:39.742 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:52:40.013 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:58 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:52:40.130 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/1 2024-04-26T07:52:40.140 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:52:40.141 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:40.141 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:52:40.141 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:40.141 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:52:40.141 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 762 k 2024-04-26T07:52:40.142 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:40.142 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:52:40.142 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:40.142 INFO:teuthology.orchestra.run.smithi001.stdout:Install 1 Package 2024-04-26T07:52:40.142 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:40.142 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 762 k 2024-04-26T07:52:40.142 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 768 k 2024-04-26T07:52:40.142 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:52:40.215 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/1 2024-04-26T07:52:40.509 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/1 2024-04-26T07:52:40.591 INFO:teuthology.orchestra.run.smithi001.stdout:cephadm-19.0.0-3092.g5bfac0af.el9.noarch.rpm 1.7 MB/s | 762 kB 00:00 2024-04-26T07:52:40.591 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:40.591 INFO:teuthology.orchestra.run.smithi001.stdout:Total 1.7 MB/s | 762 kB 00:00 2024-04-26T07:52:40.591 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:52:40.597 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:52:40.597 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:52:40.603 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:52:40.604 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:52:40.683 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:52:40.716 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/1 2024-04-26T07:52:40.716 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:52:40.716 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:40.716 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:52:40.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T07:52:41.158 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/1 2024-04-26T07:52:41.261 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/1 2024-04-26T07:52:41.471 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:00 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:52:41.594 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/1 2024-04-26T07:52:41.595 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:52:41.595 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 145 k 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 145 k 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 435 k 2024-04-26T07:52:41.596 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:52:41.852 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/1 2024-04-26T07:52:41.852 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:41.852 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:52:41.852 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:41.852 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:41.853 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:52:41.940 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-immutable-object-cache-19.0.0-3092.g5bfac0 420 kB/s | 145 kB 00:00 2024-04-26T07:52:41.941 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:41.942 INFO:teuthology.orchestra.run.smithi062.stdout:Total 418 kB/s | 145 kB 00:00 2024-04-26T07:52:41.942 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:52:41.950 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:52:41.950 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:52:42.010 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:52:42.010 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:52:42.050 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T07:52:42.159 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:52:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3092.g5bfac0af. 1/1 2024-04-26T07:52:42.267 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3092.g5bfac0af. 1/1 2024-04-26T07:52:42.267 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:42.267 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T07:52:42.268 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:42.577 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:00 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:52:42.701 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:52:42.701 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:42.701 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repo Size 2024-04-26T07:52:42.701 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 145 k 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout:Install 1 Package 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 145 k 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 435 k 2024-04-26T07:52:42.702 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:52:43.043 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-immutable-object-cache-19.0.0-3092.g5bfac0 425 kB/s | 145 kB 00:00 2024-04-26T07:52:43.043 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:43.044 INFO:teuthology.orchestra.run.smithi001.stdout:Total 423 kB/s | 145 kB 00:00 2024-04-26T07:52:43.044 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:52:43.054 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:52:43.054 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:52:43.114 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:52:43.114 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:52:43.200 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3092.g5bfac0af. 1/1 2024-04-26T07:52:43.200 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:43.200 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:52:43.200 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:43.200 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:43.200 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:52:43.305 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:52:43.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr 2024-04-26T07:52:43.428 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3092.g5bfac0af. 1/1 2024-04-26T07:52:43.453 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3092.g5bfac0af. 1/1 2024-04-26T07:52:43.453 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:52:43.453 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T07:52:43.454 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:43.946 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:02 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:52:44.028 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:52:44.071 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:52:44.073 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:52:44.073 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:52:44.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-dashboard 2024-04-26T07:52:44.310 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3092.g5bfac0af. 1/1 2024-04-26T07:52:44.310 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:44.310 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:52:44.310 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:52:44.310 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:44.310 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:52:44.504 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-mgr 2024-04-26T07:52:44.664 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:03 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:52:44.790 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:52:44.791 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:44.791 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:52:44.791 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 3.5 M 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 34 k 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 16 k 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T07:52:44.792 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T07:52:44.793 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T07:52:44.793 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T07:52:44.793 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T07:52:44.793 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:44.793 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:52:44.793 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:52:44.793 INFO:teuthology.orchestra.run.smithi062.stdout:Install 12 Packages 2024-04-26T07:52:44.793 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:44.794 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 8.6 M 2024-04-26T07:52:44.794 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 104 M 2024-04-26T07:52:44.794 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:52:45.039 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:03 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:52:45.122 INFO:teuthology.orchestra.run.smithi001.stdout:Package ceph-mgr-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:52:45.166 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:52:45.167 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:52:45.167 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:52:45.263 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-mgr-dashboard 2024-04-26T07:52:45.385 INFO:teuthology.orchestra.run.smithi062.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3092.g5b 164 kB/s | 34 kB 00:00 2024-04-26T07:52:45.477 INFO:teuthology.orchestra.run.smithi062.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3092.g5bf 55 kB/s | 16 kB 00:00 2024-04-26T07:52:45.536 INFO:teuthology.orchestra.run.smithi062.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-04-26T07:52:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 3.2 MB/s | 269 kB 00:00 2024-04-26T07:52:45.603 INFO:teuthology.orchestra.run.smithi062.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 13 MB/s | 863 kB 00:00 2024-04-26T07:52:45.794 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:03 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:52:45.812 INFO:teuthology.orchestra.run.smithi062.stdout:(6/12): ceph-mgr-dashboard-19.0.0-3092.g5bfac0a 5.6 MB/s | 3.5 MB 00:00 2024-04-26T07:52:45.919 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:52:45.920 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:45.920 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:52:45.920 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:45.920 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:52:45.920 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 3.5 M 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 34 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 16 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T07:52:45.921 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:45.922 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:52:45.922 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:52:45.922 INFO:teuthology.orchestra.run.smithi001.stdout:Install 12 Packages 2024-04-26T07:52:45.922 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:45.922 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 8.6 M 2024-04-26T07:52:45.922 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 104 M 2024-04-26T07:52:45.923 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:52:46.004 INFO:teuthology.orchestra.run.smithi062.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 49 kB/s | 19 kB 00:00 2024-04-26T07:52:46.320 INFO:teuthology.orchestra.run.smithi062.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 458 kB/s | 144 kB 00:00 2024-04-26T07:52:46.371 INFO:teuthology.orchestra.run.smithi062.stdout:(9/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 678 kB/s | 548 kB 00:00 2024-04-26T07:52:46.380 INFO:teuthology.orchestra.run.smithi001.stdout:(1/12): ceph-prometheus-alerts-19.0.0-3092.g5bf 90 kB/s | 16 kB 00:00 2024-04-26T07:52:46.438 INFO:teuthology.orchestra.run.smithi062.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 263 kB/s | 31 kB 00:00 2024-04-26T07:52:46.438 INFO:teuthology.orchestra.run.smithi001.stdout:(2/12): ceph-grafana-dashboards-19.0.0-3092.g5b 142 kB/s | 34 kB 00:00 2024-04-26T07:52:46.496 INFO:teuthology.orchestra.run.smithi062.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-04-26T07:52:46.530 INFO:teuthology.orchestra.run.smithi001.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.9 MB/s | 269 kB 00:00 2024-04-26T07:52:46.589 INFO:teuthology.orchestra.run.smithi001.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-04-26T07:52:46.622 INFO:teuthology.orchestra.run.smithi001.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 9.3 MB/s | 863 kB 00:00 2024-04-26T07:52:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.2 MB/s | 2.0 MB 00:00 2024-04-26T07:52:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:Total 4.5 MB/s | 8.6 MB 00:01 2024-04-26T07:52:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:52:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:52:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:52:46.831 INFO:teuthology.orchestra.run.smithi001.stdout:(6/12): ceph-mgr-dashboard-19.0.0-3092.g5bfac0a 5.6 MB/s | 3.5 MB 00:00 2024-04-26T07:52:46.856 INFO:teuthology.orchestra.run.smithi001.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 83 kB/s | 19 kB 00:00 2024-04-26T07:52:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:52:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:52:47.098 INFO:teuthology.orchestra.run.smithi001.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 597 kB/s | 144 kB 00:00 2024-04-26T07:52:47.199 INFO:teuthology.orchestra.run.smithi001.stdout:(9/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 902 kB/s | 548 kB 00:00 2024-04-26T07:52:47.224 INFO:teuthology.orchestra.run.smithi001.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 245 kB/s | 31 kB 00:00 2024-04-26T07:52:47.299 INFO:teuthology.orchestra.run.smithi001.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.8 MB/s | 188 kB 00:00 2024-04-26T07:52:47.516 INFO:teuthology.orchestra.run.smithi001.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.0 MB/s | 2.0 MB 00:00 2024-04-26T07:52:47.517 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:52:47.519 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:47.520 INFO:teuthology.orchestra.run.smithi001.stdout:Total 5.4 MB/s | 8.6 MB 00:01 2024-04-26T07:52:47.570 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:52:47.590 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:52:47.590 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:52:47.606 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-26T07:52:47.649 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-26T07:52:47.696 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-26T07:52:47.726 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-26T07:52:47.756 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:52:47.756 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:52:47.806 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-26T07:52:47.942 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-26T07:52:48.033 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-26T07:52:48.131 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-26T07:52:48.158 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-26T07:52:48.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3092.g5bfac0af.el9 10/12 2024-04-26T07:52:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:52:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-26T07:52:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-26T07:52:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-26T07:52:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-26T07:52:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-26T07:52:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-26T07:52:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-26T07:52:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-26T07:52:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-26T07:52:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3092.g5bfac0af.el9 10/12 2024-04-26T07:52:49.299 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3092.g5bfac0af.el 11/12 2024-04-26T07:52:49.333 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3092.g5bfac0af.el9.noa 12/12 2024-04-26T07:52:50.014 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3092.g5bfac0af.el 11/12 2024-04-26T07:52:50.052 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3092.g5bfac0af.el9.noa 12/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3092.g5bfac0af.el9.noa 12/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3092.g5bfac0af.el 1/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3092.g5bfac0af.el9.noa 2/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3092.g5bfac0af.el9 3/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-26T07:52:50.739 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T07:52:51.032 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T07:52:51.033 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T07:52:51.033 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T07:52:51.033 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T07:52:51.033 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T07:52:51.033 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T07:52:51.033 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T07:52:51.033 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:51.033 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:52:51.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-26T07:52:51.362 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3092.g5bfac0af.el9.noa 12/12 2024-04-26T07:52:51.362 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3092.g5bfac0af.el 1/12 2024-04-26T07:52:51.362 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3092.g5bfac0af.el9.noa 2/12 2024-04-26T07:52:51.362 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3092.g5bfac0af.el9 3/12 2024-04-26T07:52:51.362 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-26T07:52:51.362 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-26T07:52:51.363 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-26T07:52:51.363 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-26T07:52:51.363 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-26T07:52:51.363 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-26T07:52:51.363 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-26T07:52:51.363 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-26T07:52:51.787 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-26T07:52:51.787 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:51.787 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:52:51.787 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T07:52:51.787 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:51.788 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:52:51.796 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:10 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:52:51.922 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:52:51.923 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-26T07:52:51.923 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:52:51.923 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 7.4 M 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T07:52:51.924 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:51.925 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:52:51.925 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-26T07:52:51.925 INFO:teuthology.orchestra.run.smithi062.stdout:Install 12 Packages 2024-04-26T07:52:51.925 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:52:51.925 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 38 M 2024-04-26T07:52:51.925 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 209 M 2024-04-26T07:52:51.925 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:52:52.214 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-26T07:52:52.487 INFO:teuthology.orchestra.run.smithi062.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-26T07:52:52.520 INFO:teuthology.orchestra.run.smithi062.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.0 MB/s | 803 kB 00:00 2024-04-26T07:52:52.546 INFO:teuthology.orchestra.run.smithi062.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 569 kB/s | 33 kB 00:00 2024-04-26T07:52:52.621 INFO:teuthology.orchestra.run.smithi062.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2024-04-26T07:52:52.638 INFO:teuthology.orchestra.run.smithi062.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 203 kB/s | 18 kB 00:00 2024-04-26T07:52:52.655 INFO:teuthology.orchestra.run.smithi062.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-04-26T07:52:52.705 INFO:teuthology.orchestra.run.smithi062.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.9 MB/s | 244 kB 00:00 2024-04-26T07:52:52.752 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:10 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:52:52.781 INFO:teuthology.orchestra.run.smithi062.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2024-04-26T07:52:52.864 INFO:teuthology.orchestra.run.smithi062.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 33 MB/s | 5.1 MB 00:00 2024-04-26T07:52:52.887 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:52:52.887 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-04-26T07:52:52.887 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:52:52.887 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-04-26T07:52:52.887 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:52:52.887 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 7.4 M 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T07:52:52.888 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:52.889 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:52:52.889 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-04-26T07:52:52.889 INFO:teuthology.orchestra.run.smithi001.stdout:Install 12 Packages 2024-04-26T07:52:52.889 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:52:52.889 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 38 M 2024-04-26T07:52:52.889 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 209 M 2024-04-26T07:52:52.889 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:52:52.890 INFO:teuthology.orchestra.run.smithi062.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-04-26T07:52:53.190 INFO:teuthology.orchestra.run.smithi062.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-04-26T07:52:53.291 INFO:teuthology.orchestra.run.smithi001.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-26T07:52:53.341 INFO:teuthology.orchestra.run.smithi001.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-04-26T07:52:53.366 INFO:teuthology.orchestra.run.smithi001.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 439 kB/s | 33 kB 00:00 2024-04-26T07:52:53.442 INFO:teuthology.orchestra.run.smithi001.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2024-04-26T07:52:53.467 INFO:teuthology.orchestra.run.smithi001.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 184 kB/s | 18 kB 00:00 2024-04-26T07:52:53.492 INFO:teuthology.orchestra.run.smithi001.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-04-26T07:52:53.593 INFO:teuthology.orchestra.run.smithi001.stdout:(7/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 38 MB/s | 4.7 MB 00:00 2024-04-26T07:52:53.618 INFO:teuthology.orchestra.run.smithi001.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-04-26T07:52:53.718 INFO:teuthology.orchestra.run.smithi001.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 5.1 MB 00:00 2024-04-26T07:52:53.743 INFO:teuthology.orchestra.run.smithi001.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.0 MB/s | 250 kB 00:00 2024-04-26T07:52:53.844 INFO:teuthology.orchestra.run.smithi001.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-3 10 MB/s | 7.4 MB 00:00 2024-04-26T07:52:53.957 INFO:teuthology.orchestra.run.smithi062.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-3 4.5 MB/s | 7.4 MB 00:01 2024-04-26T07:52:53.959 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:53.960 INFO:teuthology.orchestra.run.smithi062.stdout:Total 19 MB/s | 38 MB 00:02 2024-04-26T07:52:54.160 INFO:teuthology.orchestra.run.smithi001.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-04-26T07:52:54.163 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:52:54.163 INFO:teuthology.orchestra.run.smithi001.stdout:Total 30 MB/s | 38 MB 00:01 2024-04-26T07:52:54.318 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:52:54.347 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:52:54.347 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:52:54.521 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:52:54.548 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:52:54.548 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:52:54.781 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:52:54.782 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:52:54.980 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:52:54.981 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:52:55.663 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:52:55.720 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-26T07:52:55.764 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-26T07:52:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:52:55.880 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-26T07:52:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-26T07:52:55.924 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-26T07:52:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-26T07:52:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-26T07:52:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-26T07:52:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-26T07:52:56.138 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-26T07:52:56.218 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-26T07:52:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-26T07:52:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-26T07:52:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-26T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-26T07:52:57.032 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-26T07:52:57.133 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-26T07:52:57.244 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-26T07:52:58.358 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T07:52:58.537 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T07:52:59.444 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-26T07:52:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3092.g5bfac 12/12 2024-04-26T07:52:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-26T07:52:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3092.g5bfac 12/12 2024-04-26T07:53:01.980 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3092.g5bfac 12/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3092.g5bfac 1/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T07:53:01.981 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-26T07:53:02.091 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3092.g5bfac 12/12 2024-04-26T07:53:02.091 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3092.g5bfac 1/12 2024-04-26T07:53:02.091 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-26T07:53:02.091 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-26T07:53:02.091 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-26T07:53:02.091 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-26T07:53:02.091 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-26T07:53:02.091 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-26T07:53:02.092 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-26T07:53:02.092 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-26T07:53:02.092 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T07:53:02.092 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-26T07:53:02.374 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-26T07:53:02.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:02.374 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:02.375 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-26T07:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:02.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-rook 2024-04-26T07:53:02.848 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-mgr-rook 2024-04-26T07:53:03.325 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:22 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:03.382 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:21 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:03.450 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:03.451 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:03.451 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:53:03.451 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 49 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T07:53:03.452 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T07:53:03.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:03.453 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:03.453 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:03.453 INFO:teuthology.orchestra.run.smithi062.stdout:Install 13 Packages 2024-04-26T07:53:03.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:03.453 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 2.2 M 2024-04-26T07:53:03.453 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 26 M 2024-04-26T07:53:03.454 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:03.508 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:03.509 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:53:03.509 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:03.509 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 49 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T07:53:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T07:53:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:03.511 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:03.511 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:03.511 INFO:teuthology.orchestra.run.smithi001.stdout:Install 13 Packages 2024-04-26T07:53:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:03.511 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 2.2 M 2024-04-26T07:53:03.511 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 26 M 2024-04-26T07:53:03.511 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:03.798 INFO:teuthology.orchestra.run.smithi062.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 190 kB/s | 26 kB 00:00 2024-04-26T07:53:03.821 INFO:teuthology.orchestra.run.smithi062.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 120 kB/s | 19 kB 00:00 2024-04-26T07:53:03.871 INFO:teuthology.orchestra.run.smithi062.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-04-26T07:53:03.896 INFO:teuthology.orchestra.run.smithi062.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-26T07:53:03.921 INFO:teuthology.orchestra.run.smithi062.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 5.5 MB/s | 279 kB 00:00 2024-04-26T07:53:03.947 INFO:teuthology.orchestra.run.smithi062.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.1 MB/s | 54 kB 00:00 2024-04-26T07:53:03.972 INFO:teuthology.orchestra.run.smithi062.stdout:(7/13): ceph-mgr-rook-19.0.0-3092.g5bfac0af.el9 158 kB/s | 49 kB 00:00 2024-04-26T07:53:04.072 INFO:teuthology.orchestra.run.smithi062.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 214 kB/s | 32 kB 00:00 2024-04-26T07:53:04.097 INFO:teuthology.orchestra.run.smithi062.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 100 kB/s | 15 kB 00:00 2024-04-26T07:53:04.156 INFO:teuthology.orchestra.run.smithi062.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.1 MB/s | 206 kB 00:00 2024-04-26T07:53:04.181 INFO:teuthology.orchestra.run.smithi062.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2024-04-26T07:53:04.192 INFO:teuthology.orchestra.run.smithi001.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 190 kB/s | 26 kB 00:00 2024-04-26T07:53:04.215 INFO:teuthology.orchestra.run.smithi062.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-04-26T07:53:04.216 INFO:teuthology.orchestra.run.smithi001.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 120 kB/s | 19 kB 00:00 2024-04-26T07:53:04.240 INFO:teuthology.orchestra.run.smithi062.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2024-04-26T07:53:04.242 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:04.242 INFO:teuthology.orchestra.run.smithi062.stdout:Total 2.8 MB/s | 2.2 MB 00:00 2024-04-26T07:53:04.275 INFO:teuthology.orchestra.run.smithi001.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-04-26T07:53:04.301 INFO:teuthology.orchestra.run.smithi001.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-04-26T07:53:04.305 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:04.321 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:04.321 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:04.326 INFO:teuthology.orchestra.run.smithi001.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 5.5 MB/s | 279 kB 00:00 2024-04-26T07:53:04.354 INFO:teuthology.orchestra.run.smithi001.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.1 MB/s | 54 kB 00:00 2024-04-26T07:53:04.377 INFO:teuthology.orchestra.run.smithi001.stdout:(7/13): ceph-mgr-rook-19.0.0-3092.g5bfac0af.el9 154 kB/s | 49 kB 00:00 2024-04-26T07:53:04.412 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:04.412 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:04.694 INFO:teuthology.orchestra.run.smithi001.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 44 kB/s | 15 kB 00:00 2024-04-26T07:53:04.777 INFO:teuthology.orchestra.run.smithi001.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 71 kB/s | 32 kB 00:00 2024-04-26T07:53:04.925 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:04.952 INFO:teuthology.orchestra.run.smithi001.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 357 kB/s | 206 kB 00:00 2024-04-26T07:53:04.978 INFO:teuthology.orchestra.run.smithi001.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 295 kB/s | 59 kB 00:00 2024-04-26T07:53:05.069 INFO:teuthology.orchestra.run.smithi001.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 769 kB/s | 90 kB 00:00 2024-04-26T07:53:05.096 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-26T07:53:05.152 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-26T07:53:05.207 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-26T07:53:05.243 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-26T07:53:05.244 INFO:teuthology.orchestra.run.smithi001.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-04-26T07:53:05.250 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:05.251 INFO:teuthology.orchestra.run.smithi001.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-04-26T07:53:05.285 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-26T07:53:05.321 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:05.338 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:05.338 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:05.384 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-26T07:53:05.430 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:05.431 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:05.493 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-26T07:53:05.545 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-26T07:53:05.939 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:06.118 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-26T07:53:06.176 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-26T07:53:06.237 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-26T07:53:06.272 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-26T07:53:06.313 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-26T07:53:06.315 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-26T07:53:06.358 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-26T07:53:06.391 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-26T07:53:06.413 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-26T07:53:06.440 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-26T07:53:06.469 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.0.0-3092.g5bfac0af.el9.noarch 13/13 2024-04-26T07:53:06.524 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-26T07:53:06.575 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-26T07:53:07.208 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3092.g5bfac0af.el9.noarch 13/13 2024-04-26T07:53:07.208 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3092.g5bfac0af.el9.noarch 1/13 2024-04-26T07:53:07.208 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-26T07:53:07.209 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-26T07:53:07.346 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-26T07:53:07.404 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-26T07:53:07.438 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-26T07:53:07.486 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T07:53:07.498 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T07:53:07.499 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T07:53:07.499 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T07:53:07.499 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T07:53:07.499 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T07:53:07.499 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T07:53:07.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:07.499 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:07.515 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.0.0-3092.g5bfac0af.el9.noarch 13/13 2024-04-26T07:53:07.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-cephadm 2024-04-26T07:53:08.275 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3092.g5bfac0af.el9.noarch 13/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3092.g5bfac0af.el9.noarch 1/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-26T07:53:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-26T07:53:08.293 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:27 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:08.417 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:08.418 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:08.418 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:53:08.418 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:08.418 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:08.418 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 142 k 2024-04-26T07:53:08.418 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:53:08.418 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout:Install 6 Packages 2024-04-26T07:53:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:08.420 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 7.0 M 2024-04-26T07:53:08.420 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 33 M 2024-04-26T07:53:08.420 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:08.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-26T07:53:08.593 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:08.593 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:08.593 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:53:08.593 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T07:53:08.593 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T07:53:08.593 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:08.594 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:08.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-mgr-cephadm 2024-04-26T07:53:09.224 INFO:teuthology.orchestra.run.smithi062.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-04-26T07:53:09.366 INFO:teuthology.orchestra.run.smithi062.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-04-26T07:53:09.371 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:27 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:09.425 INFO:teuthology.orchestra.run.smithi062.stdout:(3/6): ceph-mgr-cephadm-19.0.0-3092.g5bfac0af.e 375 kB/s | 142 kB 00:00 2024-04-26T07:53:09.496 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 142 k 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T07:53:09.497 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T07:53:09.498 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:09.498 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:09.498 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:09.498 INFO:teuthology.orchestra.run.smithi001.stdout:Install 6 Packages 2024-04-26T07:53:09.498 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:09.498 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 7.0 M 2024-04-26T07:53:09.498 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 33 M 2024-04-26T07:53:09.499 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:09.533 INFO:teuthology.orchestra.run.smithi062.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 346 kB/s | 58 kB 00:00 2024-04-26T07:53:09.558 INFO:teuthology.orchestra.run.smithi062.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.6 MB/s | 548 kB 00:00 2024-04-26T07:53:09.583 INFO:teuthology.orchestra.run.smithi062.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 322 kB/s | 51 kB 00:00 2024-04-26T07:53:09.585 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:09.585 INFO:teuthology.orchestra.run.smithi062.stdout:Total 6.0 MB/s | 7.0 MB 00:01 2024-04-26T07:53:09.658 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:09.670 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:09.670 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:09.773 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:09.773 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:10.071 INFO:teuthology.orchestra.run.smithi001.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-04-26T07:53:10.082 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:10.204 INFO:teuthology.orchestra.run.smithi001.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-04-26T07:53:10.260 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-26T07:53:10.314 INFO:teuthology.orchestra.run.smithi001.stdout:(3/6): ceph-mgr-cephadm-19.0.0-3092.g5bfac0af.e 328 kB/s | 142 kB 00:00 2024-04-26T07:53:10.314 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-26T07:53:10.530 INFO:teuthology.orchestra.run.smithi001.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 177 kB/s | 58 kB 00:00 2024-04-26T07:53:10.621 INFO:teuthology.orchestra.run.smithi001.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 165 kB/s | 51 kB 00:00 2024-04-26T07:53:10.713 INFO:teuthology.orchestra.run.smithi001.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 855 kB/s | 548 kB 00:00 2024-04-26T07:53:10.716 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:10.716 INFO:teuthology.orchestra.run.smithi001.stdout:Total 5.7 MB/s | 7.0 MB 00:01 2024-04-26T07:53:10.792 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:10.805 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:10.806 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:10.876 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-26T07:53:10.908 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:10.908 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:10.975 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-26T07:53:11.046 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-26T07:53:11.081 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 6/6 2024-04-26T07:53:11.223 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:11.398 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-26T07:53:11.460 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-26T07:53:11.847 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 6/6 2024-04-26T07:53:11.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/6 2024-04-26T07:53:11.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-26T07:53:11.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-26T07:53:11.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-26T07:53:11.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-26T07:53:12.015 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-26T07:53:12.098 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-26T07:53:12.104 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:12.105 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:12.169 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-26T07:53:12.196 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 6/6 2024-04-26T07:53:12.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-fuse 2024-04-26T07:53:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:31 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:12.914 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 6/6 2024-04-26T07:53:12.914 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 1/6 2024-04-26T07:53:12.914 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-26T07:53:12.914 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-26T07:53:12.914 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-26T07:53:12.914 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-26T07:53:12.974 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:12.974 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 890 k 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 970 k 2024-04-26T07:53:12.975 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 2.8 M 2024-04-26T07:53:12.976 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:13.166 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-26T07:53:13.166 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:13.166 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:13.166 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:53:13.166 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T07:53:13.166 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T07:53:13.166 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T07:53:13.166 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T07:53:13.167 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T07:53:13.167 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:13.167 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:13.246 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 592 kB/s | 80 kB 00:00 2024-04-26T07:53:13.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-fuse 2024-04-26T07:53:13.429 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): ceph-fuse-19.0.0-3092.g5bfac0af.el9.x86_ 2.7 MB/s | 890 kB 00:00 2024-04-26T07:53:13.430 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:13.430 INFO:teuthology.orchestra.run.smithi062.stdout:Total 2.1 MB/s | 970 kB 00:00 2024-04-26T07:53:13.443 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:13.466 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:13.466 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:13.551 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:13.551 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:13.742 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-26T07:53:13.913 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:31 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/2 2024-04-26T07:53:14.037 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:14.037 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:14.037 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:53:14.037 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:14.037 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:14.037 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 890 k 2024-04-26T07:53:14.038 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:53:14.038 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T07:53:14.038 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:14.038 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:14.038 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:14.038 INFO:teuthology.orchestra.run.smithi001.stdout:Install 2 Packages 2024-04-26T07:53:14.038 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:14.039 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 970 k 2024-04-26T07:53:14.039 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 2.8 M 2024-04-26T07:53:14.039 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:14.284 INFO:teuthology.orchestra.run.smithi001.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 648 kB/s | 80 kB 00:00 2024-04-26T07:53:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/2 2024-04-26T07:53:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/2 2024-04-26T07:53:14.601 INFO:teuthology.orchestra.run.smithi001.stdout:(2/2): ceph-fuse-19.0.0-3092.g5bfac0af.el9.x86_ 2.0 MB/s | 890 kB 00:00 2024-04-26T07:53:14.602 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:14.602 INFO:teuthology.orchestra.run.smithi001.stdout:Total 1.7 MB/s | 970 kB 00:00 2024-04-26T07:53:14.615 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:14.641 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:14.641 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:14.723 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:14.724 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-26T07:53:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:14.794 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-26T07:53:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:14.794 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:14.913 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:15.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-volume 2024-04-26T07:53:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-26T07:53:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/2 2024-04-26T07:53:15.570 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:34 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:15.697 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:15.697 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-26T07:53:15.697 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:15.697 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 264 k 2024-04-26T07:53:15.698 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-26T07:53:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T07:53:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:15.698 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:15.698 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:15.698 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-04-26T07:53:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:15.699 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 341 k 2024-04-26T07:53:15.699 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.5 M 2024-04-26T07:53:15.699 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 2/2 2024-04-26T07:53:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/2 2024-04-26T07:53:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-26T07:53:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:15.978 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-26T07:53:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:15.978 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:16.109 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 609 kB/s | 77 kB 00:00 2024-04-26T07:53:16.267 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-volume 2024-04-26T07:53:16.351 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): ceph-volume-19.0.0-3092.g5bfac0af.el9.no 715 kB/s | 264 kB 00:00 2024-04-26T07:53:16.353 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:16.353 INFO:teuthology.orchestra.run.smithi062.stdout:Total 521 kB/s | 341 kB 00:00 2024-04-26T07:53:16.364 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:16.374 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:16.375 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:16.402 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:16.403 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:16.549 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-26T07:53:16.770 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.0.0-3092.g5bfac0af.el9.noarch 2/2 2024-04-26T07:53:16.786 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.0.0-3092.g5bfac0af.el9.noarch 2/2 2024-04-26T07:53:16.787 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:53:16.787 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T07:53:16.787 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:16.807 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:34 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:16.934 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:16.934 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:16.934 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-04-26T07:53:16.934 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:16.934 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:16.935 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.0.0-3092.g5bfac0af.el9 ceph-noarch 264 k 2024-04-26T07:53:16.935 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-04-26T07:53:16.935 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T07:53:16.935 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:16.935 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:16.935 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:16.935 INFO:teuthology.orchestra.run.smithi001.stdout:Install 2 Packages 2024-04-26T07:53:16.935 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:16.936 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 341 k 2024-04-26T07:53:16.936 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 1.5 M 2024-04-26T07:53:16.936 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:17.138 INFO:teuthology.orchestra.run.smithi001.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 572 kB/s | 77 kB 00:00 2024-04-26T07:53:17.288 INFO:teuthology.orchestra.run.smithi001.stdout:(2/2): ceph-volume-19.0.0-3092.g5bfac0af.el9.no 925 kB/s | 264 kB 00:00 2024-04-26T07:53:17.290 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:17.290 INFO:teuthology.orchestra.run.smithi001.stdout:Total 960 kB/s | 341 kB 00:00 2024-04-26T07:53:17.302 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:17.314 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:17.315 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:17.340 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:17.340 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:17.416 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.0.0-3092.g5bfac0af.el9.noarch 1/2 2024-04-26T07:53:17.490 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:17.689 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-26T07:53:17.699 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-26T07:53:17.699 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:17.699 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:17.699 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:53:17.699 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T07:53:17.699 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:17.699 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:17.733 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.0.0-3092.g5bfac0af.el9.noarch 2/2 2024-04-26T07:53:17.749 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.0.0-3092.g5bfac0af.el9.noarch 2/2 2024-04-26T07:53:17.749 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:53:17.749 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T07:53:17.749 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:18.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados-devel 2024-04-26T07:53:18.429 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.0.0-3092.g5bfac0af.el9.noarch 1/2 2024-04-26T07:53:18.543 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:37 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:18.669 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:18.671 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:18.671 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-04-26T07:53:18.671 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:18.671 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:18.671 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 127 k 2024-04-26T07:53:18.672 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:18.672 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:18.672 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:18.672 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-26T07:53:18.672 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:18.672 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 127 k 2024-04-26T07:53:18.672 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 456 k 2024-04-26T07:53:18.673 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:18.719 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-26T07:53:18.720 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:18.720 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:18.720 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.0.0-3092.g5bfac0af.el9.noarch 2024-04-26T07:53:18.720 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T07:53:18.720 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:18.720 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:19.063 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install librados-devel 2024-04-26T07:53:19.500 INFO:teuthology.orchestra.run.smithi062.stdout:librados-devel-19.0.0-3092.g5bfac0af.el9.x86_64 153 kB/s | 127 kB 00:00 2024-04-26T07:53:19.500 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:19.500 INFO:teuthology.orchestra.run.smithi062.stdout:Total 153 kB/s | 127 kB 00:00 2024-04-26T07:53:19.501 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:19.508 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:19.508 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:19.581 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:19.581 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:19.599 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:37 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:19.723 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:19.724 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:19.724 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repo Size 2024-04-26T07:53:19.724 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 127 k 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout:Install 1 Package 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 127 k 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 456 k 2024-04-26T07:53:19.725 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:19.761 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:19.874 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:20.272 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:20.521 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:20.521 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:20.644 INFO:teuthology.orchestra.run.smithi001.stdout:librados-devel-19.0.0-3092.g5bfac0af.el9.x86_64 138 kB/s | 127 kB 00:00 2024-04-26T07:53:20.645 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:20.645 INFO:teuthology.orchestra.run.smithi001.stdout:Total 138 kB/s | 127 kB 00:00 2024-04-26T07:53:20.645 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:20.652 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:20.653 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:20.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs2 2024-04-26T07:53:20.727 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:20.728 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:20.883 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:20.985 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:21.273 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:40 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:21.360 INFO:teuthology.orchestra.run.smithi062.stdout:Package libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:21.382 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:21.405 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:21.406 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:53:21.406 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:21.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs-devel 2024-04-26T07:53:21.637 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:21.638 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:21.638 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:21.638 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:21.638 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:21.638 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:21.883 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install libcephfs2 2024-04-26T07:53:22.017 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:41 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:22.141 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:22.142 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-04-26T07:53:22.142 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:22.142 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 32 k 2024-04-26T07:53:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:22.142 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:22.143 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:22.143 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-26T07:53:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:22.143 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 32 k 2024-04-26T07:53:22.143 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 142 k 2024-04-26T07:53:22.143 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:22.428 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:40 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:22.479 INFO:teuthology.orchestra.run.smithi062.stdout:libcephfs-devel-19.0.0-3092.g5bfac0af.el9.x86_6 94 kB/s | 32 kB 00:00 2024-04-26T07:53:22.480 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:22.480 INFO:teuthology.orchestra.run.smithi062.stdout:Total 94 kB/s | 32 kB 00:00 2024-04-26T07:53:22.480 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:22.484 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:22.484 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:22.487 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:22.487 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:22.512 INFO:teuthology.orchestra.run.smithi001.stdout:Package libcephfs2-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:22.557 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:22.559 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:53:22.559 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:22.576 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:22.635 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install libcephfs-devel 2024-04-26T07:53:22.678 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:23.004 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:23.177 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:41 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:23.235 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:23.235 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:23.235 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:23.235 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:23.235 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:23.235 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:23.303 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:23.303 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:23.303 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repo Size 2024-04-26T07:53:23.303 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:23.303 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:23.303 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 32 k 2024-04-26T07:53:23.304 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:23.304 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:23.304 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:23.304 INFO:teuthology.orchestra.run.smithi001.stdout:Install 1 Package 2024-04-26T07:53:23.304 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:23.304 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 32 k 2024-04-26T07:53:23.304 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 142 k 2024-04-26T07:53:23.304 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:23.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados2 2024-04-26T07:53:23.723 INFO:teuthology.orchestra.run.smithi001.stdout:libcephfs-devel-19.0.0-3092.g5bfac0af.el9.x86_6 76 kB/s | 32 kB 00:00 2024-04-26T07:53:23.723 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:23.724 INFO:teuthology.orchestra.run.smithi001.stdout:Total 75 kB/s | 32 kB 00:00 2024-04-26T07:53:23.724 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:23.728 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:23.728 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:23.730 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:23.730 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:23.816 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:23.913 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:42 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:24.022 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:24.066 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:24.067 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:53:24.067 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:24.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librbd1 2024-04-26T07:53:24.267 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:24.480 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:24.480 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:24.480 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:24.480 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:24.480 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:24.480 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:24.659 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:43 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:24.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install librados2 2024-04-26T07:53:24.739 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:24.784 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:24.785 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:53:24.785 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:24.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rados 2024-04-26T07:53:25.216 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:43 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:25.298 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:25.342 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:25.343 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:53:25.343 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:25.401 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:44 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:25.423 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install librbd1 2024-04-26T07:53:25.484 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rados-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:25.527 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:25.528 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:53:25.528 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:25.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rgw 2024-04-26T07:53:25.961 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:43 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:26.043 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:26.088 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:26.089 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:53:26.089 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:26.121 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:45 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:26.160 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install python3-rados 2024-04-26T07:53:26.202 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:26.248 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:26.249 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:53:26.249 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:26.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-cephfs 2024-04-26T07:53:26.687 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:44 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:26.768 INFO:teuthology.orchestra.run.smithi001.stdout:Package python3-rados-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:26.812 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:26.813 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:53:26.813 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:26.847 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:45 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:26.898 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install python3-rgw 2024-04-26T07:53:26.927 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-cephfs-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:26.970 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:26.971 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:53:26.972 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:27.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rbd 2024-04-26T07:53:27.437 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:45 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:27.519 INFO:teuthology.orchestra.run.smithi001.stdout:Package python3-rgw-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:27.563 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:27.564 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:53:27.564 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:27.565 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:46 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:27.631 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install python3-cephfs 2024-04-26T07:53:27.648 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:27.691 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-26T07:53:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:27.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-fuse 2024-04-26T07:53:28.162 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:46 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:28.243 INFO:teuthology.orchestra.run.smithi001.stdout:Package python3-cephfs-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:28.287 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:28.288 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:53:28.288 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:28.295 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:47 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:28.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install python3-rbd 2024-04-26T07:53:28.420 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 85 k 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:28.421 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-26T07:53:28.422 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:28.422 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 85 k 2024-04-26T07:53:28.422 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 231 k 2024-04-26T07:53:28.422 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:46 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:28.974 INFO:teuthology.orchestra.run.smithi001.stdout:Package python3-rbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 is already installed. 2024-04-26T07:53:28.991 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-fuse-19.0.0-3092.g5bfac0af.el9.x86_64.rpm 150 kB/s | 85 kB 00:00 2024-04-26T07:53:28.991 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:28.992 INFO:teuthology.orchestra.run.smithi062.stdout:Total 150 kB/s | 85 kB 00:00 2024-04-26T07:53:28.992 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:29.000 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:29.000 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:29.017 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:29.018 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-04-26T07:53:29.018 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:29.069 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:29.070 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:29.105 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install rbd-fuse 2024-04-26T07:53:29.219 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:29.306 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:29.644 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:47 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:29.653 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:29.769 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:29.770 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:29.770 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-04-26T07:53:29.770 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:29.770 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:29.770 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 85 k 2024-04-26T07:53:29.770 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:29.770 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:29.770 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:29.771 INFO:teuthology.orchestra.run.smithi001.stdout:Install 1 Package 2024-04-26T07:53:29.771 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:29.771 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 85 k 2024-04-26T07:53:29.771 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 231 k 2024-04-26T07:53:29.771 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:29.936 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:29.945 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:29.945 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:29.945 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:29.945 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:29.945 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:30.134 INFO:teuthology.orchestra.run.smithi001.stdout:rbd-fuse-19.0.0-3092.g5bfac0af.el9.x86_64.rpm 234 kB/s | 85 kB 00:00 2024-04-26T07:53:30.135 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:30.135 INFO:teuthology.orchestra.run.smithi001.stdout:Total 234 kB/s | 85 kB 00:00 2024-04-26T07:53:30.135 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:30.143 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:30.143 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:30.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-mirror 2024-04-26T07:53:30.210 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:30.210 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:30.366 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:30.474 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:30.708 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:49 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:30.810 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:30.834 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:30.835 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-04-26T07:53:30.835 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:30.835 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 3.1 M 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 3.1 M 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 13 M 2024-04-26T07:53:30.836 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:31.069 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:31.070 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:31.070 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:31.070 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:31.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install rbd-mirror 2024-04-26T07:53:31.883 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:49 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:32.009 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:32.009 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:32.009 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repo Size 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 3.1 M 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout:Install 1 Package 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 3.1 M 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 13 M 2024-04-26T07:53:32.010 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:32.654 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-mirror-19.0.0-3092.g5bfac0af.el9.x86_64.rpm 1.7 MB/s | 3.1 MB 00:01 2024-04-26T07:53:32.655 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:32.655 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.7 MB/s | 3.1 MB 00:01 2024-04-26T07:53:32.655 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:32.751 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:32.752 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:32.938 INFO:teuthology.orchestra.run.smithi001.stdout:rbd-mirror-19.0.0-3092.g5bfac0af.el9.x86_64.rpm 3.3 MB/s | 3.1 MB 00:00 2024-04-26T07:53:32.938 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:32.939 INFO:teuthology.orchestra.run.smithi001.stdout:Total 3.3 MB/s | 3.1 MB 00:00 2024-04-26T07:53:32.939 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:32.949 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:32.949 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:33.037 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:33.037 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:33.201 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:33.278 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:33.305 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:33.305 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:53:33.305 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T07:53:33.305 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T07:53:33.305 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T07:53:33.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:33.486 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:33.547 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:33.574 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:33.575 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T07:53:33.575 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T07:53:33.575 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T07:53:33.575 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T07:53:33.575 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:34.386 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:34.386 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:34.387 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:34.387 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:34.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-nbd 2024-04-26T07:53:34.639 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:34.639 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:34.639 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:34.639 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:34.639 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:34.639 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:34.874 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install rbd-nbd 2024-04-26T07:53:35.159 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:54 ago on Fri 26 Apr 2024 07:51:41 AM UTC. 2024-04-26T07:53:35.286 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-26T07:53:35.286 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:35.286 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-26T07:53:35.286 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:35.286 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-26T07:53:35.286 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 170 k 2024-04-26T07:53:35.287 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-26T07:53:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-26T07:53:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-26T07:53:35.287 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 170 k 2024-04-26T07:53:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 494 k 2024-04-26T07:53:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-26T07:53:35.410 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:53 ago on Fri 26 Apr 2024 07:51:42 AM UTC. 2024-04-26T07:53:35.537 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-04-26T07:53:35.538 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:35.538 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-04-26T07:53:35.538 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:35.538 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-04-26T07:53:35.538 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.0.0-3092.g5bfac0af.el9 ceph 170 k 2024-04-26T07:53:35.538 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:35.539 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-04-26T07:53:35.539 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-04-26T07:53:35.539 INFO:teuthology.orchestra.run.smithi001.stdout:Install 1 Package 2024-04-26T07:53:35.539 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:35.539 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 170 k 2024-04-26T07:53:35.539 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 494 k 2024-04-26T07:53:35.539 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-04-26T07:53:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-nbd-19.0.0-3092.g5bfac0af.el9.x86_64.rpm 493 kB/s | 170 kB 00:00 2024-04-26T07:53:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:Total 492 kB/s | 170 kB 00:00 2024-04-26T07:53:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-26T07:53:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-26T07:53:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-26T07:53:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-26T07:53:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-26T07:53:35.868 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-26T07:53:35.972 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:35.991 INFO:teuthology.orchestra.run.smithi001.stdout:rbd-nbd-19.0.0-3092.g5bfac0af.el9.x86_64.rpm 377 kB/s | 170 kB 00:00 2024-04-26T07:53:35.992 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:53:35.992 INFO:teuthology.orchestra.run.smithi001.stdout:Total 375 kB/s | 170 kB 00:00 2024-04-26T07:53:35.992 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-04-26T07:53:36.001 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-04-26T07:53:36.001 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-04-26T07:53:36.068 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-04-26T07:53:36.069 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-04-26T07:53:36.228 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-04-26T07:53:36.332 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:36.359 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-26T07:53:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-26T07:53:36.709 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:36.845 DEBUG:teuthology.parallel:result is None 2024-04-26T07:53:36.945 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 1/1 2024-04-26T07:53:36.945 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:36.945 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-04-26T07:53:36.945 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.0.0-3092.g5bfac0af.el9.x86_64 2024-04-26T07:53:36.945 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:36.945 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-04-26T07:53:37.181 DEBUG:teuthology.parallel:result is None 2024-04-26T07:53:37.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:53:37.330 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T07:53:37.352 INFO:teuthology.orchestra.run.smithi001.stdout:19.0.0-3092.g5bfac0af.el9 2024-04-26T07:53:37.353 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3092.g5bfac0af.el9 2024-04-26T07:53:37.353 INFO:teuthology.task.install:The correct ceph version 19.0.0-3092.g5bfac0af is installed. 2024-04-26T07:53:37.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:53:37.503 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T07:53:37.526 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-3092.g5bfac0af.el9 2024-04-26T07:53:37.526 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3092.g5bfac0af.el9 2024-04-26T07:53:37.526 INFO:teuthology.task.install:The correct ceph version 19.0.0-3092.g5bfac0af is installed. 2024-04-26T07:53:37.528 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T07:53:37.529 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:37.529 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T07:53:37.556 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:37.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T07:53:37.594 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T07:53:37.594 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:37.594 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T07:53:37.622 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T07:53:37.690 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:37.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T07:53:37.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T07:53:37.782 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T07:53:37.782 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:37.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T07:53:37.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T07:53:37.871 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:37.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T07:53:37.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T07:53:37.961 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T07:53:37.961 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:37.962 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T07:53:37.986 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T07:53:38.050 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:38.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T07:53:38.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T07:53:38.138 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T07:53:38.231 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T07:53:38.231 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /var/log/ceph 2024-04-26T07:53:38.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-04-26T07:53:38.258 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T07:53:38.258 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T07:53:38.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T07:53:38.323 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T07:53:38.323 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T07:53:38.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T07:53:38.396 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T07:53:38.396 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T07:53:38.397 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640', 'branch': 'fix_error_message_flow', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': 'gsalomon@redhat.com', 'first_in_suite': False, 'job_id': '7674640', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'fix_error_message_flow'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'fix_error_message_flow', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}}, 'owner': 'scheduled_gsalomon@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 8229, 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'fix_error_message_flow', 'suite_path': '/home/teuthworker/src/github.com_galsalomon66_ceph_5bfac0af933f1833ec096c3048e2c80e20507e52/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/galsalomon66/ceph', 'suite_sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52', 'targets': {'smithi001.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOvOaAghTYyI00S0sp3S+uR+6LpYtE8KKSAsDMO8/QHIVl9xf5Ujq6yAf3u6KirxQHWzg2pop8Xb07IHvKz1mw=', 'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHpJJS1HwxmA0PLhh4yvH65eFEcl69taPnALw3oSXzrEMcLAWO1ztf+nKsottz7XPcdsf1RMBBZ9wHI9tg2KgFw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_07:23:10', 'tube': 'smithi', 'user': 'gsalomon', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T07:53:38.397 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T07:53:38.429 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T07:53:38.445 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T07:53:38.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T07:53:38.510 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:38.510 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T07:53:38.562 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T07:53:38.562 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-04-26T07:53:38.617 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T07:53:38.618 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:53:38.618 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-26T07:53:38.618 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:53:38.618 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:53:38.618 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-04-26 07:53:33.837032080 +0000 2024-04-26T07:53:38.618 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-04-26 07:51:02.706627070 +0000 2024-04-26T07:53:38.618 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-04-26 07:51:02.706627070 +0000 2024-04-26T07:53:38.618 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-04-26 07:51:02.706627070 +0000 2024-04-26T07:53:38.619 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T07:53:38.680 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-04-26T07:53:38.680 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-04-26T07:53:38.680 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000101885 s, 5.0 MB/s 2024-04-26T07:53:38.681 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T07:53:38.738 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-04-26 07:53:33.838032068 +0000 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-04-26 07:51:03.220620466 +0000 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-04-26 07:51:03.220620466 +0000 2024-04-26T07:53:38.797 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-04-26 07:51:03.220620466 +0000 2024-04-26T07:53:38.798 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T07:53:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-04-26T07:53:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-04-26T07:53:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.00010049 s, 5.1 MB/s 2024-04-26T07:53:38.861 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T07:53:38.917 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-04-26T07:53:38.972 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T07:53:38.973 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:53:38.973 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T07:53:38.973 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:53:38.973 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:53:38.973 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-04-26 07:53:33.838032068 +0000 2024-04-26T07:53:38.973 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-04-26 07:51:03.556616149 +0000 2024-04-26T07:53:38.973 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-04-26 07:51:03.556616149 +0000 2024-04-26T07:53:38.973 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-04-26 07:51:03.556616149 +0000 2024-04-26T07:53:38.974 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T07:53:39.035 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-04-26T07:53:39.035 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-04-26T07:53:39.035 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 9.6247e-05 s, 5.3 MB/s 2024-04-26T07:53:39.036 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T07:53:39.092 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-04-26 07:53:33.839032055 +0000 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-04-26 07:51:03.913611562 +0000 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-04-26 07:51:03.913611562 +0000 2024-04-26T07:53:39.148 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-04-26 07:51:03.913611562 +0000 2024-04-26T07:53:39.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T07:53:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-04-26T07:53:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-04-26T07:53:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 9.2069e-05 s, 5.6 MB/s 2024-04-26T07:53:39.212 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T07:53:39.268 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T07:53:39.268 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:39.269 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T07:53:39.288 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T07:53:39.288 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-04-26T07:53:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T07:53:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:53:39.347 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-26T07:53:39.347 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:53:39.347 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:53:39.347 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-26 07:53:33.573484405 +0000 2024-04-26T07:53:39.347 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-26 07:51:02.932237396 +0000 2024-04-26T07:53:39.347 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-26 07:51:02.932237396 +0000 2024-04-26T07:53:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-26 07:51:02.932237396 +0000 2024-04-26T07:53:39.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T07:53:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-26T07:53:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-26T07:53:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000278247 s, 1.8 MB/s 2024-04-26T07:53:39.416 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T07:53:39.476 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-04-26T07:53:39.534 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T07:53:39.534 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:53:39.534 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-26T07:53:39.534 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:53:39.534 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:53:39.534 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-26 07:53:33.574484390 +0000 2024-04-26T07:53:39.534 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-26 07:51:03.278231478 +0000 2024-04-26T07:53:39.535 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-26 07:51:03.278231478 +0000 2024-04-26T07:53:39.535 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-26 07:51:03.278231478 +0000 2024-04-26T07:53:39.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T07:53:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-26T07:53:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-26T07:53:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000202636 s, 2.5 MB/s 2024-04-26T07:53:39.602 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T07:53:39.661 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-04-26T07:53:39.720 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T07:53:39.720 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:53:39.720 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T07:53:39.720 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:53:39.720 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:53:39.720 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-26 07:53:33.574484390 +0000 2024-04-26T07:53:39.721 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-26 07:51:03.627225508 +0000 2024-04-26T07:53:39.721 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-26 07:51:03.627225508 +0000 2024-04-26T07:53:39.721 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-26 07:51:03.627225508 +0000 2024-04-26T07:53:39.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T07:53:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-26T07:53:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-26T07:53:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.00024527 s, 2.1 MB/s 2024-04-26T07:53:39.788 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T07:53:39.846 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-04-26T07:53:39.903 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T07:53:39.903 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:53:39.903 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-26T07:53:39.903 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:53:39.904 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:53:39.904 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-26 07:53:33.575484374 +0000 2024-04-26T07:53:39.904 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-26 07:51:03.970219641 +0000 2024-04-26T07:53:39.904 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-26 07:51:03.970219641 +0000 2024-04-26T07:53:39.904 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-26 07:51:03.970219641 +0000 2024-04-26T07:53:39.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T07:53:39.968 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-26T07:53:39.968 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-26T07:53:39.968 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000228603 s, 2.2 MB/s 2024-04-26T07:53:39.969 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T07:53:40.027 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T07:53:40.027 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-26T07:53:40.027 INFO:tasks.ceph:Generating config... 2024-04-26T07:53:40.029 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T07:53:40.029 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-04-26T07:53:40.029 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-26T07:53:40.029 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-26T07:53:40.029 INFO:tasks.ceph:[client] setuser = ceph 2024-04-26T07:53:40.029 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T07:53:40.029 INFO:tasks.ceph:[osd] debug objclass = 20 2024-04-26T07:53:40.029 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T07:53:40.029 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T07:53:40.030 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T07:53:40.031 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T07:53:40.031 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T07:53:40.031 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T07:53:40.031 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T07:53:40.031 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T07:53:40.031 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T07:53:40.031 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T07:53:40.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T07:53:40.081 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T07:53:40.084 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T07:53:40.129 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:53:40.155 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.1')] 2024-04-26T07:53:40.156 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.1'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-04-26T07:53:40.157 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:40.157 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T07:53:40.212 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.1 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:40.293 INFO:teuthology.orchestra.run.smithi001.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:53:40.293 INFO:teuthology.orchestra.run.smithi001.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:53:40.293 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:40.293 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: generated fsid ed2f0749-350f-459a-96bf-130a296577eb 2024-04-26T07:53:40.293 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-04-26T07:53:40.294 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 0 2024-04-26T07:53:40.294 INFO:teuthology.orchestra.run.smithi001.stdout:fsid ed2f0749-350f-459a-96bf-130a296577eb 2024-04-26T07:53:40.294 INFO:teuthology.orchestra.run.smithi001.stdout:last_changed 2024-04-26T07:53:40.295562+0000 2024-04-26T07:53:40.294 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-04-26T07:53:40.295562+0000 2024-04-26T07:53:40.294 INFO:teuthology.orchestra.run.smithi001.stdout:min_mon_release 17 (quincy) 2024-04-26T07:53:40.294 INFO:teuthology.orchestra.run.smithi001.stdout:election_strategy: 1 2024-04-26T07:53:40.294 INFO:teuthology.orchestra.run.smithi001.stdout:0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-04-26T07:53:40.294 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-26T07:53:40.295 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T07:53:40.351 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ed2f0749-350f-459a-96bf-130a296577eb... 2024-04-26T07:53:40.351 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T07:53:40.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T07:53:40.438 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-04-26T07:53:40.438 INFO:teuthology.orchestra.run.smithi001.stdout: chdir = "" 2024-04-26T07:53:40.439 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T07:53:40.439 INFO:teuthology.orchestra.run.smithi001.stdout: auth supported = cephx 2024-04-26T07:53:40.439 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: filestore xattr use omap = true 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: mon clock drift allowed = 1.000 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: osd crush chooseleaf type = 0 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: auth debug = true 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on old message = true 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on bug = true 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.440 INFO:teuthology.orchestra.run.smithi001.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: mon pg warn max object skew = 0 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default size = 2 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow primary affinity = true 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow pg remap = true 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on legacy crush tunables = false 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on crush straw calc version zero = false 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on no sortbitwise = false 2024-04-26T07:53:40.441 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on osd down out interval zero = false 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on too few osds = false 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: mon_allow_pool_size_one = true 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: osd default data pool replay window = 5 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: mon allow pool delete = true 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.442 INFO:teuthology.orchestra.run.smithi001.stdout: mon cluster log file level = debug 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: debug asserts on shutdown = true 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: mon health detail to clog = false 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: mon host = 172.21.15.1 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = ed2f0749-350f-459a-96bf-130a296577eb 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:[osd] 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: osd journal size = 100 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub load threshold = 5.0 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub max interval = 600 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: osd mclock profile = high_recovery_ops 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: osd recover clone overlap = true 2024-04-26T07:53:40.443 INFO:teuthology.orchestra.run.smithi001.stdout: osd recovery max chunk = 1048576 2024-04-26T07:53:40.444 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.444 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug shutdown = true 2024-04-26T07:53:40.444 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug op order = true 2024-04-26T07:53:40.444 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug verify stray on activate = true 2024-04-26T07:53:40.444 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug trim objects = true 2024-04-26T07:53:40.444 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.444 INFO:teuthology.orchestra.run.smithi001.stdout: osd open classes on start = true 2024-04-26T07:53:40.444 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug pg log writeout = true 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: osd deep scrub update digest min age = 30 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: osd map max advance = 10 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: journal zero on create = true 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: filestore ondisk finisher threads = 3 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: filestore apply finisher threads = 3 2024-04-26T07:53:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: bdev debug aio = true 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug misdirected ops = true 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: debug objclass = 20 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: bdev async discard = True 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: bdev enable discard = True 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore allocator = bitmap 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore block size = 96636764160 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore fsck on mount = True 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluefs = 1/20 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluestore = 1/20 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: debug osd = 20 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: debug rocksdb = 4/10 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T07:53:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd full ratio = 0.9 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd nearfull ratio = 0.8 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: osd failsafe full ratio = 0.95 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: osd objectstore = bluestore 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr] 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: debug mgr = 20 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: mgr/telemetry/nag = false 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout:[mon] 2024-04-26T07:53:40.448 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: debug paxos = 20 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: mon data avail warn = 5 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: mon mgr mkfs grace = 240 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd reporter subtree level = osd 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd prime pg temp = true 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.449 INFO:teuthology.orchestra.run.smithi001.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: # 1m isn't quite enough 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: mon_down_mkfs_grace = 2m 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_filestore_osds = false 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout:[client] 2024-04-26T07:53:40.450 INFO:teuthology.orchestra.run.smithi001.stdout: rgw cache enabled = true 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable ops log = true 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable usage log = true 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: rgw gc obj min wait = 15 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: debug rgw = 20 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: setgroup = ceph 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout: setuser = ceph 2024-04-26T07:53:40.451 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.a] 2024-04-26T07:53:40.452 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-04-26T07:53:40.452 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-04-26T07:53:40.452 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T07:53:40.452 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-04-26T07:53:40.452 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.452 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-04-26T07:53:40.452 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.452 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-04-26T07:53:40.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-04-26T07:53:40.454 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = 172.21.15.1 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = ed2f0749-350f-459a-96bf-130a296577eb 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.456 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug objclass = 20 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-04-26T07:53:40.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:53:40.458 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:53:40.459 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-04-26T07:53:40.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: rgw gc obj min wait = 15 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: debug rgw = 20 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: setgroup = ceph 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout: setuser = ceph 2024-04-26T07:53:40.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-04-26T07:53:40.463 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T07:53:40.463 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T07:53:40.555 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T07:53:40.556 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:40.556 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T07:53:40.571 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:40.571 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T07:53:40.626 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi001.front.sepia.ceph.com 2024-04-26T07:53:40.626 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:40.626 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T07:53:40.627 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:53:40.700 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:40.700 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:40.756 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:53:40.756 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:40.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T07:53:40.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:53:40.795 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:40.795 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:40.853 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T07:53:40.854 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T07:53:40.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T07:53:40.960 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T07:53:40.963 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T07:53:40.963 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T07:53:40.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T07:53:41.006 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T07:53:41.018 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T07:53:41.019 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-26T07:53:41.019 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T07:53:41.045 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T07:53:41.045 INFO:tasks.ceph:role: osd.0 2024-04-26T07:53:41.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com 2024-04-26T07:53:41.045 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T07:53:41.109 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:53:41.110 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:53:41.142 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-04-26T07:53:41.144 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-04-26T07:53:41.144 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T07:53:41.213 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T07:53:41.282 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:41.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:41.375+0000 7f33d4c15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T07:53:41.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:41.375+0000 7f33d4c15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T07:53:41.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:41.375+0000 7f33d4c15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:53:41.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:41.375+0000 7f33d4c15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:53:41.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:41.375+0000 7f33d4c15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:53:41.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:41.375+0000 7f33d4c15640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T07:53:44.229 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T07:53:44.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T07:53:44.289 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T07:53:44.290 INFO:tasks.ceph:role: osd.1 2024-04-26T07:53:44.290 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:53:44.290 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T07:53:44.366 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:53:44.367 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:53:44.863 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-26T07:53:44.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-26T07:53:44.865 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T07:53:44.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T07:53:45.025 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T07:53:45.092 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T07:53:45.092 INFO:tasks.ceph:role: osd.2 2024-04-26T07:53:45.093 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:53:45.093 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T07:53:45.166 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:53:45.166 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:53:45.167 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:53:45.167 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T07:53:45.167 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:53:45.167 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:53:45.167 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:53:45.167 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T07:53:45.167 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:53:45.167 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:53:45.623 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-26T07:53:45.625 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-26T07:53:45.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-26T07:53:45.718 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T07:53:45.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T07:53:45.813 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T07:53:45.813 INFO:tasks.ceph:role: osd.3 2024-04-26T07:53:45.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:53:45.813 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T07:53:45.885 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:53:45.885 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:53:45.886 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:53:45.886 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T07:53:45.886 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:53:45.886 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:53:45.886 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:53:45.886 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T07:53:45.886 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:53:45.887 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:53:46.374 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-26T07:53:46.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-26T07:53:46.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-26T07:53:46.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T07:53:46.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:46.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:46.619+0000 7fc60d701640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T07:53:46.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:46.622+0000 7fc60d701640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T07:53:46.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:46.622+0000 7fc60d701640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:53:46.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:46.622+0000 7fc60d701640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:53:46.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:46.622+0000 7fc60d701640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:53:46.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:46.629+0000 7fc60d701640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T07:53:49.481 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T07:53:49.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:49.602+0000 7f5b44b0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T07:53:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:49.602+0000 7f5b44b0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T07:53:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:49.602+0000 7f5b44b0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:53:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:49.602+0000 7f5b44b0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:53:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:49.602+0000 7f5b44b0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:53:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:49.603+0000 7f5b44b0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T07:53:52.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T07:53:52.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:52.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:52.585+0000 7f3898610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T07:53:52.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:52.586+0000 7f3898610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T07:53:52.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:52.586+0000 7f3898610640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:53:52.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:52.586+0000 7f3898610640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:53:52.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:52.586+0000 7f3898610640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:53:52.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:52.586+0000 7f3898610640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T07:53:55.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T07:53:55.470 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T07:53:55.471 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:55.471 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T07:53:55.501 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:55.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T07:53:55.539 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:55.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T07:53:55.609 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:55.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T07:53:55.676 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:55.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T07:53:55.742 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:55.742 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T07:53:55.802 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T07:53:55.803 DEBUG:teuthology.orchestra.run.smithi001:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T07:53:55.833 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.0] 2024-04-26T07:53:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCFXStmbft2FhAAUu5EVjJ3bpDF4+vTf2W4pA== 2024-04-26T07:53:55.833 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.x] 2024-04-26T07:53:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCEXStmwCJjORAALPy2u2OdoVL6AqL3KAxEuA== 2024-04-26T07:53:55.833 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.1] 2024-04-26T07:53:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCKXStmh8b3JBAA19BPaWzM5ryOe00VdRrI7Q== 2024-04-26T07:53:55.834 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.2] 2024-04-26T07:53:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCNXStmBgb5IxAAUV/wkhgcVfasAqJ4KMtuSQ== 2024-04-26T07:53:55.834 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.3] 2024-04-26T07:53:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCQXStmGtr8IhAAxrNq/Ng8Tnvzk0+yQf0A/A== 2024-04-26T07:53:55.835 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-04-26T07:53:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCFXStm7AZ9ABAAccSwogfOtR1u5APAe3iq1A== 2024-04-26T07:53:55.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:53:55.932 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T07:53:55.985 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:53:56.038 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:53:56.089 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:53:56.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T07:53:56.192 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T07:53:56.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T07:53:56.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T07:53:56.322 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T07:53:56.349 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:53:56.409 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T07:53:56.409 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T07:53:56.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T07:53:56.455 INFO:tasks.ceph.mon.a:Started 2024-04-26T07:53:56.456 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T07:53:56.456 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T07:53:56.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T07:53:56.459 INFO:tasks.ceph.mgr.x:Started 2024-04-26T07:53:56.460 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T07:53:56.460 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T07:53:56.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.563+0000 7f9a36adb640 1 Processor -- start 2024-04-26T07:53:56.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.563+0000 7f9a36adb640 1 -- start start 2024-04-26T07:53:56.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.563+0000 7f9a36adb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9a3012f840 0x7f9a30133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:56.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.563+0000 7f9a36adb640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a30099fe0 con 0x7f9a3012ec10 2024-04-26T07:53:56.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.563+0000 7f9a36adb640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3009b5e0 con 0x7f9a3012f840 2024-04-26T07:53:56.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.564+0000 7f9a2ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9a3012f840 0x7f9a30133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:56.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.564+0000 7f9a34877640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9a3012ec10 0x7f9a3012f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52110/0 (socket says 172.21.15.1:52110) 2024-04-26T07:53:56.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.564+0000 7f9a34877640 1 -- 172.21.15.1:0/3724449598 learned_addr learned my addr 172.21.15.1:0/3724449598 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:53:56.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.564+0000 7f9a2ffff640 1 -- 172.21.15.1:0/3724449598 >> v1:172.21.15.1:6789/0 conn(0x7f9a3012ec10 legacy=0x7f9a3012f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:56.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.564+0000 7f9a2ffff640 1 -- 172.21.15.1:0/3724449598 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3009b340 con 0x7f9a3012f840 2024-04-26T07:53:56.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a2ffff640 1 --2- 172.21.15.1:0/3724449598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012f840 0x7f9a30133f30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009720 tx=0x7f9a2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0b6d11342049a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:56.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a2f7fe640 1 -- 172.21.15.1:0/3724449598 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a24035020 con 0x7f9a3012f840 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a2f7fe640 1 -- 172.21.15.1:0/3724449598 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a24031760 con 0x7f9a3012f840 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a2f7fe640 1 -- 172.21.15.1:0/3724449598 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a24031a60 con 0x7f9a3012f840 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a36adb640 1 -- 172.21.15.1:0/3724449598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012f840 msgr2=0x7f9a30133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a36adb640 1 --2- 172.21.15.1:0/3724449598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012f840 0x7f9a30133f30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009720 tx=0x7f9a2402b8d0 comp rx=0 tx=0).stop 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a36adb640 1 -- 172.21.15.1:0/3724449598 shutdown_connections 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a36adb640 1 --2- 172.21.15.1:0/3724449598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012f840 0x7f9a30133f30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.565+0000 7f9a36adb640 1 -- 172.21.15.1:0/3724449598 >> 172.21.15.1:0/3724449598 conn(0x7f9a300a1520 msgr2=0x7f9a300a1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.566+0000 7f9a36adb640 1 -- 172.21.15.1:0/3724449598 shutdown_connections 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.566+0000 7f9a36adb640 1 -- 172.21.15.1:0/3724449598 wait complete. 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.566+0000 7f9a36adb640 1 Processor -- start 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.566+0000 7f9a36adb640 1 -- start start 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.567+0000 7f9a36adb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012ec10 0x7f9a30132140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.567+0000 7f9a36adb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3009a8c0 con 0x7f9a3012ec10 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.567+0000 7f9a34877640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012ec10 0x7f9a30132140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:56.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.567+0000 7f9a34877640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012ec10 0x7f9a30132140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38770/0 (socket says 172.21.15.1:38770) 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.567+0000 7f9a34877640 1 -- 172.21.15.1:0/2495101440 learned_addr learned my addr 172.21.15.1:0/2495101440 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.567+0000 7f9a34877640 1 -- 172.21.15.1:0/2495101440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a30133940 con 0x7f9a3012ec10 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.567+0000 7f9a34877640 1 --2- 172.21.15.1:0/2495101440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012ec10 0x7f9a30132140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c4a0 tx=0x7f9a2000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.568+0000 7f9a2d7fa640 1 -- 172.21.15.1:0/2495101440 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a20017070 con 0x7f9a3012ec10 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.568+0000 7f9a2d7fa640 1 -- 172.21.15.1:0/2495101440 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a20005c10 con 0x7f9a3012ec10 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.568+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3006d500 con 0x7f9a3012ec10 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.568+0000 7f9a2d7fa640 1 -- 172.21.15.1:0/2495101440 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a20007070 con 0x7f9a3012ec10 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.568+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a30132860 con 0x7f9a3012ec10 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.568+0000 7f9a2d7fa640 1 -- 172.21.15.1:0/2495101440 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9a2001a070 con 0x7f9a3012ec10 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.568+0000 7f9a2d7fa640 1 -- 172.21.15.1:0/2495101440 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9a20012400 con 0x7f9a3012ec10 2024-04-26T07:53:56.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.569+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3006ea70 con 0x7f9a3012ec10 2024-04-26T07:53:56.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.571+0000 7f9a2d7fa640 1 -- 172.21.15.1:0/2495101440 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9a2001c440 con 0x7f9a3012ec10 2024-04-26T07:53:56.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.637+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f9a300636f0 con 0x7f9a3012ec10 2024-04-26T07:53:56.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.638+0000 7f9a2d7fa640 1 -- 172.21.15.1:0/2495101440 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f9a20007210 con 0x7f9a3012ec10 2024-04-26T07:53:56.636 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-04-26T07:53:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.638+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012ec10 msgr2=0x7f9a30132140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.638+0000 7f9a36adb640 1 --2- 172.21.15.1:0/2495101440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012ec10 0x7f9a30132140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c4a0 tx=0x7f9a2000c960 comp rx=0 tx=0).stop 2024-04-26T07:53:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.639+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 shutdown_connections 2024-04-26T07:53:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.639+0000 7f9a36adb640 1 --2- 172.21.15.1:0/2495101440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a3012ec10 0x7f9a30132140 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.639+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 >> 172.21.15.1:0/2495101440 conn(0x7f9a300a1520 msgr2=0x7f9a30128090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.639+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 shutdown_connections 2024-04-26T07:53:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:56.639+0000 7f9a36adb640 1 -- 172.21.15.1:0/2495101440 wait complete. 2024-04-26T07:53:56.647 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T07:53:56.647 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T07:53:56.648 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-04-26T07:53:56.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T07:53:56.661 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:56.662+0000 7f136ba3f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T07:53:56.672 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:56.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T07:53:56.696 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:56.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T07:53:56.761 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-26T07:53:56.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T07:53:56.820 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:56.821+0000 7f136ba3f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T07:53:56.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 26a6bcce-05b9-47ad-a6e3-1e096604187a 0 2024-04-26T07:53:56.876 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:56.878+0000 7f136ba3f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T07:53:56.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.967+0000 7f2e099f7640 1 Processor -- start 2024-04-26T07:53:56.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.967+0000 7f2e099f7640 1 -- start start 2024-04-26T07:53:56.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e099f7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2e0410f990 0x7f2e0411d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e099f7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0411db30 con 0x7f2e0410ee10 2024-04-26T07:53:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e099f7640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0411ed30 con 0x7f2e0410f990 2024-04-26T07:53:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e027fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2e0410f990 0x7f2e0411d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e02ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2e0410ee10 0x7f2e0410f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:51528/0 (socket says 172.21.15.62:51528) 2024-04-26T07:53:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e027fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2e0410f990 0x7f2e0411d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:36806/0 (socket says 172.21.15.62:36806) 2024-04-26T07:53:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e02ffd640 1 -- 172.21.15.62:0/413351639 learned_addr learned my addr 172.21.15.62:0/413351639 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:53:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e027fc640 1 -- 172.21.15.62:0/413351639 >> v1:172.21.15.1:6789/0 conn(0x7f2e0410ee10 legacy=0x7f2e0410f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.968+0000 7f2e027fc640 1 -- 172.21.15.62:0/413351639 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0411eee0 con 0x7f2e0410f990 2024-04-26T07:53:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.969+0000 7f2e027fc640 1 --2- 172.21.15.62:0/413351639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410f990 0x7f2e0411d500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009720 tx=0x7f2df402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76feb8adbe242e9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.969+0000 7f2e01ffb640 1 -- 172.21.15.62:0/413351639 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df40316d0 con 0x7f2e0410f990 2024-04-26T07:53:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.969+0000 7f2e01ffb640 1 -- 172.21.15.62:0/413351639 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df4037070 con 0x7f2e0410f990 2024-04-26T07:53:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.969+0000 7f2e01ffb640 1 -- 172.21.15.62:0/413351639 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df40319c0 con 0x7f2e0410f990 2024-04-26T07:53:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.970+0000 7f2e099f7640 1 -- 172.21.15.62:0/413351639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410f990 msgr2=0x7f2e0411d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.970+0000 7f2e099f7640 1 --2- 172.21.15.62:0/413351639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410f990 0x7f2e0411d500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009720 tx=0x7f2df402b840 comp rx=0 tx=0).stop 2024-04-26T07:53:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.970+0000 7f2e099f7640 1 -- 172.21.15.62:0/413351639 shutdown_connections 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.970+0000 7f2e099f7640 1 --2- 172.21.15.62:0/413351639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410f990 0x7f2e0411d500 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.970+0000 7f2e099f7640 1 -- 172.21.15.62:0/413351639 >> 172.21.15.62:0/413351639 conn(0x7f2e0406fc20 msgr2=0x7f2e04072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.970+0000 7f2e099f7640 1 -- 172.21.15.62:0/413351639 shutdown_connections 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.970+0000 7f2e099f7640 1 -- 172.21.15.62:0/413351639 wait complete. 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.971+0000 7f2e099f7640 1 Processor -- start 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.971+0000 7f2e099f7640 1 -- start start 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.971+0000 7f2e099f7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410ee10 0x7f2e041aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.971+0000 7f2e099f7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0411e220 con 0x7f2e0410ee10 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.971+0000 7f2e02ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410ee10 0x7f2e041aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.971+0000 7f2e02ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410ee10 0x7f2e041aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:36814/0 (socket says 172.21.15.62:36814) 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.971+0000 7f2e02ffd640 1 -- 172.21.15.62:0/69493065 learned_addr learned my addr 172.21.15.62:0/69493065 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.971+0000 7f2e02ffd640 1 -- 172.21.15.62:0/69493065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e041ad480 con 0x7f2e0410ee10 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.972+0000 7f2e02ffd640 1 --2- 172.21.15.62:0/69493065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410ee10 0x7f2e041aceb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c4a0 tx=0x7f2df800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:56.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.972+0000 7f2debfff640 1 -- 172.21.15.62:0/69493065 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df8017070 con 0x7f2e0410ee10 2024-04-26T07:53:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.972+0000 7f2debfff640 1 -- 172.21.15.62:0/69493065 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df8005c10 con 0x7f2e0410ee10 2024-04-26T07:53:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.972+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e041ad710 con 0x7f2e0410ee10 2024-04-26T07:53:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.972+0000 7f2debfff640 1 -- 172.21.15.62:0/69493065 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df8007070 con 0x7f2e0410ee10 2024-04-26T07:53:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.972+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e041a6f90 con 0x7f2e0410ee10 2024-04-26T07:53:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.972+0000 7f2debfff640 1 -- 172.21.15.62:0/69493065 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2df801a070 con 0x7f2e0410ee10 2024-04-26T07:53:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.972+0000 7f2debfff640 1 -- 172.21.15.62:0/69493065 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2df8012400 con 0x7f2e0410ee10 2024-04-26T07:53:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.973+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e04073760 con 0x7f2e0410ee10 2024-04-26T07:53:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:56.975+0000 7f2debfff640 1 -- 172.21.15.62:0/69493065 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2df801c440 con 0x7f2e0410ee10 2024-04-26T07:53:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.049+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26a6bcce-05b9-47ad-a6e3-1e096604187a", "id": 0} v 0) -- 0x7f2e0406b6f0 con 0x7f2e0410ee10 2024-04-26T07:53:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.050+0000 7f2debfff640 1 -- 172.21.15.62:0/69493065 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26a6bcce-05b9-47ad-a6e3-1e096604187a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2df8007210 con 0x7f2e0410ee10 2024-04-26T07:53:57.049 INFO:teuthology.orchestra.run.smithi062.stdout:0 2024-04-26T07:53:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.051+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410ee10 msgr2=0x7f2e041aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.051+0000 7f2e099f7640 1 --2- 172.21.15.62:0/69493065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410ee10 0x7f2e041aceb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c4a0 tx=0x7f2df800c960 comp rx=0 tx=0).stop 2024-04-26T07:53:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.051+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 shutdown_connections 2024-04-26T07:53:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.051+0000 7f2e099f7640 1 --2- 172.21.15.62:0/69493065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e0410ee10 0x7f2e041aceb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.051+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 >> 172.21.15.62:0/69493065 conn(0x7f2e0406fc20 msgr2=0x7f2e04070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.051+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 shutdown_connections 2024-04-26T07:53:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.051+0000 7f2e099f7640 1 -- 172.21.15.62:0/69493065 wait complete. 2024-04-26T07:53:57.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 61f3627b-bf5b-44b1-8c7a-49c6f237241e 1 2024-04-26T07:53:57.175 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:57.177+0000 7f136ba3f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T07:53:57.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.202+0000 7fb51b563640 1 Processor -- start 2024-04-26T07:53:57.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.202+0000 7fb51b563640 1 -- start start 2024-04-26T07:53:57.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.202+0000 7fb51b563640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5141184b0 0x7fb514118890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:57.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.202+0000 7fb51b563640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb514118f50 con 0x7fb514112370 2024-04-26T07:53:57.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.202+0000 7fb51b563640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb514112f30 con 0x7fb5141184b0 2024-04-26T07:53:57.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.203+0000 7fb5192ff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5141184b0 0x7fb514118890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.203+0000 7fb5192ff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5141184b0 0x7fb514118890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:36816/0 (socket says 172.21.15.62:36816) 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.203+0000 7fb518afe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb514112370 0x7fb514112820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:51544/0 (socket says 172.21.15.62:51544) 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.203+0000 7fb5192ff640 1 -- 172.21.15.62:0/1254918696 learned_addr learned my addr 172.21.15.62:0/1254918696 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.203+0000 7fb5192ff640 1 -- 172.21.15.62:0/1254918696 >> v1:172.21.15.1:6789/0 conn(0x7fb514112370 legacy=0x7fb514112820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.203+0000 7fb5192ff640 1 -- 172.21.15.62:0/1254918696 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5141130e0 con 0x7fb5141184b0 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.204+0000 7fb5192ff640 1 --2- 172.21.15.62:0/1254918696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5141184b0 0x7fb514118890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb5040097f0 tx=0x7fb50402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a28324b815d8595 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.204+0000 7fb50bfff640 1 -- 172.21.15.62:0/1254918696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb504035020 con 0x7fb5141184b0 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.204+0000 7fb50bfff640 1 -- 172.21.15.62:0/1254918696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5040317a0 con 0x7fb5141184b0 2024-04-26T07:53:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.204+0000 7fb50bfff640 1 -- 172.21.15.62:0/1254918696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb504031aa0 con 0x7fb5141184b0 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 -- 172.21.15.62:0/1254918696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5141184b0 msgr2=0x7fb514118890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 --2- 172.21.15.62:0/1254918696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5141184b0 0x7fb514118890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb5040097f0 tx=0x7fb50402b910 comp rx=0 tx=0).stop 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 -- 172.21.15.62:0/1254918696 shutdown_connections 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 --2- 172.21.15.62:0/1254918696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5141184b0 0x7fb514118890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 -- 172.21.15.62:0/1254918696 >> 172.21.15.62:0/1254918696 conn(0x7fb51406e940 msgr2=0x7fb51406ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 -- 172.21.15.62:0/1254918696 shutdown_connections 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 -- 172.21.15.62:0/1254918696 wait complete. 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 Processor -- start 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.205+0000 7fb51b563640 1 -- start start 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.206+0000 7fb51b563640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb514112370 0x7fb5141aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.206+0000 7fb51b563640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb51411e6f0 con 0x7fb514112370 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.206+0000 7fb5192ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb514112370 0x7fb5141aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.206+0000 7fb5192ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb514112370 0x7fb5141aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:36824/0 (socket says 172.21.15.62:36824) 2024-04-26T07:53:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.206+0000 7fb5192ff640 1 -- 172.21.15.62:0/2284058754 learned_addr learned my addr 172.21.15.62:0/2284058754 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:53:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.206+0000 7fb5192ff640 1 -- 172.21.15.62:0/2284058754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5141ad480 con 0x7fb514112370 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.207+0000 7fb5192ff640 1 --2- 172.21.15.62:0/2284058754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb514112370 0x7fb5141aceb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5040097f0 tx=0x7fb5040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.207+0000 7fb509ffb640 1 -- 172.21.15.62:0/2284058754 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb50403ad00 con 0x7fb514112370 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.207+0000 7fb509ffb640 1 -- 172.21.15.62:0/2284058754 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5040443f0 con 0x7fb514112370 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.207+0000 7fb509ffb640 1 -- 172.21.15.62:0/2284058754 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5040446d0 con 0x7fb514112370 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.207+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5141ad6b0 con 0x7fb514112370 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.207+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5141a6d30 con 0x7fb514112370 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.207+0000 7fb509ffb640 1 -- 172.21.15.62:0/2284058754 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb50404b060 con 0x7fb514112370 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.207+0000 7fb509ffb640 1 -- 172.21.15.62:0/2284058754 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb50404dcf0 con 0x7fb514112370 2024-04-26T07:53:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.208+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb514111da0 con 0x7fb514112370 2024-04-26T07:53:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.211+0000 7fb509ffb640 1 -- 172.21.15.62:0/2284058754 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb50403f070 con 0x7fb514112370 2024-04-26T07:53:57.225 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:57.226+0000 7f136ba3f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T07:53:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.286+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd new", "uuid": "61f3627b-bf5b-44b1-8c7a-49c6f237241e", "id": 1} v 0) -- 0x7fb51406b6f0 con 0x7fb514112370 2024-04-26T07:53:57.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.287+0000 7fb509ffb640 1 -- 172.21.15.62:0/2284058754 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61f3627b-bf5b-44b1-8c7a-49c6f237241e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb50404d450 con 0x7fb514112370 2024-04-26T07:53:57.286 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-04-26T07:53:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.289+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb514112370 msgr2=0x7fb5141aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.289+0000 7fb51b563640 1 --2- 172.21.15.62:0/2284058754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb514112370 0x7fb5141aceb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5040097f0 tx=0x7fb5040046c0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.289+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 shutdown_connections 2024-04-26T07:53:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.289+0000 7fb51b563640 1 --2- 172.21.15.62:0/2284058754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb514112370 0x7fb5141aceb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.289+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 >> 172.21.15.62:0/2284058754 conn(0x7fb51406e940 msgr2=0x7fb514113fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.289+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 shutdown_connections 2024-04-26T07:53:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.289+0000 7fb51b563640 1 -- 172.21.15.62:0/2284058754 wait complete. 2024-04-26T07:53:57.301 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 80545748-33d8-421e-9138-61368e68ba31 2 2024-04-26T07:53:57.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.402+0000 7f1801437640 1 Processor -- start 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.402+0000 7f1801437640 1 -- start start 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.402+0000 7f1801437640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17fc1184b0 0x7f17fc118890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.402+0000 7f1801437640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc118f50 con 0x7f17fc112370 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.402+0000 7f1801437640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f17fc112f30 con 0x7f17fc1184b0 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.403+0000 7f17faffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17fc1184b0 0x7f17fc118890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.403+0000 7f17fa7fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f17fc112370 0x7f17fc112820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:51556/0 (socket says 172.21.15.62:51556) 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.403+0000 7f17fa7fc640 1 -- 172.21.15.62:0/1771928384 learned_addr learned my addr 172.21.15.62:0/1771928384 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.403+0000 7f17faffd640 1 -- 172.21.15.62:0/1771928384 >> v1:172.21.15.1:6789/0 conn(0x7f17fc112370 legacy=0x7f17fc112820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.403+0000 7f17f9ffb640 1 -- 172.21.15.62:0/1771928384 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130550504 0 0) 0x7f17fc118f50 con 0x7f17fc112370 2024-04-26T07:53:57.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.403+0000 7f17faffd640 1 -- 172.21.15.62:0/1771928384 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc1130e0 con 0x7f17fc1184b0 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.404+0000 7f17faffd640 1 --2- 172.21.15.62:0/1771928384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc1184b0 0x7f17fc118890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009720 tx=0x7f17f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5929137fcadb850e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.404+0000 7f17f9ffb640 1 -- 172.21.15.62:0/1771928384 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f00316d0 con 0x7f17fc1184b0 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.404+0000 7f17f9ffb640 1 -- 172.21.15.62:0/1771928384 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f0037070 con 0x7f17fc1184b0 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.404+0000 7f17f9ffb640 1 -- 172.21.15.62:0/1771928384 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f00319c0 con 0x7f17fc1184b0 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.404+0000 7f1801437640 1 -- 172.21.15.62:0/1771928384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc1184b0 msgr2=0x7f17fc118890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.404+0000 7f1801437640 1 --2- 172.21.15.62:0/1771928384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc1184b0 0x7f17fc118890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009720 tx=0x7f17f002b840 comp rx=0 tx=0).stop 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.405+0000 7f1801437640 1 -- 172.21.15.62:0/1771928384 shutdown_connections 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.405+0000 7f1801437640 1 --2- 172.21.15.62:0/1771928384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc1184b0 0x7f17fc118890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.405+0000 7f1801437640 1 -- 172.21.15.62:0/1771928384 >> 172.21.15.62:0/1771928384 conn(0x7f17fc06e940 msgr2=0x7f17fc06ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.405+0000 7f1801437640 1 -- 172.21.15.62:0/1771928384 shutdown_connections 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.405+0000 7f1801437640 1 -- 172.21.15.62:0/1771928384 wait complete. 2024-04-26T07:53:57.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.405+0000 7f1801437640 1 Processor -- start 2024-04-26T07:53:57.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.405+0000 7f1801437640 1 -- start start 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.406+0000 7f1801437640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc112370 0x7f17fc1acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.406+0000 7f1801437640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc11e6f0 con 0x7f17fc112370 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.406+0000 7f17faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc112370 0x7f17fc1acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.406+0000 7f17faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc112370 0x7f17fc1acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:36846/0 (socket says 172.21.15.62:36846) 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.406+0000 7f17faffd640 1 -- 172.21.15.62:0/450128262 learned_addr learned my addr 172.21.15.62:0/450128262 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.406+0000 7f17faffd640 1 -- 172.21.15.62:0/450128262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc1ad340 con 0x7f17fc112370 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.406+0000 7f17faffd640 1 --2- 172.21.15.62:0/450128262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc112370 0x7f17fc1acd70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009840 tx=0x7f17f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.407+0000 7f17e37fe640 1 -- 172.21.15.62:0/450128262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0032770 con 0x7f17fc112370 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.407+0000 7f17e37fe640 1 -- 172.21.15.62:0/450128262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f0032910 con 0x7f17fc112370 2024-04-26T07:53:57.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.407+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc1ad570 con 0x7f17fc112370 2024-04-26T07:53:57.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.407+0000 7f17e37fe640 1 -- 172.21.15.62:0/450128262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0032c30 con 0x7f17fc112370 2024-04-26T07:53:57.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.407+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc1a6bf0 con 0x7f17fc112370 2024-04-26T07:53:57.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.407+0000 7f17e37fe640 1 -- 172.21.15.62:0/450128262 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f17f004c060 con 0x7f17fc112370 2024-04-26T07:53:57.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.407+0000 7f17e37fe640 1 -- 172.21.15.62:0/450128262 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f17f002f050 con 0x7f17fc112370 2024-04-26T07:53:57.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.408+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17fc111da0 con 0x7f17fc112370 2024-04-26T07:53:57.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.410+0000 7f17e37fe640 1 -- 172.21.15.62:0/450128262 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f17f0040070 con 0x7f17fc112370 2024-04-26T07:53:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.483+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd new", "uuid": "80545748-33d8-421e-9138-61368e68ba31", "id": 2} v 0) -- 0x7f17fc06b6f0 con 0x7f17fc112370 2024-04-26T07:53:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.485+0000 7f17e37fe640 1 -- 172.21.15.62:0/450128262 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "80545748-33d8-421e-9138-61368e68ba31", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f17f0032dd0 con 0x7f17fc112370 2024-04-26T07:53:57.483 INFO:teuthology.orchestra.run.smithi062.stdout:2 2024-04-26T07:53:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.485+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc112370 msgr2=0x7f17fc1acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.485+0000 7f1801437640 1 --2- 172.21.15.62:0/450128262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc112370 0x7f17fc1acd70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009840 tx=0x7f17f00046c0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.485+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 shutdown_connections 2024-04-26T07:53:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.485+0000 7f1801437640 1 --2- 172.21.15.62:0/450128262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17fc112370 0x7f17fc1acd70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.485+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 >> 172.21.15.62:0/450128262 conn(0x7f17fc06e940 msgr2=0x7f17fc114330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.486+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 shutdown_connections 2024-04-26T07:53:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.486+0000 7f1801437640 1 -- 172.21.15.62:0/450128262 wait complete. 2024-04-26T07:53:57.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 29666b44-480b-4bce-9098-149f556d175e 3 2024-04-26T07:53:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.595+0000 7f0faf318640 1 Processor -- start 2024-04-26T07:53:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.596+0000 7f0faf318640 1 -- start start 2024-04-26T07:53:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.596+0000 7f0faf318640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0fa81184b0 0x7f0fa8118890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.596+0000 7f0faf318640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa8118f50 con 0x7f0fa8112370 2024-04-26T07:53:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.596+0000 7f0faf318640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa8112f30 con 0x7f0fa81184b0 2024-04-26T07:53:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.596+0000 7f0fad0b4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0fa81184b0 0x7f0fa8118890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.596+0000 7f0fac8b3640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0fa8112370 0x7f0fa8112820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:51560/0 (socket says 172.21.15.62:51560) 2024-04-26T07:53:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.596+0000 7f0fac8b3640 1 -- 172.21.15.62:0/811521387 learned_addr learned my addr 172.21.15.62:0/811521387 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:53:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.597+0000 7f0fad0b4640 1 -- 172.21.15.62:0/811521387 >> v1:172.21.15.1:6789/0 conn(0x7f0fa8112370 legacy=0x7f0fa8112820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.597+0000 7f0f9ffff640 1 -- 172.21.15.62:0/811521387 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581142921 0 0) 0x7f0fa8118f50 con 0x7f0fa8112370 2024-04-26T07:53:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.597+0000 7f0fad0b4640 1 -- 172.21.15.62:0/811521387 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa81130e0 con 0x7f0fa81184b0 2024-04-26T07:53:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.597+0000 7f0fad0b4640 1 --2- 172.21.15.62:0/811521387 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa81184b0 0x7f0fa8118890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009720 tx=0x7f0fa402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bd321e9959840c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0f9ffff640 1 -- 172.21.15.62:0/811521387 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa40316d0 con 0x7f0fa81184b0 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0f9ffff640 1 -- 172.21.15.62:0/811521387 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa4037070 con 0x7f0fa81184b0 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0f9ffff640 1 -- 172.21.15.62:0/811521387 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa40319c0 con 0x7f0fa81184b0 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0faf318640 1 -- 172.21.15.62:0/811521387 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa81184b0 msgr2=0x7f0fa8118890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0faf318640 1 --2- 172.21.15.62:0/811521387 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa81184b0 0x7f0fa8118890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009720 tx=0x7f0fa402b840 comp rx=0 tx=0).stop 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0faf318640 1 -- 172.21.15.62:0/811521387 shutdown_connections 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0faf318640 1 --2- 172.21.15.62:0/811521387 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa81184b0 0x7f0fa8118890 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0faf318640 1 -- 172.21.15.62:0/811521387 >> 172.21.15.62:0/811521387 conn(0x7f0fa806e940 msgr2=0x7f0fa806ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0faf318640 1 -- 172.21.15.62:0/811521387 shutdown_connections 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.598+0000 7f0faf318640 1 -- 172.21.15.62:0/811521387 wait complete. 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.599+0000 7f0faf318640 1 Processor -- start 2024-04-26T07:53:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.599+0000 7f0faf318640 1 -- start start 2024-04-26T07:53:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.599+0000 7f0faf318640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa8112370 0x7f0fa81acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.599+0000 7f0faf318640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa811e6f0 con 0x7f0fa8112370 2024-04-26T07:53:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0fad0b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa8112370 0x7f0fa81acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0fad0b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa8112370 0x7f0fa81acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:36860/0 (socket says 172.21.15.62:36860) 2024-04-26T07:53:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0fad0b4640 1 -- 172.21.15.62:0/3299054633 learned_addr learned my addr 172.21.15.62:0/3299054633 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:53:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0fad0b4640 1 -- 172.21.15.62:0/3299054633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa81ad340 con 0x7f0fa8112370 2024-04-26T07:53:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0fad0b4640 1 --2- 172.21.15.62:0/3299054633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa8112370 0x7f0fa81acd70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009840 tx=0x7f0fa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0f9dffb640 1 -- 172.21.15.62:0/3299054633 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa4032770 con 0x7f0fa8112370 2024-04-26T07:53:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0f9dffb640 1 -- 172.21.15.62:0/3299054633 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa4032910 con 0x7f0fa8112370 2024-04-26T07:53:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0f9dffb640 1 -- 172.21.15.62:0/3299054633 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa4032c30 con 0x7f0fa8112370 2024-04-26T07:53:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa81ad570 con 0x7f0fa8112370 2024-04-26T07:53:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.600+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa81a6bf0 con 0x7f0fa8112370 2024-04-26T07:53:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.601+0000 7f0f9dffb640 1 -- 172.21.15.62:0/3299054633 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0fa404c060 con 0x7f0fa8112370 2024-04-26T07:53:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.601+0000 7f0f9dffb640 1 -- 172.21.15.62:0/3299054633 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0fa402f050 con 0x7f0fa8112370 2024-04-26T07:53:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.601+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa8111da0 con 0x7f0fa8112370 2024-04-26T07:53:57.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.604+0000 7f0f9dffb640 1 -- 172.21.15.62:0/3299054633 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0fa4040070 con 0x7f0fa8112370 2024-04-26T07:53:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.678+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd new", "uuid": "29666b44-480b-4bce-9098-149f556d175e", "id": 3} v 0) -- 0x7f0fa806b6f0 con 0x7f0fa8112370 2024-04-26T07:53:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.679+0000 7f0f9dffb640 1 -- 172.21.15.62:0/3299054633 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29666b44-480b-4bce-9098-149f556d175e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0fa4032dd0 con 0x7f0fa8112370 2024-04-26T07:53:57.677 INFO:teuthology.orchestra.run.smithi062.stdout:3 2024-04-26T07:53:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.680+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa8112370 msgr2=0x7f0fa81acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.680+0000 7f0faf318640 1 --2- 172.21.15.62:0/3299054633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa8112370 0x7f0fa81acd70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009840 tx=0x7f0fa40046c0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.680+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 shutdown_connections 2024-04-26T07:53:57.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.680+0000 7f0faf318640 1 --2- 172.21.15.62:0/3299054633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fa8112370 0x7f0fa81acd70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.680+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 >> 172.21.15.62:0/3299054633 conn(0x7f0fa806e940 msgr2=0x7f0fa8114330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.680+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 shutdown_connections 2024-04-26T07:53:57.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:53:57.680+0000 7f0faf318640 1 -- 172.21.15.62:0/3299054633 wait complete. 2024-04-26T07:53:57.689 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T07:53:57.689 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T07:53:57.692 INFO:tasks.ceph.osd.0:Started 2024-04-26T07:53:57.693 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T07:53:57.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T07:53:57.696 INFO:tasks.ceph.osd.1:Started 2024-04-26T07:53:57.696 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T07:53:57.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T07:53:57.700 INFO:tasks.ceph.osd.2:Started 2024-04-26T07:53:57.700 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T07:53:57.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T07:53:57.702 INFO:tasks.ceph.osd.3:Started 2024-04-26T07:53:57.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:53:57.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.816+0000 7f35eaadb640 1 Processor -- start 2024-04-26T07:53:57.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.816+0000 7f35eaadb640 1 -- start start 2024-04-26T07:53:57.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.816+0000 7f35eaadb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35e4128920 0x7f35e4128d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:57.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.816+0000 7f35eaadb640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e406da60 con 0x7f35e4095d70 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.816+0000 7f35eaadb640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f35e4073070 con 0x7f35e4128920 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.816+0000 7f35e8877640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35e4128920 0x7f35e4128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.816+0000 7f35dbfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f35e4095d70 0x7f35e4096190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52136/0 (socket says 172.21.15.1:52136) 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.816+0000 7f35dbfff640 1 -- 172.21.15.1:0/3680299965 learned_addr learned my addr 172.21.15.1:0/3680299965 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.817+0000 7f35e8877640 1 -- 172.21.15.1:0/3680299965 >> v1:172.21.15.1:6789/0 conn(0x7f35e4095d70 legacy=0x7f35e4096190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.817+0000 7f35e8877640 1 -- 172.21.15.1:0/3680299965 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e4129240 con 0x7f35e4128920 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.817+0000 7f35e8877640 1 --2- 172.21.15.1:0/3680299965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4128920 0x7f35e4128d00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009720 tx=0x7f35e002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d839a3a4030c88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35db7fe640 1 -- 172.21.15.1:0/3680299965 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e00316d0 con 0x7f35e4128920 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35db7fe640 1 -- 172.21.15.1:0/3680299965 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e0037070 con 0x7f35e4128920 2024-04-26T07:53:57.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35db7fe640 1 -- 172.21.15.1:0/3680299965 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e00319c0 con 0x7f35e4128920 2024-04-26T07:53:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35eaadb640 1 -- 172.21.15.1:0/3680299965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4128920 msgr2=0x7f35e4128d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35eaadb640 1 --2- 172.21.15.1:0/3680299965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4128920 0x7f35e4128d00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009720 tx=0x7f35e002b840 comp rx=0 tx=0).stop 2024-04-26T07:53:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35eaadb640 1 -- 172.21.15.1:0/3680299965 shutdown_connections 2024-04-26T07:53:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35eaadb640 1 --2- 172.21.15.1:0/3680299965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4128920 0x7f35e4128d00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35eaadb640 1 -- 172.21.15.1:0/3680299965 >> 172.21.15.1:0/3680299965 conn(0x7f35e409add0 msgr2=0x7f35e409b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35eaadb640 1 -- 172.21.15.1:0/3680299965 shutdown_connections 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.818+0000 7f35eaadb640 1 -- 172.21.15.1:0/3680299965 wait complete. 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.819+0000 7f35eaadb640 1 Processor -- start 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.819+0000 7f35eaadb640 1 -- start start 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.820+0000 7f35eaadb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4095d70 0x7f35e408e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.820+0000 7f35eaadb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f35e406d0f0 con 0x7f35e4095d70 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.820+0000 7f35e8877640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4095d70 0x7f35e408e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.820+0000 7f35e8877640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4095d70 0x7f35e408e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38808/0 (socket says 172.21.15.1:38808) 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.820+0000 7f35e8877640 1 -- 172.21.15.1:0/1682235477 learned_addr learned my addr 172.21.15.1:0/1682235477 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.820+0000 7f35e8877640 1 -- 172.21.15.1:0/1682235477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e4091530 con 0x7f35e4095d70 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.820+0000 7f35e8877640 1 --2- 172.21.15.1:0/1682235477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4095d70 0x7f35e408e380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35e0000c00 tx=0x7f35e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.820+0000 7f35d97fa640 1 -- 172.21.15.1:0/1682235477 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e0032770 con 0x7f35e4095d70 2024-04-26T07:53:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.821+0000 7f35d97fa640 1 -- 172.21.15.1:0/1682235477 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e0032910 con 0x7f35e4095d70 2024-04-26T07:53:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.821+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e4090570 con 0x7f35e4095d70 2024-04-26T07:53:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.821+0000 7f35d97fa640 1 -- 172.21.15.1:0/1682235477 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e0032c30 con 0x7f35e4095d70 2024-04-26T07:53:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.821+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e4090fa0 con 0x7f35e4095d70 2024-04-26T07:53:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.821+0000 7f35d97fa640 1 -- 172.21.15.1:0/1682235477 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f35e004c060 con 0x7f35e4095d70 2024-04-26T07:53:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.821+0000 7f35d97fa640 1 -- 172.21.15.1:0/1682235477 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f35e002f050 con 0x7f35e4095d70 2024-04-26T07:53:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.821+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e40636f0 con 0x7f35e4095d70 2024-04-26T07:53:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.823+0000 7f35d97fa640 1 -- 172.21.15.1:0/1682235477 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f35e0040070 con 0x7f35e4095d70 2024-04-26T07:53:57.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.885+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35e406b6f0 con 0x7f35e4095d70 2024-04-26T07:53:57.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.886+0000 7f35d97fa640 1 -- 172.21.15.1:0/1682235477 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f35e0032dd0 con 0x7f35e4095d70 2024-04-26T07:53:57.885 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:53:57.885 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"fsid":"ed2f0749-350f-459a-96bf-130a296577eb","created":"2024-04-26T07:53:56.542247+0000","modified":"2024-04-26T07:53:57.679587+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T07:53:57.679587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26a6bcce-05b9-47ad-a6e3-1e096604187a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"61f3627b-bf5b-44b1-8c7a-49c6f237241e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"80545748-33d8-421e-9138-61368e68ba31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"29666b44-480b-4bce-9098-149f556d175e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:53:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.887+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4095d70 msgr2=0x7f35e408e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.887+0000 7f35eaadb640 1 --2- 172.21.15.1:0/1682235477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4095d70 0x7f35e408e380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35e0000c00 tx=0x7f35e00046c0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.887+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 shutdown_connections 2024-04-26T07:53:57.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.887+0000 7f35eaadb640 1 --2- 172.21.15.1:0/1682235477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35e4095d70 0x7f35e408e380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:57.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.887+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 >> 172.21.15.1:0/1682235477 conn(0x7f35e409add0 msgr2=0x7f35e4121f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:57.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.887+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 shutdown_connections 2024-04-26T07:53:57.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:53:57.887+0000 7f35eaadb640 1 -- 172.21.15.1:0/1682235477 wait complete. 2024-04-26T07:53:57.896 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T07:53:57.899 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T07:53:57.984 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:57.985+0000 7f136ba3f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T07:53:58.074 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:58.076+0000 7f136ba3f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T07:53:58.119 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:58.120+0000 7f136ba3f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T07:53:58.289 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-04-26T07:53:58.290+0000 7fc1f7144640 -1 Falling back to public interface 2024-04-26T07:53:58.291 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:58.292+0000 7f136ba3f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T07:53:58.293 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-04-26T07:53:58.294+0000 7f6a077b8640 -1 Falling back to public interface 2024-04-26T07:53:58.298 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-04-26T07:53:58.299+0000 7f7be4f31640 -1 Falling back to public interface 2024-04-26T07:53:58.301 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T07:53:58.307 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-04-26T07:53:58.308+0000 7f0eb81d8640 -1 Falling back to public interface 2024-04-26T07:53:58.353 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:58.354+0000 7f136ba3f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T07:53:58.396 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.397+0000 7fca89e31640 1 Processor -- start 2024-04-26T07:53:58.396 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.397+0000 7fca89e31640 1 -- start start 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.397+0000 7fca89e31640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fca8412c3a0 0x7fca84130de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.397+0000 7fca89e31640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca84093d10 con 0x7fca8412b8b0 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.397+0000 7fca89e31640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fca84095dd0 con 0x7fca8412c3a0 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.397+0000 7fca837fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fca8412b8b0 0x7fca8412bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52142/0 (socket says 172.21.15.1:52142) 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.397+0000 7fca837fe640 1 -- 172.21.15.1:0/1413076813 learned_addr learned my addr 172.21.15.1:0/1413076813 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.398+0000 7fca82ffd640 1 --2- 172.21.15.1:0/1413076813 >> v2:172.21.15.1:3300/0 conn(0x7fca8412c3a0 0x7fca84130de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.398+0000 7fca827fc640 1 -- 172.21.15.1:0/1413076813 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097311857 0 0) 0x7fca84093d10 con 0x7fca8412b8b0 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.398+0000 7fca827fc640 1 -- 172.21.15.1:0/1413076813 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca6c003520 con 0x7fca8412b8b0 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.398+0000 7fca82ffd640 1 -- 172.21.15.1:0/1413076813 >> v1:172.21.15.1:6789/0 conn(0x7fca8412b8b0 legacy=0x7fca8412bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:58.397 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.398+0000 7fca82ffd640 1 -- 172.21.15.1:0/1413076813 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca840921b0 con 0x7fca8412c3a0 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca82ffd640 1 --2- 172.21.15.1:0/1413076813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412c3a0 0x7fca84130de0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca78009720 tx=0x7fca7802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8d5f7dd6bd7337 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca827fc640 1 -- 172.21.15.1:0/1413076813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca780316d0 con 0x7fca8412c3a0 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca827fc640 1 -- 172.21.15.1:0/1413076813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca78037070 con 0x7fca8412c3a0 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca827fc640 1 -- 172.21.15.1:0/1413076813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca780319c0 con 0x7fca8412c3a0 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca89e31640 1 -- 172.21.15.1:0/1413076813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412c3a0 msgr2=0x7fca84130de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca89e31640 1 --2- 172.21.15.1:0/1413076813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412c3a0 0x7fca84130de0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca78009720 tx=0x7fca7802b840 comp rx=0 tx=0).stop 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca89e31640 1 -- 172.21.15.1:0/1413076813 shutdown_connections 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca89e31640 1 --2- 172.21.15.1:0/1413076813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412c3a0 0x7fca84130de0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:58.400 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca89e31640 1 -- 172.21.15.1:0/1413076813 >> 172.21.15.1:0/1413076813 conn(0x7fca8409bec0 msgr2=0x7fca8409c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca89e31640 1 -- 172.21.15.1:0/1413076813 shutdown_connections 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.399+0000 7fca89e31640 1 -- 172.21.15.1:0/1413076813 wait complete. 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.400+0000 7fca89e31640 1 Processor -- start 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.400+0000 7fca89e31640 1 -- start start 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca89e31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412b8b0 0x7fca841c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca89e31640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fca84131320 con 0x7fca8412b8b0 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca837fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412b8b0 0x7fca841c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca837fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412b8b0 0x7fca841c15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38828/0 (socket says 172.21.15.1:38828) 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca837fe640 1 -- 172.21.15.1:0/2232446240 learned_addr learned my addr 172.21.15.1:0/2232446240 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca837fe640 1 -- 172.21.15.1:0/2232446240 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca84124ff0 con 0x7fca8412b8b0 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca837fe640 1 --2- 172.21.15.1:0/2232446240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412b8b0 0x7fca841c15c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c480 tx=0x7fca7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:53:58.401 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca6bfff640 1 -- 172.21.15.1:0/2232446240 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74017070 con 0x7fca8412b8b0 2024-04-26T07:53:58.402 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca6bfff640 1 -- 172.21.15.1:0/2232446240 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca74005c10 con 0x7fca8412b8b0 2024-04-26T07:53:58.402 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca6bfff640 1 -- 172.21.15.1:0/2232446240 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74007070 con 0x7fca8412b8b0 2024-04-26T07:53:58.402 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca84124b70 con 0x7fca8412b8b0 2024-04-26T07:53:58.402 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.401+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca841c1b00 con 0x7fca8412b8b0 2024-04-26T07:53:58.402 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.402+0000 7fca6bfff640 1 -- 172.21.15.1:0/2232446240 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca7401a070 con 0x7fca8412b8b0 2024-04-26T07:53:58.402 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.402+0000 7fca6bfff640 1 -- 172.21.15.1:0/2232446240 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fca74012910 con 0x7fca8412b8b0 2024-04-26T07:53:58.403 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.402+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca840636f0 con 0x7fca8412b8b0 2024-04-26T07:53:58.403 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.404+0000 7fca6bfff640 1 -- 172.21.15.1:0/2232446240 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fca74021020 con 0x7fca8412b8b0 2024-04-26T07:53:58.408 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:58.409+0000 7f136ba3f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T07:53:58.465 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.466+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca840683a0 con 0x7fca8412b8b0 2024-04-26T07:53:58.465 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.466+0000 7fca6bfff640 1 -- 172.21.15.1:0/2232446240 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fca74012cc0 con 0x7fca8412b8b0 2024-04-26T07:53:58.465 INFO:teuthology.misc.health.smithi001.stdout: 2024-04-26T07:53:58.466 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":6,"fsid":"ed2f0749-350f-459a-96bf-130a296577eb","created":"2024-04-26T07:53:56.542247+0000","modified":"2024-04-26T07:53:57.679587+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T07:53:57.679587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26a6bcce-05b9-47ad-a6e3-1e096604187a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"61f3627b-bf5b-44b1-8c7a-49c6f237241e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"80545748-33d8-421e-9138-61368e68ba31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"29666b44-480b-4bce-9098-149f556d175e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:53:58.467 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.467+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412b8b0 msgr2=0x7fca841c15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:53:58.467 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.467+0000 7fca89e31640 1 --2- 172.21.15.1:0/2232446240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412b8b0 0x7fca841c15c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c480 tx=0x7fca7400c940 comp rx=0 tx=0).stop 2024-04-26T07:53:58.467 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.467+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 shutdown_connections 2024-04-26T07:53:58.467 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.467+0000 7fca89e31640 1 --2- 172.21.15.1:0/2232446240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca8412b8b0 0x7fca841c15c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:53:58.468 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.467+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 >> 172.21.15.1:0/2232446240 conn(0x7fca8409bec0 msgr2=0x7fca841296b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:53:58.468 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.467+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 shutdown_connections 2024-04-26T07:53:58.468 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:53:58.467+0000 7fca89e31640 1 -- 172.21.15.1:0/2232446240 wait complete. 2024-04-26T07:53:58.475 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-26T07:53:58.525 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:58.526+0000 7f136ba3f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T07:53:58.922 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:58.923+0000 7f136ba3f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T07:53:59.191 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:59.193+0000 7f136ba3f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T07:53:59.246 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:59.247+0000 7f136ba3f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T07:53:59.367 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:59.369+0000 7f136ba3f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T07:53:59.655 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:59.657+0000 7f136ba3f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T07:53:59.705 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:59.706+0000 7f136ba3f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T07:53:59.868 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:53:59.869+0000 7f136ba3f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T07:54:00.011 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:54:00.013+0000 7f136ba3f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T07:54:00.063 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:54:00.065+0000 7f136ba3f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T07:54:00.136 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:54:00.138+0000 7f136ba3f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T07:54:00.184 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:54:00.185+0000 7f136ba3f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T07:54:00.679 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:54:00.680+0000 7f136ba3f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T07:54:00.802 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:54:00.804+0000 7f136ba3f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T07:54:01.734 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-04-26T07:54:01.736+0000 7fc1f7144640 -1 osd.0 0 log_to_monitors true 2024-04-26T07:54:01.766 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-04-26T07:54:01.768+0000 7f7be4f31640 -1 osd.2 0 log_to_monitors true 2024-04-26T07:54:01.808 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-04-26T07:54:01.809+0000 7f6a077b8640 -1 osd.1 0 log_to_monitors true 2024-04-26T07:54:01.813 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-26T07:54:01.813+0000 7f130c654640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-26T07:54:01.843 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-04-26T07:54:01.845+0000 7f0eb81d8640 -1 osd.3 0 log_to_monitors true 2024-04-26T07:54:03.663 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-04-26T07:54:03.664+0000 7fc1f30da640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T07:54:03.677 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-04-26T07:54:03.679+0000 7fc1eaefa640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:54:04.565 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-04-26T07:54:04.566+0000 7f6a0374e640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T07:54:04.574 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-04-26T07:54:04.576+0000 7f69fb56e640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:54:04.600 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-04-26T07:54:04.601+0000 7f0eb416e640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T07:54:04.610 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-04-26T07:54:04.612+0000 7f0eabf8e640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:54:04.627 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-04-26T07:54:04.629+0000 7f7be0ec7640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T07:54:04.640 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-04-26T07:54:04.642+0000 7f7bd8ce7640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:54:04.879 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T07:54:04.983 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.984+0000 7fa9f910e640 1 Processor -- start 2024-04-26T07:54:04.983 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.984+0000 7fa9f910e640 1 -- start start 2024-04-26T07:54:04.984 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.985+0000 7fa9f910e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa9f4097790 0x7fa9f4097b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:04.984 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.985+0000 7fa9f910e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f409b1a0 con 0x7fa9f40980b0 2024-04-26T07:54:04.984 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.985+0000 7fa9f910e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f409b7c0 con 0x7fa9f4097790 2024-04-26T07:54:04.984 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.985+0000 7fa9f2d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa9f4097790 0x7fa9f4097b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:04.984 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.985+0000 7fa9ebfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa9f40980b0 0x7fa9f4099120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53696/0 (socket says 172.21.15.1:53696) 2024-04-26T07:54:04.984 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.985+0000 7fa9ebfff640 1 -- 172.21.15.1:0/2279460943 learned_addr learned my addr 172.21.15.1:0/2279460943 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:04.984 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.985+0000 7fa9f2d9d640 1 -- 172.21.15.1:0/2279460943 >> v1:172.21.15.1:6789/0 conn(0x7fa9f40980b0 legacy=0x7fa9f4099120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:04.984 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.985+0000 7fa9f2d9d640 1 -- 172.21.15.1:0/2279460943 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f409b4b0 con 0x7fa9f4097790 2024-04-26T07:54:04.985 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.986+0000 7fa9f2d9d640 1 --2- 172.21.15.1:0/2279460943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f4097b70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009720 tx=0x7fa9e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a040d54b7fe5fbe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:04.985 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.986+0000 7fa9f259c640 1 -- 172.21.15.1:0/2279460943 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e4035020 con 0x7fa9f4097790 2024-04-26T07:54:04.985 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.986+0000 7fa9f259c640 1 -- 172.21.15.1:0/2279460943 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e4031760 con 0x7fa9f4097790 2024-04-26T07:54:04.985 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.986+0000 7fa9f259c640 1 -- 172.21.15.1:0/2279460943 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e4031a60 con 0x7fa9f4097790 2024-04-26T07:54:04.986 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.987+0000 7fa9f910e640 1 -- 172.21.15.1:0/2279460943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 msgr2=0x7fa9f4097b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:04.986 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.987+0000 7fa9f910e640 1 --2- 172.21.15.1:0/2279460943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f4097b70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009720 tx=0x7fa9e402b8d0 comp rx=0 tx=0).stop 2024-04-26T07:54:04.986 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.987+0000 7fa9f910e640 1 -- 172.21.15.1:0/2279460943 shutdown_connections 2024-04-26T07:54:04.986 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.987+0000 7fa9f910e640 1 --2- 172.21.15.1:0/2279460943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f4097b70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:04.986 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.987+0000 7fa9f910e640 1 -- 172.21.15.1:0/2279460943 >> 172.21.15.1:0/2279460943 conn(0x7fa9f409f8c0 msgr2=0x7fa9f409fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:04.986 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.987+0000 7fa9f910e640 1 -- 172.21.15.1:0/2279460943 shutdown_connections 2024-04-26T07:54:04.986 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.987+0000 7fa9f910e640 1 -- 172.21.15.1:0/2279460943 wait complete. 2024-04-26T07:54:04.987 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.988+0000 7fa9f910e640 1 Processor -- start 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.988+0000 7fa9f910e640 1 -- start start 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.988+0000 7fa9f910e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f412acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.988+0000 7fa9f910e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f40999b0 con 0x7fa9f4097790 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f412acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f412acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55732/0 (socket says 172.21.15.1:55732) 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9f2d9d640 1 -- 172.21.15.1:0/2098675672 learned_addr learned my addr 172.21.15.1:0/2098675672 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9f2d9d640 1 -- 172.21.15.1:0/2098675672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f412bdd0 con 0x7fa9f4097790 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9f2d9d640 1 --2- 172.21.15.1:0/2098675672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f412acb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009720 tx=0x7fa9e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9eb7fe640 1 -- 172.21.15.1:0/2098675672 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e403be40 con 0x7fa9f4097790 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9eb7fe640 1 -- 172.21.15.1:0/2098675672 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e40453f0 con 0x7fa9f4097790 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9eb7fe640 1 -- 172.21.15.1:0/2098675672 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e40456f0 con 0x7fa9f4097790 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f406eb30 con 0x7fa9f4097790 2024-04-26T07:54:04.988 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.989+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f412b1f0 con 0x7fa9f4097790 2024-04-26T07:54:04.989 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.990+0000 7fa9eb7fe640 1 -- 172.21.15.1:0/2098675672 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (secure 0 0 0) 0x7fa9e404c060 con 0x7fa9f4097790 2024-04-26T07:54:04.989 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.990+0000 7fa9eb7fe640 1 --2- 172.21.15.1:0/2098675672 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa9d4038530 0x7fa9d403a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:04.989 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.990+0000 7fa9eb7fe640 1 -- 172.21.15.1:0/2098675672 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7fa9e406d2c0 con 0x7fa9f4097790 2024-04-26T07:54:04.989 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.990+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f40636f0 con 0x7fa9f4097790 2024-04-26T07:54:04.989 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.991+0000 7fa9ebfff640 1 --2- 172.21.15.1:0/2098675672 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa9d4038530 0x7fa9d403a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:04.990 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.991+0000 7fa9ebfff640 1 --2- 172.21.15.1:0/2098675672 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa9d4038530 0x7fa9d403a9f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc000f60 tx=0x7fa9dc007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:04.994 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:04.996+0000 7fa9eb7fe640 1 -- 172.21.15.1:0/2098675672 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa9e4040070 con 0x7fa9f4097790 2024-04-26T07:54:05.180 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.182+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9f40683a0 con 0x7fa9f4097790 2024-04-26T07:54:05.180 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.182+0000 7fa9eb7fe640 1 -- 172.21.15.1:0/2098675672 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+6056 (secure 0 0 0) 0x7fa9e40393b0 con 0x7fa9f4097790 2024-04-26T07:54:05.181 INFO:teuthology.misc.health.smithi001.stdout: 2024-04-26T07:54:05.181 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":9,"fsid":"ed2f0749-350f-459a-96bf-130a296577eb","created":"2024-04-26T07:53:56.542247+0000","modified":"2024-04-26T07:54:04.666258+0000","last_up_change":"2024-04-26T07:54:04.666258+0000","last_in_change":"2024-04-26T07:53:57.679587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26a6bcce-05b9-47ad-a6e3-1e096604187a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6801","nonce":3827982423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6803","nonce":3827982423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6807","nonce":3827982423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6805","nonce":3827982423}]},"public_addr":"172.21.15.1:6801/3827982423","cluster_addr":"172.21.15.1:6803/3827982423","heartbeat_back_addr":"172.21.15.1:6807/3827982423","heartbeat_front_addr":"172.21.15.1:6805/3827982423","state":["exists","up"]},{"osd":1,"uuid":"61f3627b-bf5b-44b1-8c7a-49c6f237241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6801","nonce":1888558046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6803","nonce":1888558046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6807","nonce":1888558046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6805","nonce":1888558046}]},"public_addr":"172.21.15.62:6801/1888558046","cluster_addr":"172.21.15.62:6803/1888558046","heartbeat_back_addr":"172.21.15.62:6807/1888558046","heartbeat_front_addr":"172.21.15.62:6805/1888558046","state":["exists","up"]},{"osd":2,"uuid":"80545748-33d8-421e-9138-61368e68ba31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6809","nonce":1138534927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6811","nonce":1138534927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6815","nonce":1138534927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6813","nonce":1138534927}]},"public_addr":"172.21.15.62:6809/1138534927","cluster_addr":"172.21.15.62:6811/1138534927","heartbeat_back_addr":"172.21.15.62:6815/1138534927","heartbeat_front_addr":"172.21.15.62:6813/1138534927","state":["exists","up"]},{"osd":3,"uuid":"29666b44-480b-4bce-9098-149f556d175e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6817","nonce":1472283839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6819","nonce":1472283839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6823","nonce":1472283839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6821","nonce":1472283839}]},"public_addr":"172.21.15.62:6817/1472283839","cluster_addr":"172.21.15.62:6819/1472283839","heartbeat_back_addr":"172.21.15.62:6823/1472283839","heartbeat_front_addr":"172.21.15.62:6821/1472283839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:54:05.183 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.184+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa9d4038530 msgr2=0x7fa9d403a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:05.183 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.184+0000 7fa9f910e640 1 --2- 172.21.15.1:0/2098675672 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa9d4038530 0x7fa9d403a9f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc000f60 tx=0x7fa9dc007a80 comp rx=0 tx=0).stop 2024-04-26T07:54:05.183 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.184+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 msgr2=0x7fa9f412acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:05.183 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.184+0000 7fa9f910e640 1 --2- 172.21.15.1:0/2098675672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f412acb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009720 tx=0x7fa9e40046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:05.183 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.185+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 shutdown_connections 2024-04-26T07:54:05.183 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.185+0000 7fa9f910e640 1 --2- 172.21.15.1:0/2098675672 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa9d4038530 0x7fa9d403a9f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:05.183 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.185+0000 7fa9f910e640 1 --2- 172.21.15.1:0/2098675672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9f4097790 0x7fa9f412acb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:05.183 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.185+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 >> 172.21.15.1:0/2098675672 conn(0x7fa9f409f8c0 msgr2=0x7fa9f409bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:05.184 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.185+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 shutdown_connections 2024-04-26T07:54:05.184 INFO:teuthology.misc.health.smithi001.stderr:2024-04-26T07:54:05.185+0000 7fa9f910e640 1 -- 172.21.15.1:0/2098675672 wait complete. 2024-04-26T07:54:05.192 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-26T07:54:05.193 INFO:tasks.ceph:Creating RBD pool 2024-04-26T07:54:05.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T07:54:05.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f101ddd5640 1 Processor -- start 2024-04-26T07:54:05.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f101ddd5640 1 -- start start 2024-04-26T07:54:05.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f101ddd5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f101806cd60 0x7f101806d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:05.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f101ddd5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101809b440 con 0x7f101806d680 2024-04-26T07:54:05.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f101ddd5640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f10180964d0 con 0x7f101806cd60 2024-04-26T07:54:05.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f10177fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f101806cd60 0x7f101806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:05.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f10177fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f101806cd60 0x7f101806d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55742/0 (socket says 172.21.15.1:55742) 2024-04-26T07:54:05.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f1016ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f101806d680 0x7f101812f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53704/0 (socket says 172.21.15.1:53704) 2024-04-26T07:54:05.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.294+0000 7f10177fe640 1 -- 172.21.15.1:0/1148692211 learned_addr learned my addr 172.21.15.1:0/1148692211 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:05.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.295+0000 7f10177fe640 1 -- 172.21.15.1:0/1148692211 >> v1:172.21.15.1:6789/0 conn(0x7f101806d680 legacy=0x7f101812f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:05.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.295+0000 7f10177fe640 1 -- 172.21.15.1:0/1148692211 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1018096fd0 con 0x7f101806cd60 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.295+0000 7f10177fe640 1 --2- 172.21.15.1:0/1148692211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f101806d140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f100c0097f0 tx=0x7f100c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c089e8b83deaac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f10167fc640 1 -- 172.21.15.1:0/1148692211 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c035020 con 0x7f101806cd60 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f10167fc640 1 -- 172.21.15.1:0/1148692211 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c0317a0 con 0x7f101806cd60 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f10167fc640 1 -- 172.21.15.1:0/1148692211 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c031aa0 con 0x7f101806cd60 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f101ddd5640 1 -- 172.21.15.1:0/1148692211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 msgr2=0x7f101806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f101ddd5640 1 --2- 172.21.15.1:0/1148692211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f101806d140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f100c0097f0 tx=0x7f100c02b910 comp rx=0 tx=0).stop 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f101ddd5640 1 -- 172.21.15.1:0/1148692211 shutdown_connections 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f101ddd5640 1 --2- 172.21.15.1:0/1148692211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f101806d140 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:05.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f101ddd5640 1 -- 172.21.15.1:0/1148692211 >> 172.21.15.1:0/1148692211 conn(0x7f101809e5f0 msgr2=0x7f101809aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:05.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f101ddd5640 1 -- 172.21.15.1:0/1148692211 shutdown_connections 2024-04-26T07:54:05.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.296+0000 7f101ddd5640 1 -- 172.21.15.1:0/1148692211 wait complete. 2024-04-26T07:54:05.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.297+0000 7f101ddd5640 1 Processor -- start 2024-04-26T07:54:05.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.297+0000 7f101ddd5640 1 -- start start 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.297+0000 7f101ddd5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f1018123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f101ddd5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f101812f9d0 con 0x7f101806cd60 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f10177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f1018123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f10177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f1018123080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55754/0 (socket says 172.21.15.1:55754) 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f10177fe640 1 -- 172.21.15.1:0/2213855871 learned_addr learned my addr 172.21.15.1:0/2213855871 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f10177fe640 1 -- 172.21.15.1:0/2213855871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1018124660 con 0x7f101806cd60 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f10177fe640 1 --2- 172.21.15.1:0/2213855871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f1018123080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f100c0090b0 tx=0x7f100c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f0ffffff640 1 -- 172.21.15.1:0/2213855871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c049070 con 0x7f101806cd60 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f0ffffff640 1 -- 172.21.15.1:0/2213855871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c031a80 con 0x7f101806cd60 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1018072ef0 con 0x7f101806cd60 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f0ffffff640 1 -- 172.21.15.1:0/2213855871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c044550 con 0x7f101806cd60 2024-04-26T07:54:05.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.298+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101812ef70 con 0x7f101806cd60 2024-04-26T07:54:05.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.299+0000 7f0ffffff640 1 -- 172.21.15.1:0/2213855871 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (secure 0 0 0) 0x7f100c04c070 con 0x7f101806cd60 2024-04-26T07:54:05.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.299+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1018094d60 con 0x7f101806cd60 2024-04-26T07:54:05.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.299+0000 7f0ffffff640 1 --2- 172.21.15.1:0/2213855871 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1004038580 0x7f100403aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:05.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.299+0000 7f0ffffff640 1 -- 172.21.15.1:0/2213855871 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7f100c06d9d0 con 0x7f101806cd60 2024-04-26T07:54:05.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.300+0000 7f1016ffd640 1 --2- 172.21.15.1:0/2213855871 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1004038580 0x7f100403aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:05.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.300+0000 7f1016ffd640 1 --2- 172.21.15.1:0/2213855871 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1004038580 0x7f100403aa40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1008000f60 tx=0x7f1008007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:05.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.304+0000 7f0ffffff640 1 -- 172.21.15.1:0/2213855871 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1018094d60 con 0x7f101806cd60 2024-04-26T07:54:05.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.488+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f10180636f0 con 0x7f101806cd60 2024-04-26T07:54:05.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.666+0000 7f0ffffff640 1 -- 172.21.15.1:0/2213855871 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) ==== 109+0+0 (secure 0 0 0) 0x7f100c03f070 con 0x7f101806cd60 2024-04-26T07:54:05.665 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'rbd' created 2024-04-26T07:54:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1004038580 msgr2=0x7f100403aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 --2- 172.21.15.1:0/2213855871 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1004038580 0x7f100403aa40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1008000f60 tx=0x7f1008007a80 comp rx=0 tx=0).stop 2024-04-26T07:54:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 msgr2=0x7f1018123080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 --2- 172.21.15.1:0/2213855871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f1018123080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f100c0090b0 tx=0x7f100c0046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 shutdown_connections 2024-04-26T07:54:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 --2- 172.21.15.1:0/2213855871 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1004038580 0x7f100403aa40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 --2- 172.21.15.1:0/2213855871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f101806cd60 0x7f1018123080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 >> 172.21.15.1:0/2213855871 conn(0x7f101809e5f0 msgr2=0x7f1018091870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 shutdown_connections 2024-04-26T07:54:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.669+0000 7f101ddd5640 1 -- 172.21.15.1:0/2213855871 wait complete. 2024-04-26T07:54:05.678 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T07:54:05.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.782+0000 7f4ebd54b640 1 Processor -- start 2024-04-26T07:54:05.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.782+0000 7f4ebd54b640 1 -- start start 2024-04-26T07:54:05.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4ebd54b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4eb812fdf0 0x7f4eb81321e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:05.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4ebd54b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb812cb80 con 0x7f4eb812cfd0 2024-04-26T07:54:05.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4ebd54b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb8097330 con 0x7f4eb812fdf0 2024-04-26T07:54:05.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4eb67fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4eb812fdf0 0x7f4eb81321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:05.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4eb6ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4eb812cfd0 0x7f4eb812d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53718/0 (socket says 172.21.15.1:53718) 2024-04-26T07:54:05.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4eb6ffd640 1 -- 172.21.15.1:0/2585630637 learned_addr learned my addr 172.21.15.1:0/2585630637 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:05.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4eb67fc640 1 -- 172.21.15.1:0/2585630637 >> v1:172.21.15.1:6789/0 conn(0x7f4eb812cfd0 legacy=0x7f4eb812d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:05.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4eb67fc640 1 -- 172.21.15.1:0/2585630637 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb809c600 con 0x7f4eb812fdf0 2024-04-26T07:54:05.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.783+0000 7f4eb5ffb640 1 -- 172.21.15.1:0/2585630637 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133739742 0 0) 0x7f4eb812cb80 con 0x7f4eb812cfd0 2024-04-26T07:54:05.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.784+0000 7f4eb67fc640 1 --2- 172.21.15.1:0/2585630637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812fdf0 0x7f4eb81321e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009720 tx=0x7f4eac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0170ad71138df25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:05.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.784+0000 7f4eb5ffb640 1 -- 172.21.15.1:0/2585630637 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eac0316d0 con 0x7f4eb812fdf0 2024-04-26T07:54:05.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.784+0000 7f4eb5ffb640 1 -- 172.21.15.1:0/2585630637 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eac037070 con 0x7f4eb812fdf0 2024-04-26T07:54:05.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.784+0000 7f4eb5ffb640 1 -- 172.21.15.1:0/2585630637 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eac0319c0 con 0x7f4eb812fdf0 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.785+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2585630637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812fdf0 msgr2=0x7f4eb81321e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.785+0000 7f4ebd54b640 1 --2- 172.21.15.1:0/2585630637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812fdf0 0x7f4eb81321e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009720 tx=0x7f4eac02b840 comp rx=0 tx=0).stop 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.785+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2585630637 shutdown_connections 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.785+0000 7f4ebd54b640 1 --2- 172.21.15.1:0/2585630637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812fdf0 0x7f4eb81321e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.785+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2585630637 >> 172.21.15.1:0/2585630637 conn(0x7f4eb809b4e0 msgr2=0x7f4eb809b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.785+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2585630637 shutdown_connections 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.785+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2585630637 wait complete. 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.786+0000 7f4ebd54b640 1 Processor -- start 2024-04-26T07:54:05.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.786+0000 7f4ebd54b640 1 -- start start 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.786+0000 7f4ebd54b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812cfd0 0x7f4eb81288c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.786+0000 7f4ebd54b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb809cc90 con 0x7f4eb812cfd0 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.786+0000 7f4eb6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812cfd0 0x7f4eb81288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.786+0000 7f4eb6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812cfd0 0x7f4eb81288c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55782/0 (socket says 172.21.15.1:55782) 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.786+0000 7f4eb6ffd640 1 -- 172.21.15.1:0/2702601184 learned_addr learned my addr 172.21.15.1:0/2702601184 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.787+0000 7f4eb6ffd640 1 -- 172.21.15.1:0/2702601184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb8072c60 con 0x7f4eb812cfd0 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.787+0000 7f4eb6ffd640 1 --2- 172.21.15.1:0/2702601184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812cfd0 0x7f4eb81288c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c840 tx=0x7f4ea800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.787+0000 7f4e9f7fe640 1 -- 172.21.15.1:0/2702601184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ea8018070 con 0x7f4eb812cfd0 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.787+0000 7f4e9f7fe640 1 -- 172.21.15.1:0/2702601184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea800a660 con 0x7f4eb812cfd0 2024-04-26T07:54:05.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.787+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb8072450 con 0x7f4eb812cfd0 2024-04-26T07:54:05.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.787+0000 7f4e9f7fe640 1 -- 172.21.15.1:0/2702601184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ea800a980 con 0x7f4eb812cfd0 2024-04-26T07:54:05.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.787+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb8071ac0 con 0x7f4eb812cfd0 2024-04-26T07:54:05.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.788+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb80636f0 con 0x7f4eb812cfd0 2024-04-26T07:54:05.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.788+0000 7f4e9f7fe640 1 -- 172.21.15.1:0/2702601184 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (secure 0 0 0) 0x7f4ea801b070 con 0x7f4eb812cfd0 2024-04-26T07:54:05.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.788+0000 7f4e9f7fe640 1 --2- 172.21.15.1:0/2702601184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4ea4038530 0x7f4ea403a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:05.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.788+0000 7f4e9f7fe640 1 -- 172.21.15.1:0/2702601184 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 3460+0+0 (secure 0 0 0) 0x7f4ea804ab90 con 0x7f4eb812cfd0 2024-04-26T07:54:05.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.788+0000 7f4eb67fc640 1 --2- 172.21.15.1:0/2702601184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4ea4038530 0x7f4ea403a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:05.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.789+0000 7f4eb67fc640 1 --2- 172.21.15.1:0/2702601184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4ea4038530 0x7f4ea403a9f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8075a00 tx=0x7f4eac008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:05.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.793+0000 7f4e9f7fe640 1 -- 172.21.15.1:0/2702601184 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ea8011360 con 0x7f4eb812cfd0 2024-04-26T07:54:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:05.980+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f4eb8072250 con 0x7f4eb812cfd0 2024-04-26T07:54:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.667+0000 7f4e9f7fe640 1 -- 172.21.15.1:0/2702601184 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) ==== 173+0+0 (secure 0 0 0) 0x7f4eb8072250 con 0x7f4eb812cfd0 2024-04-26T07:54:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4ea4038530 msgr2=0x7f4ea403a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 --2- 172.21.15.1:0/2702601184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4ea4038530 0x7f4ea403a9f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8075a00 tx=0x7f4eac008030 comp rx=0 tx=0).stop 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812cfd0 msgr2=0x7f4eb81288c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 --2- 172.21.15.1:0/2702601184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812cfd0 0x7f4eb81288c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c840 tx=0x7f4ea800cd00 comp rx=0 tx=0).stop 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 shutdown_connections 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 --2- 172.21.15.1:0/2702601184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4ea4038530 0x7f4ea403a9f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 --2- 172.21.15.1:0/2702601184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb812cfd0 0x7f4eb81288c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 >> 172.21.15.1:0/2702601184 conn(0x7f4eb809b4e0 msgr2=0x7f4eb812f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 shutdown_connections 2024-04-26T07:54:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.670+0000 7f4ebd54b640 1 -- 172.21.15.1:0/2702601184 wait complete. 2024-04-26T07:54:06.683 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T07:54:06.683 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T07:54:06.683 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T07:54:06.684 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T07:54:06.684 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T07:54:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.793+0000 7fb18837c640 1 Processor -- start 2024-04-26T07:54:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.793+0000 7fb18837c640 1 -- start start 2024-04-26T07:54:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.793+0000 7fb18837c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb18006d5b0 0x7fb1801321c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.793+0000 7fb18837c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb180096b70 con 0x7fb18009d590 2024-04-26T07:54:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.793+0000 7fb18837c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb180096e10 con 0x7fb18006d5b0 2024-04-26T07:54:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.794+0000 7fb185917640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb18006d5b0 0x7fb1801321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.794+0000 7fb186118640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb18009d590 0x7fb18006cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53722/0 (socket says 172.21.15.1:53722) 2024-04-26T07:54:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.794+0000 7fb186118640 1 -- 172.21.15.1:0/3427670310 learned_addr learned my addr 172.21.15.1:0/3427670310 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.794+0000 7fb185917640 1 -- 172.21.15.1:0/3427670310 >> v1:172.21.15.1:6789/0 conn(0x7fb18009d590 legacy=0x7fb18006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.794+0000 7fb185116640 1 -- 172.21.15.1:0/3427670310 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175656882 0 0) 0x7fb180096b70 con 0x7fb18009d590 2024-04-26T07:54:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.794+0000 7fb185917640 1 -- 172.21.15.1:0/3427670310 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18009dca0 con 0x7fb18006d5b0 2024-04-26T07:54:06.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.795+0000 7fb185917640 1 --2- 172.21.15.1:0/3427670310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1801321c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb170009720 tx=0x7fb17002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b082250f9eac263 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:06.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.795+0000 7fb185116640 1 -- 172.21.15.1:0/3427670310 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb170035020 con 0x7fb18006d5b0 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.795+0000 7fb185116640 1 -- 172.21.15.1:0/3427670310 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb170031760 con 0x7fb18006d5b0 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.795+0000 7fb185116640 1 -- 172.21.15.1:0/3427670310 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb170031a60 con 0x7fb18006d5b0 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.795+0000 7fb18837c640 1 -- 172.21.15.1:0/3427670310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 msgr2=0x7fb1801321c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.795+0000 7fb18837c640 1 --2- 172.21.15.1:0/3427670310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1801321c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb170009720 tx=0x7fb17002b8d0 comp rx=0 tx=0).stop 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.796+0000 7fb18837c640 1 -- 172.21.15.1:0/3427670310 shutdown_connections 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.796+0000 7fb18837c640 1 --2- 172.21.15.1:0/3427670310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1801321c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.796+0000 7fb18837c640 1 -- 172.21.15.1:0/3427670310 >> 172.21.15.1:0/3427670310 conn(0x7fb18009c560 msgr2=0x7fb18009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.796+0000 7fb18837c640 1 -- 172.21.15.1:0/3427670310 shutdown_connections 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.796+0000 7fb18837c640 1 -- 172.21.15.1:0/3427670310 wait complete. 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.796+0000 7fb18837c640 1 Processor -- start 2024-04-26T07:54:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.796+0000 7fb18837c640 1 -- start start 2024-04-26T07:54:06.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb18837c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1800932f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb18837c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb180132700 con 0x7fb18006d5b0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb186118640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1800932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb186118640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1800932f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55794/0 (socket says 172.21.15.1:55794) 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb186118640 1 -- 172.21.15.1:0/1356822245 learned_addr learned my addr 172.21.15.1:0/1356822245 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb186118640 1 -- 172.21.15.1:0/1356822245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18006ff30 con 0x7fb18006d5b0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb186118640 1 --2- 172.21.15.1:0/1356822245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1800932f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00c420 tx=0x7fb17c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb176ffd640 1 -- 172.21.15.1:0/1356822245 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c018070 con 0x7fb18006d5b0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb176ffd640 1 -- 172.21.15.1:0/1356822245 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c0074d0 con 0x7fb18006d5b0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb176ffd640 1 -- 172.21.15.1:0/1356822245 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c004950 con 0x7fb18006d5b0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.797+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb180094dc0 con 0x7fb18006d5b0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.798+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18006f7e0 con 0x7fb18006d5b0 2024-04-26T07:54:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.798+0000 7fb176ffd640 1 -- 172.21.15.1:0/1356822245 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (secure 0 0 0) 0x7fb17c01b070 con 0x7fb18006d5b0 2024-04-26T07:54:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.798+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1800636f0 con 0x7fb18006d5b0 2024-04-26T07:54:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.799+0000 7fb176ffd640 1 --2- 172.21.15.1:0/1356822245 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb164038530 0x7fb16403a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.799+0000 7fb176ffd640 1 -- 172.21.15.1:0/1356822245 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7fb17c04a820 con 0x7fb18006d5b0 2024-04-26T07:54:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.799+0000 7fb185917640 1 --2- 172.21.15.1:0/1356822245 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb164038530 0x7fb16403a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.799+0000 7fb185917640 1 --2- 172.21.15.1:0/1356822245 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb164038530 0x7fb16403a9f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb170036000 tx=0x7fb170008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:06.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:06.804+0000 7fb176ffd640 1 -- 172.21.15.1:0/1356822245 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb17c01c9b0 con 0x7fb18006d5b0 2024-04-26T07:54:07.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.042+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb180098130 con 0x7fb18006d5b0 2024-04-26T07:54:07.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.043+0000 7fb176ffd640 1 -- 172.21.15.1:0/1356822245 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) ==== 74+0+87704 (secure 0 0 0) 0x7fb17c0376b0 con 0x7fb18006d5b0 2024-04-26T07:54:07.044 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:54:07.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb164038530 msgr2=0x7fb16403a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 --2- 172.21.15.1:0/1356822245 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb164038530 0x7fb16403a9f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb170036000 tx=0x7fb170008030 comp rx=0 tx=0).stop 2024-04-26T07:54:07.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 msgr2=0x7fb1800932f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 --2- 172.21.15.1:0/1356822245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1800932f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00c420 tx=0x7fb17c00c8e0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 shutdown_connections 2024-04-26T07:54:07.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 --2- 172.21.15.1:0/1356822245 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb164038530 0x7fb16403a9f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 --2- 172.21.15.1:0/1356822245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18006d5b0 0x7fb1800932f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 >> 172.21.15.1:0/1356822245 conn(0x7fb18009c560 msgr2=0x7fb180098930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 shutdown_connections 2024-04-26T07:54:07.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.046+0000 7fb18837c640 1 -- 172.21.15.1:0/1356822245 wait complete. 2024-04-26T07:54:07.055 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":4,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3728486338},{"type":"v1","addr":"172.21.15.62:6825","nonce":3728486338}]},"active_addr":"172.21.15.62:6825/3728486338","active_change":"2024-04-26T07:54:00.806888+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":645392437}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":481706798}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":4076384956}]}]} 2024-04-26T07:54:07.057 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T07:54:07.057 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T07:54:07.057 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:54:07.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.159+0000 7fed60e91640 1 Processor -- start 2024-04-26T07:54:07.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.159+0000 7fed60e91640 1 -- start start 2024-04-26T07:54:07.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed60e91640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fed5c12eba0 0x7fed5c130f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed60e91640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5c06da60 con 0x7fed5c128920 2024-04-26T07:54:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed60e91640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fed5c073070 con 0x7fed5c12eba0 2024-04-26T07:54:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed59d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fed5c12eba0 0x7fed5c130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed5a59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fed5c128920 0x7fed5c128d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53736/0 (socket says 172.21.15.1:53736) 2024-04-26T07:54:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed59d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fed5c12eba0 0x7fed5c130f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55808/0 (socket says 172.21.15.1:55808) 2024-04-26T07:54:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed5a59c640 1 -- 172.21.15.1:0/1419856589 learned_addr learned my addr 172.21.15.1:0/1419856589 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed59d9b640 1 -- 172.21.15.1:0/1419856589 >> v1:172.21.15.1:6789/0 conn(0x7fed5c128920 legacy=0x7fed5c128d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed59d9b640 1 -- 172.21.15.1:0/1419856589 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c094640 con 0x7fed5c12eba0 2024-04-26T07:54:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.160+0000 7fed5959a640 1 -- 172.21.15.1:0/1419856589 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927593198 0 0) 0x7fed54001110 con 0x7fed5c128920 2024-04-26T07:54:07.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.161+0000 7fed59d9b640 1 --2- 172.21.15.1:0/1419856589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c12eba0 0x7fed5c130f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed50009720 tx=0x7fed5002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4df80e48793ec74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.161+0000 7fed5959a640 1 -- 172.21.15.1:0/1419856589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500316d0 con 0x7fed5c12eba0 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.161+0000 7fed5959a640 1 -- 172.21.15.1:0/1419856589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed50037070 con 0x7fed5c12eba0 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.161+0000 7fed5959a640 1 -- 172.21.15.1:0/1419856589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500319c0 con 0x7fed5c12eba0 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.161+0000 7fed60e91640 1 -- 172.21.15.1:0/1419856589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c12eba0 msgr2=0x7fed5c130f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.161+0000 7fed60e91640 1 --2- 172.21.15.1:0/1419856589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c12eba0 0x7fed5c130f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed50009720 tx=0x7fed5002b840 comp rx=0 tx=0).stop 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.162+0000 7fed60e91640 1 -- 172.21.15.1:0/1419856589 shutdown_connections 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.162+0000 7fed60e91640 1 --2- 172.21.15.1:0/1419856589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c12eba0 0x7fed5c130f90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.162+0000 7fed60e91640 1 -- 172.21.15.1:0/1419856589 >> 172.21.15.1:0/1419856589 conn(0x7fed5c09add0 msgr2=0x7fed5c09b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.162+0000 7fed60e91640 1 -- 172.21.15.1:0/1419856589 shutdown_connections 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.162+0000 7fed60e91640 1 -- 172.21.15.1:0/1419856589 wait complete. 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.163+0000 7fed60e91640 1 Processor -- start 2024-04-26T07:54:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.163+0000 7fed60e91640 1 -- start start 2024-04-26T07:54:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.163+0000 7fed60e91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c128920 0x7fed5c12be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.163+0000 7fed60e91640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c06d620 con 0x7fed5c128920 2024-04-26T07:54:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.163+0000 7fed5a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c128920 0x7fed5c12be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.163+0000 7fed5a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c128920 0x7fed5c12be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55810/0 (socket says 172.21.15.1:55810) 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.163+0000 7fed5a59c640 1 -- 172.21.15.1:0/1340157057 learned_addr learned my addr 172.21.15.1:0/1340157057 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.163+0000 7fed5a59c640 1 -- 172.21.15.1:0/1340157057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c06e6c0 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.164+0000 7fed5a59c640 1 --2- 172.21.15.1:0/1340157057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c128920 0x7fed5c12be30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c700 tx=0x7fed5400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.164+0000 7fed4affd640 1 -- 172.21.15.1:0/1340157057 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed54018070 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.164+0000 7fed4affd640 1 -- 172.21.15.1:0/1340157057 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed540070d0 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.164+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c06e050 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.164+0000 7fed4affd640 1 -- 172.21.15.1:0/1340157057 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed540073f0 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.164+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c12c550 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.165+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5c0636f0 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.165+0000 7fed4affd640 1 -- 172.21.15.1:0/1340157057 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (secure 0 0 0) 0x7fed5401b070 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.165+0000 7fed4affd640 1 --2- 172.21.15.1:0/1340157057 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fed3c0384e0 0x7fed3c03a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.165+0000 7fed4affd640 1 -- 172.21.15.1:0/1340157057 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7fed5404a850 con 0x7fed5c128920 2024-04-26T07:54:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.165+0000 7fed59d9b640 1 --2- 172.21.15.1:0/1340157057 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fed3c0384e0 0x7fed3c03a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.166+0000 7fed59d9b640 1 --2- 172.21.15.1:0/1340157057 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fed3c0384e0 0x7fed3c03a9a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed50036000 tx=0x7fed50008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.170+0000 7fed4affd640 1 -- 172.21.15.1:0/1340157057 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed5c06da60 con 0x7fed5c128920 2024-04-26T07:54:07.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.353+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed5c06b6f0 con 0x7fed5c128920 2024-04-26T07:54:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.354+0000 7fed4affd640 1 -- 172.21.15.1:0/1340157057 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+9733 (secure 0 0 0) 0x7fed54004890 con 0x7fed5c128920 2024-04-26T07:54:07.352 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:54:07.352 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":11,"fsid":"ed2f0749-350f-459a-96bf-130a296577eb","created":"2024-04-26T07:53:56.542247+0000","modified":"2024-04-26T07:54:06.667589+0000","last_up_change":"2024-04-26T07:54:04.666258+0000","last_in_change":"2024-04-26T07:53:57.679587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T07:54:04.826613+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:54:05.492038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26a6bcce-05b9-47ad-a6e3-1e096604187a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6801","nonce":3827982423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6803","nonce":3827982423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6807","nonce":3827982423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6805","nonce":3827982423}]},"public_addr":"172.21.15.1:6801/3827982423","cluster_addr":"172.21.15.1:6803/3827982423","heartbeat_back_addr":"172.21.15.1:6807/3827982423","heartbeat_front_addr":"172.21.15.1:6805/3827982423","state":["exists","up"]},{"osd":1,"uuid":"61f3627b-bf5b-44b1-8c7a-49c6f237241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6801","nonce":1888558046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6803","nonce":1888558046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6807","nonce":1888558046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6805","nonce":1888558046}]},"public_addr":"172.21.15.62:6801/1888558046","cluster_addr":"172.21.15.62:6803/1888558046","heartbeat_back_addr":"172.21.15.62:6807/1888558046","heartbeat_front_addr":"172.21.15.62:6805/1888558046","state":["exists","up"]},{"osd":2,"uuid":"80545748-33d8-421e-9138-61368e68ba31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6809","nonce":1138534927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6811","nonce":1138534927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6815","nonce":1138534927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6813","nonce":1138534927}]},"public_addr":"172.21.15.62:6809/1138534927","cluster_addr":"172.21.15.62:6811/1138534927","heartbeat_back_addr":"172.21.15.62:6815/1138534927","heartbeat_front_addr":"172.21.15.62:6813/1138534927","state":["exists","up"]},{"osd":3,"uuid":"29666b44-480b-4bce-9098-149f556d175e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6817","nonce":1472283839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6819","nonce":1472283839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6823","nonce":1472283839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6821","nonce":1472283839}]},"public_addr":"172.21.15.62:6817/1472283839","cluster_addr":"172.21.15.62:6819/1472283839","heartbeat_back_addr":"172.21.15.62:6823/1472283839","heartbeat_front_addr":"172.21.15.62:6821/1472283839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.762879+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.791186+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.815660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:04.602611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:54:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fed3c0384e0 msgr2=0x7fed3c03a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 --2- 172.21.15.1:0/1340157057 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fed3c0384e0 0x7fed3c03a9a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed50036000 tx=0x7fed50008030 comp rx=0 tx=0).stop 2024-04-26T07:54:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c128920 msgr2=0x7fed5c12be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 --2- 172.21.15.1:0/1340157057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c128920 0x7fed5c12be30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c700 tx=0x7fed5400cbc0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 shutdown_connections 2024-04-26T07:54:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 --2- 172.21.15.1:0/1340157057 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fed3c0384e0 0x7fed3c03a9a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 --2- 172.21.15.1:0/1340157057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed5c128920 0x7fed5c12be30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 >> 172.21.15.1:0/1340157057 conn(0x7fed5c09add0 msgr2=0x7fed5c0934e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 shutdown_connections 2024-04-26T07:54:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.356+0000 7fed60e91640 1 -- 172.21.15.1:0/1340157057 wait complete. 2024-04-26T07:54:07.365 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T07:54:07.365 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:54:07.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.466+0000 7effba877640 1 Processor -- start 2024-04-26T07:54:07.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.466+0000 7effba877640 1 -- start start 2024-04-26T07:54:07.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.466+0000 7effba877640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7effb412d680 0x7effb4131d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effba877640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb4096c10 con 0x7effb412c9e0 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effba877640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7effb4096de0 con 0x7effb412d680 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effb3fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7effb412c9e0 0x7effb412cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53738/0 (socket says 172.21.15.1:53738) 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effb3fff640 1 -- 172.21.15.1:0/3371814896 learned_addr learned my addr 172.21.15.1:0/3371814896 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effb37fe640 1 --2- 172.21.15.1:0/3371814896 >> v2:172.21.15.1:3300/0 conn(0x7effb412d680 0x7effb4131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effb2ffd640 1 -- 172.21.15.1:0/3371814896 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846884682 0 0) 0x7effb4096c10 con 0x7effb412c9e0 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effb2ffd640 1 -- 172.21.15.1:0/3371814896 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa0003520 con 0x7effb412c9e0 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effb37fe640 1 -- 172.21.15.1:0/3371814896 >> v1:172.21.15.1:6789/0 conn(0x7effb412c9e0 legacy=0x7effb412cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.467+0000 7effb37fe640 1 -- 172.21.15.1:0/3371814896 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb4096510 con 0x7effb412d680 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.468+0000 7effb37fe640 1 --2- 172.21.15.1:0/3371814896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412d680 0x7effb4131d60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009720 tx=0x7eff9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390266de35565598 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.468+0000 7effb2ffd640 1 -- 172.21.15.1:0/3371814896 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c0316d0 con 0x7effb412d680 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.468+0000 7effb2ffd640 1 -- 172.21.15.1:0/3371814896 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c037070 con 0x7effb412d680 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.468+0000 7effb2ffd640 1 -- 172.21.15.1:0/3371814896 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c0319c0 con 0x7effb412d680 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.468+0000 7effba877640 1 -- 172.21.15.1:0/3371814896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412d680 msgr2=0x7effb4131d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.468+0000 7effba877640 1 --2- 172.21.15.1:0/3371814896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412d680 0x7effb4131d60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009720 tx=0x7eff9c02b840 comp rx=0 tx=0).stop 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.469+0000 7effba877640 1 -- 172.21.15.1:0/3371814896 shutdown_connections 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.469+0000 7effba877640 1 --2- 172.21.15.1:0/3371814896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412d680 0x7effb4131d60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.469+0000 7effba877640 1 -- 172.21.15.1:0/3371814896 >> 172.21.15.1:0/3371814896 conn(0x7effb409add0 msgr2=0x7effb409b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.469+0000 7effba877640 1 -- 172.21.15.1:0/3371814896 shutdown_connections 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.469+0000 7effba877640 1 -- 172.21.15.1:0/3371814896 wait complete. 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.469+0000 7effba877640 1 Processor -- start 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effba877640 1 -- start start 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effba877640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412c9e0 0x7effb40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effba877640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7effb41324b0 con 0x7effb412c9e0 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effb3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412c9e0 0x7effb40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effb3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412c9e0 0x7effb40700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55828/0 (socket says 172.21.15.1:55828) 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effb3fff640 1 -- 172.21.15.1:0/3403450635 learned_addr learned my addr 172.21.15.1:0/3403450635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effb3fff640 1 -- 172.21.15.1:0/3403450635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb4122170 con 0x7effb412c9e0 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effb3fff640 1 --2- 172.21.15.1:0/3403450635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412c9e0 0x7effb40700a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effa400c480 tx=0x7effa400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.470+0000 7effb0ff9640 1 -- 172.21.15.1:0/3403450635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa4017070 con 0x7effb412c9e0 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.471+0000 7effb0ff9640 1 -- 172.21.15.1:0/3403450635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa4005c10 con 0x7effb412c9e0 2024-04-26T07:54:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.471+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb4072c40 con 0x7effb412c9e0 2024-04-26T07:54:07.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.471+0000 7effb0ff9640 1 -- 172.21.15.1:0/3403450635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa4007070 con 0x7effb412c9e0 2024-04-26T07:54:07.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.471+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb40705e0 con 0x7effb412c9e0 2024-04-26T07:54:07.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.471+0000 7effb0ff9640 1 -- 172.21.15.1:0/3403450635 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (secure 0 0 0) 0x7effa401a070 con 0x7effb412c9e0 2024-04-26T07:54:07.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.471+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb4072f20 con 0x7effb412c9e0 2024-04-26T07:54:07.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.472+0000 7effb0ff9640 1 --2- 172.21.15.1:0/3403450635 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94038530 0x7eff9403a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.472+0000 7effb0ff9640 1 -- 172.21.15.1:0/3403450635 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7effa404a810 con 0x7effb412c9e0 2024-04-26T07:54:07.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.472+0000 7effb37fe640 1 --2- 172.21.15.1:0/3403450635 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94038530 0x7eff9403a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.472+0000 7effb37fe640 1 --2- 172.21.15.1:0/3403450635 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94038530 0x7eff9403a9f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff9c036000 tx=0x7eff9c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.476+0000 7effb0ff9640 1 -- 172.21.15.1:0/3403450635 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effb4072f20 con 0x7effb412c9e0 2024-04-26T07:54:07.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.661+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effb40636f0 con 0x7effb412c9e0 2024-04-26T07:54:07.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.661+0000 7effb0ff9640 1 -- 172.21.15.1:0/3403450635 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+9733 (secure 0 0 0) 0x7effa401ac60 con 0x7effb412c9e0 2024-04-26T07:54:07.660 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:54:07.660 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":11,"fsid":"ed2f0749-350f-459a-96bf-130a296577eb","created":"2024-04-26T07:53:56.542247+0000","modified":"2024-04-26T07:54:06.667589+0000","last_up_change":"2024-04-26T07:54:04.666258+0000","last_in_change":"2024-04-26T07:53:57.679587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T07:54:04.826613+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:54:05.492038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26a6bcce-05b9-47ad-a6e3-1e096604187a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6801","nonce":3827982423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6803","nonce":3827982423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6807","nonce":3827982423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6805","nonce":3827982423}]},"public_addr":"172.21.15.1:6801/3827982423","cluster_addr":"172.21.15.1:6803/3827982423","heartbeat_back_addr":"172.21.15.1:6807/3827982423","heartbeat_front_addr":"172.21.15.1:6805/3827982423","state":["exists","up"]},{"osd":1,"uuid":"61f3627b-bf5b-44b1-8c7a-49c6f237241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6801","nonce":1888558046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6803","nonce":1888558046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6807","nonce":1888558046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6805","nonce":1888558046}]},"public_addr":"172.21.15.62:6801/1888558046","cluster_addr":"172.21.15.62:6803/1888558046","heartbeat_back_addr":"172.21.15.62:6807/1888558046","heartbeat_front_addr":"172.21.15.62:6805/1888558046","state":["exists","up"]},{"osd":2,"uuid":"80545748-33d8-421e-9138-61368e68ba31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6809","nonce":1138534927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6811","nonce":1138534927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6815","nonce":1138534927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6813","nonce":1138534927}]},"public_addr":"172.21.15.62:6809/1138534927","cluster_addr":"172.21.15.62:6811/1138534927","heartbeat_back_addr":"172.21.15.62:6815/1138534927","heartbeat_front_addr":"172.21.15.62:6813/1138534927","state":["exists","up"]},{"osd":3,"uuid":"29666b44-480b-4bce-9098-149f556d175e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6817","nonce":1472283839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6819","nonce":1472283839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6823","nonce":1472283839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6821","nonce":1472283839}]},"public_addr":"172.21.15.62:6817/1472283839","cluster_addr":"172.21.15.62:6819/1472283839","heartbeat_back_addr":"172.21.15.62:6823/1472283839","heartbeat_front_addr":"172.21.15.62:6821/1472283839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.762879+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.791186+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.815660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:04.602611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.663+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94038530 msgr2=0x7eff9403a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.663+0000 7effba877640 1 --2- 172.21.15.1:0/3403450635 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94038530 0x7eff9403a9f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff9c036000 tx=0x7eff9c008030 comp rx=0 tx=0).stop 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.663+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412c9e0 msgr2=0x7effb40700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.663+0000 7effba877640 1 --2- 172.21.15.1:0/3403450635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412c9e0 0x7effb40700a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effa400c480 tx=0x7effa400c940 comp rx=0 tx=0).stop 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.663+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 shutdown_connections 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.663+0000 7effba877640 1 --2- 172.21.15.1:0/3403450635 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94038530 0x7eff9403a9f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.663+0000 7effba877640 1 --2- 172.21.15.1:0/3403450635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effb412c9e0 0x7effb40700a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.663+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 >> 172.21.15.1:0/3403450635 conn(0x7effb409add0 msgr2=0x7effb40978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.664+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 shutdown_connections 2024-04-26T07:54:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.664+0000 7effba877640 1 -- 172.21.15.1:0/3403450635 wait complete. 2024-04-26T07:54:07.675 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T07:54:07.675 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T07:54:07.676 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T07:54:07.676 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T07:54:07.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.783+0000 7fe04b503640 1 Processor -- start 2024-04-26T07:54:07.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.783+0000 7feb57beb640 1 Processor -- start 2024-04-26T07:54:07.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.783+0000 7f0565b6a640 1 Processor -- start 2024-04-26T07:54:07.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.783+0000 7f9fb2323640 1 Processor -- start 2024-04-26T07:54:07.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f9fb2323640 1 -- start start 2024-04-26T07:54:07.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.783+0000 7fe04b503640 1 -- start start 2024-04-26T07:54:07.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f0565b6a640 1 -- start start 2024-04-26T07:54:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7feb57beb640 1 -- start start 2024-04-26T07:54:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7fe04b503640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe044094ed0 0x7fe0440952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f9fb2323640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9fac12b6e0 0x7f9fac12bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f0565b6a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f056012f770 0x7f0560134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7feb57beb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feb50128920 0x7feb50128d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f9fb2323640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fac096790 con 0x7f9fac094c60 2024-04-26T07:54:07.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f0565b6a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f056009b470 con 0x7f056009a0f0 2024-04-26T07:54:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f9fb2323640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f9fac06ce10 con 0x7f9fac12b6e0 2024-04-26T07:54:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f9fabfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9fac12b6e0 0x7f9fac12bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f0565b6a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f056009b780 con 0x7f056012f770 2024-04-26T07:54:07.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f9fabfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9fac12b6e0 0x7f9fac12bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55838/0 (socket says 172.21.15.1:55838) 2024-04-26T07:54:07.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7fe04b503640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe044096760 con 0x7fe0440957f0 2024-04-26T07:54:07.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7fe04b503640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe04406d310 con 0x7fe044094ed0 2024-04-26T07:54:07.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7fe048a9e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe0440957f0 0x7fe04412b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53752/0 (socket says 172.21.15.1:53752) 2024-04-26T07:54:07.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7fe048a9e640 1 -- 172.21.15.1:0/1781339458 learned_addr learned my addr 172.21.15.1:0/1781339458 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:07.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f055f7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f056009a0f0 0x7f056012f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53764/0 (socket says 172.21.15.1:53764) 2024-04-26T07:54:07.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f055f7fe640 1 -- 172.21.15.1:0/3168127936 learned_addr learned my addr 172.21.15.1:0/3168127936 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:07.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f9fabfff640 1 -- 172.21.15.1:0/2769762479 learned_addr learned my addr 172.21.15.1:0/2769762479 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:07.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7f055effd640 1 --2- 172.21.15.1:0/3168127936 >> v2:172.21.15.1:3300/0 conn(0x7f056012f770 0x7f0560134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7feb55186640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7feb50095d70 0x7feb50096190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53778/0 (socket says 172.21.15.1:53778) 2024-04-26T07:54:07.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7feb55186640 1 -- 172.21.15.1:0/305154976 learned_addr learned my addr 172.21.15.1:0/305154976 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:07.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7feb55987640 1 --2- 172.21.15.1:0/305154976 >> v2:172.21.15.1:3300/0 conn(0x7feb50128920 0x7feb50128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7feb57beb640 1 -- 172.21.15.1:0/305154976 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5006da60 con 0x7feb50095d70 2024-04-26T07:54:07.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7feb57beb640 1 -- 172.21.15.1:0/305154976 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7feb50073070 con 0x7feb50128920 2024-04-26T07:54:07.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.784+0000 7fe04929f640 1 --2- 172.21.15.1:0/1781339458 >> v2:172.21.15.1:3300/0 conn(0x7fe044094ed0 0x7fe0440952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7f9fabfff640 1 -- 172.21.15.1:0/2769762479 >> v1:172.21.15.1:6789/0 conn(0x7f9fac094c60 legacy=0x7f9fac095070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7f9fabfff640 1 -- 172.21.15.1:0/2769762479 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fac096cf0 con 0x7f9fac12b6e0 2024-04-26T07:54:07.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7fe03bfff640 1 -- 172.21.15.1:0/1781339458 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417725740 0 0) 0x7fe044096760 con 0x7fe0440957f0 2024-04-26T07:54:07.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7fe03bfff640 1 -- 172.21.15.1:0/1781339458 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe030003520 con 0x7fe0440957f0 2024-04-26T07:54:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7feb55987640 1 -- 172.21.15.1:0/305154976 >> v1:172.21.15.1:6789/0 conn(0x7feb50095d70 legacy=0x7feb50096190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7feb55987640 1 -- 172.21.15.1:0/305154976 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb50129240 con 0x7feb50128920 2024-04-26T07:54:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7f055effd640 1 -- 172.21.15.1:0/3168127936 >> v1:172.21.15.1:6789/0 conn(0x7f056009a0f0 legacy=0x7f056012f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7f055effd640 1 -- 172.21.15.1:0/3168127936 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056012fb80 con 0x7f056012f770 2024-04-26T07:54:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7fe04929f640 1 -- 172.21.15.1:0/1781339458 >> v1:172.21.15.1:6789/0 conn(0x7fe0440957f0 legacy=0x7fe04412b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7fe03bfff640 1 -- 172.21.15.1:0/1781339458 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2786596099 0 0) 0x7fe030003520 con 0x7fe0440957f0 2024-04-26T07:54:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.785+0000 7fe04929f640 1 -- 172.21.15.1:0/1781339458 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe044096d30 con 0x7fe044094ed0 2024-04-26T07:54:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7f9fabfff640 1 --2- 172.21.15.1:0/2769762479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac12b6e0 0x7f9fac12bac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00ba80 tx=0x7f9f9c02deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10f55bcc751e691 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7f9faaffd640 1 -- 172.21.15.1:0/2769762479 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f9c034070 con 0x7f9fac12b6e0 2024-04-26T07:54:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7f9faaffd640 1 -- 172.21.15.1:0/2769762479 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f9c02eb90 con 0x7f9fac12b6e0 2024-04-26T07:54:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7f9faaffd640 1 -- 172.21.15.1:0/2769762479 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f9c038400 con 0x7f9fac12b6e0 2024-04-26T07:54:07.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7feb55987640 1 --2- 172.21.15.1:0/305154976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50128920 0x7feb50128d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009720 tx=0x7feb4c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e48d6bb86f1ada8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7fe04929f640 1 --2- 172.21.15.1:0/1781339458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe0440952b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe040009720 tx=0x7fe04002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2cc23af65714f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7f055effd640 1 --2- 172.21.15.1:0/3168127936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056012f770 0x7f0560134110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0554009720 tx=0x7f055402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75c2912a9ab61c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7feb54985640 1 -- 172.21.15.1:0/305154976 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4c0316d0 con 0x7feb50128920 2024-04-26T07:54:07.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7feb54985640 1 -- 172.21.15.1:0/305154976 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c037070 con 0x7feb50128920 2024-04-26T07:54:07.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7feb54985640 1 -- 172.21.15.1:0/305154976 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4c0319c0 con 0x7feb50128920 2024-04-26T07:54:07.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7fe03bfff640 1 -- 172.21.15.1:0/1781339458 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe040037070 con 0x7fe044094ed0 2024-04-26T07:54:07.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.786+0000 7fe03bfff640 1 -- 172.21.15.1:0/1781339458 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe040030510 con 0x7fe044094ed0 2024-04-26T07:54:07.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7fe03bfff640 1 -- 172.21.15.1:0/1781339458 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0340015a0 con 0x7fe044094ed0 2024-04-26T07:54:07.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f055e7fc640 1 -- 172.21.15.1:0/3168127936 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05540316d0 con 0x7f056012f770 2024-04-26T07:54:07.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f9fb2323640 1 -- 172.21.15.1:0/2769762479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac12b6e0 msgr2=0x7f9fac12bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f9fb2323640 1 --2- 172.21.15.1:0/2769762479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac12b6e0 0x7f9fac12bac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00ba80 tx=0x7f9f9c02deb0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f055e7fc640 1 -- 172.21.15.1:0/3168127936 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0554037070 con 0x7f056012f770 2024-04-26T07:54:07.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f9fb2323640 1 -- 172.21.15.1:0/2769762479 shutdown_connections 2024-04-26T07:54:07.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f9fb2323640 1 --2- 172.21.15.1:0/2769762479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac12b6e0 0x7f9fac12bac0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f9fb2323640 1 -- 172.21.15.1:0/2769762479 >> 172.21.15.1:0/2769762479 conn(0x7f9fac09add0 msgr2=0x7f9fac09b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f055e7fc640 1 -- 172.21.15.1:0/3168127936 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05540316d0 con 0x7f056012f770 2024-04-26T07:54:07.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7feb57beb640 1 -- 172.21.15.1:0/305154976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50128920 msgr2=0x7feb50128d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f9fb2323640 1 -- 172.21.15.1:0/2769762479 shutdown_connections 2024-04-26T07:54:07.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7feb57beb640 1 --2- 172.21.15.1:0/305154976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50128920 0x7feb50128d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009720 tx=0x7feb4c02b840 comp rx=0 tx=0).stop 2024-04-26T07:54:07.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7f9fb2323640 1 -- 172.21.15.1:0/2769762479 wait complete. 2024-04-26T07:54:07.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7feb57beb640 1 -- 172.21.15.1:0/305154976 shutdown_connections 2024-04-26T07:54:07.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7fe04b503640 1 -- 172.21.15.1:0/1781339458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 msgr2=0x7fe0440952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7fe04b503640 1 --2- 172.21.15.1:0/1781339458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe0440952b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe040009720 tx=0x7fe04002b710 comp rx=0 tx=0).stop 2024-04-26T07:54:07.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7feb57beb640 1 --2- 172.21.15.1:0/305154976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50128920 0x7feb50128d00 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009720 tx=0x7feb4c02b840 comp rx=0 tx=0).stop 2024-04-26T07:54:07.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7feb57beb640 1 -- 172.21.15.1:0/305154976 >> 172.21.15.1:0/305154976 conn(0x7feb5009add0 msgr2=0x7feb5009b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7fe04b503640 1 -- 172.21.15.1:0/1781339458 shutdown_connections 2024-04-26T07:54:07.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7fe04b503640 1 --2- 172.21.15.1:0/1781339458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe0440952b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7fe04b503640 1 -- 172.21.15.1:0/1781339458 >> 172.21.15.1:0/1781339458 conn(0x7fe04409add0 msgr2=0x7fe04409b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7fe04b503640 1 -- 172.21.15.1:0/1781339458 shutdown_connections 2024-04-26T07:54:07.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.787+0000 7fe04b503640 1 -- 172.21.15.1:0/1781339458 wait complete. 2024-04-26T07:54:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7f0565b6a640 1 -- 172.21.15.1:0/3168127936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056012f770 msgr2=0x7f0560134110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7f0565b6a640 1 --2- 172.21.15.1:0/3168127936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056012f770 0x7f0560134110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0554009720 tx=0x7f055402b840 comp rx=0 tx=0).stop 2024-04-26T07:54:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7feb57beb640 1 -- 172.21.15.1:0/305154976 shutdown_connections 2024-04-26T07:54:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7f0565b6a640 1 -- 172.21.15.1:0/3168127936 shutdown_connections 2024-04-26T07:54:07.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7f0565b6a640 1 --2- 172.21.15.1:0/3168127936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056012f770 0x7f0560134110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7f0565b6a640 1 -- 172.21.15.1:0/3168127936 >> 172.21.15.1:0/3168127936 conn(0x7f05600a1690 msgr2=0x7f05600a1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7feb57beb640 1 -- 172.21.15.1:0/305154976 wait complete. 2024-04-26T07:54:07.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7f0565b6a640 1 -- 172.21.15.1:0/3168127936 shutdown_connections 2024-04-26T07:54:07.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7f0565b6a640 1 -- 172.21.15.1:0/3168127936 wait complete. 2024-04-26T07:54:07.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7f9fb2323640 1 Processor -- start 2024-04-26T07:54:07.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.788+0000 7fe04b503640 1 Processor -- start 2024-04-26T07:54:07.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7fe04b503640 1 -- start start 2024-04-26T07:54:07.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f9fb2323640 1 -- start start 2024-04-26T07:54:07.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f0565b6a640 1 Processor -- start 2024-04-26T07:54:07.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7feb57beb640 1 Processor -- start 2024-04-26T07:54:07.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7feb57beb640 1 -- start start 2024-04-26T07:54:07.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7fe04b503640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe044133770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7fe04b503640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe0440943d0 con 0x7fe044094ed0 2024-04-26T07:54:07.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f0565b6a640 1 -- start start 2024-04-26T07:54:07.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f9fb2323640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac094c60 0x7f9fac1bf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7fe04929f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe044133770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7fe04929f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe044133770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55882/0 (socket says 172.21.15.1:55882) 2024-04-26T07:54:07.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f9fb2323640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac094620 con 0x7f9fac094c60 2024-04-26T07:54:07.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7fe04929f640 1 -- 172.21.15.1:0/3365501856 learned_addr learned my addr 172.21.15.1:0/3365501856 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f9fabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac094c60 0x7f9fac1bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f9fabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac094c60 0x7f9fac1bf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55890/0 (socket says 172.21.15.1:55890) 2024-04-26T07:54:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7feb57beb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50095d70 0x7feb501c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f9fabfff640 1 -- 172.21.15.1:0/2929751287 learned_addr learned my addr 172.21.15.1:0/2929751287 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:07.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f0565b6a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056009a0f0 0x7f05601c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7f0565b6a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05601349e0 con 0x7f056009a0f0 2024-04-26T07:54:07.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.789+0000 7feb57beb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feb5006d0f0 con 0x7feb50095d70 2024-04-26T07:54:07.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7fe04929f640 1 -- 172.21.15.1:0/3365501856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0440927f0 con 0x7fe044094ed0 2024-04-26T07:54:07.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7feb55987640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50095d70 0x7feb501c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f055f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056009a0f0 0x7f05601c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f9fabfff640 1 -- 172.21.15.1:0/2929751287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fac072340 con 0x7f9fac094c60 2024-04-26T07:54:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f055f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056009a0f0 0x7f05601c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55914/0 (socket says 172.21.15.1:55914) 2024-04-26T07:54:07.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f055f7fe640 1 -- 172.21.15.1:0/3946711611 learned_addr learned my addr 172.21.15.1:0/3946711611 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7feb55987640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50095d70 0x7feb501c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55900/0 (socket says 172.21.15.1:55900) 2024-04-26T07:54:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7feb55987640 1 -- 172.21.15.1:0/438714408 learned_addr learned my addr 172.21.15.1:0/438714408 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f9fabfff640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac094c60 0x7f9fac1bf520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000c00 tx=0x7f9f9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7fe04929f640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe044133770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe040035040 tx=0x7fe0400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f055f7fe640 1 -- 172.21.15.1:0/3946711611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05601337d0 con 0x7f056009a0f0 2024-04-26T07:54:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f9c047020 con 0x7f9fac094c60 2024-04-26T07:54:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7feb55987640 1 -- 172.21.15.1:0/438714408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5008c080 con 0x7feb50095d70 2024-04-26T07:54:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f9fb2323640 1 -- 172.21.15.1:0/2929751287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fac090470 con 0x7f9fac094c60 2024-04-26T07:54:07.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f9c043890 con 0x7f9fac094c60 2024-04-26T07:54:07.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f9c043bb0 con 0x7f9fac094c60 2024-04-26T07:54:07.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe040042020 con 0x7fe044094ed0 2024-04-26T07:54:07.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7f9fb2323640 1 -- 172.21.15.1:0/2929751287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fac1bfa60 con 0x7f9fac094c60 2024-04-26T07:54:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0440923b0 con 0x7fe044094ed0 2024-04-26T07:54:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe040030d90 con 0x7fe044094ed0 2024-04-26T07:54:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.791+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe040037040 con 0x7fe044094ed0 2024-04-26T07:54:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.790+0000 7feb55987640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50095d70 0x7feb501c3f60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb4c02bdd0 tx=0x7feb4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.791+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe044091c40 con 0x7fe044094ed0 2024-04-26T07:54:07.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.791+0000 7f055f7fe640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056009a0f0 0x7f05601c3d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f055000c480 tx=0x7f055000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.791+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4c032770 con 0x7feb50095d70 2024-04-26T07:54:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.791+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9f9c04a020 con 0x7f9fac094c60 2024-04-26T07:54:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.791+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0550017070 con 0x7f056009a0f0 2024-04-26T07:54:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.791+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056009c420 con 0x7f056009a0f0 2024-04-26T07:54:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.791+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5008cd10 con 0x7feb50095d70 2024-04-26T07:54:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb50072040 con 0x7feb50095d70 2024-04-26T07:54:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9fac0636f0 con 0x7f9fac094c60 2024-04-26T07:54:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056006d710 con 0x7f056009a0f0 2024-04-26T07:54:07.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c032910 con 0x7feb50095d70 2024-04-26T07:54:07.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4c032bf0 con 0x7feb50095d70 2024-04-26T07:54:07.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe044092640 con 0x7fe044094ed0 2024-04-26T07:54:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7f9fa8ff9640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9f980385c0 0x7f9f9803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f9f9c070360 con 0x7f9fac094c60 2024-04-26T07:54:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7f9fa8ff9640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7f9f9803dd40 0x7f9f98040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f9c02eb90 con 0x7f9f9803dd40 2024-04-26T07:54:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f9f9c077050 con 0x7f9fac094c60 2024-04-26T07:54:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.792+0000 7f9fab7fe640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9f980385c0 0x7f9f9803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0550005c10 con 0x7f056009a0f0 2024-04-26T07:54:07.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7f9fb08c0640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7f9f9803dd40 0x7f9f98040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05600636f0 con 0x7f056009a0f0 2024-04-26T07:54:07.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7f9fab7fe640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9f980385c0 0x7f9f9803aa80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f60 tx=0x7f9fa0007a30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb50127c00 con 0x7feb50095d70 2024-04-26T07:54:07.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe040045020 con 0x7fe044094ed0 2024-04-26T07:54:07.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7f9fb08c0640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7f9f9803dd40 0x7f9f98040180 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7feb4c04c060 con 0x7feb50095d70 2024-04-26T07:54:07.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0550021060 con 0x7f056009a0f0 2024-04-26T07:54:07.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f055001a070 con 0x7f056009a0f0 2024-04-26T07:54:07.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7fe039ffb640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe028038750 0x7fe02803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fe04006d870 con 0x7fe044094ed0 2024-04-26T07:54:07.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7feb467fc640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feb34038610 0x7feb3403aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7fe039ffb640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe02803ded0 0x7fe028040310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe040030510 con 0x7fe02803ded0 2024-04-26T07:54:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fe04006dc60 con 0x7fe044094ed0 2024-04-26T07:54:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7fe048a9e640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe028038750 0x7fe02803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.793+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7feb4c02f050 con 0x7feb50095d70 2024-04-26T07:54:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f0547fff640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f054c038660 0x7f054c03ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7feb467fc640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7feb3403dd90 0x7feb340401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb4c001d30 con 0x7feb3403dd90 2024-04-26T07:54:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7feb55186640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feb34038610 0x7feb3403aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7feb4c070560 con 0x7feb50095d70 2024-04-26T07:54:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f055004aa70 con 0x7f056009a0f0 2024-04-26T07:54:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7fe049aa0640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe02803ded0 0x7fe028040310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f0547fff640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f054c03dde0 0x7f054c040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f055001eec0 con 0x7f054c03dde0 2024-04-26T07:54:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f055001a360 con 0x7f056009a0f0 2024-04-26T07:54:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f055effd640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f054c038660 0x7f054c03ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7feb56188640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7feb3403dd90 0x7feb340401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f9c02eb90 con 0x7f9f9803dd40 2024-04-26T07:54:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f055ffff640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f054c03dde0 0x7f054c040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7feb55186640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feb34038610 0x7feb3403aad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb40007fd0 tx=0x7feb40007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7fe048a9e640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe028038750 0x7fe02803ac10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe034001710 tx=0x7fe0340010c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7fe049aa0640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe02803ded0 0x7fe028040310 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7feb56188640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7feb3403dd90 0x7feb340401d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f055effd640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f054c038660 0x7f054c03ab20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0554036000 tx=0x7f0554008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.794+0000 7f055ffff640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f054c03dde0 0x7f054c040220 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.795+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe040030510 con 0x7fe02803ded0 2024-04-26T07:54:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.795+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb4c001d30 con 0x7feb3403dd90 2024-04-26T07:54:07.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.796+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f055001eec0 con 0x7f054c03dde0 2024-04-26T07:54:07.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.809+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9fac06b6f0 con 0x7f9f9803dd40 2024-04-26T07:54:07.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9fa8ff9640 1 -- 172.21.15.1:0/2929751287 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9fac06b6f0 con 0x7f9f9803dd40 2024-04-26T07:54:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7f9f9803dd40 msgr2=0x7f9f98040180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7f9f9803dd40 0x7f9f98040180 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb5008d820 con 0x7feb3403dd90 2024-04-26T07:54:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9f980385c0 msgr2=0x7f9f9803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9f980385c0 0x7f9f9803aa80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f60 tx=0x7f9fa0007a30 comp rx=0 tx=0).stop 2024-04-26T07:54:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac094c60 msgr2=0x7f9fac1bf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe0440636f0 con 0x7fe02803ded0 2024-04-26T07:54:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f056006b6f0 con 0x7f054c03dde0 2024-04-26T07:54:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac094c60 0x7f9fac1bf520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000c00 tx=0x7f9f9c0046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 shutdown_connections 2024-04-26T07:54:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7f9f9803dd40 0x7f9f98040180 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9f980385c0 0x7f9f9803aa80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 --2- 172.21.15.1:0/2929751287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fac094c60 0x7f9fac1bf520 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 >> 172.21.15.1:0/2929751287 conn(0x7f9fac09add0 msgr2=0x7f9fac1b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 shutdown_connections 2024-04-26T07:54:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f9f927fc640 1 -- 172.21.15.1:0/2929751287 wait complete. 2024-04-26T07:54:07.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7feb467fc640 1 -- 172.21.15.1:0/438714408 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb5008d820 con 0x7feb3403dd90 2024-04-26T07:54:07.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7f0547fff640 1 -- 172.21.15.1:0/3946711611 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f056006b6f0 con 0x7f054c03dde0 2024-04-26T07:54:07.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.810+0000 7fe039ffb640 1 -- 172.21.15.1:0/3365501856 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe0440636f0 con 0x7fe02803ded0 2024-04-26T07:54:07.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7feb3403dd90 msgr2=0x7feb340401d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7feb3403dd90 0x7feb340401d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f054c03dde0 msgr2=0x7f054c040220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f054c03dde0 0x7f054c040220 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe02803ded0 msgr2=0x7fe028040310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe02803ded0 0x7fe028040310 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feb34038610 msgr2=0x7feb3403aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feb34038610 0x7feb3403aad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb40007fd0 tx=0x7feb40007ac0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50095d70 msgr2=0x7feb501c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50095d70 0x7feb501c3f60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb4c02bdd0 tx=0x7feb4c0046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f054c038660 msgr2=0x7f054c03ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f054c038660 0x7f054c03ab20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0554036000 tx=0x7f0554008030 comp rx=0 tx=0).stop 2024-04-26T07:54:07.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 shutdown_connections 2024-04-26T07:54:07.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7feb3403dd90 0x7feb340401d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feb34038610 0x7feb3403aad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 --2- 172.21.15.1:0/438714408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb50095d70 0x7feb501c3f60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056009a0f0 msgr2=0x7f05601c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056009a0f0 0x7f05601c3d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f055000c480 tx=0x7f055000c940 comp rx=0 tx=0).stop 2024-04-26T07:54:07.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 >> 172.21.15.1:0/438714408 conn(0x7feb5009add0 msgr2=0x7feb50126600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe028038750 msgr2=0x7fe02803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe028038750 0x7fe02803ac10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe034001710 tx=0x7fe0340010c0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 msgr2=0x7fe044133770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:07.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 shutdown_connections 2024-04-26T07:54:07.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 shutdown_connections 2024-04-26T07:54:07.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe044133770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe040035040 tx=0x7fe0400046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 shutdown_connections 2024-04-26T07:54:07.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7feb57beb640 1 -- 172.21.15.1:0/438714408 wait complete. 2024-04-26T07:54:07.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe02803ded0 0x7fe028040310 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe028038750 0x7fe02803ac10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 --2- 172.21.15.1:0/3365501856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe044094ed0 0x7fe044133770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 >> 172.21.15.1:0/3365501856 conn(0x7fe04409add0 msgr2=0x7fe044070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 shutdown_connections 2024-04-26T07:54:07.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7fe04b503640 1 -- 172.21.15.1:0/3365501856 wait complete. 2024-04-26T07:54:07.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f054c03dde0 0x7f054c040220 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f054c038660 0x7f054c03ab20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 --2- 172.21.15.1:0/3946711611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056009a0f0 0x7f05601c3d00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:07.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 >> 172.21.15.1:0/3946711611 conn(0x7f05600a1690 msgr2=0x7f056012e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:07.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.811+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 shutdown_connections 2024-04-26T07:54:07.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.812+0000 7f0565b6a640 1 -- 172.21.15.1:0/3946711611 wait complete. 2024-04-26T07:54:07.849 INFO:teuthology.orchestra.run.smithi001.stdout:38654705668 2024-04-26T07:54:07.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:54:07.850 INFO:teuthology.orchestra.run.smithi001.stdout:38654705668 2024-04-26T07:54:07.850 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:54:07.851 INFO:teuthology.orchestra.run.smithi001.stdout:38654705666 2024-04-26T07:54:07.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:54:07.852 INFO:teuthology.orchestra.run.smithi001.stdout:38654705667 2024-04-26T07:54:07.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:54:07.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.996+0000 7f4824693640 1 Processor -- start 2024-04-26T07:54:07.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.996+0000 7efeeb794640 1 Processor -- start 2024-04-26T07:54:07.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.996+0000 7f4824693640 1 -- start start 2024-04-26T07:54:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.996+0000 7f783a447640 1 Processor -- start 2024-04-26T07:54:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.996+0000 7f783a447640 1 -- start start 2024-04-26T07:54:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.996+0000 7efeeb794640 1 -- start start 2024-04-26T07:54:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f783a447640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f783406f710 0x7f783412bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f783a447640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783409ec90 con 0x7f783412bb70 2024-04-26T07:54:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f783a447640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f7834125e20 con 0x7f783406f710 2024-04-26T07:54:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f8cf0f3d640 1 Processor -- start 2024-04-26T07:54:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f8cf0f3d640 1 -- start start 2024-04-26T07:54:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7efeeb794640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efee4128920 0x7efee4128d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f4824693640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f481c094ed0 0x7f481c0952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7efeeb794640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee406da60 con 0x7efee4095d70 2024-04-26T07:54:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f78337fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f783406f710 0x7f783412bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7efeeb794640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7efee4073070 con 0x7efee4128920 2024-04-26T07:54:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f78337fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f783406f710 0x7f783412bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55930/0 (socket says 172.21.15.1:55930) 2024-04-26T07:54:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f78337fe640 1 -- 172.21.15.1:0/1930196380 learned_addr learned my addr 172.21.15.1:0/1930196380 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7efee9530640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efee4128920 0x7efee4128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7efee9530640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efee4128920 0x7efee4128d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55950/0 (socket says 172.21.15.1:55950) 2024-04-26T07:54:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7efee8d2f640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efee4095d70 0x7efee4096190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53786/0 (socket says 172.21.15.1:53786) 2024-04-26T07:54:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7efee9530640 1 -- 172.21.15.1:0/1687948728 learned_addr learned my addr 172.21.15.1:0/1687948728 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f4824693640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481c096760 con 0x7f481c0957f0 2024-04-26T07:54:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f4824693640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f481c06d310 con 0x7f481c094ed0 2024-04-26T07:54:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f482242f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f481c094ed0 0x7f481c0952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f482242f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f481c094ed0 0x7f481c0952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55936/0 (socket says 172.21.15.1:55936) 2024-04-26T07:54:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.997+0000 7f482242f640 1 -- 172.21.15.1:0/243352133 learned_addr learned my addr 172.21.15.1:0/243352133 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f8cf0f3d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8cec131f50 0x7f8cec134340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f8cf0f3d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cec12b6e0 con 0x7f8cec12bba0 2024-04-26T07:54:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f8cf0f3d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f8cec072770 con 0x7f8cec131f50 2024-04-26T07:54:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f78337fe640 1 -- 172.21.15.1:0/1930196380 >> v1:172.21.15.1:6789/0 conn(0x7f783412bb70 legacy=0x7f783406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f7832ffd640 1 -- 172.21.15.1:0/1930196380 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312138618 0 0) 0x7f783409ec90 con 0x7f783412bb70 2024-04-26T07:54:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7efed7fff640 1 -- 172.21.15.1:0/1687948728 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 177286667 0 0) 0x7efed8001110 con 0x7efee4095d70 2024-04-26T07:54:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7efed7fff640 1 -- 172.21.15.1:0/1687948728 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efed0005730 con 0x7efee4095d70 2024-04-26T07:54:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f78337fe640 1 -- 172.21.15.1:0/1930196380 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783412b950 con 0x7f783406f710 2024-04-26T07:54:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7efee9530640 1 -- 172.21.15.1:0/1687948728 >> v1:172.21.15.1:6789/0 conn(0x7efee4095d70 legacy=0x7efee4096190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7efee9530640 1 -- 172.21.15.1:0/1687948728 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee4129240 con 0x7efee4128920 2024-04-26T07:54:08.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f482242f640 1 -- 172.21.15.1:0/243352133 >> v1:172.21.15.1:6789/0 conn(0x7f481c0957f0 legacy=0x7f481c12b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f482242f640 1 -- 172.21.15.1:0/243352133 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c096d30 con 0x7f481c094ed0 2024-04-26T07:54:08.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f8ce3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8cec131f50 0x7f8cec134340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f8ce3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8cec131f50 0x7f8cec134340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55960/0 (socket says 172.21.15.1:55960) 2024-04-26T07:54:08.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f8ce3fff640 1 -- 172.21.15.1:0/2400252631 learned_addr learned my addr 172.21.15.1:0/2400252631 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:08.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f8ce3fff640 1 -- 172.21.15.1:0/2400252631 >> v1:172.21.15.1:6789/0 conn(0x7f8cec12bba0 legacy=0x7f8cec12bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.998+0000 7f8ce3fff640 1 -- 172.21.15.1:0/2400252631 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec12b980 con 0x7f8cec131f50 2024-04-26T07:54:08.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7f78337fe640 1 --2- 172.21.15.1:0/1930196380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f783412bf50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f78280097f0 tx=0x7f782802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618f76519d059460 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7f7832ffd640 1 -- 172.21.15.1:0/1930196380 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7828035020 con 0x7f783406f710 2024-04-26T07:54:08.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7efee9530640 1 --2- 172.21.15.1:0/1687948728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4128920 0x7efee4128d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efee00097f0 tx=0x7efee002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db9c37506b9bbbd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7f7832ffd640 1 -- 172.21.15.1:0/1930196380 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78280317a0 con 0x7f783406f710 2024-04-26T07:54:08.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7f7832ffd640 1 -- 172.21.15.1:0/1930196380 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7828031aa0 con 0x7f783406f710 2024-04-26T07:54:08.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7f482242f640 1 --2- 172.21.15.1:0/243352133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c0952b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4818009cc0 tx=0x7f481802cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5679b08f44c3976 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7efed7fff640 1 -- 172.21.15.1:0/1687948728 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee002e070 con 0x7efee4128920 2024-04-26T07:54:08.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7efed7fff640 1 -- 172.21.15.1:0/1687948728 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee0037070 con 0x7efee4128920 2024-04-26T07:54:08.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:07.999+0000 7efed7fff640 1 -- 172.21.15.1:0/1687948728 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee0031730 con 0x7efee4128920 2024-04-26T07:54:08.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f8ce3fff640 1 --2- 172.21.15.1:0/2400252631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec131f50 0x7f8cec134340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40097f0 tx=0x7f8cd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abefcac568166b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f482142d640 1 -- 172.21.15.1:0/243352133 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481802d990 con 0x7f481c094ed0 2024-04-26T07:54:08.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f783a447640 1 -- 172.21.15.1:0/1930196380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 msgr2=0x7f783412bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f783a447640 1 --2- 172.21.15.1:0/1930196380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f783412bf50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f78280097f0 tx=0x7f782802b910 comp rx=0 tx=0).stop 2024-04-26T07:54:08.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f482142d640 1 -- 172.21.15.1:0/243352133 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481802db30 con 0x7f481c094ed0 2024-04-26T07:54:08.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f8ce9d9b640 1 -- 172.21.15.1:0/2400252631 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4035020 con 0x7f8cec131f50 2024-04-26T07:54:08.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f482142d640 1 -- 172.21.15.1:0/243352133 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481802de30 con 0x7f481c094ed0 2024-04-26T07:54:08.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f8ce9d9b640 1 -- 172.21.15.1:0/2400252631 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd40317a0 con 0x7f8cec131f50 2024-04-26T07:54:08.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f8ce9d9b640 1 -- 172.21.15.1:0/2400252631 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4031aa0 con 0x7f8cec131f50 2024-04-26T07:54:08.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f783a447640 1 -- 172.21.15.1:0/1930196380 shutdown_connections 2024-04-26T07:54:08.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f783a447640 1 --2- 172.21.15.1:0/1930196380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f783412bf50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f783a447640 1 -- 172.21.15.1:0/1930196380 >> 172.21.15.1:0/1930196380 conn(0x7f783409d1e0 msgr2=0x7f78340721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:08.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7efeeb794640 1 -- 172.21.15.1:0/1687948728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4128920 msgr2=0x7efee4128d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7efeeb794640 1 --2- 172.21.15.1:0/1687948728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4128920 0x7efee4128d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efee00097f0 tx=0x7efee002b880 comp rx=0 tx=0).stop 2024-04-26T07:54:08.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f783a447640 1 -- 172.21.15.1:0/1930196380 shutdown_connections 2024-04-26T07:54:08.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7efeeb794640 1 -- 172.21.15.1:0/1687948728 shutdown_connections 2024-04-26T07:54:08.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7efeeb794640 1 --2- 172.21.15.1:0/1687948728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4128920 0x7efee4128d00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7efeeb794640 1 -- 172.21.15.1:0/1687948728 >> 172.21.15.1:0/1687948728 conn(0x7efee409add0 msgr2=0x7efee409b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:08.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7f783a447640 1 -- 172.21.15.1:0/1930196380 wait complete. 2024-04-26T07:54:08.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7efeeb794640 1 -- 172.21.15.1:0/1687948728 shutdown_connections 2024-04-26T07:54:08.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.000+0000 7efeeb794640 1 -- 172.21.15.1:0/1687948728 wait complete. 2024-04-26T07:54:08.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/2400252631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec131f50 msgr2=0x7f8cec134340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f8cf0f3d640 1 --2- 172.21.15.1:0/2400252631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec131f50 0x7f8cec134340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40097f0 tx=0x7f8cd402b910 comp rx=0 tx=0).stop 2024-04-26T07:54:08.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/2400252631 shutdown_connections 2024-04-26T07:54:08.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f8cf0f3d640 1 --2- 172.21.15.1:0/2400252631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec131f50 0x7f8cec134340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/2400252631 >> 172.21.15.1:0/2400252631 conn(0x7f8cec09e1a0 msgr2=0x7f8cec09e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:08.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f4824693640 1 -- 172.21.15.1:0/243352133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 msgr2=0x7f481c0952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f4824693640 1 --2- 172.21.15.1:0/243352133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c0952b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4818009cc0 tx=0x7f481802cff0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/2400252631 shutdown_connections 2024-04-26T07:54:08.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/2400252631 wait complete. 2024-04-26T07:54:08.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f4824693640 1 -- 172.21.15.1:0/243352133 shutdown_connections 2024-04-26T07:54:08.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f4824693640 1 --2- 172.21.15.1:0/243352133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c0952b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f4824693640 1 -- 172.21.15.1:0/243352133 >> 172.21.15.1:0/243352133 conn(0x7f481c09add0 msgr2=0x7f481c09b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:08.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f4824693640 1 -- 172.21.15.1:0/243352133 shutdown_connections 2024-04-26T07:54:08.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f4824693640 1 -- 172.21.15.1:0/243352133 wait complete. 2024-04-26T07:54:08.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f783a447640 1 Processor -- start 2024-04-26T07:54:08.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7f783a447640 1 -- start start 2024-04-26T07:54:08.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.001+0000 7efeeb794640 1 Processor -- start 2024-04-26T07:54:08.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7efeeb794640 1 -- start start 2024-04-26T07:54:08.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f783a447640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f78341b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f8cf0f3d640 1 Processor -- start 2024-04-26T07:54:08.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7efeeb794640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4095d70 0x7efee408e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7efeeb794640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efee406d0f0 con 0x7efee4095d70 2024-04-26T07:54:08.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f4824693640 1 Processor -- start 2024-04-26T07:54:08.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f7833fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f78341b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f7833fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f78341b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55962/0 (socket says 172.21.15.1:55962) 2024-04-26T07:54:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f7833fff640 1 -- 172.21.15.1:0/2835429046 learned_addr learned my addr 172.21.15.1:0/2835429046 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f783a447640 1 -- 172.21.15.1:0/2835429046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f783412c490 con 0x7f783406f710 2024-04-26T07:54:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f8cf0f3d640 1 -- start start 2024-04-26T07:54:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7f4824693640 1 -- start start 2024-04-26T07:54:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7efee9530640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4095d70 0x7efee408e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7efee9530640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4095d70 0x7efee408e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55968/0 (socket says 172.21.15.1:55968) 2024-04-26T07:54:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.002+0000 7efee9530640 1 -- 172.21.15.1:0/1912682080 learned_addr learned my addr 172.21.15.1:0/1912682080 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f4824693640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c1bc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f4824693640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f481c0943d0 con 0x7f481c094ed0 2024-04-26T07:54:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f7833fff640 1 -- 172.21.15.1:0/2835429046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78341b6370 con 0x7f783406f710 2024-04-26T07:54:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f8cf0f3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec12bba0 0x7f8cec123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f8cf0f3d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec134a00 con 0x7f8cec12bba0 2024-04-26T07:54:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f482242f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c1bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f482242f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c1bc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55990/0 (socket says 172.21.15.1:55990) 2024-04-26T07:54:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f8cea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec12bba0 0x7f8cec123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f8cea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec12bba0 0x7f8cec123080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55976/0 (socket says 172.21.15.1:55976) 2024-04-26T07:54:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f8cea59c640 1 -- 172.21.15.1:0/682153006 learned_addr learned my addr 172.21.15.1:0/682153006 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7efee9530640 1 -- 172.21.15.1:0/1912682080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee408fe90 con 0x7efee4095d70 2024-04-26T07:54:08.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7efee9530640 1 --2- 172.21.15.1:0/1912682080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4095d70 0x7efee408e4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efee002b8c0 tx=0x7efee00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f482242f640 1 -- 172.21.15.1:0/1278821396 learned_addr learned my addr 172.21.15.1:0/1278821396 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:08.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f7833fff640 1 --2- 172.21.15.1:0/2835429046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f78341b2a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f782400c430 tx=0x7f782400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f8cea59c640 1 -- 172.21.15.1:0/682153006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec124290 con 0x7f8cec12bba0 2024-04-26T07:54:08.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7efed5ffb640 1 -- 172.21.15.1:0/1912682080 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee00325a0 con 0x7efee4095d70 2024-04-26T07:54:08.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7efed5ffb640 1 -- 172.21.15.1:0/1912682080 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee0032740 con 0x7efee4095d70 2024-04-26T07:54:08.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7efed5ffb640 1 -- 172.21.15.1:0/1912682080 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee0032a20 con 0x7efee4095d70 2024-04-26T07:54:08.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee4090560 con 0x7efee4095d70 2024-04-26T07:54:08.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f7830ff9640 1 -- 172.21.15.1:0/2835429046 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7824017070 con 0x7f783406f710 2024-04-26T07:54:08.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f7830ff9640 1 -- 172.21.15.1:0/2835429046 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78240053b0 con 0x7f783406f710 2024-04-26T07:54:08.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee4091520 con 0x7efee4095d70 2024-04-26T07:54:08.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7f482242f640 1 -- 172.21.15.1:0/1278821396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c093570 con 0x7f481c094ed0 2024-04-26T07:54:08.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.003+0000 7f8cea59c640 1 --2- 172.21.15.1:0/682153006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec12bba0 0x7f8cec123080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00c450 tx=0x7f8cdc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7f7830ff9640 1 -- 172.21.15.1:0/2835429046 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7824003760 con 0x7f783406f710 2024-04-26T07:54:08.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7f783a447640 1 -- 172.21.15.1:0/2835429046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78341b5d50 con 0x7f783406f710 2024-04-26T07:54:08.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7f783a447640 1 -- 172.21.15.1:0/2835429046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78341b6060 con 0x7f783406f710 2024-04-26T07:54:08.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7f482242f640 1 --2- 172.21.15.1:0/1278821396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c1bc230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4818009cc0 tx=0x7f4818004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7f8ce2ffd640 1 -- 172.21.15.1:0/682153006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc017070 con 0x7f8cec12bba0 2024-04-26T07:54:08.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7f8ce2ffd640 1 -- 172.21.15.1:0/682153006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc005200 con 0x7f8cec12bba0 2024-04-26T07:54:08.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.004+0000 7f8ce2ffd640 1 -- 172.21.15.1:0/682153006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc017070 con 0x7f8cec12bba0 2024-04-26T07:54:08.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cec12e740 con 0x7f8cec12bba0 2024-04-26T07:54:08.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cec1235c0 con 0x7f8cec12bba0 2024-04-26T07:54:08.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7efed5ffb640 1 -- 172.21.15.1:0/1912682080 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7efee0032bc0 con 0x7efee4095d70 2024-04-26T07:54:08.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7f4812ffd640 1 -- 172.21.15.1:0/1278821396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4818044020 con 0x7f481c094ed0 2024-04-26T07:54:08.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481c091cd0 con 0x7f481c094ed0 2024-04-26T07:54:08.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f481c1bc770 con 0x7f481c094ed0 2024-04-26T07:54:08.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7efed5ffb640 1 --2- 172.21.15.1:0/1912682080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7efec80385c0 0x7efec803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee40636f0 con 0x7efee4095d70 2024-04-26T07:54:08.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7efed5ffb640 1 -- 172.21.15.1:0/1912682080 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7efee006d300 con 0x7efee4095d70 2024-04-26T07:54:08.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f7830ff9640 1 -- 172.21.15.1:0/2835429046 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f782401a070 con 0x7f783406f710 2024-04-26T07:54:08.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f781a7fc640 1 -- 172.21.15.1:0/2835429046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78340636f0 con 0x7f783406f710 2024-04-26T07:54:08.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.005+0000 7f4812ffd640 1 -- 172.21.15.1:0/1278821396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481802da90 con 0x7f481c094ed0 2024-04-26T07:54:08.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f4812ffd640 1 -- 172.21.15.1:0/1278821396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4818044020 con 0x7f481c094ed0 2024-04-26T07:54:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cec0636f0 con 0x7f8cec12bba0 2024-04-26T07:54:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f8ce2ffd640 1 -- 172.21.15.1:0/682153006 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8cdc01a070 con 0x7f8cec12bba0 2024-04-26T07:54:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7efee8d2f640 1 --2- 172.21.15.1:0/1912682080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7efec80385c0 0x7efec803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f7830ff9640 1 --2- 172.21.15.1:0/2835429046 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7820038610 0x7f782003aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f7830ff9640 1 -- 172.21.15.1:0/2835429046 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f782404aa00 con 0x7f783406f710 2024-04-26T07:54:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f78337fe640 1 --2- 172.21.15.1:0/2835429046 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7820038610 0x7f782003aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f8ce2ffd640 1 --2- 172.21.15.1:0/682153006 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8ccc038950 0x7f8ccc03ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4804005080 con 0x7f481c094ed0 2024-04-26T07:54:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.006+0000 7f8ce2ffd640 1 -- 172.21.15.1:0/682153006 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f8cdc011de0 con 0x7f8cec12bba0 2024-04-26T07:54:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.007+0000 7f8ce3fff640 1 --2- 172.21.15.1:0/682153006 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8ccc038950 0x7f8ccc03ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.007+0000 7efee8d2f640 1 --2- 172.21.15.1:0/1912682080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7efec80385c0 0x7efec803aa80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efed80015d0 tx=0x7efed8007890 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.007+0000 7f4812ffd640 1 -- 172.21.15.1:0/1278821396 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4818047020 con 0x7f481c094ed0 2024-04-26T07:54:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.007+0000 7f78337fe640 1 --2- 172.21.15.1:0/2835429046 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7820038610 0x7f782003aad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78280097f0 tx=0x7f7828008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.007+0000 7f4812ffd640 1 --2- 172.21.15.1:0/1278821396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f480003ab10 0x7f480003cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.007+0000 7f8ce3fff640 1 --2- 172.21.15.1:0/682153006 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8ccc038950 0x7f8ccc03ae10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4036000 tx=0x7f8cd4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.007+0000 7f4821c2e640 1 --2- 172.21.15.1:0/1278821396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f480003ab10 0x7f480003cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.008+0000 7f4821c2e640 1 --2- 172.21.15.1:0/1278821396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f480003ab10 0x7f480003cfd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f481c095c40 tx=0x7f480c0079d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.011+0000 7f4812ffd640 1 -- 172.21.15.1:0/1278821396 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f481803b040 con 0x7f481c094ed0 2024-04-26T07:54:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.011+0000 7efed5ffb640 1 -- 172.21.15.1:0/1912682080 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efee0040070 con 0x7efee4095d70 2024-04-26T07:54:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.020+0000 7f7830ff9640 1 -- 172.21.15.1:0/2835429046 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f782401a970 con 0x7f783406f710 2024-04-26T07:54:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.029+0000 7f8ce2ffd640 1 -- 172.21.15.1:0/682153006 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8cdc01a360 con 0x7f8cec12bba0 2024-04-26T07:54:08.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.038+0000 7f4812ffd640 1 -- 172.21.15.1:0/1278821396 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f481804e070 con 0x7f481c094ed0 2024-04-26T07:54:08.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.216+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efee4099030 con 0x7efee4095d70 2024-04-26T07:54:08.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.216+0000 7efed5ffb640 1 -- 172.21.15.1:0/1912682080 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efee003b3f0 con 0x7efee4095d70 2024-04-26T07:54:08.214 INFO:teuthology.orchestra.run.smithi001.stdout:38654705667 2024-04-26T07:54:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.218+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7efec80385c0 msgr2=0x7efec803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.218+0000 7efeeb794640 1 --2- 172.21.15.1:0/1912682080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7efec80385c0 0x7efec803aa80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efed80015d0 tx=0x7efed8007890 comp rx=0 tx=0).stop 2024-04-26T07:54:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.218+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4095d70 msgr2=0x7efee408e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.218+0000 7efeeb794640 1 --2- 172.21.15.1:0/1912682080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4095d70 0x7efee408e4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efee002b8c0 tx=0x7efee00046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.218+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 shutdown_connections 2024-04-26T07:54:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.218+0000 7efeeb794640 1 --2- 172.21.15.1:0/1912682080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7efec80385c0 0x7efec803aa80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.218+0000 7efeeb794640 1 --2- 172.21.15.1:0/1912682080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efee4095d70 0x7efee408e4f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.218+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 >> 172.21.15.1:0/1912682080 conn(0x7efee409add0 msgr2=0x7efee4121f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:08.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.219+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 shutdown_connections 2024-04-26T07:54:08.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.219+0000 7efeeb794640 1 -- 172.21.15.1:0/1912682080 wait complete. 2024-04-26T07:54:08.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2024-04-26T07:54:08.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.229+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4804005370 con 0x7f481c094ed0 2024-04-26T07:54:08.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.229+0000 7f4812ffd640 1 -- 172.21.15.1:0/1278821396 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f481806cb80 con 0x7f481c094ed0 2024-04-26T07:54:08.229 INFO:teuthology.orchestra.run.smithi001.stdout:38654705666 2024-04-26T07:54:08.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f480003ab10 msgr2=0x7f480003cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 --2- 172.21.15.1:0/1278821396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f480003ab10 0x7f480003cfd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f481c095c40 tx=0x7f480c0079d0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 msgr2=0x7f481c1bc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 --2- 172.21.15.1:0/1278821396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c1bc230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4818009cc0 tx=0x7f4818004a40 comp rx=0 tx=0).stop 2024-04-26T07:54:08.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 shutdown_connections 2024-04-26T07:54:08.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 --2- 172.21.15.1:0/1278821396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f480003ab10 0x7f480003cfd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 --2- 172.21.15.1:0/1278821396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c094ed0 0x7f481c1bc230 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 >> 172.21.15.1:0/1278821396 conn(0x7f481c09add0 msgr2=0x7f481c1b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:08.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 shutdown_connections 2024-04-26T07:54:08.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.232+0000 7f4824693640 1 -- 172.21.15.1:0/1278821396 wait complete. 2024-04-26T07:54:08.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.3 2024-04-26T07:54:08.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.267+0000 7f781a7fc640 1 -- 172.21.15.1:0/2835429046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f783406b6f0 con 0x7f783406f710 2024-04-26T07:54:08.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.267+0000 7f7830ff9640 1 -- 172.21.15.1:0/2835429046 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7824049850 con 0x7f783406f710 2024-04-26T07:54:08.266 INFO:teuthology.orchestra.run.smithi001.stdout:38654705665 2024-04-26T07:54:08.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 -- 172.21.15.1:0/2835429046 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7820038610 msgr2=0x7f782003aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 --2- 172.21.15.1:0/2835429046 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7820038610 0x7f782003aad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78280097f0 tx=0x7f7828008030 comp rx=0 tx=0).stop 2024-04-26T07:54:08.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 -- 172.21.15.1:0/2835429046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 msgr2=0x7f78341b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 --2- 172.21.15.1:0/2835429046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f78341b2a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f782400c430 tx=0x7f782400c8f0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 -- 172.21.15.1:0/2835429046 shutdown_connections 2024-04-26T07:54:08.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 --2- 172.21.15.1:0/2835429046 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7820038610 0x7f782003aad0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 --2- 172.21.15.1:0/2835429046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f783406f710 0x7f78341b2a70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 -- 172.21.15.1:0/2835429046 >> 172.21.15.1:0/2835429046 conn(0x7f783409d1e0 msgr2=0x7f783409bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:08.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 -- 172.21.15.1:0/2835429046 shutdown_connections 2024-04-26T07:54:08.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.269+0000 7f781a7fc640 1 -- 172.21.15.1:0/2835429046 wait complete. 2024-04-26T07:54:08.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.274+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8cec124a00 con 0x7f8cec12bba0 2024-04-26T07:54:08.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.274+0000 7f8ce2ffd640 1 -- 172.21.15.1:0/682153006 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8cdc0192c0 con 0x7f8cec12bba0 2024-04-26T07:54:08.273 INFO:teuthology.orchestra.run.smithi001.stdout:38654705667 2024-04-26T07:54:08.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8ccc038950 msgr2=0x7f8ccc03ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 --2- 172.21.15.1:0/682153006 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8ccc038950 0x7f8ccc03ae10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4036000 tx=0x7f8cd4008030 comp rx=0 tx=0).stop 2024-04-26T07:54:08.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec12bba0 msgr2=0x7f8cec123080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:08.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 --2- 172.21.15.1:0/682153006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec12bba0 0x7f8cec123080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00c450 tx=0x7f8cdc00c910 comp rx=0 tx=0).stop 2024-04-26T07:54:08.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 shutdown_connections 2024-04-26T07:54:08.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 --2- 172.21.15.1:0/682153006 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8ccc038950 0x7f8ccc03ae10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 --2- 172.21.15.1:0/682153006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cec12bba0 0x7f8cec123080 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:08.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 >> 172.21.15.1:0/682153006 conn(0x7f8cec09e1a0 msgr2=0x7f8cec096bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:08.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 shutdown_connections 2024-04-26T07:54:08.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:08.276+0000 7f8cf0f3d640 1 -- 172.21.15.1:0/682153006 wait complete. 2024-04-26T07:54:08.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.2 2024-04-26T07:54:08.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-04-26T07:54:09.229 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:54:09.242 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:54:09.279 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:54:09.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:54:09.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.347+0000 7fb4afc62640 1 Processor -- start 2024-04-26T07:54:09.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.347+0000 7fb4afc62640 1 -- start start 2024-04-26T07:54:09.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.348+0000 7fb4afc62640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb4a812eba0 0x7fb4a8130f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.348+0000 7fb4afc62640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a806da60 con 0x7fb4a8128920 2024-04-26T07:54:09.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.348+0000 7fb4afc62640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a8073070 con 0x7fb4a812eba0 2024-04-26T07:54:09.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.348+0000 7fb4ad1fd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb4a812eba0 0x7fb4a8130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.348+0000 7fb4ad9fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb4a8128920 0x7fb4a8128d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53822/0 (socket says 172.21.15.1:53822) 2024-04-26T07:54:09.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.348+0000 7fb4ad9fe640 1 -- 172.21.15.1:0/2506228697 learned_addr learned my addr 172.21.15.1:0/2506228697 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:09.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.348+0000 7fb4ad1fd640 1 -- 172.21.15.1:0/2506228697 >> v1:172.21.15.1:6789/0 conn(0x7fb4a8128920 legacy=0x7fb4a8128d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.348+0000 7fb4ad1fd640 1 -- 172.21.15.1:0/2506228697 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a8094640 con 0x7fb4a812eba0 2024-04-26T07:54:09.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.349+0000 7fb4ad1fd640 1 --2- 172.21.15.1:0/2506228697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a812eba0 0x7fb4a8130f90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb498009720 tx=0x7fb49802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f242bb00acff1a47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.350+0000 7fb4ac9fc640 1 -- 172.21.15.1:0/2506228697 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4980316d0 con 0x7fb4a812eba0 2024-04-26T07:54:09.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.350+0000 7fb4ac9fc640 1 -- 172.21.15.1:0/2506228697 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb498037070 con 0x7fb4a812eba0 2024-04-26T07:54:09.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.350+0000 7fb4ac9fc640 1 -- 172.21.15.1:0/2506228697 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4980319c0 con 0x7fb4a812eba0 2024-04-26T07:54:09.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.351+0000 7fb4afc62640 1 -- 172.21.15.1:0/2506228697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a812eba0 msgr2=0x7fb4a8130f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.351+0000 7fb4afc62640 1 --2- 172.21.15.1:0/2506228697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a812eba0 0x7fb4a8130f90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb498009720 tx=0x7fb49802b840 comp rx=0 tx=0).stop 2024-04-26T07:54:09.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.351+0000 7fb4afc62640 1 -- 172.21.15.1:0/2506228697 shutdown_connections 2024-04-26T07:54:09.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.351+0000 7fb4afc62640 1 --2- 172.21.15.1:0/2506228697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a812eba0 0x7fb4a8130f90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.351+0000 7fb4afc62640 1 -- 172.21.15.1:0/2506228697 >> 172.21.15.1:0/2506228697 conn(0x7fb4a809add0 msgr2=0x7fb4a809b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.351+0000 7fb4afc62640 1 -- 172.21.15.1:0/2506228697 shutdown_connections 2024-04-26T07:54:09.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.351+0000 7fb4afc62640 1 -- 172.21.15.1:0/2506228697 wait complete. 2024-04-26T07:54:09.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.352+0000 7fb4afc62640 1 Processor -- start 2024-04-26T07:54:09.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.352+0000 7fb4afc62640 1 -- start start 2024-04-26T07:54:09.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.353+0000 7fb4afc62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a8128920 0x7fb4a8094c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.353+0000 7fb4afc62640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a806d620 con 0x7fb4a8128920 2024-04-26T07:54:09.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.353+0000 7fb4ad9fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a8128920 0x7fb4a8094c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.353+0000 7fb4ad9fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a8128920 0x7fb4a8094c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55996/0 (socket says 172.21.15.1:55996) 2024-04-26T07:54:09.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.353+0000 7fb4ad9fe640 1 -- 172.21.15.1:0/3821371486 learned_addr learned my addr 172.21.15.1:0/3821371486 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:09.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.354+0000 7fb4ad9fe640 1 -- 172.21.15.1:0/3821371486 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a80723f0 con 0x7fb4a8128920 2024-04-26T07:54:09.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.354+0000 7fb4ad9fe640 1 --2- 172.21.15.1:0/3821371486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a8128920 0x7fb4a8094c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400c4a0 tx=0x7fb4a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.354+0000 7fb49e7fc640 1 -- 172.21.15.1:0/3821371486 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4017070 con 0x7fb4a8128920 2024-04-26T07:54:09.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.354+0000 7fb49e7fc640 1 -- 172.21.15.1:0/3821371486 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a4005c10 con 0x7fb4a8128920 2024-04-26T07:54:09.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.354+0000 7fb49e7fc640 1 -- 172.21.15.1:0/3821371486 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4007070 con 0x7fb4a8128920 2024-04-26T07:54:09.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.354+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a8127390 con 0x7fb4a8128920 2024-04-26T07:54:09.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.354+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a812bb60 con 0x7fb4a8128920 2024-04-26T07:54:09.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.356+0000 7fb49e7fc640 1 -- 172.21.15.1:0/3821371486 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb4a401a070 con 0x7fb4a8128920 2024-04-26T07:54:09.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.355+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a80636f0 con 0x7fb4a8128920 2024-04-26T07:54:09.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.356+0000 7fb49e7fc640 1 --2- 172.21.15.1:0/3821371486 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb48c0385c0 0x7fb48c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.356+0000 7fb49e7fc640 1 -- 172.21.15.1:0/3821371486 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fb4a404a7e0 con 0x7fb4a8128920 2024-04-26T07:54:09.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.356+0000 7fb4ad1fd640 1 --2- 172.21.15.1:0/3821371486 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb48c0385c0 0x7fb48c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.357+0000 7fb4ad1fd640 1 --2- 172.21.15.1:0/3821371486 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb48c0385c0 0x7fb48c03aa80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb498036000 tx=0x7fb498008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.361+0000 7fb49e7fc640 1 -- 172.21.15.1:0/3821371486 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4a806da60 con 0x7fb4a8128920 2024-04-26T07:54:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.388+0000 7f5b348a6640 1 Processor -- start 2024-04-26T07:54:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.388+0000 7f5b348a6640 1 -- start start 2024-04-26T07:54:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.388+0000 7f5b348a6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5b3012b880 0x7f5b3012bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.389+0000 7f5b348a6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3009a780 con 0x7f5b3012c1a0 2024-04-26T07:54:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.389+0000 7f5b348a6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f5b3009a9c0 con 0x7f5b3012b880 2024-04-26T07:54:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.389+0000 7f5b2e59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5b3012b880 0x7f5b3012bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.389+0000 7f5b2e59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5b3012b880 0x7f5b3012bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56004/0 (socket says 172.21.15.1:56004) 2024-04-26T07:54:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.389+0000 7f5b2e59c640 1 -- 172.21.15.1:0/1144764272 learned_addr learned my addr 172.21.15.1:0/1144764272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.389+0000 7f5b2e59c640 1 -- 172.21.15.1:0/1144764272 >> v1:172.21.15.1:6789/0 conn(0x7f5b3012c1a0 legacy=0x7f5b3012ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.389+0000 7f5b2e59c640 1 -- 172.21.15.1:0/1144764272 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3009b750 con 0x7f5b3012b880 2024-04-26T07:54:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.390+0000 7f5b2e59c640 1 --2- 172.21.15.1:0/1144764272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3012bc60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b200097f0 tx=0x7f5b2002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcffe13dd23d491a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.390+0000 7f5b2d59a640 1 -- 172.21.15.1:0/1144764272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b20034070 con 0x7f5b3012b880 2024-04-26T07:54:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.390+0000 7f5b2d59a640 1 -- 172.21.15.1:0/1144764272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b20030790 con 0x7f5b3012b880 2024-04-26T07:54:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.390+0000 7f5b2d59a640 1 -- 172.21.15.1:0/1144764272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b20030a90 con 0x7f5b3012b880 2024-04-26T07:54:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.391+0000 7f5b348a6640 1 -- 172.21.15.1:0/1144764272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 msgr2=0x7f5b3012bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.391+0000 7f5b348a6640 1 --2- 172.21.15.1:0/1144764272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3012bc60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b200097f0 tx=0x7f5b2002b9a0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.391+0000 7f5b348a6640 1 -- 172.21.15.1:0/1144764272 shutdown_connections 2024-04-26T07:54:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.391+0000 7f5b348a6640 1 --2- 172.21.15.1:0/1144764272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3012bc60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.391+0000 7f5b348a6640 1 -- 172.21.15.1:0/1144764272 >> 172.21.15.1:0/1144764272 conn(0x7f5b300a1700 msgr2=0x7f5b300a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.391+0000 7f5b348a6640 1 -- 172.21.15.1:0/1144764272 shutdown_connections 2024-04-26T07:54:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.391+0000 7f5b348a6640 1 -- 172.21.15.1:0/1144764272 wait complete. 2024-04-26T07:54:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.392+0000 7f5b348a6640 1 Processor -- start 2024-04-26T07:54:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.392+0000 7f5b348a6640 1 -- start start 2024-04-26T07:54:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.393+0000 7f5b348a6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3006d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.393+0000 7f5b348a6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3009b0b0 con 0x7f5b3012b880 2024-04-26T07:54:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.393+0000 7f5b2e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.393+0000 7f5b2e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3006d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56016/0 (socket says 172.21.15.1:56016) 2024-04-26T07:54:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.393+0000 7f5b2e59c640 1 -- 172.21.15.1:0/3921986608 learned_addr learned my addr 172.21.15.1:0/3921986608 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.393+0000 7f5b2e59c640 1 -- 172.21.15.1:0/3921986608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3006f5b0 con 0x7f5b3012b880 2024-04-26T07:54:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.393+0000 7f5b2e59c640 1 --2- 172.21.15.1:0/3921986608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3006d080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b200097f0 tx=0x7f5b20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.394+0000 7f5b1effd640 1 -- 172.21.15.1:0/3921986608 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b20048070 con 0x7f5b3012b880 2024-04-26T07:54:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.394+0000 7f5b1effd640 1 -- 172.21.15.1:0/3921986608 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b20039ce0 con 0x7f5b3012b880 2024-04-26T07:54:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.394+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b301b7a90 con 0x7f5b3012b880 2024-04-26T07:54:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.394+0000 7f5b1effd640 1 -- 172.21.15.1:0/3921986608 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b20034040 con 0x7f5b3012b880 2024-04-26T07:54:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.394+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b3006d5c0 con 0x7f5b3012b880 2024-04-26T07:54:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.395+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b3009d630 con 0x7f5b3012b880 2024-04-26T07:54:09.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.395+0000 7f5b1effd640 1 -- 172.21.15.1:0/3921986608 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5b2004b070 con 0x7f5b3012b880 2024-04-26T07:54:09.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.395+0000 7f5b1effd640 1 --2- 172.21.15.1:0/3921986608 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5b100385c0 0x7f5b1003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.395+0000 7f5b1effd640 1 -- 172.21.15.1:0/3921986608 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f5b20040050 con 0x7f5b3012b880 2024-04-26T07:54:09.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.396+0000 7f5b2dd9b640 1 --2- 172.21.15.1:0/3921986608 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5b100385c0 0x7f5b1003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.396+0000 7f5b2dd9b640 1 --2- 172.21.15.1:0/3921986608 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5b100385c0 0x7f5b1003aa80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b24000f60 tx=0x7f5b24007a30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.400+0000 7f5b1effd640 1 -- 172.21.15.1:0/3921986608 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b3009d630 con 0x7f5b3012b880 2024-04-26T07:54:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.426+0000 7feaf0c43640 1 Processor -- start 2024-04-26T07:54:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.426+0000 7feaf0c43640 1 -- start start 2024-04-26T07:54:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.427+0000 7feaf0c43640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feaec12c370 0x7feaec1340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.427+0000 7feaf0c43640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaec09a780 con 0x7feaec12b880 2024-04-26T07:54:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.427+0000 7feaf0c43640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7feaec09a9c0 con 0x7feaec12c370 2024-04-26T07:54:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.427+0000 7feaea59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7feaec12b880 0x7feaec12bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53842/0 (socket says 172.21.15.1:53842) 2024-04-26T07:54:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.427+0000 7feaea59c640 1 -- 172.21.15.1:0/2038813582 learned_addr learned my addr 172.21.15.1:0/2038813582 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.427+0000 7feae9d9b640 1 --2- 172.21.15.1:0/2038813582 >> v2:172.21.15.1:3300/0 conn(0x7feaec12c370 0x7feaec1340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.428+0000 7feae959a640 1 -- 172.21.15.1:0/2038813582 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623310770 0 0) 0x7feadc001110 con 0x7feaec12b880 2024-04-26T07:54:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.428+0000 7feae959a640 1 -- 172.21.15.1:0/2038813582 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead4003520 con 0x7feaec12b880 2024-04-26T07:54:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.428+0000 7feae9d9b640 1 -- 172.21.15.1:0/2038813582 >> v1:172.21.15.1:6789/0 conn(0x7feaec12b880 legacy=0x7feaec12bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.428+0000 7feae9d9b640 1 -- 172.21.15.1:0/2038813582 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec09b750 con 0x7feaec12c370 2024-04-26T07:54:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.429+0000 7feae9d9b640 1 --2- 172.21.15.1:0/2038813582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12c370 0x7feaec1340a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feae0009720 tx=0x7feae002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ef8d9a44b55236 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.429+0000 7feae959a640 1 -- 172.21.15.1:0/2038813582 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feae0035020 con 0x7feaec12c370 2024-04-26T07:54:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.429+0000 7feae959a640 1 -- 172.21.15.1:0/2038813582 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae0031760 con 0x7feaec12c370 2024-04-26T07:54:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.429+0000 7feae959a640 1 -- 172.21.15.1:0/2038813582 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feae0031a40 con 0x7feaec12c370 2024-04-26T07:54:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.429+0000 7feaf0c43640 1 -- 172.21.15.1:0/2038813582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12c370 msgr2=0x7feaec1340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.429+0000 7feaf0c43640 1 --2- 172.21.15.1:0/2038813582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12c370 0x7feaec1340a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feae0009720 tx=0x7feae002b8d0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.430+0000 7feaf0c43640 1 -- 172.21.15.1:0/2038813582 shutdown_connections 2024-04-26T07:54:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.430+0000 7feaf0c43640 1 --2- 172.21.15.1:0/2038813582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12c370 0x7feaec1340a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.430+0000 7feaf0c43640 1 -- 172.21.15.1:0/2038813582 >> 172.21.15.1:0/2038813582 conn(0x7feaec0a1700 msgr2=0x7feaec0a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.430+0000 7feaf0c43640 1 -- 172.21.15.1:0/2038813582 shutdown_connections 2024-04-26T07:54:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.430+0000 7feaf0c43640 1 -- 172.21.15.1:0/2038813582 wait complete. 2024-04-26T07:54:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.431+0000 7feaf0c43640 1 Processor -- start 2024-04-26T07:54:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.431+0000 7feaf0c43640 1 -- start start 2024-04-26T07:54:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.431+0000 7feaf0c43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12b880 0x7feaec1c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.431+0000 7feaf0c43640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feaec134760 con 0x7feaec12b880 2024-04-26T07:54:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.431+0000 7feaea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12b880 0x7feaec1c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.431+0000 7feaea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12b880 0x7feaec1c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56020/0 (socket says 172.21.15.1:56020) 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.431+0000 7feaea59c640 1 -- 172.21.15.1:0/2509891763 learned_addr learned my addr 172.21.15.1:0/2509891763 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.431+0000 7feaea59c640 1 -- 172.21.15.1:0/2509891763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec06da00 con 0x7feaec12b880 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.432+0000 7feaea59c640 1 --2- 172.21.15.1:0/2509891763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12b880 0x7feaec1c3a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c6b0 tx=0x7feadc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.432+0000 7feadaffd640 1 -- 172.21.15.1:0/2509891763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feadc017070 con 0x7feaec12b880 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.432+0000 7feadaffd640 1 -- 172.21.15.1:0/2509891763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feadc007e40 con 0x7feaec12b880 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.432+0000 7feadaffd640 1 -- 172.21.15.1:0/2509891763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feadc0059e0 con 0x7feaec12b880 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.432+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec06e540 con 0x7feaec12b880 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.432+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec06e100 con 0x7feaec12b880 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.433+0000 7feadaffd640 1 -- 172.21.15.1:0/2509891763 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7feadc01a070 con 0x7feaec12b880 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.433+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec06d1d0 con 0x7feaec12b880 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.433+0000 7feadaffd640 1 --2- 172.21.15.1:0/2509891763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feacc038520 0x7feacc03a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.433+0000 7feadaffd640 1 -- 172.21.15.1:0/2509891763 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7feadc04a950 con 0x7feaec12b880 2024-04-26T07:54:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.434+0000 7feae9d9b640 1 --2- 172.21.15.1:0/2509891763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feacc038520 0x7feacc03a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.434+0000 7feae9d9b640 1 --2- 172.21.15.1:0/2509891763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feacc038520 0x7feacc03a9e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feae0036000 tx=0x7feae0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.443+0000 7feadaffd640 1 -- 172.21.15.1:0/2509891763 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feaec09a780 con 0x7feaec12b880 2024-04-26T07:54:09.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.464+0000 7fdc567b3640 1 Processor -- start 2024-04-26T07:54:09.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.464+0000 7fdc567b3640 1 -- start start 2024-04-26T07:54:09.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.464+0000 7fdc567b3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdc5009a0f0 0x7fdc5012f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.464+0000 7fdc567b3640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5009b470 con 0x7fdc5012f5a0 2024-04-26T07:54:09.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.464+0000 7fdc567b3640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5009b780 con 0x7fdc5009a0f0 2024-04-26T07:54:09.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.465+0000 7fdc4ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdc5009a0f0 0x7fdc5012f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.465+0000 7fdc4f7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdc5012f5a0 0x7fdc5012b8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53848/0 (socket says 172.21.15.1:53848) 2024-04-26T07:54:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.465+0000 7fdc4f7fe640 1 -- 172.21.15.1:0/3534007084 learned_addr learned my addr 172.21.15.1:0/3534007084 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.465+0000 7fdc4ffff640 1 -- 172.21.15.1:0/3534007084 >> v1:172.21.15.1:6789/0 conn(0x7fdc5012f5a0 legacy=0x7fdc5012b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.465+0000 7fdc4ffff640 1 -- 172.21.15.1:0/3534007084 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5012f9b0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.466+0000 7fdc4ffff640 1 --2- 172.21.15.1:0/3534007084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5012f060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009720 tx=0x7fdc4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77aafd1696f16eff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.466+0000 7fdc4effd640 1 -- 172.21.15.1:0/3534007084 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc400316d0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.466+0000 7fdc4effd640 1 -- 172.21.15.1:0/3534007084 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc40037070 con 0x7fdc5009a0f0 2024-04-26T07:54:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.466+0000 7fdc4effd640 1 -- 172.21.15.1:0/3534007084 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc400319c0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.467+0000 7fdc567b3640 1 -- 172.21.15.1:0/3534007084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 msgr2=0x7fdc5012f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.467+0000 7fdc567b3640 1 --2- 172.21.15.1:0/3534007084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5012f060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009720 tx=0x7fdc4002b840 comp rx=0 tx=0).stop 2024-04-26T07:54:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.467+0000 7fdc567b3640 1 -- 172.21.15.1:0/3534007084 shutdown_connections 2024-04-26T07:54:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.467+0000 7fdc567b3640 1 --2- 172.21.15.1:0/3534007084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5012f060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.467+0000 7fdc567b3640 1 -- 172.21.15.1:0/3534007084 >> 172.21.15.1:0/3534007084 conn(0x7fdc500a1690 msgr2=0x7fdc500a1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.467+0000 7fdc567b3640 1 -- 172.21.15.1:0/3534007084 shutdown_connections 2024-04-26T07:54:09.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.467+0000 7fdc567b3640 1 -- 172.21.15.1:0/3534007084 wait complete. 2024-04-26T07:54:09.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.468+0000 7fdc567b3640 1 Processor -- start 2024-04-26T07:54:09.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.468+0000 7fdc567b3640 1 -- start start 2024-04-26T07:54:09.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.468+0000 7fdc567b3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.468+0000 7fdc567b3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5012c3d0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5006fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56036/0 (socket says 172.21.15.1:56036) 2024-04-26T07:54:09.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc4ffff640 1 -- 172.21.15.1:0/2219835199 learned_addr learned my addr 172.21.15.1:0/2219835199 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:09.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc4ffff640 1 -- 172.21.15.1:0/2219835199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc50071fe0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc4ffff640 1 --2- 172.21.15.1:0/2219835199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5006fae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc40034040 tx=0x7fdc400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc4cff9640 1 -- 172.21.15.1:0/2219835199 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc40032640 con 0x7fdc5009a0f0 2024-04-26T07:54:09.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5008f3d0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc4cff9640 1 -- 172.21.15.1:0/2219835199 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc400327e0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.469+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc50071370 con 0x7fdc5009a0f0 2024-04-26T07:54:09.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.470+0000 7fdc4cff9640 1 -- 172.21.15.1:0/2219835199 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc40032640 con 0x7fdc5009a0f0 2024-04-26T07:54:09.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.470+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc500636f0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.471+0000 7fdc4cff9640 1 -- 172.21.15.1:0/2219835199 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fdc40032990 con 0x7fdc5009a0f0 2024-04-26T07:54:09.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.472+0000 7fdc4cff9640 1 --2- 172.21.15.1:0/2219835199 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc3c038750 0x7fdc3c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.472+0000 7fdc4cff9640 1 -- 172.21.15.1:0/2219835199 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fdc4002f050 con 0x7fdc5009a0f0 2024-04-26T07:54:09.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.472+0000 7fdc4f7fe640 1 --2- 172.21.15.1:0/2219835199 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc3c038750 0x7fdc3c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.472+0000 7fdc4f7fe640 1 --2- 172.21.15.1:0/2219835199 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc3c038750 0x7fdc3c03ac10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdc44005880 tx=0x7fdc44007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.480+0000 7fdc4cff9640 1 -- 172.21.15.1:0/2219835199 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdc50071fe0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.596+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb4a806b6f0 con 0x7fb4a8128920 2024-04-26T07:54:09.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.597+0000 7fb49e7fc640 1 -- 172.21.15.1:0/3821371486 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4a4012400 con 0x7fb4a8128920 2024-04-26T07:54:09.595 INFO:teuthology.orchestra.run.smithi001.stdout:38654705668 2024-04-26T07:54:09.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb48c0385c0 msgr2=0x7fb48c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 --2- 172.21.15.1:0/3821371486 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb48c0385c0 0x7fb48c03aa80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb498036000 tx=0x7fb498008030 comp rx=0 tx=0).stop 2024-04-26T07:54:09.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a8128920 msgr2=0x7fb4a8094c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 --2- 172.21.15.1:0/3821371486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a8128920 0x7fb4a8094c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400c4a0 tx=0x7fb4a400c960 comp rx=0 tx=0).stop 2024-04-26T07:54:09.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 shutdown_connections 2024-04-26T07:54:09.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 --2- 172.21.15.1:0/3821371486 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb48c0385c0 0x7fb48c03aa80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 --2- 172.21.15.1:0/3821371486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4a8128920 0x7fb4a8094c60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 >> 172.21.15.1:0/3821371486 conn(0x7fb4a809add0 msgr2=0x7fb4a80934c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 shutdown_connections 2024-04-26T07:54:09.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.599+0000 7fb4afc62640 1 -- 172.21.15.1:0/3821371486 wait complete. 2024-04-26T07:54:09.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.603+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5b3009ca60 con 0x7f5b3012b880 2024-04-26T07:54:09.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.603+0000 7f5b1effd640 1 -- 172.21.15.1:0/3921986608 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5b3009ca60 con 0x7f5b3012b880 2024-04-26T07:54:09.601 INFO:teuthology.orchestra.run.smithi001.stdout:38654705667 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.605+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5b100385c0 msgr2=0x7f5b1003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.605+0000 7f5b348a6640 1 --2- 172.21.15.1:0/3921986608 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5b100385c0 0x7f5b1003aa80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b24000f60 tx=0x7f5b24007a30 comp rx=0 tx=0).stop 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.605+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 msgr2=0x7f5b3006d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.605+0000 7f5b348a6640 1 --2- 172.21.15.1:0/3921986608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3006d080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b200097f0 tx=0x7f5b20004730 comp rx=0 tx=0).stop 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.605+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 shutdown_connections 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.605+0000 7f5b348a6640 1 --2- 172.21.15.1:0/3921986608 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5b100385c0 0x7f5b1003aa80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.605+0000 7f5b348a6640 1 --2- 172.21.15.1:0/3921986608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b3012b880 0x7f5b3006d080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.605+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 >> 172.21.15.1:0/3921986608 conn(0x7f5b300a1700 msgr2=0x7f5b3012a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.606+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 shutdown_connections 2024-04-26T07:54:09.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.606+0000 7f5b348a6640 1 -- 172.21.15.1:0/3921986608 wait complete. 2024-04-26T07:54:09.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2024-04-26T07:54:09.609 DEBUG:teuthology.parallel:result is None 2024-04-26T07:54:09.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.3 2024-04-26T07:54:09.619 DEBUG:teuthology.parallel:result is None 2024-04-26T07:54:09.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.634+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feaec134560 con 0x7feaec12b880 2024-04-26T07:54:09.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.634+0000 7feadaffd640 1 -- 172.21.15.1:0/2509891763 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feadc005e20 con 0x7feaec12b880 2024-04-26T07:54:09.632 INFO:teuthology.orchestra.run.smithi001.stdout:38654705666 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feacc038520 msgr2=0x7feacc03a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 --2- 172.21.15.1:0/2509891763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feacc038520 0x7feacc03a9e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feae0036000 tx=0x7feae0008030 comp rx=0 tx=0).stop 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12b880 msgr2=0x7feaec1c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 --2- 172.21.15.1:0/2509891763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12b880 0x7feaec1c3a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c6b0 tx=0x7feadc00cb70 comp rx=0 tx=0).stop 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 shutdown_connections 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 --2- 172.21.15.1:0/2509891763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7feacc038520 0x7feacc03a9e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 --2- 172.21.15.1:0/2509891763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feaec12b880 0x7feaec1c3a80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 >> 172.21.15.1:0/2509891763 conn(0x7feaec0a1700 msgr2=0x7feaec12e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 shutdown_connections 2024-04-26T07:54:09.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.636+0000 7feaf0c43640 1 -- 172.21.15.1:0/2509891763 wait complete. 2024-04-26T07:54:09.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.2 2024-04-26T07:54:09.646 DEBUG:teuthology.parallel:result is None 2024-04-26T07:54:09.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.675+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdc5006b6f0 con 0x7fdc5009a0f0 2024-04-26T07:54:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.675+0000 7fdc4cff9640 1 -- 172.21.15.1:0/2219835199 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc40040070 con 0x7fdc5009a0f0 2024-04-26T07:54:09.674 INFO:teuthology.orchestra.run.smithi001.stdout:38654705668 2024-04-26T07:54:09.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.677+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc3c038750 msgr2=0x7fdc3c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.677+0000 7fdc567b3640 1 --2- 172.21.15.1:0/2219835199 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc3c038750 0x7fdc3c03ac10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdc44005880 tx=0x7fdc44007a80 comp rx=0 tx=0).stop 2024-04-26T07:54:09.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.677+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 msgr2=0x7fdc5006fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.677+0000 7fdc567b3640 1 --2- 172.21.15.1:0/2219835199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5006fae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc40034040 tx=0x7fdc400046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.677+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 shutdown_connections 2024-04-26T07:54:09.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.677+0000 7fdc567b3640 1 --2- 172.21.15.1:0/2219835199 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc3c038750 0x7fdc3c03ac10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.677+0000 7fdc567b3640 1 --2- 172.21.15.1:0/2219835199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc5009a0f0 0x7fdc5006fae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.677+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 >> 172.21.15.1:0/2219835199 conn(0x7fdc500a1690 msgr2=0x7fdc5012a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.678+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 shutdown_connections 2024-04-26T07:54:09.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.678+0000 7fdc567b3640 1 -- 172.21.15.1:0/2219835199 wait complete. 2024-04-26T07:54:09.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-04-26T07:54:09.686 DEBUG:teuthology.parallel:result is None 2024-04-26T07:54:09.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T07:54:09.687 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:54:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.829+0000 7f7d5197e640 1 Processor -- start 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.829+0000 7f7d5197e640 1 -- start start 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.830+0000 7f7d5197e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d4c12c370 0x7f7d4c1340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.830+0000 7f7d5197e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d4c09a780 con 0x7f7d4c12b880 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.830+0000 7f7d5197e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4c09a9c0 con 0x7f7d4c12c370 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.830+0000 7f7d4a7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d4c12c370 0x7f7d4c1340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.830+0000 7f7d4affd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7d4c12b880 0x7f7d4c12bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53850/0 (socket says 172.21.15.1:53850) 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.830+0000 7f7d4affd640 1 -- 172.21.15.1:0/1237200750 learned_addr learned my addr 172.21.15.1:0/1237200750 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.830+0000 7f7d4a7fc640 1 -- 172.21.15.1:0/1237200750 >> v1:172.21.15.1:6789/0 conn(0x7f7d4c12b880 legacy=0x7f7d4c12bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.830+0000 7f7d4a7fc640 1 -- 172.21.15.1:0/1237200750 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c09b750 con 0x7f7d4c12c370 2024-04-26T07:54:09.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.831+0000 7f7d4a7fc640 1 --2- 172.21.15.1:0/1237200750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12c370 0x7f7d4c1340a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009720 tx=0x7f7d3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f10b58087b5dbcf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.831+0000 7f7d49ffb640 1 -- 172.21.15.1:0/1237200750 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d34035020 con 0x7f7d4c12c370 2024-04-26T07:54:09.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.831+0000 7f7d49ffb640 1 -- 172.21.15.1:0/1237200750 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d34031760 con 0x7f7d4c12c370 2024-04-26T07:54:09.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.831+0000 7f7d49ffb640 1 -- 172.21.15.1:0/1237200750 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d34031a60 con 0x7f7d4c12c370 2024-04-26T07:54:09.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.831+0000 7f7d5197e640 1 -- 172.21.15.1:0/1237200750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12c370 msgr2=0x7f7d4c1340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:09.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.831+0000 7f7d5197e640 1 --2- 172.21.15.1:0/1237200750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12c370 0x7f7d4c1340a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009720 tx=0x7f7d3402b8d0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.832+0000 7f7d5197e640 1 -- 172.21.15.1:0/1237200750 shutdown_connections 2024-04-26T07:54:09.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.832+0000 7f7d5197e640 1 --2- 172.21.15.1:0/1237200750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12c370 0x7f7d4c1340a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.832+0000 7f7d5197e640 1 -- 172.21.15.1:0/1237200750 >> 172.21.15.1:0/1237200750 conn(0x7f7d4c0a1700 msgr2=0x7f7d4c0a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.832+0000 7f7d5197e640 1 -- 172.21.15.1:0/1237200750 shutdown_connections 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.832+0000 7f7d5197e640 1 -- 172.21.15.1:0/1237200750 wait complete. 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.832+0000 7f7d5197e640 1 Processor -- start 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.833+0000 7f7d5197e640 1 -- start start 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.833+0000 7f7d5197e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12b880 0x7f7d4c131bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.833+0000 7f7d5197e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c134760 con 0x7f7d4c12b880 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.833+0000 7f7d4affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12b880 0x7f7d4c131bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.833+0000 7f7d4affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12b880 0x7f7d4c131bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56062/0 (socket says 172.21.15.1:56062) 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.833+0000 7f7d4affd640 1 -- 172.21.15.1:0/3844113473 learned_addr learned my addr 172.21.15.1:0/3844113473 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.833+0000 7f7d4affd640 1 -- 172.21.15.1:0/3844113473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c06e420 con 0x7f7d4c12b880 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.833+0000 7f7d4affd640 1 --2- 172.21.15.1:0/3844113473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12b880 0x7f7d4c131bc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00cb20 tx=0x7f7d3c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.834+0000 7f7d43fff640 1 -- 172.21.15.1:0/3844113473 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d3c017070 con 0x7f7d4c12b880 2024-04-26T07:54:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.834+0000 7f7d43fff640 1 -- 172.21.15.1:0/3844113473 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3c00abf0 con 0x7f7d4c12b880 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.834+0000 7f7d43fff640 1 -- 172.21.15.1:0/3844113473 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d3c012400 con 0x7f7d4c12b880 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.834+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4c133e20 con 0x7f7d4c12b880 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.834+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4c06db10 con 0x7f7d4c12b880 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.834+0000 7f7d43fff640 1 -- 172.21.15.1:0/3844113473 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7d3c01a070 con 0x7f7d4c12b880 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.835+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c0636f0 con 0x7f7d4c12b880 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.835+0000 7f7d43fff640 1 --2- 172.21.15.1:0/3844113473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7d2c0385c0 0x7f7d2c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.835+0000 7f7d43fff640 1 -- 172.21.15.1:0/3844113473 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f7d3c04b3d0 con 0x7f7d4c12b880 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.835+0000 7f7d4a7fc640 1 --2- 172.21.15.1:0/3844113473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7d2c0385c0 0x7f7d2c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:09.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.835+0000 7f7d4a7fc640 1 --2- 172.21.15.1:0/3844113473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7d2c0385c0 0x7f7d2c03aa80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d34036000 tx=0x7f7d34008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:09.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:09.839+0000 7f7d43fff640 1 -- 172.21.15.1:0/3844113473 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d4c09a780 con 0x7f7d4c12b880 2024-04-26T07:54:10.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.020+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d4c06e5f0 con 0x7f7d2c0385c0 2024-04-26T07:54:10.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.022+0000 7f7d43fff640 1 -- 172.21.15.1:0/3844113473 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31860 (secure 0 0 0) 0x7f7d4c06e5f0 con 0x7f7d2c0385c0 2024-04-26T07:54:10.021 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:54:10.021 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:54:10.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7d2c0385c0 msgr2=0x7f7d2c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 --2- 172.21.15.1:0/3844113473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7d2c0385c0 0x7f7d2c03aa80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d34036000 tx=0x7f7d34008030 comp rx=0 tx=0).stop 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12b880 msgr2=0x7f7d4c131bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 --2- 172.21.15.1:0/3844113473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12b880 0x7f7d4c131bc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00cb20 tx=0x7f7d3c00a060 comp rx=0 tx=0).stop 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 shutdown_connections 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 --2- 172.21.15.1:0/3844113473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7d2c0385c0 0x7f7d2c03aa80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 --2- 172.21.15.1:0/3844113473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d4c12b880 0x7f7d4c131bc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 >> 172.21.15.1:0/3844113473 conn(0x7f7d4c0a1700 msgr2=0x7f7d4c12e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 shutdown_connections 2024-04-26T07:54:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.024+0000 7f7d5197e640 1 -- 172.21.15.1:0/3844113473 wait complete. 2024-04-26T07:54:10.033 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-04-26T07:54:08.811797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118444,"kb_used_data":1416,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377368916,"statfs":{"total":386547056640,"available":386425769984,"internally_reserved":0,"allocated":1449984,"data_stored":1156292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673786+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:54:07.673786+0000","last_peered":"2024-04-26T07:54:07.673786+0000","last_clean":"2024-04-26T07:54:07.673786+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:54:07.673786+0000","last_undegraded":"2024-04-26T07:54:07.673786+0000","last_fullsized":"2024-04-26T07:54:07.673786+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:13.205208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T07:54:06.677576+0000","last_change":"2024-04-26T07:54:06.676954+0000","last_active":"2024-04-26T07:54:06.677576+0000","last_peered":"2024-04-26T07:54:06.677576+0000","last_clean":"2024-04-26T07:54:06.677576+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:54:06.677576+0000","last_undegraded":"2024-04-26T07:54:06.677576+0000","last_fullsized":"2024-04-26T07:54:06.677576+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:51.420988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673702+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:54:07.673702+0000","last_peered":"2024-04-26T07:54:07.673702+0000","last_clean":"2024-04-26T07:54:07.673702+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:54:07.673702+0000","last_undegraded":"2024-04-26T07:54:07.673702+0000","last_fullsized":"2024-04-26T07:54:07.673702+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:41.674149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T07:54:06.677099+0000","last_change":"2024-04-26T07:54:06.676454+0000","last_active":"2024-04-26T07:54:06.677099+0000","last_peered":"2024-04-26T07:54:06.677099+0000","last_clean":"2024-04-26T07:54:06.677099+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:54:06.677099+0000","last_undegraded":"2024-04-26T07:54:06.677099+0000","last_fullsized":"2024-04-26T07:54:06.677099+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:56.210658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673707+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:54:07.673707+0000","last_peered":"2024-04-26T07:54:07.673707+0000","last_clean":"2024-04-26T07:54:07.673707+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:54:07.673707+0000","last_undegraded":"2024-04-26T07:54:07.673707+0000","last_fullsized":"2024-04-26T07:54:07.673707+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:23.138091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T07:54:06.676747+0000","last_change":"2024-04-26T07:54:06.674967+0000","last_active":"2024-04-26T07:54:06.676747+0000","last_peered":"2024-04-26T07:54:06.676747+0000","last_clean":"2024-04-26T07:54:06.676747+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:54:06.676747+0000","last_undegraded":"2024-04-26T07:54:06.676747+0000","last_fullsized":"2024-04-26T07:54:06.676747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:51.420988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673711+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:54:07.673711+0000","last_peered":"2024-04-26T07:54:07.673711+0000","last_clean":"2024-04-26T07:54:07.673711+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:54:07.673711+0000","last_undegraded":"2024-04-26T07:54:07.673711+0000","last_fullsized":"2024-04-26T07:54:07.673711+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:57.072237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673715+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:54:07.673715+0000","last_peered":"2024-04-26T07:54:07.673715+0000","last_clean":"2024-04-26T07:54:07.673715+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:54:07.673715+0000","last_undegraded":"2024-04-26T07:54:07.673715+0000","last_fullsized":"2024-04-26T07:54:07.673715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:36.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":162,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.714411+0000","last_change":"2024-04-26T07:54:06.676207+0000","last_active":"2024-04-26T07:54:07.714411+0000","last_peered":"2024-04-26T07:54:07.714411+0000","last_clean":"2024-04-26T07:54:07.714411+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:54:07.714411+0000","last_undegraded":"2024-04-26T07:54:07.714411+0000","last_fullsized":"2024-04-26T07:54:07.714411+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":561152,"data_stored":485941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35444,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336396,"statfs":{"total":96636764160,"available":96600469504,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:54:10.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:54:10.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.135+0000 7fd44cd11640 1 Processor -- start 2024-04-26T07:54:10.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.135+0000 7fd44cd11640 1 -- start start 2024-04-26T07:54:10.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.135+0000 7fd44cd11640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd448128920 0x7fd448128d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.135+0000 7fd44cd11640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44806da60 con 0x7fd448095d70 2024-04-26T07:54:10.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.135+0000 7fd44cd11640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fd448073070 con 0x7fd448128920 2024-04-26T07:54:10.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.135+0000 7fd44659c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd448128920 0x7fd448128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.135+0000 7fd445d9b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd448095d70 0x7fd448096190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53858/0 (socket says 172.21.15.1:53858) 2024-04-26T07:54:10.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.135+0000 7fd445d9b640 1 -- 172.21.15.1:0/450514718 learned_addr learned my addr 172.21.15.1:0/450514718 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:10.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.136+0000 7fd44659c640 1 -- 172.21.15.1:0/450514718 >> v1:172.21.15.1:6789/0 conn(0x7fd448095d70 legacy=0x7fd448096190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.136+0000 7fd44659c640 1 -- 172.21.15.1:0/450514718 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd448129240 con 0x7fd448128920 2024-04-26T07:54:10.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.136+0000 7fd44659c640 1 --2- 172.21.15.1:0/450514718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448128920 0x7fd448128d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd438009720 tx=0x7fd43802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b7dabb24139925 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.136+0000 7fd44559a640 1 -- 172.21.15.1:0/450514718 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4380316d0 con 0x7fd448128920 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44559a640 1 -- 172.21.15.1:0/450514718 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd438037070 con 0x7fd448128920 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44559a640 1 -- 172.21.15.1:0/450514718 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4380319c0 con 0x7fd448128920 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44cd11640 1 -- 172.21.15.1:0/450514718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448128920 msgr2=0x7fd448128d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44cd11640 1 --2- 172.21.15.1:0/450514718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448128920 0x7fd448128d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd438009720 tx=0x7fd43802b840 comp rx=0 tx=0).stop 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44cd11640 1 -- 172.21.15.1:0/450514718 shutdown_connections 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44cd11640 1 --2- 172.21.15.1:0/450514718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448128920 0x7fd448128d00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44cd11640 1 -- 172.21.15.1:0/450514718 >> 172.21.15.1:0/450514718 conn(0x7fd44809add0 msgr2=0x7fd44809b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44cd11640 1 -- 172.21.15.1:0/450514718 shutdown_connections 2024-04-26T07:54:10.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.137+0000 7fd44cd11640 1 -- 172.21.15.1:0/450514718 wait complete. 2024-04-26T07:54:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.138+0000 7fd44cd11640 1 Processor -- start 2024-04-26T07:54:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.138+0000 7fd44cd11640 1 -- start start 2024-04-26T07:54:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44cd11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448095d70 0x7fd44808b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44cd11640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd44806d0f0 con 0x7fd448095d70 2024-04-26T07:54:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448095d70 0x7fd44808b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448095d70 0x7fd44808b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56074/0 (socket says 172.21.15.1:56074) 2024-04-26T07:54:10.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44659c640 1 -- 172.21.15.1:0/293741183 learned_addr learned my addr 172.21.15.1:0/293741183 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:10.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44659c640 1 -- 172.21.15.1:0/293741183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44808d070 con 0x7fd448095d70 2024-04-26T07:54:10.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44659c640 1 --2- 172.21.15.1:0/293741183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448095d70 0x7fd44808b2c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd438000c00 tx=0x7fd4380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd436ffd640 1 -- 172.21.15.1:0/293741183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd438032770 con 0x7fd448095d70 2024-04-26T07:54:10.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd436ffd640 1 -- 172.21.15.1:0/293741183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd438032910 con 0x7fd448095d70 2024-04-26T07:54:10.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44808dde0 con 0x7fd448095d70 2024-04-26T07:54:10.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd436ffd640 1 -- 172.21.15.1:0/293741183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd438032c30 con 0x7fd448095d70 2024-04-26T07:54:10.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.139+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44808e8b0 con 0x7fd448095d70 2024-04-26T07:54:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.140+0000 7fd436ffd640 1 -- 172.21.15.1:0/293741183 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd43804c060 con 0x7fd448095d70 2024-04-26T07:54:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.140+0000 7fd436ffd640 1 --2- 172.21.15.1:0/293741183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd4280385c0 0x7fd42803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.140+0000 7fd436ffd640 1 -- 172.21.15.1:0/293741183 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fd43802f050 con 0x7fd448095d70 2024-04-26T07:54:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.140+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd448126500 con 0x7fd448095d70 2024-04-26T07:54:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.141+0000 7fd445d9b640 1 --2- 172.21.15.1:0/293741183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd4280385c0 0x7fd42803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.141+0000 7fd445d9b640 1 --2- 172.21.15.1:0/293741183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd4280385c0 0x7fd42803aa80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007fd0 tx=0x7fd43c007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.145+0000 7fd436ffd640 1 -- 172.21.15.1:0/293741183 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd448126500 con 0x7fd448095d70 2024-04-26T07:54:10.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.326+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4480636f0 con 0x7fd4280385c0 2024-04-26T07:54:10.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.327+0000 7fd436ffd640 1 -- 172.21.15.1:0/293741183 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31860 (secure 0 0 0) 0x7fd4480636f0 con 0x7fd4280385c0 2024-04-26T07:54:10.326 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:54:10.326 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd4280385c0 msgr2=0x7fd42803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 --2- 172.21.15.1:0/293741183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd4280385c0 0x7fd42803aa80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007fd0 tx=0x7fd43c007ac0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448095d70 msgr2=0x7fd44808b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 --2- 172.21.15.1:0/293741183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448095d70 0x7fd44808b2c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd438000c00 tx=0x7fd4380046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 shutdown_connections 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 --2- 172.21.15.1:0/293741183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd4280385c0 0x7fd42803aa80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 --2- 172.21.15.1:0/293741183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd448095d70 0x7fd44808b2c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 >> 172.21.15.1:0/293741183 conn(0x7fd44809add0 msgr2=0x7fd448123fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 shutdown_connections 2024-04-26T07:54:10.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.329+0000 7fd44cd11640 1 -- 172.21.15.1:0/293741183 wait complete. 2024-04-26T07:54:10.338 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-04-26T07:54:08.811797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118444,"kb_used_data":1416,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377368916,"statfs":{"total":386547056640,"available":386425769984,"internally_reserved":0,"allocated":1449984,"data_stored":1156292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673786+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:54:07.673786+0000","last_peered":"2024-04-26T07:54:07.673786+0000","last_clean":"2024-04-26T07:54:07.673786+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:54:07.673786+0000","last_undegraded":"2024-04-26T07:54:07.673786+0000","last_fullsized":"2024-04-26T07:54:07.673786+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:13.205208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T07:54:06.677576+0000","last_change":"2024-04-26T07:54:06.676954+0000","last_active":"2024-04-26T07:54:06.677576+0000","last_peered":"2024-04-26T07:54:06.677576+0000","last_clean":"2024-04-26T07:54:06.677576+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:54:06.677576+0000","last_undegraded":"2024-04-26T07:54:06.677576+0000","last_fullsized":"2024-04-26T07:54:06.677576+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:51.420988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673702+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:54:07.673702+0000","last_peered":"2024-04-26T07:54:07.673702+0000","last_clean":"2024-04-26T07:54:07.673702+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:54:07.673702+0000","last_undegraded":"2024-04-26T07:54:07.673702+0000","last_fullsized":"2024-04-26T07:54:07.673702+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:41.674149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T07:54:06.677099+0000","last_change":"2024-04-26T07:54:06.676454+0000","last_active":"2024-04-26T07:54:06.677099+0000","last_peered":"2024-04-26T07:54:06.677099+0000","last_clean":"2024-04-26T07:54:06.677099+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:54:06.677099+0000","last_undegraded":"2024-04-26T07:54:06.677099+0000","last_fullsized":"2024-04-26T07:54:06.677099+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:56.210658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673707+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:54:07.673707+0000","last_peered":"2024-04-26T07:54:07.673707+0000","last_clean":"2024-04-26T07:54:07.673707+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:54:07.673707+0000","last_undegraded":"2024-04-26T07:54:07.673707+0000","last_fullsized":"2024-04-26T07:54:07.673707+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:23.138091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T07:54:06.676747+0000","last_change":"2024-04-26T07:54:06.674967+0000","last_active":"2024-04-26T07:54:06.676747+0000","last_peered":"2024-04-26T07:54:06.676747+0000","last_clean":"2024-04-26T07:54:06.676747+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:54:06.676747+0000","last_undegraded":"2024-04-26T07:54:06.676747+0000","last_fullsized":"2024-04-26T07:54:06.676747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:51.420988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673711+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:54:07.673711+0000","last_peered":"2024-04-26T07:54:07.673711+0000","last_clean":"2024-04-26T07:54:07.673711+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:54:07.673711+0000","last_undegraded":"2024-04-26T07:54:07.673711+0000","last_fullsized":"2024-04-26T07:54:07.673711+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:57.072237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.673715+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:54:07.673715+0000","last_peered":"2024-04-26T07:54:07.673715+0000","last_clean":"2024-04-26T07:54:07.673715+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:54:07.673715+0000","last_undegraded":"2024-04-26T07:54:07.673715+0000","last_fullsized":"2024-04-26T07:54:07.673715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:36.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":162,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-26T07:54:07.714411+0000","last_change":"2024-04-26T07:54:06.676207+0000","last_active":"2024-04-26T07:54:07.714411+0000","last_peered":"2024-04-26T07:54:07.714411+0000","last_clean":"2024-04-26T07:54:07.714411+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:54:07.714411+0000","last_undegraded":"2024-04-26T07:54:07.714411+0000","last_fullsized":"2024-04-26T07:54:07.714411+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":561152,"data_stored":485941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35444,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336396,"statfs":{"total":96636764160,"available":96600469504,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:54:10.339 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T07:54:10.339 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T07:54:10.340 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T07:54:10.340 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T07:54:10.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.440+0000 7fe954c11640 1 Processor -- start 2024-04-26T07:54:10.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.440+0000 7fe954c11640 1 -- start start 2024-04-26T07:54:10.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe954c11640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe95012eba0 0x7fe950130f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe954c11640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95006da60 con 0x7fe950128920 2024-04-26T07:54:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe954c11640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe950073070 con 0x7fe95012eba0 2024-04-26T07:54:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe94dd9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe95012eba0 0x7fe950130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe94e59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe950128920 0x7fe950128d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53864/0 (socket says 172.21.15.1:53864) 2024-04-26T07:54:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe94e59c640 1 -- 172.21.15.1:0/4164463821 learned_addr learned my addr 172.21.15.1:0/4164463821 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:54:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe94dd9b640 1 -- 172.21.15.1:0/4164463821 >> v1:172.21.15.1:6789/0 conn(0x7fe950128920 legacy=0x7fe950128d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe94dd9b640 1 -- 172.21.15.1:0/4164463821 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe950094640 con 0x7fe95012eba0 2024-04-26T07:54:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.441+0000 7fe94d59a640 1 -- 172.21.15.1:0/4164463821 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982432565 0 0) 0x7fe948001110 con 0x7fe950128920 2024-04-26T07:54:10.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.442+0000 7fe94dd9b640 1 --2- 172.21.15.1:0/4164463821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe95012eba0 0x7fe950130f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe938009720 tx=0x7fe93802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44205b8840356da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.442+0000 7fe94d59a640 1 -- 172.21.15.1:0/4164463821 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9380316d0 con 0x7fe95012eba0 2024-04-26T07:54:10.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.442+0000 7fe94d59a640 1 -- 172.21.15.1:0/4164463821 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe938037070 con 0x7fe95012eba0 2024-04-26T07:54:10.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.442+0000 7fe94d59a640 1 -- 172.21.15.1:0/4164463821 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9380319c0 con 0x7fe95012eba0 2024-04-26T07:54:10.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.442+0000 7fe954c11640 1 -- 172.21.15.1:0/4164463821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe95012eba0 msgr2=0x7fe950130f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.442+0000 7fe954c11640 1 --2- 172.21.15.1:0/4164463821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe95012eba0 0x7fe950130f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe938009720 tx=0x7fe93802b840 comp rx=0 tx=0).stop 2024-04-26T07:54:10.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.443+0000 7fe954c11640 1 -- 172.21.15.1:0/4164463821 shutdown_connections 2024-04-26T07:54:10.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.443+0000 7fe954c11640 1 --2- 172.21.15.1:0/4164463821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe95012eba0 0x7fe950130f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.443+0000 7fe954c11640 1 -- 172.21.15.1:0/4164463821 >> 172.21.15.1:0/4164463821 conn(0x7fe95009add0 msgr2=0x7fe95009b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:10.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.443+0000 7fe954c11640 1 -- 172.21.15.1:0/4164463821 shutdown_connections 2024-04-26T07:54:10.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.443+0000 7fe954c11640 1 -- 172.21.15.1:0/4164463821 wait complete. 2024-04-26T07:54:10.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe954c11640 1 Processor -- start 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe954c11640 1 -- start start 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe954c11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe950128920 0x7fe9501c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe954c11640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe95006d620 con 0x7fe950128920 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe94e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe950128920 0x7fe9501c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe94e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe950128920 0x7fe9501c04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56084/0 (socket says 172.21.15.1:56084) 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe94e59c640 1 -- 172.21.15.1:0/314776065 learned_addr learned my addr 172.21.15.1:0/314776065 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe94e59c640 1 -- 172.21.15.1:0/314776065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe950125ce0 con 0x7fe950128920 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.444+0000 7fe94e59c640 1 --2- 172.21.15.1:0/314776065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe950128920 0x7fe9501c04a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe94800c700 tx=0x7fe94800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.445+0000 7fe946ffd640 1 -- 172.21.15.1:0/314776065 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe948018070 con 0x7fe950128920 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.445+0000 7fe946ffd640 1 -- 172.21.15.1:0/314776065 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9480070d0 con 0x7fe950128920 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.445+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95012ae10 con 0x7fe950128920 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.445+0000 7fe946ffd640 1 -- 172.21.15.1:0/314776065 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9480073f0 con 0x7fe950128920 2024-04-26T07:54:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.445+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95012a260 con 0x7fe950128920 2024-04-26T07:54:10.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.445+0000 7fe946ffd640 1 -- 172.21.15.1:0/314776065 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe94801b070 con 0x7fe950128920 2024-04-26T07:54:10.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.446+0000 7fe946ffd640 1 --2- 172.21.15.1:0/314776065 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9300385c0 0x7fe93003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.446+0000 7fe946ffd640 1 -- 172.21.15.1:0/314776065 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fe94804a930 con 0x7fe950128920 2024-04-26T07:54:10.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.446+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9500636f0 con 0x7fe950128920 2024-04-26T07:54:10.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.446+0000 7fe94dd9b640 1 --2- 172.21.15.1:0/314776065 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9300385c0 0x7fe93003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.446+0000 7fe94dd9b640 1 --2- 172.21.15.1:0/314776065 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9300385c0 0x7fe93003aa80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe938036000 tx=0x7fe938008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.450+0000 7fe946ffd640 1 -- 172.21.15.1:0/314776065 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe95006da60 con 0x7fe950128920 2024-04-26T07:54:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.673+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe95006b6f0 con 0x7fe950128920 2024-04-26T07:54:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.673+0000 7fe946ffd640 1 -- 172.21.15.1:0/314776065 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe9480047e0 con 0x7fe950128920 2024-04-26T07:54:10.672 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:54:10.672 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9300385c0 msgr2=0x7fe93003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 --2- 172.21.15.1:0/314776065 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9300385c0 0x7fe93003aa80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe938036000 tx=0x7fe938008030 comp rx=0 tx=0).stop 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe950128920 msgr2=0x7fe9501c04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 --2- 172.21.15.1:0/314776065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe950128920 0x7fe9501c04a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe94800c700 tx=0x7fe94800cbc0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 shutdown_connections 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 --2- 172.21.15.1:0/314776065 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9300385c0 0x7fe93003aa80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 --2- 172.21.15.1:0/314776065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe950128920 0x7fe9501c04a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 >> 172.21.15.1:0/314776065 conn(0x7fe95009add0 msgr2=0x7fe950094c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.675+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 shutdown_connections 2024-04-26T07:54:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:54:10.676+0000 7fe954c11640 1 -- 172.21.15.1:0/314776065 wait complete. 2024-04-26T07:54:10.685 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T07:54:10.685 INFO:teuthology.run_tasks:Running task rgw... 2024-04-26T07:54:10.711 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-26T07:54:10.711 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-26T07:54:10.712 INFO:tasks.rgw:Creating data pools 2024-04-26T07:54:10.712 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-26T07:54:10.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-04-26T07:54:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.829+0000 7fa749ff2640 1 Processor -- start 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.829+0000 7fa749ff2640 1 -- start start 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.829+0000 7fa749ff2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa74411b2a0 0x7fa74411d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.829+0000 7fa749ff2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74411dbd0 con 0x7fa7441184b0 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.829+0000 7fa749ff2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa74411edb0 con 0x7fa74411b2a0 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.830+0000 7fa742ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa74411b2a0 0x7fa74411d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.830+0000 7fa7437fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa7441184b0 0x7fa744118890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33028/0 (socket says 172.21.15.62:33028) 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.830+0000 7fa7437fe640 1 -- 172.21.15.62:0/2446696973 learned_addr learned my addr 172.21.15.62:0/2446696973 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.830+0000 7fa742ffd640 1 -- 172.21.15.62:0/2446696973 >> v1:172.21.15.1:6789/0 conn(0x7fa7441184b0 legacy=0x7fa744118890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.830+0000 7fa742ffd640 1 -- 172.21.15.62:0/2446696973 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74411ef30 con 0x7fa74411b2a0 2024-04-26T07:54:10.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.830+0000 7fa7427fc640 1 -- 172.21.15.62:0/2446696973 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032983269 0 0) 0x7fa74411dbd0 con 0x7fa7441184b0 2024-04-26T07:54:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.831+0000 7fa742ffd640 1 --2- 172.21.15.62:0/2446696973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa74411b2a0 0x7fa74411d690 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa734009720 tx=0x7fa73402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37480787d6d9199 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.831+0000 7fa7427fc640 1 -- 172.21.15.62:0/2446696973 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7340316d0 con 0x7fa74411b2a0 2024-04-26T07:54:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.831+0000 7fa7427fc640 1 -- 172.21.15.62:0/2446696973 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa734037070 con 0x7fa74411b2a0 2024-04-26T07:54:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.831+0000 7fa7427fc640 1 -- 172.21.15.62:0/2446696973 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7340319c0 con 0x7fa74411b2a0 2024-04-26T07:54:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.832+0000 7fa749ff2640 1 -- 172.21.15.62:0/2446696973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa74411b2a0 msgr2=0x7fa74411d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.832+0000 7fa749ff2640 1 --2- 172.21.15.62:0/2446696973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa74411b2a0 0x7fa74411d690 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa734009720 tx=0x7fa73402b840 comp rx=0 tx=0).stop 2024-04-26T07:54:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.832+0000 7fa749ff2640 1 -- 172.21.15.62:0/2446696973 shutdown_connections 2024-04-26T07:54:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.832+0000 7fa749ff2640 1 --2- 172.21.15.62:0/2446696973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa74411b2a0 0x7fa74411d690 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.832+0000 7fa749ff2640 1 -- 172.21.15.62:0/2446696973 >> 172.21.15.62:0/2446696973 conn(0x7fa74406e8f0 msgr2=0x7fa74406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.832+0000 7fa749ff2640 1 -- 172.21.15.62:0/2446696973 shutdown_connections 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.832+0000 7fa749ff2640 1 -- 172.21.15.62:0/2446696973 wait complete. 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.832+0000 7fa749ff2640 1 Processor -- start 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.833+0000 7fa749ff2640 1 -- start start 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.833+0000 7fa749ff2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7441184b0 0x7fa7441acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.833+0000 7fa749ff2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa74411e2c0 con 0x7fa7441184b0 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.833+0000 7fa7437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7441184b0 0x7fa7441acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.833+0000 7fa7437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7441184b0 0x7fa7441acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:58910/0 (socket says 172.21.15.62:58910) 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.833+0000 7fa7437fe640 1 -- 172.21.15.62:0/1636928894 learned_addr learned my addr 172.21.15.62:0/1636928894 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.834+0000 7fa7437fe640 1 -- 172.21.15.62:0/1636928894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7441ad370 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.834+0000 7fa7437fe640 1 --2- 172.21.15.62:0/1636928894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7441184b0 0x7fa7441acda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00c420 tx=0x7fa72c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.834+0000 7fa73bfff640 1 -- 172.21.15.62:0/1636928894 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa72c018070 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.834+0000 7fa73bfff640 1 -- 172.21.15.62:0/1636928894 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c0074d0 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.834+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7441ad600 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.834+0000 7fa73bfff640 1 -- 172.21.15.62:0/1636928894 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa72c004950 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.834+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7441a6e00 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.835+0000 7fa73bfff640 1 -- 172.21.15.62:0/1636928894 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa72c01b070 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.835+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa744111da0 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.835+0000 7fa73bfff640 1 --2- 172.21.15.62:0/1636928894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa7240385c0 0x7fa72403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.835+0000 7fa73bfff640 1 -- 172.21.15.62:0/1636928894 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fa72c04a9f0 con 0x7fa7441184b0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.835+0000 7fa742ffd640 1 --2- 172.21.15.62:0/1636928894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa7240385c0 0x7fa72403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.836+0000 7fa742ffd640 1 --2- 172.21.15.62:0/1636928894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa7240385c0 0x7fa72403aa80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa734036000 tx=0x7fa734008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:10.840+0000 7fa73bfff640 1 -- 172.21.15.62:0/1636928894 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa72c011980 con 0x7fa7441184b0 2024-04-26T07:54:11.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.033+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7fa74406b6f0 con 0x7fa7441184b0 2024-04-26T07:54:11.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.971+0000 7fa73bfff640 1 -- 172.21.15.62:0/1636928894 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v13) ==== 151+0+0 (secure 0 0 0) 0x7fa72c011be0 con 0x7fa7441184b0 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa7240385c0 msgr2=0x7fa72403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 --2- 172.21.15.62:0/1636928894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa7240385c0 0x7fa72403aa80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa734036000 tx=0x7fa734008030 comp rx=0 tx=0).stop 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7441184b0 msgr2=0x7fa7441acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 --2- 172.21.15.62:0/1636928894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7441184b0 0x7fa7441acda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00c420 tx=0x7fa72c00c8e0 comp rx=0 tx=0).stop 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 shutdown_connections 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 --2- 172.21.15.62:0/1636928894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fa7240385c0 0x7fa72403aa80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 --2- 172.21.15.62:0/1636928894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7441184b0 0x7fa7441acda0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 >> 172.21.15.62:0/1636928894 conn(0x7fa74406e8f0 msgr2=0x7fa744110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 shutdown_connections 2024-04-26T07:54:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:11.975+0000 7fa749ff2640 1 -- 172.21.15.62:0/1636928894 wait complete. 2024-04-26T07:54:11.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-04-26T07:54:12.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.108+0000 7f0b5a111640 1 Processor -- start 2024-04-26T07:54:12.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.108+0000 7f0b5a111640 1 -- start start 2024-04-26T07:54:12.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.108+0000 7f0b5a111640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0b54110e30 0x7f0b5411a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:12.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.108+0000 7f0b5a111640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b54111350 con 0x7f0b5410f130 2024-04-26T07:54:12.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.108+0000 7f0b5a111640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f0b54111520 con 0x7f0b54110e30 2024-04-26T07:54:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.109+0000 7f0b52ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0b54110e30 0x7f0b5411a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.109+0000 7f0b537fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0b5410f130 0x7f0b54110720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33032/0 (socket says 172.21.15.62:33032) 2024-04-26T07:54:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.109+0000 7f0b537fe640 1 -- 172.21.15.62:0/1749821831 learned_addr learned my addr 172.21.15.62:0/1749821831 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.109+0000 7f0b52ffd640 1 -- 172.21.15.62:0/1749821831 >> v1:172.21.15.1:6789/0 conn(0x7f0b5410f130 legacy=0x7f0b54110720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.109+0000 7f0b52ffd640 1 -- 172.21.15.62:0/1749821831 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5411bcf0 con 0x7f0b54110e30 2024-04-26T07:54:12.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.110+0000 7f0b52ffd640 1 --2- 172.21.15.62:0/1749821831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b54110e30 0x7f0b5411a7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009720 tx=0x7f0b4802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86579d94aaf8dfc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:12.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.110+0000 7f0b527fc640 1 -- 172.21.15.62:0/1749821831 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b480316d0 con 0x7f0b54110e30 2024-04-26T07:54:12.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.110+0000 7f0b527fc640 1 -- 172.21.15.62:0/1749821831 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b48037070 con 0x7f0b54110e30 2024-04-26T07:54:12.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.110+0000 7f0b527fc640 1 -- 172.21.15.62:0/1749821831 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b480319c0 con 0x7f0b54110e30 2024-04-26T07:54:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.111+0000 7f0b5a111640 1 -- 172.21.15.62:0/1749821831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b54110e30 msgr2=0x7f0b5411a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.111+0000 7f0b5a111640 1 --2- 172.21.15.62:0/1749821831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b54110e30 0x7f0b5411a7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009720 tx=0x7f0b4802b840 comp rx=0 tx=0).stop 2024-04-26T07:54:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.111+0000 7f0b5a111640 1 -- 172.21.15.62:0/1749821831 shutdown_connections 2024-04-26T07:54:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.111+0000 7f0b5a111640 1 --2- 172.21.15.62:0/1749821831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b54110e30 0x7f0b5411a7a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.111+0000 7f0b5a111640 1 -- 172.21.15.62:0/1749821831 >> 172.21.15.62:0/1749821831 conn(0x7f0b5406f990 msgr2=0x7f0b54071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.111+0000 7f0b5a111640 1 -- 172.21.15.62:0/1749821831 shutdown_connections 2024-04-26T07:54:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.111+0000 7f0b5a111640 1 -- 172.21.15.62:0/1749821831 wait complete. 2024-04-26T07:54:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.111+0000 7f0b5a111640 1 Processor -- start 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.112+0000 7f0b5a111640 1 -- start start 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.112+0000 7f0b5a111640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b5410f130 0x7f0b54111890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.112+0000 7f0b5a111640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5411b200 con 0x7f0b5410f130 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.112+0000 7f0b537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b5410f130 0x7f0b54111890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.112+0000 7f0b537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b5410f130 0x7f0b54111890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:58934/0 (socket says 172.21.15.62:58934) 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.112+0000 7f0b537fe640 1 -- 172.21.15.62:0/2426317263 learned_addr learned my addr 172.21.15.62:0/2426317263 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.113+0000 7f0b537fe640 1 -- 172.21.15.62:0/2426317263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b54111e60 con 0x7f0b5410f130 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.113+0000 7f0b537fe640 1 --2- 172.21.15.62:0/2426317263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b5410f130 0x7f0b54111890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400c480 tx=0x7f0b4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.113+0000 7f0b3bfff640 1 -- 172.21.15.62:0/2426317263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b44017070 con 0x7f0b5410f130 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.113+0000 7f0b3bfff640 1 -- 172.21.15.62:0/2426317263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b44005c10 con 0x7f0b5410f130 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.113+0000 7f0b3bfff640 1 -- 172.21.15.62:0/2426317263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b440070d0 con 0x7f0b5410f130 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.113+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b541120f0 con 0x7f0b5410f130 2024-04-26T07:54:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.113+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b54112640 con 0x7f0b5410f130 2024-04-26T07:54:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.114+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b540734d0 con 0x7f0b5410f130 2024-04-26T07:54:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.114+0000 7f0b3bfff640 1 -- 172.21.15.62:0/2426317263 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0b4401a070 con 0x7f0b5410f130 2024-04-26T07:54:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.114+0000 7f0b3bfff640 1 --2- 172.21.15.62:0/2426317263 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b400385a0 0x7f0b4003aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.114+0000 7f0b3bfff640 1 -- 172.21.15.62:0/2426317263 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3774+0+0 (secure 0 0 0) 0x7f0b4404aa50 con 0x7f0b5410f130 2024-04-26T07:54:12.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.114+0000 7f0b52ffd640 1 --2- 172.21.15.62:0/2426317263 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b400385a0 0x7f0b4003aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:12.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.115+0000 7f0b52ffd640 1 --2- 172.21.15.62:0/2426317263 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b400385a0 0x7f0b4003aa60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b48036000 tx=0x7f0b48008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:12.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.119+0000 7f0b3bfff640 1 -- 172.21.15.62:0/2426317263 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b4401ac60 con 0x7f0b5410f130 2024-04-26T07:54:12.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:12.305+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f0b5406b6f0 con 0x7f0b5410f130 2024-04-26T07:54:13.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.975+0000 7f0b3bfff640 1 -- 172.21.15.62:0/2426317263 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v15) ==== 227+0+0 (secure 0 0 0) 0x7f0b4401a9a0 con 0x7f0b5410f130 2024-04-26T07:54:13.974 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'default.rgw.buckets.data' created 2024-04-26T07:54:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.979+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b400385a0 msgr2=0x7f0b4003aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.979+0000 7f0b5a111640 1 --2- 172.21.15.62:0/2426317263 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b400385a0 0x7f0b4003aa60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b48036000 tx=0x7f0b48008030 comp rx=0 tx=0).stop 2024-04-26T07:54:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.979+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b5410f130 msgr2=0x7f0b54111890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.979+0000 7f0b5a111640 1 --2- 172.21.15.62:0/2426317263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b5410f130 0x7f0b54111890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400c480 tx=0x7f0b4400c940 comp rx=0 tx=0).stop 2024-04-26T07:54:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.980+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 shutdown_connections 2024-04-26T07:54:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.980+0000 7f0b5a111640 1 --2- 172.21.15.62:0/2426317263 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b400385a0 0x7f0b4003aa60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:13.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.980+0000 7f0b5a111640 1 --2- 172.21.15.62:0/2426317263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b5410f130 0x7f0b54111890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:13.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.980+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 >> 172.21.15.62:0/2426317263 conn(0x7f0b5406f990 msgr2=0x7f0b541159b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:13.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.980+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 shutdown_connections 2024-04-26T07:54:13.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:13.980+0000 7f0b5a111640 1 -- 172.21.15.62:0/2426317263 wait complete. 2024-04-26T07:54:14.001 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-26T07:54:14.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.108+0000 7f922e9b6640 1 Processor -- start 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.108+0000 7f922e9b6640 1 -- start start 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.108+0000 7f922e9b6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f922806d780 0x7f922806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.108+0000 7f922e9b6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922811dc80 con 0x7f922806e0a0 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.108+0000 7f922e9b6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f922811ee80 con 0x7f922806d780 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.109+0000 7f9227fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f922806d780 0x7f922806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.109+0000 7f9227fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f922806d780 0x7f922806db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:58942/0 (socket says 172.21.15.62:58942) 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.109+0000 7f9227fff640 1 -- 172.21.15.62:0/2521190232 learned_addr learned my addr 172.21.15.62:0/2521190232 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.109+0000 7f9227fff640 1 -- 172.21.15.62:0/2521190232 >> v1:172.21.15.1:6789/0 conn(0x7f922806e0a0 legacy=0x7f922811c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.109+0000 7f9227fff640 1 -- 172.21.15.62:0/2521190232 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922811f030 con 0x7f922806d780 2024-04-26T07:54:14.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.110+0000 7f9227fff640 1 --2- 172.21.15.62:0/2521190232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f922806db60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92180097f0 tx=0x7f921802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa3a19f2104285f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:14.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.110+0000 7f9226ffd640 1 -- 172.21.15.62:0/2521190232 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9218035020 con 0x7f922806d780 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.110+0000 7f9226ffd640 1 -- 172.21.15.62:0/2521190232 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92180317a0 con 0x7f922806d780 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.110+0000 7f9226ffd640 1 -- 172.21.15.62:0/2521190232 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9218031aa0 con 0x7f922806d780 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.111+0000 7f922e9b6640 1 -- 172.21.15.62:0/2521190232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 msgr2=0x7f922806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.111+0000 7f922e9b6640 1 --2- 172.21.15.62:0/2521190232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f922806db60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92180097f0 tx=0x7f921802b910 comp rx=0 tx=0).stop 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.111+0000 7f922e9b6640 1 -- 172.21.15.62:0/2521190232 shutdown_connections 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.111+0000 7f922e9b6640 1 --2- 172.21.15.62:0/2521190232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f922806db60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.111+0000 7f922e9b6640 1 -- 172.21.15.62:0/2521190232 >> 172.21.15.62:0/2521190232 conn(0x7f92280710c0 msgr2=0x7f92280734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.111+0000 7f922e9b6640 1 -- 172.21.15.62:0/2521190232 shutdown_connections 2024-04-26T07:54:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.111+0000 7f922e9b6640 1 -- 172.21.15.62:0/2521190232 wait complete. 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.112+0000 7f922e9b6640 1 Processor -- start 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.112+0000 7f922e9b6640 1 -- start start 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.112+0000 7f922e9b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f92281acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.112+0000 7f922e9b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f922811e370 con 0x7f922806d780 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.112+0000 7f9227fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f92281acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.112+0000 7f9227fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f92281acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:58952/0 (socket says 172.21.15.62:58952) 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.112+0000 7f9227fff640 1 -- 172.21.15.62:0/2644090842 learned_addr learned my addr 172.21.15.62:0/2644090842 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.113+0000 7f9227fff640 1 -- 172.21.15.62:0/2644090842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92281ad4b0 con 0x7f922806d780 2024-04-26T07:54:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.113+0000 7f9227fff640 1 --2- 172.21.15.62:0/2644090842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f92281acee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92180097f0 tx=0x7f92180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:14.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.113+0000 7f9224ff9640 1 -- 172.21.15.62:0/2644090842 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921803ad00 con 0x7f922806d780 2024-04-26T07:54:14.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.113+0000 7f9224ff9640 1 -- 172.21.15.62:0/2644090842 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92180443f0 con 0x7f922806d780 2024-04-26T07:54:14.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.113+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92281ad6e0 con 0x7f922806d780 2024-04-26T07:54:14.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.113+0000 7f9224ff9640 1 -- 172.21.15.62:0/2644090842 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92180446d0 con 0x7f922806d780 2024-04-26T07:54:14.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.113+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92281a6d60 con 0x7f922806d780 2024-04-26T07:54:14.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.114+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9228073d40 con 0x7f922806d780 2024-04-26T07:54:14.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.114+0000 7f9224ff9640 1 -- 172.21.15.62:0/2644090842 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f921804b060 con 0x7f922806d780 2024-04-26T07:54:14.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.114+0000 7f9224ff9640 1 --2- 172.21.15.62:0/2644090842 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9214038570 0x7f921403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:14.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.114+0000 7f9224ff9640 1 -- 172.21.15.62:0/2644090842 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4249+0+0 (secure 0 0 0) 0x7f921806dbb0 con 0x7f922806d780 2024-04-26T07:54:14.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.115+0000 7f92277fe640 1 --2- 172.21.15.62:0/2644090842 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9214038570 0x7f921403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:14.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.115+0000 7f92277fe640 1 --2- 172.21.15.62:0/2644090842 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9214038570 0x7f921403aa30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f922806e4f0 tx=0x7f921c0079d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:14.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.120+0000 7f9224ff9640 1 -- 172.21.15.62:0/2644090842 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f921803f070 con 0x7f922806d780 2024-04-26T07:54:14.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.305+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f922806b6f0 con 0x7f922806d780 2024-04-26T07:54:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.981+0000 7f9224ff9640 1 -- 172.21.15.62:0/2644090842 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v16) ==== 185+0+0 (secure 0 0 0) 0x7f921804dca0 con 0x7f922806d780 2024-04-26T07:54:14.980 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-26T07:54:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.983+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9214038570 msgr2=0x7f921403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 --2- 172.21.15.62:0/2644090842 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9214038570 0x7f921403aa30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f922806e4f0 tx=0x7f921c0079d0 comp rx=0 tx=0).stop 2024-04-26T07:54:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 msgr2=0x7f92281acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 --2- 172.21.15.62:0/2644090842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f92281acee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92180097f0 tx=0x7f92180046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 shutdown_connections 2024-04-26T07:54:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 --2- 172.21.15.62:0/2644090842 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9214038570 0x7f921403aa30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 --2- 172.21.15.62:0/2644090842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922806d780 0x7f92281acee0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 >> 172.21.15.62:0/2644090842 conn(0x7f92280710c0 msgr2=0x7f922811b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 shutdown_connections 2024-04-26T07:54:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:14.984+0000 7f922e9b6640 1 -- 172.21.15.62:0/2644090842 wait complete. 2024-04-26T07:54:15.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-26T07:54:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.122+0000 7f5b10426640 1 Processor -- start 2024-04-26T07:54:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.122+0000 7f5b10426640 1 -- start start 2024-04-26T07:54:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.122+0000 7f5b10426640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5b0806d780 0x7f5b0806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.122+0000 7f5b10426640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0811dc00 con 0x7f5b0806e0a0 2024-04-26T07:54:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.122+0000 7f5b10426640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f5b0811ede0 con 0x7f5b0806d780 2024-04-26T07:54:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.123+0000 7f5b0e1c2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5b0806d780 0x7f5b0806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.123+0000 7f5b0d9c1640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5b0806e0a0 0x7f5b0811c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33044/0 (socket says 172.21.15.62:33044) 2024-04-26T07:54:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.123+0000 7f5b0d9c1640 1 -- 172.21.15.62:0/2304275162 learned_addr learned my addr 172.21.15.62:0/2304275162 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.123+0000 7f5b0e1c2640 1 -- 172.21.15.62:0/2304275162 >> v1:172.21.15.1:6789/0 conn(0x7f5b0806e0a0 legacy=0x7f5b0811c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.123+0000 7f5b0e1c2640 1 -- 172.21.15.62:0/2304275162 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0811ef90 con 0x7f5b0806d780 2024-04-26T07:54:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.124+0000 7f5b0e1c2640 1 --2- 172.21.15.62:0/2304275162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b0806db60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009720 tx=0x7f5b0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c9d01a93d70f74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.124+0000 7f5b0d1c0640 1 -- 172.21.15.62:0/2304275162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b00035020 con 0x7f5b0806d780 2024-04-26T07:54:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.124+0000 7f5b0d1c0640 1 -- 172.21.15.62:0/2304275162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00031760 con 0x7f5b0806d780 2024-04-26T07:54:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.124+0000 7f5b0d1c0640 1 -- 172.21.15.62:0/2304275162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b00031a60 con 0x7f5b0806d780 2024-04-26T07:54:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.124+0000 7f5b10426640 1 -- 172.21.15.62:0/2304275162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 msgr2=0x7f5b0806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.124+0000 7f5b10426640 1 --2- 172.21.15.62:0/2304275162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b0806db60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009720 tx=0x7f5b0002b8d0 comp rx=0 tx=0).stop 2024-04-26T07:54:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 -- 172.21.15.62:0/2304275162 shutdown_connections 2024-04-26T07:54:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 --2- 172.21.15.62:0/2304275162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b0806db60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 -- 172.21.15.62:0/2304275162 >> 172.21.15.62:0/2304275162 conn(0x7f5b080710a0 msgr2=0x7f5b080734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 -- 172.21.15.62:0/2304275162 shutdown_connections 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 -- 172.21.15.62:0/2304275162 wait complete. 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 Processor -- start 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 -- start start 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b081acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.125+0000 7f5b10426640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0811e2f0 con 0x7f5b0806d780 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b0e1c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b081acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b0e1c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b081acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:58962/0 (socket says 172.21.15.62:58962) 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b0e1c2640 1 -- 172.21.15.62:0/400722810 learned_addr learned my addr 172.21.15.62:0/400722810 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b0e1c2640 1 -- 172.21.15.62:0/400722810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b081ad500 con 0x7f5b0806d780 2024-04-26T07:54:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b0e1c2640 1 --2- 172.21.15.62:0/400722810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b081acf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b0002b910 tx=0x7f5b000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b06ffd640 1 -- 172.21.15.62:0/400722810 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b0003bcd0 con 0x7f5b0806d780 2024-04-26T07:54:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b06ffd640 1 -- 172.21.15.62:0/400722810 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b000453f0 con 0x7f5b0806d780 2024-04-26T07:54:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b081ad730 con 0x7f5b0806d780 2024-04-26T07:54:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b06ffd640 1 -- 172.21.15.62:0/400722810 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b00045710 con 0x7f5b0806d780 2024-04-26T07:54:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.126+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b081a6db0 con 0x7f5b0806d780 2024-04-26T07:54:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.127+0000 7f5b06ffd640 1 -- 172.21.15.62:0/400722810 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5b0004c060 con 0x7f5b0806d780 2024-04-26T07:54:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.127+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0804fe20 con 0x7f5b0806d780 2024-04-26T07:54:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.127+0000 7f5b06ffd640 1 --2- 172.21.15.62:0/400722810 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5af4038570 0x7f5af403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.127+0000 7f5b06ffd640 1 -- 172.21.15.62:0/400722810 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4260+0+0 (secure 0 0 0) 0x7f5b0006db50 con 0x7f5b0806d780 2024-04-26T07:54:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.127+0000 7f5b0d9c1640 1 --2- 172.21.15.62:0/400722810 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5af4038570 0x7f5af403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.128+0000 7f5b0d9c1640 1 --2- 172.21.15.62:0/400722810 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5af4038570 0x7f5af403aa30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b0806e4f0 tx=0x7f5afc007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.132+0000 7f5b06ffd640 1 -- 172.21.15.62:0/400722810 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b0804fe20 con 0x7f5b0806d780 2024-04-26T07:54:15.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.319+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f5b0806e0a0 con 0x7f5b0806d780 2024-04-26T07:54:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.985+0000 7f5b06ffd640 1 -- 172.21.15.62:0/400722810 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v17) ==== 169+0+0 (secure 0 0 0) 0x7f5b00040070 con 0x7f5b0806d780 2024-04-26T07:54:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'default.rgw.buckets.index' created 2024-04-26T07:54:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.989+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5af4038570 msgr2=0x7f5af403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.989+0000 7f5b10426640 1 --2- 172.21.15.62:0/400722810 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5af4038570 0x7f5af403aa30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b0806e4f0 tx=0x7f5afc007a80 comp rx=0 tx=0).stop 2024-04-26T07:54:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.989+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 msgr2=0x7f5b081acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:15.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.989+0000 7f5b10426640 1 --2- 172.21.15.62:0/400722810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b081acf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b0002b910 tx=0x7f5b000046c0 comp rx=0 tx=0).stop 2024-04-26T07:54:15.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.989+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 shutdown_connections 2024-04-26T07:54:15.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.989+0000 7f5b10426640 1 --2- 172.21.15.62:0/400722810 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5af4038570 0x7f5af403aa30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:15.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.989+0000 7f5b10426640 1 --2- 172.21.15.62:0/400722810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b0806d780 0x7f5b081acf30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:15.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.989+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 >> 172.21.15.62:0/400722810 conn(0x7f5b080710a0 msgr2=0x7f5b0811d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:15.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.991+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 shutdown_connections 2024-04-26T07:54:15.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:15.991+0000 7f5b10426640 1 -- 172.21.15.62:0/400722810 wait complete. 2024-04-26T07:54:16.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-26T07:54:16.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.114+0000 7f27546fd640 1 Processor -- start 2024-04-26T07:54:16.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.114+0000 7f27546fd640 1 -- start start 2024-04-26T07:54:16.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.115+0000 7f27546fd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f274c11b4f0 0x7f274c11d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:16.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.115+0000 7f27546fd640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f274c10fab0 con 0x7f274c10ee10 2024-04-26T07:54:16.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.115+0000 7f27546fd640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f274c11ee30 con 0x7f274c11b4f0 2024-04-26T07:54:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.115+0000 7f2751c98640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f274c11b4f0 0x7f274c11d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.115+0000 7f2751c98640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f274c11b4f0 0x7f274c11d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:58970/0 (socket says 172.21.15.62:58970) 2024-04-26T07:54:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.115+0000 7f2751c98640 1 -- 172.21.15.62:0/655372143 learned_addr learned my addr 172.21.15.62:0/655372143 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.115+0000 7f2752499640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f274c10ee10 0x7f274c10f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33052/0 (socket says 172.21.15.62:33052) 2024-04-26T07:54:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.116+0000 7f2751c98640 1 -- 172.21.15.62:0/655372143 >> v1:172.21.15.1:6789/0 conn(0x7f274c10ee10 legacy=0x7f274c10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:16.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.116+0000 7f2751c98640 1 -- 172.21.15.62:0/655372143 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c11efb0 con 0x7f274c11b4f0 2024-04-26T07:54:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.116+0000 7f2751c98640 1 --2- 172.21.15.62:0/655372143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c11b4f0 0x7f274c11d8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f27400097f0 tx=0x7f274002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49bb716c3b6260a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f2751497640 1 -- 172.21.15.62:0/655372143 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2740035020 con 0x7f274c11b4f0 2024-04-26T07:54:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f2751497640 1 -- 172.21.15.62:0/655372143 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27400317a0 con 0x7f274c11b4f0 2024-04-26T07:54:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f2751497640 1 -- 172.21.15.62:0/655372143 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2740031aa0 con 0x7f274c11b4f0 2024-04-26T07:54:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f27546fd640 1 -- 172.21.15.62:0/655372143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c11b4f0 msgr2=0x7f274c11d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f27546fd640 1 --2- 172.21.15.62:0/655372143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c11b4f0 0x7f274c11d8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f27400097f0 tx=0x7f274002b910 comp rx=0 tx=0).stop 2024-04-26T07:54:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f27546fd640 1 -- 172.21.15.62:0/655372143 shutdown_connections 2024-04-26T07:54:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f27546fd640 1 --2- 172.21.15.62:0/655372143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c11b4f0 0x7f274c11d8e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:16.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f27546fd640 1 -- 172.21.15.62:0/655372143 >> 172.21.15.62:0/655372143 conn(0x7f274c06fba0 msgr2=0x7f274c071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:16.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f27546fd640 1 -- 172.21.15.62:0/655372143 shutdown_connections 2024-04-26T07:54:16.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.117+0000 7f27546fd640 1 -- 172.21.15.62:0/655372143 wait complete. 2024-04-26T07:54:16.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.118+0000 7f27546fd640 1 Processor -- start 2024-04-26T07:54:16.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.118+0000 7f27546fd640 1 -- start start 2024-04-26T07:54:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.118+0000 7f27546fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c10ee10 0x7f274c1acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.118+0000 7f27546fd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f274c11e340 con 0x7f274c10ee10 2024-04-26T07:54:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.118+0000 7f2752499640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c10ee10 0x7f274c1acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.118+0000 7f2752499640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c10ee10 0x7f274c1acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:58980/0 (socket says 172.21.15.62:58980) 2024-04-26T07:54:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.118+0000 7f2752499640 1 -- 172.21.15.62:0/3727027581 learned_addr learned my addr 172.21.15.62:0/3727027581 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:16.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.119+0000 7f2752499640 1 -- 172.21.15.62:0/3727027581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c1ad4b0 con 0x7f274c10ee10 2024-04-26T07:54:16.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.119+0000 7f2752499640 1 --2- 172.21.15.62:0/3727027581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c10ee10 0x7f274c1acee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f274400c3d0 tx=0x7f274400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:16.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.119+0000 7f274affd640 1 -- 172.21.15.62:0/3727027581 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2744007410 con 0x7f274c10ee10 2024-04-26T07:54:16.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.119+0000 7f274affd640 1 -- 172.21.15.62:0/3727027581 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27440075b0 con 0x7f274c10ee10 2024-04-26T07:54:16.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.119+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274c1ad6e0 con 0x7f274c10ee10 2024-04-26T07:54:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.119+0000 7f274affd640 1 -- 172.21.15.62:0/3727027581 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2744004910 con 0x7f274c10ee10 2024-04-26T07:54:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.119+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274c1a6d60 con 0x7f274c10ee10 2024-04-26T07:54:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.120+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f274c0736e0 con 0x7f274c10ee10 2024-04-26T07:54:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.120+0000 7f274affd640 1 -- 172.21.15.62:0/3727027581 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f274401a020 con 0x7f274c10ee10 2024-04-26T07:54:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.120+0000 7f274affd640 1 --2- 172.21.15.62:0/3727027581 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f27380385c0 0x7f273803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.120+0000 7f274affd640 1 -- 172.21.15.62:0/3727027581 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4624+0+0 (secure 0 0 0) 0x7f274404b210 con 0x7f274c10ee10 2024-04-26T07:54:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.121+0000 7f2751c98640 1 --2- 172.21.15.62:0/3727027581 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f27380385c0 0x7f273803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.121+0000 7f2751c98640 1 --2- 172.21.15.62:0/3727027581 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f27380385c0 0x7f273803aa80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2740036000 tx=0x7f2740008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:16.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.126+0000 7f274affd640 1 -- 172.21.15.62:0/3727027581 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f274401b9a0 con 0x7f274c10ee10 2024-04-26T07:54:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.313+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f274c06b6f0 con 0x7f274c10ee10 2024-04-26T07:54:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.988+0000 7f274affd640 1 -- 172.21.15.62:0/3727027581 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v18) ==== 187+0+0 (secure 0 0 0) 0x7f274401bc00 con 0x7f274c10ee10 2024-04-26T07:54:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-26T07:54:16.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f27380385c0 msgr2=0x7f273803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:16.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 --2- 172.21.15.62:0/3727027581 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f27380385c0 0x7f273803aa80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2740036000 tx=0x7f2740008030 comp rx=0 tx=0).stop 2024-04-26T07:54:16.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c10ee10 msgr2=0x7f274c1acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 --2- 172.21.15.62:0/3727027581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c10ee10 0x7f274c1acee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f274400c3d0 tx=0x7f274400c890 comp rx=0 tx=0).stop 2024-04-26T07:54:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 shutdown_connections 2024-04-26T07:54:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 --2- 172.21.15.62:0/3727027581 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f27380385c0 0x7f273803aa80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 --2- 172.21.15.62:0/3727027581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f274c10ee10 0x7f274c1acee0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 >> 172.21.15.62:0/3727027581 conn(0x7f274c06fba0 msgr2=0x7f274c072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 shutdown_connections 2024-04-26T07:54:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:16.993+0000 7f27546fd640 1 -- 172.21.15.62:0/3727027581 wait complete. 2024-04-26T07:54:17.018 DEBUG:tasks.rgw:Pools created 2024-04-26T07:54:17.019 INFO:tasks.rgw:Starting rgw... 2024-04-26T07:54:17.019 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-26T07:54:17.019 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-26T07:54:17.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo echo -n http://smithi062.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-26T07:54:17.045 INFO:teuthology.orchestra.run.smithi062.stdout:http://smithi062.front.sepia.ceph.com:80 2024-04-26T07:54:17.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-26T07:54:17.114 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-26T07:54:17.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-26T07:54:17.154 INFO:tasks.rgw.client.0:Started 2024-04-26T07:54:17.154 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi062.front.sepia.ceph.com:80/ 2024-04-26T07:54:17.154 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-04-26T07:54:17.207 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:54:17.208 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:54:17.208 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T07:54:17.209 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T07:54:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-04-26T07:54:18.211 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-04-26T07:54:18.233 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:54:18.234 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:54:18.235 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T07:54:18.236 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T07:54:18.236 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-04-26T07:54:20.237 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-04-26T07:54:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:54:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:54:20.263 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T07:54:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T07:54:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-04-26T07:54:24.264 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-04-26T07:54:24.289 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:54:24.289 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:54:24.289 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T07:54:24.290 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T07:54:24.290 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-04-26T07:54:26.090 INFO:tasks.rgw.client.0.smithi062.stdout:2024-04-26T07:54:26.091+0000 7f6bc8722880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-26T07:54:32.291 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-04-26T07:54:32.314 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:54:32.315 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:54:32.317 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 62333 0 --:--:-- --:--:-- --:--:-- 93500 2024-04-26T07:54:32.317 INFO:teuthology.orchestra.run.smithi062.stdout:anonymous 2024-04-26T07:54:32.318 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-04-26T07:54:32.413 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-04-26T07:54:32.413 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-26T07:54:32.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-26T07:54:32.414 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-26T07:54:32.463 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:32.463 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:32.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.465+0000 7f3c1d3a2800 1 Processor -- start 2024-04-26T07:54:32.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.465+0000 7f3c1d3a2800 1 -- start start 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1d3a2800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56305d1acb80 0x56305d1aef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1d3a2800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56305d1af540 con 0x56305d1a6960 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1d3a2800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x56305d04ae20 con 0x56305d1acb80 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1a6a7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56305d1acb80 0x56305d1aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1aea8640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x56305d1a6960 0x56305d1a6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36378/0 (socket says 172.21.15.62:36378) 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1aea8640 1 -- 172.21.15.62:0/3222694456 learned_addr learned my addr 172.21.15.62:0/3222694456 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1a6a7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56305d1acb80 0x56305d1aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60164/0 (socket says 172.21.15.62:60164) 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/3222694456 >> v1:172.21.15.1:6789/0 conn(0x56305d1a6960 legacy=0x56305d1a6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.466+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/3222694456 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56305d1b0720 con 0x56305d1acb80 2024-04-26T07:54:32.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.468+0000 7f3c1a6a7640 1 --2- 172.21.15.62:0/3222694456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1acb80 0x56305d1aef70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000a470 tx=0x7f3c1001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284da5bae24145b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c19ea6640 1 -- 172.21.15.62:0/3222694456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c10057070 con 0x56305d1acb80 2024-04-26T07:54:32.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c19ea6640 1 -- 172.21.15.62:0/3222694456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10052570 con 0x56305d1acb80 2024-04-26T07:54:32.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c19ea6640 1 -- 172.21.15.62:0/3222694456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c10052870 con 0x56305d1acb80 2024-04-26T07:54:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3222694456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1acb80 msgr2=0x56305d1aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/3222694456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1acb80 0x56305d1aef70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000a470 tx=0x7f3c1001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3222694456 shutdown_connections 2024-04-26T07:54:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/3222694456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1acb80 0x56305d1aef70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3222694456 >> 172.21.15.62:0/3222694456 conn(0x56305d1a2310 msgr2=0x56305d1a4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3222694456 shutdown_connections 2024-04-26T07:54:32.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.469+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3222694456 wait complete. 2024-04-26T07:54:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.484+0000 7f3c1d3a2800 1 Processor -- start 2024-04-26T07:54:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.484+0000 7f3c1d3a2800 1 -- start start 2024-04-26T07:54:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.484+0000 7f3c1d3a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d299c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.485+0000 7f3c1d3a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56305d0f3cc0 con 0x56305d1a6960 2024-04-26T07:54:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.485+0000 7f3c1aea8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d299c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.485+0000 7f3c1aea8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d299c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60174/0 (socket says 172.21.15.62:60174) 2024-04-26T07:54:32.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.485+0000 7f3c1aea8640 1 -- 172.21.15.62:0/3210941959 learned_addr learned my addr 172.21.15.62:0/3210941959 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.485+0000 7f3c1aea8640 1 -- 172.21.15.62:0/3210941959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56305d29a250 con 0x56305d1a6960 2024-04-26T07:54:32.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.485+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/3210941959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d299c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c001de0 tx=0x7f3c0c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb2fbce3898ea43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3b08e09640 1 -- 172.21.15.62:0/3210941959 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0c012020 con 0x56305d1a6960 2024-04-26T07:54:32.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3b08e09640 1 -- 172.21.15.62:0/3210941959 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0c00e5a0 con 0x56305d1a6960 2024-04-26T07:54:32.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3b08e09640 1 -- 172.21.15.62:0/3210941959 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0c00e8c0 con 0x56305d1a6960 2024-04-26T07:54:32.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3210941959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 msgr2=0x56305d299c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/3210941959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d299c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c001de0 tx=0x7f3c0c00b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3210941959 shutdown_connections 2024-04-26T07:54:32.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/3210941959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d299c80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3210941959 >> 172.21.15.62:0/3210941959 conn(0x56305d1a2310 msgr2=0x56305d2955a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3210941959 shutdown_connections 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.486+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3210941959 wait complete. 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.487+0000 7f3c1d3a2800 1 Processor -- start 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.487+0000 7f3c1d3a2800 1 -- start start 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.487+0000 7f3c1d3a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d2a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.487+0000 7f3c1d3a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56305d1af9e0 con 0x56305d1a6960 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.487+0000 7f3c1aea8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d2a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.487+0000 7f3c1aea8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d2a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60184/0 (socket says 172.21.15.62:60184) 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.487+0000 7f3c1aea8640 1 -- 172.21.15.62:0/2604747785 learned_addr learned my addr 172.21.15.62:0/2604747785 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.488+0000 7f3c1aea8640 1 -- 172.21.15.62:0/2604747785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56305d2a1d00 con 0x56305d1a6960 2024-04-26T07:54:32.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.488+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d2a17c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c010 tx=0x7f3c0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.488+0000 7f3b07606640 1 -- 172.21.15.62:0/2604747785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0c012070 con 0x56305d1a6960 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.488+0000 7f3b07606640 1 -- 172.21.15.62:0/2604747785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0c01a7a0 con 0x56305d1a6960 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.488+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56305d2a1f90 con 0x56305d1a6960 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.488+0000 7f3b07606640 1 -- 172.21.15.62:0/2604747785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0c01aa80 con 0x56305d1a6960 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.488+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56305d2a4c40 con 0x56305d1a6960 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.489+0000 7f3b07606640 1 -- 172.21.15.62:0/2604747785 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3c0c015020 con 0x56305d1a6960 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.489+0000 7f3b07606640 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3b00036eb0 0x7f3b00039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.489+0000 7f3b07606640 1 -- 172.21.15.62:0/2604747785 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f3c0c020070 con 0x56305d1a6960 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.489+0000 7f3c1a6a7640 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3b00036eb0 0x7f3b00039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.490+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d1acb80 0x56305d2a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.490+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2a8f40 con 0x56305d1acb80 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.490+0000 7f3c1b6a9640 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d1acb80 0x56305d2a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.490+0000 7f3c1a6a7640 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3b00036eb0 0x7f3b00039370 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c10054000 tx=0x7f3c1004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.490+0000 7f3c1b6a9640 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d1acb80 0x56305d2a8a00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.490+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/2604747785 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c1400a4a0 con 0x56305d1acb80 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.490+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2a5fd0 con 0x56305d1acb80 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.491+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/2604747785 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c1400a4a0 con 0x56305d1acb80 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.491+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2ab230 0x56305d2ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.491+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2add10 con 0x56305d2ab230 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.491+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2ab230 0x56305d2ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.492+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2ab230 0x56305d2ad620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.492+0000 7f3c1aea8640 1 -- 172.21.15.62:0/2604747785 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2ab230 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.492+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2aa1e0 con 0x56305d1acb80 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.492+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/2604747785 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c1400a4a0 con 0x56305d1acb80 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.492+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2aa680 con 0x56305d1acb80 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.493+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/2604747785 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c1400a4a0 con 0x56305d1acb80 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.493+0000 7f3c1d3a2800 1 Processor -- start 2024-04-26T07:54:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.493+0000 7f3c1d3a2800 1 -- start start 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.493+0000 7f3c1d3a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d2bce50 0x56305d2bd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.493+0000 7f3c1d3a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56305d09b170 con 0x56305d2bce50 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.493+0000 7f3c1b6a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d2bce50 0x56305d2bd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.493+0000 7f3c1b6a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d2bce50 0x56305d2bd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60200/0 (socket says 172.21.15.62:60200) 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.493+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/3952542976 learned_addr learned my addr 172.21.15.62:0/3952542976 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.494+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/3952542976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56305d2bd7b0 con 0x56305d2bce50 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.494+0000 7f3c1b6a9640 1 --2- 172.21.15.62:0/3952542976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d2bce50 0x56305d2bd270 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56305d2a2bc0 tx=0x7f3c14018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.494+0000 7f3b04e01640 1 -- 172.21.15.62:0/3952542976 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c14014450 con 0x56305d2bce50 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.494+0000 7f3b04e01640 1 -- 172.21.15.62:0/3952542976 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140145f0 con 0x56305d2bce50 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.494+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3952542976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56305d2be220 con 0x56305d2bce50 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.494+0000 7f3b04e01640 1 -- 172.21.15.62:0/3952542976 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c14014910 con 0x56305d2bce50 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.494+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3952542976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56305d2be720 con 0x56305d2bce50 2024-04-26T07:54:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.495+0000 7f3b04e01640 1 -- 172.21.15.62:0/3952542976 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3c14011040 con 0x56305d2bce50 2024-04-26T07:54:32.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.495+0000 7f3b04e01640 1 --2- 172.21.15.62:0/3952542976 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3af4036eb0 0x7f3af4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.495+0000 7f3b04e01640 1 -- 172.21.15.62:0/3952542976 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f3c1401e070 con 0x56305d2bce50 2024-04-26T07:54:32.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.495+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/3952542976 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3af4036eb0 0x7f3af4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1d3a2800 1 Processor -- start 2024-04-26T07:54:32.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1d3a2800 1 -- start start 2024-04-26T07:54:32.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/3952542976 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3af4036eb0 0x7f3af4039370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x56305d2a9380 tx=0x7f3c0c04af80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1d3a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d1a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1d3a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56305d29a5d0 con 0x56305d1a9050 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1b6a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d1a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1b6a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d1a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60202/0 (socket says 172.21.15.62:60202) 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/1748601394 learned_addr learned my addr 172.21.15.62:0/1748601394 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.496+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/1748601394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56305d1a9500 con 0x56305d1a9050 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3c1b6a9640 1 --2- 172.21.15.62:0/1748601394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d1a7740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3c14018430 tx=0x7f3c14041420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee133cd6a9df2e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3afe7fc640 1 -- 172.21.15.62:0/1748601394 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c14046070 con 0x56305d1a9050 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3afe7fc640 1 -- 172.21.15.62:0/1748601394 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c14013de0 con 0x56305d1a9050 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3afe7fc640 1 -- 172.21.15.62:0/1748601394 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c14046360 con 0x56305d1a9050 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/1748601394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 msgr2=0x56305d1a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/1748601394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d1a7740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3c14018430 tx=0x7f3c14041420 comp rx=0 tx=0).stop 2024-04-26T07:54:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/1748601394 shutdown_connections 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/1748601394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d1a7740 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/1748601394 >> 172.21.15.62:0/1748601394 conn(0x56305d2c6470 msgr2=0x56305d2c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/1748601394 shutdown_connections 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.497+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/1748601394 wait complete. 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.498+0000 7f3c1d3a2800 1 Processor -- start 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.498+0000 7f3c1d3a2800 1 -- start start 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.498+0000 7f3c1d3a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d2d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.498+0000 7f3c1d3a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56305d1a7e00 con 0x56305d1a9050 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.498+0000 7f3c1b6a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d2d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.498+0000 7f3c1b6a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d2d39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60206/0 (socket says 172.21.15.62:60206) 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.498+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 learned_addr learned my addr 172.21.15.62:0/194291367 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.498+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56305d2d3ee0 con 0x56305d1a9050 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.499+0000 7f3c1b6a9640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d2d39a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c14044040 tx=0x7f3c1404cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.499+0000 7f3afcff9640 1 -- 172.21.15.62:0/194291367 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c1403b070 con 0x56305d1a9050 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.499+0000 7f3afcff9640 1 -- 172.21.15.62:0/194291367 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1402bc70 con 0x56305d1a9050 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.499+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56305d2d4170 con 0x56305d1a9050 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.499+0000 7f3afcff9640 1 -- 172.21.15.62:0/194291367 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c14046040 con 0x56305d1a9050 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.499+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56305d2d6e20 con 0x56305d1a9050 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.500+0000 7f3afcff9640 1 -- 172.21.15.62:0/194291367 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3c140133b0 con 0x56305d1a9050 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.500+0000 7f3afcff9640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ae4036eb0 0x7f3ae4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.500+0000 7f3afcff9640 1 -- 172.21.15.62:0/194291367 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f3c14033070 con 0x56305d1a9050 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.500+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.500+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ae4036eb0 0x7f3ae4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.500+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d2df630 0x56305d2e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.500+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e2220 con 0x56305d2df630 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.500+0000 7f3c1a6a7640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d2df630 0x56305d2e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ae4036eb0 0x7f3ae4039370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c016f50 tx=0x7f3c0c040000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1a6a7640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d2df630 0x56305d2e1ad0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1d3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1d3a2800 20 realm 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e2640 con 0x56305d2df630 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1d3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1d3a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.501+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e2ee0 con 0x56305d2df630 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1d3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e3280 con 0x56305d2df630 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1d3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2e3fe0 0x56305d2e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.502+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6910 con 0x56305d2e3fe0 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.503+0000 7f3c1b6a9640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2e3fe0 0x56305d2e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.503+0000 7f3c1b6a9640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2e3fe0 0x56305d2e63d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.503+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.503+0000 7f3c1d3a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.503+0000 7f3c1d3a2800 20 searching for the correct realm 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.503+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56305d2e8960 0x56305d2eae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.503+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.503+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56305d2e8960 0x56305d2eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.504+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56305d2e8960 0x56305d2eae20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.504+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.504+0000 7f3c1aea8640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f3c0c03b070 0x7f3c0c019000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.504+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x7f3c0c03b070 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.505+0000 7f3c1a6a7640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f3c0c03b070 0x7f3c0c019000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.505+0000 7f3c1a6a7640 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f3c0c03b070 0x7f3c0c019000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.505+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.505+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.506+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.506+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2df630 2024-04-26T07:54:32.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.506+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.506+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2df630 2024-04-26T07:54:32.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.506+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.506+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.507+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.507+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.507+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.507+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x7f3c0c03b070 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.507+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.507+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.508+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.508+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2df630 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.508+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.508+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.508+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.508+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2df630 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.509+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.509+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x7f3c0c03b070 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.509+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.509+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.509+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.509+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.509+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.510+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.510+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.510+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.510+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.510+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.510+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.511+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2df630 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.511+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.511+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2df630 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.511+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.511+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.511+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.511+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.512+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.512+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x7f3c0c03b070 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.512+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.512+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2df630 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.512+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.512+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.513+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.513+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.513+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.513+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.513+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.513+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x7f3c0c03b070 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.514+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.514+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e8960 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.514+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.514+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2e3fe0 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.514+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.514+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x56305d2df630 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb4f0 con 0x7f3c0c03b070 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e7360 con 0x56305d2df630 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2df630 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.515+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e7c50 con 0x56305d2df630 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 20 zone default found 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 4 Realm: () 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 20 zonegroup default 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e3fe0 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.516+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e7840 con 0x56305d2e8960 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1d3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1d3a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2edcc0 con 0x56305d2e8960 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1d3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1d3a2800 20 started sync module instance, tier type = 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1d3a2800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.517+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ed030 con 0x7f3c0c03b070 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.518+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.518+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94765721769312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ed030 con 0x7f3c0c03b070 2024-04-26T07:54:32.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.518+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ee850 con 0x56305d2df630 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.520+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94765721769312] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.520+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.520+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94765721772864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ed030 con 0x56305d2df630 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.520+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ef2e0 con 0x56305d2e8960 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.521+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94765721772864] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.523+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.523+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94765721766784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ecfa0 con 0x56305d2e8960 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.523+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f01a0 con 0x7f3c0c03b070 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.524+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.524+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94765721779920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f08e0 con 0x7f3c0c03b070 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.524+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f1400 con 0x56305d2df630 2024-04-26T07:54:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.524+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94765721766784] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.528+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.528+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94765721784016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f13c0 con 0x56305d2df630 2024-04-26T07:54:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.528+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f1e10 con 0x56305d2e3fe0 2024-04-26T07:54:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.528+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94765721779920] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.531+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94765721784016] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.531+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.531+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94765721777872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f1960 con 0x56305d2e3fe0 2024-04-26T07:54:32.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.531+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f26b0 con 0x56305d2e3fe0 2024-04-26T07:54:32.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.532+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94765721777872] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.533+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.533+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94765721781040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f1960 con 0x56305d2e3fe0 2024-04-26T07:54:32.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.533+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f2d10 con 0x56305d2e3fe0 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.534+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.534+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94765721790496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f2c40 con 0x56305d2e3fe0 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.534+0000 7f3c1d3a2800 20 add_watcher() i=0 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.534+0000 7f3c1d3a2800 20 add_watcher() i=1 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.534+0000 7f3c1d3a2800 20 add_watcher() i=2 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.534+0000 7f3c1d3a2800 20 add_watcher() i=3 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.534+0000 7f3c1d3a2800 20 add_watcher() i=4 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.534+0000 7f3c1d3a2800 20 add_watcher() i=5 2024-04-26T07:54:32.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.535+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94765721781040] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.535+0000 7f3c1d3a2800 20 add_watcher() i=6 2024-04-26T07:54:32.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.535+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94765721790496] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.535+0000 7f3c1d3a2800 20 add_watcher() i=7 2024-04-26T07:54:32.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.535+0000 7f3c1d3a2800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:32.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.536+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f2200 con 0x56305d2df630 2024-04-26T07:54:32.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.536+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.536+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94765721792768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2f2200 con 0x56305d2df630 2024-04-26T07:54:32.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.537+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94765721792768] v27'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.537+0000 7f3ad17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:32.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.537+0000 7f3c1d3a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:32.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.537+0000 7f3c1d3a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:32.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.537+0000 7f3c1d3a2800 5 note: GC not initialized 2024-04-26T07:54:32.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.538+0000 7f3a4bfff640 20 reqs_thread_entry: start 2024-04-26T07:54:32.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.538+0000 7f3c1d3a2800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:32.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.538+0000 7f3c1d3a2800 20 Filter name: none 2024-04-26T07:54:32.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.538+0000 7f3a49ffb640 20 reqs_thread_entry: start 2024-04-26T07:54:32.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.538+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d328f30 con 0x56305d2e8960 2024-04-26T07:54:32.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.539+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.539+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d328f30 con 0x56305d2e8960 2024-04-26T07:54:32.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.539+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.539+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d328f30 con 0x56305d2df630 2024-04-26T07:54:32.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.539+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.539+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2df630 2024-04-26T07:54:32.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.539+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.539+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x7f3c0c03b070 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.540+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.540+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2e8960 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.540+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.540+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2df630 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.540+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.540+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2e8960 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.540+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.540+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x7f3c0c03b070 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.541+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.541+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2e8960 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.541+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.541+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2df630 2024-04-26T07:54:32.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.541+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.541+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2e3fe0 2024-04-26T07:54:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.542+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.542+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e3fe0 2024-04-26T07:54:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.542+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.542+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e8960 2024-04-26T07:54:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.542+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.542+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e3fe0 2024-04-26T07:54:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.543+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.543+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e3fe0 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.543+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.543+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e3fe0 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.543+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.543+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e8960 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.544+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.544+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x7f3c0c03b070 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.544+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(80 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.544+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2df630 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.544+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.544+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2df630 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.544+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.544+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e8960 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.545+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.545+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x7f3c0c03b070 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.545+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.545+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e3fe0 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.545+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.545+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2df630 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.545+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.545+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e3fe0 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.546+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.546+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e8960 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.546+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.546+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x7f3c0c03b070 2024-04-26T07:54:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.546+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.546+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e3fe0 2024-04-26T07:54:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.547+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.547+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2df630 2024-04-26T07:54:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.547+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.547+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x56305d2e8960 2024-04-26T07:54:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.547+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.547+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56305d2eb970 con 0x7f3c0c03b070 2024-04-26T07:54:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.547+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(93 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.548+0000 7f3ad17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:32.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.548+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94765721792768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2df630 2024-04-26T07:54:32.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.549+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94765721792768] v27'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.549+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94765721769312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x7f3c0c03b070 2024-04-26T07:54:32.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.552+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94765721769312] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.552+0000 7f3c1d3a2800 20 remove_watcher() i=0 2024-04-26T07:54:32.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.552+0000 7f3c1d3a2800 2 removed watcher, disabling cache 2024-04-26T07:54:32.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.552+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94765721772864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2df630 2024-04-26T07:54:32.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.554+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94765721772864] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.554+0000 7f3c1d3a2800 20 remove_watcher() i=1 2024-04-26T07:54:32.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.554+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94765721766784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2e6f70 con 0x56305d2e8960 2024-04-26T07:54:32.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.555+0000 7f3c1aea8640 1 -- 172.21.15.62:0/194291367 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94765721766784] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0c02b070 con 0x56305d2e8960 2024-04-26T07:54:32.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.555+0000 7f3c1d3a2800 20 remove_watcher() i=2 2024-04-26T07:54:32.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.555+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94765721779920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ecb80 con 0x7f3c0c03b070 2024-04-26T07:54:32.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.556+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94765721779920] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x7f3c0c03b070 2024-04-26T07:54:32.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.556+0000 7f3c1d3a2800 20 remove_watcher() i=3 2024-04-26T07:54:32.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.556+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94765721784016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2efed0 con 0x56305d2df630 2024-04-26T07:54:32.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.558+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94765721784016] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1005a040 con 0x56305d2df630 2024-04-26T07:54:32.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.558+0000 7f3c1d3a2800 20 remove_watcher() i=4 2024-04-26T07:54:32.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.558+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94765721777872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ecb80 con 0x56305d2e3fe0 2024-04-26T07:54:32.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.559+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94765721777872] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.559+0000 7f3c1d3a2800 20 remove_watcher() i=5 2024-04-26T07:54:32.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.559+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94765721781040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ef6d0 con 0x56305d2e3fe0 2024-04-26T07:54:32.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.561+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94765721781040] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.561+0000 7f3c1d3a2800 20 remove_watcher() i=6 2024-04-26T07:54:32.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.561+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94765721790496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56305d2ed560 con 0x56305d2e3fe0 2024-04-26T07:54:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1b6a9640 1 -- 172.21.15.62:0/194291367 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94765721790496] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c1402a070 con 0x56305d2e3fe0 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 20 remove_watcher() i=7 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2e3fe0 msgr2=0x56305d2e63d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2e3fe0 0x56305d2e63d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d2df630 msgr2=0x56305d2e1ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d2df630 0x56305d2e1ad0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f3c0c03b070 msgr2=0x7f3c0c019000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f3c0c03b070 0x7f3c0c019000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56305d2e8960 msgr2=0x56305d2eae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56305d2e8960 0x56305d2eae20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ae4036eb0 msgr2=0x7f3ae4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ae4036eb0 0x7f3ae4039370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c016f50 tx=0x7f3c0c040000 comp rx=0 tx=0).stop 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.562+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 msgr2=0x56305d2d39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1a6a7640 1 -- 172.21.15.62:0/194291367 reap_dead start 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d2d39a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c14044040 tx=0x7f3c1404cf70 comp rx=0 tx=0).stop 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 shutdown_connections 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/194291367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a9050 0x56305d2d39a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 >> 172.21.15.62:0/194291367 conn(0x56305d2c6470 msgr2=0x56305d2c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 shutdown_connections 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/194291367 wait complete. 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3952542976 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3af4036eb0 msgr2=0x7f3af4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/3952542976 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3af4036eb0 0x7f3af4039370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x56305d2a9380 tx=0x7f3c0c04af80 comp rx=0 tx=0).stop 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3952542976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d2bce50 msgr2=0x56305d2bd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/3952542976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d2bce50 0x56305d2bd270 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56305d2a2bc0 tx=0x7f3c14018830 comp rx=0 tx=0).stop 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3952542976 shutdown_connections 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/3952542976 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3af4036eb0 0x7f3af4039370 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/3952542976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d2bce50 0x56305d2bd270 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3952542976 >> 172.21.15.62:0/3952542976 conn(0x56305d2b0ef0 msgr2=0x56305d2b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3952542976 shutdown_connections 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/3952542976 wait complete. 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2ab230 msgr2=0x56305d2ad620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2ab230 0x56305d2ad620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d1acb80 msgr2=0x56305d2a8a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.563+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d1acb80 0x56305d2a8a00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3b00036eb0 msgr2=0x7f3b00039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3b00036eb0 0x7f3b00039370 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c10054000 tx=0x7f3c1004e000 comp rx=0 tx=0).stop 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 msgr2=0x56305d2a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d2a17c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c010 tx=0x7f3c0c000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 shutdown_connections 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56305d1acb80 0x56305d2a8a00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56305d2ab230 0x56305d2ad620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3b00036eb0 0x7f3b00039370 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 --2- 172.21.15.62:0/2604747785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56305d1a6960 0x56305d2a17c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 >> 172.21.15.62:0/2604747785 conn(0x56305d1a2310 msgr2=0x56305d293da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 shutdown_connections 2024-04-26T07:54:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.564+0000 7f3c1d3a2800 1 -- 172.21.15.62:0/2604747785 wait complete. 2024-04-26T07:54:32.581 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-04-26T07:54:32.581 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T07:54:32.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-04-26T07:54:32.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-04-26T07:54:32.582 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-04-26T07:54:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f6587e3d800 1 Processor -- start 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f6587e3d800 1 -- start start 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f6587e3d800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c5a06d8b90 0x55c5a06daf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f6587e3d800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5a06db550 con 0x55c5a06d2970 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f6587e3d800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55c5a0576e20 con 0x55c5a06d8b90 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f658513b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c5a06d8b90 0x55c5a06daf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f658593c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55c5a06d2970 0x55c5a06d2d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36394/0 (socket says 172.21.15.62:36394) 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f658513b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c5a06d8b90 0x55c5a06daf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60210/0 (socket says 172.21.15.62:60210) 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.629+0000 7f658593c640 1 -- 172.21.15.62:0/1719436231 learned_addr learned my addr 172.21.15.62:0/1719436231 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.630+0000 7f658513b640 1 -- 172.21.15.62:0/1719436231 >> v1:172.21.15.1:6789/0 conn(0x55c5a06d2970 legacy=0x55c5a06d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.630+0000 7f658513b640 1 -- 172.21.15.62:0/1719436231 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a06dc730 con 0x55c5a06d8b90 2024-04-26T07:54:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f658513b640 1 --2- 172.21.15.62:0/1719436231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d8b90 0x55c5a06daf80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f657c00a470 tx=0x7f657c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bce6db86bd67f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f658493a640 1 -- 172.21.15.62:0/1719436231 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f657c057070 con 0x55c5a06d8b90 2024-04-26T07:54:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f658493a640 1 -- 172.21.15.62:0/1719436231 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657c052570 con 0x55c5a06d8b90 2024-04-26T07:54:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f658493a640 1 -- 172.21.15.62:0/1719436231 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f657c052870 con 0x55c5a06d8b90 2024-04-26T07:54:32.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f6587e3d800 1 -- 172.21.15.62:0/1719436231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d8b90 msgr2=0x55c5a06daf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1719436231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d8b90 0x55c5a06daf80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f657c00a470 tx=0x7f657c01ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:32.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f6587e3d800 1 -- 172.21.15.62:0/1719436231 shutdown_connections 2024-04-26T07:54:32.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1719436231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d8b90 0x55c5a06daf80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f6587e3d800 1 -- 172.21.15.62:0/1719436231 >> 172.21.15.62:0/1719436231 conn(0x55c5a06ce320 msgr2=0x55c5a06d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f6587e3d800 1 -- 172.21.15.62:0/1719436231 shutdown_connections 2024-04-26T07:54:32.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.632+0000 7f6587e3d800 1 -- 172.21.15.62:0/1719436231 wait complete. 2024-04-26T07:54:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.645+0000 7f6587e3d800 1 Processor -- start 2024-04-26T07:54:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.645+0000 7f6587e3d800 1 -- start start 2024-04-26T07:54:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.645+0000 7f6587e3d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.645+0000 7f6587e3d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c5a061fcd0 con 0x55c5a06d2970 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.646+0000 7f658593c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.646+0000 7f658593c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60224/0 (socket says 172.21.15.62:60224) 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.646+0000 7f658593c640 1 -- 172.21.15.62:0/2162322841 learned_addr learned my addr 172.21.15.62:0/2162322841 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.646+0000 7f658593c640 1 -- 172.21.15.62:0/2162322841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a07c6260 con 0x55c5a06d2970 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.646+0000 7f658593c640 1 --2- 172.21.15.62:0/2162322841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07c5c90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6578001de0 tx=0x7f657800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4259d489276d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.646+0000 7f6473e07640 1 -- 172.21.15.62:0/2162322841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578012020 con 0x55c5a06d2970 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.646+0000 7f6473e07640 1 -- 172.21.15.62:0/2162322841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657800e5a0 con 0x55c5a06d2970 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.646+0000 7f6473e07640 1 -- 172.21.15.62:0/2162322841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f657800e8c0 con 0x55c5a06d2970 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 -- 172.21.15.62:0/2162322841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 msgr2=0x55c5a07c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 --2- 172.21.15.62:0/2162322841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07c5c90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6578001de0 tx=0x7f657800b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 -- 172.21.15.62:0/2162322841 shutdown_connections 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 --2- 172.21.15.62:0/2162322841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07c5c90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 -- 172.21.15.62:0/2162322841 >> 172.21.15.62:0/2162322841 conn(0x55c5a06ce320 msgr2=0x55c5a07c15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 -- 172.21.15.62:0/2162322841 shutdown_connections 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 -- 172.21.15.62:0/2162322841 wait complete. 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 Processor -- start 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.647+0000 7f6587e3d800 1 -- start start 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.648+0000 7f6587e3d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.648+0000 7f6587e3d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c5a06db9f0 con 0x55c5a06d2970 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.648+0000 7f658593c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.648+0000 7f658593c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60238/0 (socket says 172.21.15.62:60238) 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.648+0000 7f658593c640 1 -- 172.21.15.62:0/1841145089 learned_addr learned my addr 172.21.15.62:0/1841145089 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.648+0000 7f658593c640 1 -- 172.21.15.62:0/1841145089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a07cdd10 con 0x55c5a06d2970 2024-04-26T07:54:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.648+0000 7f658593c640 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07cd7d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f657800c010 tx=0x7f6578000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.649+0000 7f6472604640 1 -- 172.21.15.62:0/1841145089 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578012070 con 0x55c5a06d2970 2024-04-26T07:54:32.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.649+0000 7f6472604640 1 -- 172.21.15.62:0/1841145089 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657801a7a0 con 0x55c5a06d2970 2024-04-26T07:54:32.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.649+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5a07cdfa0 con 0x55c5a06d2970 2024-04-26T07:54:32.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.649+0000 7f6472604640 1 -- 172.21.15.62:0/1841145089 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f657801aa80 con 0x55c5a06d2970 2024-04-26T07:54:32.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.649+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a07d0c50 con 0x55c5a06d2970 2024-04-26T07:54:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f6472604640 1 -- 172.21.15.62:0/1841145089 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6578015020 con 0x55c5a06d2970 2024-04-26T07:54:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f6472604640 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f646c036eb0 0x7f646c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f6472604640 1 -- 172.21.15.62:0/1841145089 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f6578020070 con 0x55c5a06d2970 2024-04-26T07:54:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f658513b640 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f646c036eb0 0x7f646c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a06d8b90 0x55c5a07d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a07d4f50 con 0x55c5a06d8b90 2024-04-26T07:54:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f658613d640 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a06d8b90 0x55c5a07d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f658513b640 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f646c036eb0 0x7f646c039370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f657c054000 tx=0x7f657c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.650+0000 7f658613d640 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a06d8b90 0x55c5a07d4a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.651+0000 7f658613d640 1 -- 172.21.15.62:0/1841145089 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f658000a4a0 con 0x55c5a06d8b90 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.651+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a07d1fc0 con 0x55c5a06d8b90 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.651+0000 7f658613d640 1 -- 172.21.15.62:0/1841145089 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f658000a4a0 con 0x55c5a06d8b90 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.651+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a07d7290 0x55c5a07d9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.651+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a07d9d20 con 0x55c5a07d7290 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.651+0000 7f658593c640 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a07d7290 0x55c5a07d9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.652+0000 7f658593c640 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a07d7290 0x55c5a07d9680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.652+0000 7f658593c640 1 -- 172.21.15.62:0/1841145089 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f657802b070 con 0x55c5a07d7290 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.652+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a07d6240 con 0x55c5a06d8b90 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.652+0000 7f658613d640 1 -- 172.21.15.62:0/1841145089 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f658000a4a0 con 0x55c5a06d8b90 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.652+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a07d6720 con 0x55c5a06d8b90 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.653+0000 7f658613d640 1 -- 172.21.15.62:0/1841145089 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f658000a4a0 con 0x55c5a06d8b90 2024-04-26T07:54:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.653+0000 7f6587e3d800 1 Processor -- start 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.653+0000 7f6587e3d800 1 -- start start 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.653+0000 7f6587e3d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a07e8ec0 0x55c5a07e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.653+0000 7f6587e3d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c5a05c7170 con 0x55c5a07e8ec0 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.653+0000 7f658613d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a07e8ec0 0x55c5a07e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.653+0000 7f658613d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a07e8ec0 0x55c5a07e92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60252/0 (socket says 172.21.15.62:60252) 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.653+0000 7f658613d640 1 -- 172.21.15.62:0/3587237192 learned_addr learned my addr 172.21.15.62:0/3587237192 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.654+0000 7f658613d640 1 -- 172.21.15.62:0/3587237192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a07e9820 con 0x55c5a07e8ec0 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.654+0000 7f658613d640 1 --2- 172.21.15.62:0/3587237192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a07e8ec0 0x55c5a07e92e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c5a07d5310 tx=0x7f6580018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.654+0000 7f646b7fe640 1 -- 172.21.15.62:0/3587237192 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580014450 con 0x55c5a07e8ec0 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.654+0000 7f646b7fe640 1 -- 172.21.15.62:0/3587237192 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6580014610 con 0x55c5a07e8ec0 2024-04-26T07:54:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.654+0000 7f646b7fe640 1 -- 172.21.15.62:0/3587237192 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580014930 con 0x55c5a07e8ec0 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.654+0000 7f6587e3d800 1 -- 172.21.15.62:0/3587237192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5a07ea290 con 0x55c5a07e8ec0 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.654+0000 7f6587e3d800 1 -- 172.21.15.62:0/3587237192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a07ea790 con 0x55c5a07e8ec0 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.655+0000 7f646b7fe640 1 -- 172.21.15.62:0/3587237192 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6580011040 con 0x55c5a07e8ec0 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.655+0000 7f646b7fe640 1 --2- 172.21.15.62:0/3587237192 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6460036e60 0x7f6460039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.655+0000 7f646b7fe640 1 -- 172.21.15.62:0/3587237192 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f658001e070 con 0x55c5a07e8ec0 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.655+0000 7f658593c640 1 --2- 172.21.15.62:0/3587237192 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6460036e60 0x7f6460039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.655+0000 7f6587e3d800 1 Processor -- start 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.655+0000 7f658593c640 1 --2- 172.21.15.62:0/3587237192 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6460036e60 0x7f6460039320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55c5a07d53d0 tx=0x7f657804af80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.655+0000 7f6587e3d800 1 -- start start 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f6587e3d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a06d3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f6587e3d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c5a07c65e0 con 0x55c5a06d5060 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f658613d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a06d3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f658613d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a06d3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60268/0 (socket says 172.21.15.62:60268) 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f658613d640 1 -- 172.21.15.62:0/2494261704 learned_addr learned my addr 172.21.15.62:0/2494261704 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f658613d640 1 -- 172.21.15.62:0/2494261704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a06d5510 con 0x55c5a06d5060 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f658613d640 1 --2- 172.21.15.62:0/2494261704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a06d3750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f658004d080 tx=0x7f6580011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f09cbb77c1531a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f64697fa640 1 -- 172.21.15.62:0/2494261704 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580046070 con 0x55c5a06d5060 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f64697fa640 1 -- 172.21.15.62:0/2494261704 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6580013dc0 con 0x55c5a06d5060 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.656+0000 7f64697fa640 1 -- 172.21.15.62:0/2494261704 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580046360 con 0x55c5a06d5060 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 -- 172.21.15.62:0/2494261704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 msgr2=0x55c5a06d3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 --2- 172.21.15.62:0/2494261704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a06d3750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f658004d080 tx=0x7f6580011700 comp rx=0 tx=0).stop 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 -- 172.21.15.62:0/2494261704 shutdown_connections 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 --2- 172.21.15.62:0/2494261704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a06d3750 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 -- 172.21.15.62:0/2494261704 >> 172.21.15.62:0/2494261704 conn(0x55c5a07f2500 msgr2=0x55c5a07f0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 -- 172.21.15.62:0/2494261704 shutdown_connections 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 -- 172.21.15.62:0/2494261704 wait complete. 2024-04-26T07:54:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 Processor -- start 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 -- start start 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a07ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.657+0000 7f6587e3d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c5a06d3e10 con 0x55c5a06d5060 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f658613d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a07ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f658613d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a07ff9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60274/0 (socket says 172.21.15.62:60274) 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 learned_addr learned my addr 172.21.15.62:0/3661920497 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a07ffee0 con 0x55c5a06d5060 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f658613d640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a07ff9a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6580048010 tx=0x7f658004d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f64577fe640 1 -- 172.21.15.62:0/3661920497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658003c070 con 0x55c5a06d5060 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f64577fe640 1 -- 172.21.15.62:0/3661920497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6580022c90 con 0x55c5a06d5060 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5a0800170 con 0x55c5a06d5060 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f64577fe640 1 -- 172.21.15.62:0/3661920497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580046040 con 0x55c5a06d5060 2024-04-26T07:54:32.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.658+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a0802e20 con 0x55c5a06d5060 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.659+0000 7f64577fe640 1 -- 172.21.15.62:0/3661920497 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f658002b350 con 0x55c5a06d5060 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.659+0000 7f64577fe640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6450036e60 0x7f6450039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.659+0000 7f64577fe640 1 -- 172.21.15.62:0/3661920497 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f6580033030 con 0x55c5a06d5060 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.659+0000 7f658593c640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6450036e60 0x7f6450039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f658593c640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6450036e60 0x7f6450039320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6578000fd0 tx=0x7f657802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a080b670 0x55c5a080db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a080e280 con 0x55c5a080b670 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f658513b640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a080b670 0x55c5a080db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f658513b640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a080b670 0x55c5a080db30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f6587e3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f6587e3d800 20 realm 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.660+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a080e650 con 0x55c5a080b670 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a080ef20 con 0x55c5a080b670 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a080f2c0 con 0x55c5a080b670 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:32.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a0810020 0x55c5a0812410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.661+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a08129d0 con 0x55c5a0810020 2024-04-26T07:54:32.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.662+0000 7f658613d640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a0810020 0x55c5a0812410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.662+0000 7f658613d640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a0810020 0x55c5a0812410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.662+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.662+0000 7f6587e3d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.662+0000 7f6587e3d800 20 searching for the correct realm 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.662+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c5a08149a0 0x55c5a0816e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.662+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.662+0000 7f658593c640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c5a08149a0 0x55c5a0816e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.663+0000 7f658593c640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c5a08149a0 0x55c5a0816e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.663+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.663+0000 7f658593c640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f6578017050 0x7f657804c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.663+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x7f6578017050 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.663+0000 7f658513b640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f6578017050 0x7f657804c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.664+0000 7f658513b640 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f6578017050 0x7f657804c430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.664+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.664+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.665+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.665+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a080b670 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.665+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.665+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a080b670 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.665+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.665+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.665+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.665+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.666+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.666+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x7f6578017050 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.666+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.666+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.666+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.666+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a080b670 2024-04-26T07:54:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.666+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.666+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.667+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.667+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a080b670 2024-04-26T07:54:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.667+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.667+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x7f6578017050 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.667+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.667+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.668+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.668+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.668+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.668+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.668+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.668+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.668+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.668+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.669+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.669+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a080b670 2024-04-26T07:54:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.669+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.669+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a080b670 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.669+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.669+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.670+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.670+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.670+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.670+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x7f6578017050 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.670+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.670+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a080b670 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.671+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.671+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.671+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.671+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.671+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.671+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.671+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.671+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x7f6578017050 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.672+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.672+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a08149a0 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.672+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.672+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a0810020 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.672+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.672+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x55c5a080b670 2024-04-26T07:54:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0817530 con 0x7f6578017050 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0813390 con 0x55c5a080b670 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0812fa0 con 0x55c5a080b670 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.673+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0813cc0 con 0x55c5a080b670 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 20 zone default found 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 4 Realm: () 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 20 zonegroup default 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a08179b0 con 0x55c5a0810020 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0819c60 con 0x55c5a08149a0 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.674+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081a000 con 0x55c5a08149a0 2024-04-26T07:54:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.675+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.675+0000 7f6587e3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.675+0000 7f6587e3d800 20 started sync module instance, tier type = 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.675+0000 7f6587e3d800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.675+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a08190a0 con 0x7f6578017050 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.676+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.676+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94307289765280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a08190a0 con 0x7f6578017050 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.676+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081a9c0 con 0x55c5a080b670 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.677+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.677+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94307289769232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081a970 con 0x55c5a080b670 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.677+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081b990 con 0x55c5a08149a0 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.678+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94307289769232] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.678+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94307289765280] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.681+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.681+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94307289762800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081adb0 con 0x55c5a08149a0 2024-04-26T07:54:32.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.681+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081c230 con 0x7f6578017050 2024-04-26T07:54:32.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.682+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.682+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94307289776000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081cad0 con 0x7f6578017050 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.682+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081d550 con 0x55c5a080b670 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.682+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94307289762800] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.687+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.687+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94307289780320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081d550 con 0x55c5a080b670 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.687+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081df70 con 0x55c5a0810020 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.687+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94307289776000] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.688+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.688+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94307289782880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081df30 con 0x55c5a0810020 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.688+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081e980 con 0x55c5a0810020 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.688+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94307289780320] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.691+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94307289782880] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.694+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.694+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94307289777696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081e4d0 con 0x55c5a0810020 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.694+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081ee90 con 0x55c5a0810020 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.695+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.695+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94307289786848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081ee00 con 0x55c5a0810020 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.695+0000 7f6587e3d800 20 add_watcher() i=0 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.695+0000 7f6587e3d800 20 add_watcher() i=1 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.695+0000 7f6587e3d800 20 add_watcher() i=2 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.695+0000 7f6587e3d800 20 add_watcher() i=3 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.695+0000 7f6587e3d800 20 add_watcher() i=4 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.695+0000 7f6587e3d800 20 add_watcher() i=5 2024-04-26T07:54:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.696+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94307289786848] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.699+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94307289777696] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.699+0000 7f6587e3d800 20 add_watcher() i=6 2024-04-26T07:54:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.699+0000 7f6587e3d800 20 add_watcher() i=7 2024-04-26T07:54:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.699+0000 7f6587e3d800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.699+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081f280 con 0x55c5a080b670 2024-04-26T07:54:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.699+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.699+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94307289773184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081f280 con 0x55c5a080b670 2024-04-26T07:54:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.700+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94307289773184] v27'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.700+0000 7f64377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.700+0000 7f6587e3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.700+0000 7f6587e3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.700+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082afb0 con 0x55c5a080b670 2024-04-26T07:54:32.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.702+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.702+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082b680 con 0x55c5a0810020 2024-04-26T07:54:32.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.703+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.703+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082b680 con 0x55c5a08149a0 2024-04-26T07:54:32.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.705+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.705+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082bed0 con 0x55c5a080b670 2024-04-26T07:54:32.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.706+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.706+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0826c80 con 0x7f6578017050 2024-04-26T07:54:32.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.709+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.709+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0826c80 con 0x55c5a08149a0 2024-04-26T07:54:32.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.712+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.712+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0826c80 con 0x55c5a080b670 2024-04-26T07:54:32.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.715+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.715+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0826d40 con 0x55c5a0810020 2024-04-26T07:54:32.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.716+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.716+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0826d40 con 0x7f6578017050 2024-04-26T07:54:32.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.719+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.719+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0826d10 con 0x55c5a08149a0 2024-04-26T07:54:32.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.721+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.721+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x7f6578017050 2024-04-26T07:54:32.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.724+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.724+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a0810020 2024-04-26T07:54:32.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.725+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.725+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x7f6578017050 2024-04-26T07:54:32.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.726+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.726+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a0810020 2024-04-26T07:54:32.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.729+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.729+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a080b670 2024-04-26T07:54:32.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.730+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.730+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.731+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'14 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.731+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x7f6578017050 2024-04-26T07:54:32.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.732+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.732+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.733+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.733+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a080b670 2024-04-26T07:54:32.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.735+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.735+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a080b670 2024-04-26T07:54:32.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.736+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.736+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.737+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.737+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x7f6578017050 2024-04-26T07:54:32.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.738+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.738+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.739+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.739+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.741+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.741+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.744+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.744+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.746+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.746+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a0810020 2024-04-26T07:54:32.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.749+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.749+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.750+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.750+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a0810020 2024-04-26T07:54:32.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.751+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.751+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a08149a0 2024-04-26T07:54:32.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.752+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.752+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x55c5a0810020 2024-04-26T07:54:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.753+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.754+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a082cce0 con 0x7f6578017050 2024-04-26T07:54:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.755+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.755+0000 7f64367fc640 20 reqs_thread_entry: start 2024-04-26T07:54:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.755+0000 7f6587e3d800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.755+0000 7f6587e3d800 20 Filter name: none 2024-04-26T07:54:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.755+0000 7f63a7fff640 20 reqs_thread_entry: start 2024-04-26T07:54:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.755+0000 7f6587e3d800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T07:54:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.755+0000 7f6587e3d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.755+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0858030 con 0x7f6578017050 2024-04-26T07:54:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.756+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.756+0000 7f6587e3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.756+0000 7f6587e3d800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-04-26T07:54:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.756+0000 7f6587e3d800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T07:54:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T07:54:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.756+0000 7f64377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.756+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94307289773184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a07bd630 con 0x55c5a080b670 2024-04-26T07:54:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.757+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94307289773184] v27'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.757+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94307289765280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081b480 con 0x7f6578017050 2024-04-26T07:54:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.758+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94307289765280] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.758+0000 7f6587e3d800 20 remove_watcher() i=0 2024-04-26T07:54:32.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.758+0000 7f6587e3d800 2 removed watcher, disabling cache 2024-04-26T07:54:32.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.758+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94307289769232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a08195a0 con 0x55c5a080b670 2024-04-26T07:54:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.760+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94307289769232] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.760+0000 7f6587e3d800 20 remove_watcher() i=1 2024-04-26T07:54:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.760+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94307289762800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081a510 con 0x55c5a08149a0 2024-04-26T07:54:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.761+0000 7f658593c640 1 -- 172.21.15.62:0/3661920497 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94307289762800] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6578037040 con 0x55c5a08149a0 2024-04-26T07:54:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.761+0000 7f6587e3d800 20 remove_watcher() i=2 2024-04-26T07:54:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.761+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94307289776000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0818bf0 con 0x7f6578017050 2024-04-26T07:54:32.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.762+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94307289776000] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x7f6578017050 2024-04-26T07:54:32.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.762+0000 7f6587e3d800 20 remove_watcher() i=3 2024-04-26T07:54:32.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.762+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94307289780320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0818bf0 con 0x55c5a080b670 2024-04-26T07:54:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.763+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94307289780320] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f657c05a040 con 0x55c5a080b670 2024-04-26T07:54:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.763+0000 7f6587e3d800 20 remove_watcher() i=4 2024-04-26T07:54:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.763+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94307289782880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0818bf0 con 0x55c5a0810020 2024-04-26T07:54:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.764+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94307289782880] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.764+0000 7f6587e3d800 20 remove_watcher() i=5 2024-04-26T07:54:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.764+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94307289777696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a081da60 con 0x55c5a0810020 2024-04-26T07:54:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.765+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94307289777696] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.765+0000 7f6587e3d800 20 remove_watcher() i=6 2024-04-26T07:54:32.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.765+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94307289786848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c5a0818bf0 con 0x55c5a0810020 2024-04-26T07:54:32.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.766+0000 7f658613d640 1 -- 172.21.15.62:0/3661920497 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94307289786848] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6580055070 con 0x55c5a0810020 2024-04-26T07:54:32.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.766+0000 7f6587e3d800 20 remove_watcher() i=7 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a0810020 msgr2=0x55c5a0812410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a0810020 0x55c5a0812410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a080b670 msgr2=0x55c5a080db30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a080b670 0x55c5a080db30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f6578017050 msgr2=0x7f657804c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f6578017050 0x7f657804c430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c5a08149a0 msgr2=0x55c5a0816e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c5a08149a0 0x55c5a0816e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6450036e60 msgr2=0x7f6450039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6450036e60 0x7f6450039320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6578000fd0 tx=0x7f657802f000 comp rx=0 tx=0).stop 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 msgr2=0x55c5a07ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3661920497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d5060 0x55c5a07ff9a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6580048010 tx=0x7f658004d010 comp rx=0 tx=0).stop 2024-04-26T07:54:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 reap_dead start 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f658513b640 1 -- 172.21.15.62:0/3661920497 reap_dead start 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 shutdown_connections 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 >> 172.21.15.62:0/3661920497 conn(0x55c5a07f2500 msgr2=0x55c5a07efb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 shutdown_connections 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3661920497 wait complete. 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3587237192 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6460036e60 msgr2=0x7f6460039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3587237192 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6460036e60 0x7f6460039320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55c5a07d53d0 tx=0x7f657804af80 comp rx=0 tx=0).stop 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3587237192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a07e8ec0 msgr2=0x55c5a07e92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3587237192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a07e8ec0 0x55c5a07e92e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c5a07d5310 tx=0x7f6580018830 comp rx=0 tx=0).stop 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3587237192 shutdown_connections 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3587237192 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6460036e60 0x7f6460039320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 --2- 172.21.15.62:0/3587237192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a07e8ec0 0x55c5a07e92e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3587237192 >> 172.21.15.62:0/3587237192 conn(0x55c5a07dcf60 msgr2=0x55c5a07dd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3587237192 shutdown_connections 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.767+0000 7f6587e3d800 1 -- 172.21.15.62:0/3587237192 wait complete. 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a07d7290 msgr2=0x55c5a07d9680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a07d7290 0x55c5a07d9680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a06d8b90 msgr2=0x55c5a07d4a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a06d8b90 0x55c5a07d4a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f646c036eb0 msgr2=0x7f646c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f646c036eb0 0x7f646c039370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f657c054000 tx=0x7f657c04e000 comp rx=0 tx=0).stop 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 msgr2=0x55c5a07cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07cd7d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f657800c010 tx=0x7f6578000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 shutdown_connections 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c5a06d8b90 0x55c5a07d4a10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c5a07d7290 0x55c5a07d9680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f646c036eb0 0x7f646c039370 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 --2- 172.21.15.62:0/1841145089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5a06d2970 0x55c5a07cd7d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 >> 172.21.15.62:0/1841145089 conn(0x55c5a06ce320 msgr2=0x55c5a07bfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 shutdown_connections 2024-04-26T07:54:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.768+0000 7f6587e3d800 1 -- 172.21.15.62:0/1841145089 wait complete. 2024-04-26T07:54:32.774 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T07:54:32.775 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-04-26T07:54:32.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-04-26T07:54:32.775 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-04-26T07:54:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.821+0000 7fadf3a19800 1 Processor -- start 2024-04-26T07:54:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.821+0000 7fadf3a19800 1 -- start start 2024-04-26T07:54:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.821+0000 7fadf3a19800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55924d50b190 0x55924d50d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.821+0000 7fadf3a19800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55924d5115d0 con 0x55924d50dac0 2024-04-26T07:54:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.821+0000 7fadf3a19800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55924d3ace20 con 0x55924d50b190 2024-04-26T07:54:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.822+0000 7fadf1518640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55924d50b190 0x55924d50d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.822+0000 7fadf1518640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55924d50b190 0x55924d50d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60290/0 (socket says 172.21.15.62:60290) 2024-04-26T07:54:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.822+0000 7fadf0d17640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55924d50dac0 0x55924d50feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36408/0 (socket says 172.21.15.62:36408) 2024-04-26T07:54:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.822+0000 7fadf1518640 1 -- 172.21.15.62:0/3855691917 learned_addr learned my addr 172.21.15.62:0/3855691917 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.822+0000 7fadf1518640 1 -- 172.21.15.62:0/3855691917 >> v1:172.21.15.1:6789/0 conn(0x55924d50dac0 legacy=0x55924d50feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.822+0000 7fadf1518640 1 -- 172.21.15.62:0/3855691917 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924d5127b0 con 0x55924d50b190 2024-04-26T07:54:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.824+0000 7fadf1518640 1 --2- 172.21.15.62:0/3855691917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50d580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fade400a520 tx=0x7fade401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed75abb5db2043d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.824+0000 7fade3fff640 1 -- 172.21.15.62:0/3855691917 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4057070 con 0x55924d50b190 2024-04-26T07:54:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.824+0000 7fade3fff640 1 -- 172.21.15.62:0/3855691917 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade4052570 con 0x55924d50b190 2024-04-26T07:54:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.824+0000 7fade3fff640 1 -- 172.21.15.62:0/3855691917 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade404ae60 con 0x55924d50b190 2024-04-26T07:54:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.825+0000 7fadf3a19800 1 -- 172.21.15.62:0/3855691917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 msgr2=0x55924d50d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.825+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3855691917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50d580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fade400a520 tx=0x7fade401d010 comp rx=0 tx=0).stop 2024-04-26T07:54:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.825+0000 7fadf3a19800 1 -- 172.21.15.62:0/3855691917 shutdown_connections 2024-04-26T07:54:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.825+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3855691917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50d580 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.825+0000 7fadf3a19800 1 -- 172.21.15.62:0/3855691917 >> 172.21.15.62:0/3855691917 conn(0x55924d504ba0 msgr2=0x55924d506fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.825+0000 7fadf3a19800 1 -- 172.21.15.62:0/3855691917 shutdown_connections 2024-04-26T07:54:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.825+0000 7fadf3a19800 1 -- 172.21.15.62:0/3855691917 wait complete. 2024-04-26T07:54:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.837+0000 7fadf3a19800 1 Processor -- start 2024-04-26T07:54:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.837+0000 7fadf3a19800 1 -- start start 2024-04-26T07:54:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.837+0000 7fadf3a19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.837+0000 7fadf3a19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55924d455cd0 con 0x55924d50b190 2024-04-26T07:54:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.838+0000 7fadf1518640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.838+0000 7fadf1518640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60292/0 (socket says 172.21.15.62:60292) 2024-04-26T07:54:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.838+0000 7fadf1518640 1 -- 172.21.15.62:0/1398217588 learned_addr learned my addr 172.21.15.62:0/1398217588 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.838+0000 7fadf1518640 1 -- 172.21.15.62:0/1398217588 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924d509090 con 0x55924d50b190 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.838+0000 7fadf1518640 1 --2- 172.21.15.62:0/1398217588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50aad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fade401d050 tx=0x7fade404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fda024e64338a93 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.838+0000 7facdf606640 1 -- 172.21.15.62:0/1398217588 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4057040 con 0x55924d50b190 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.838+0000 7facdf606640 1 -- 172.21.15.62:0/1398217588 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade4052720 con 0x55924d50b190 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.838+0000 7facdf606640 1 -- 172.21.15.62:0/1398217588 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4052a40 con 0x55924d50b190 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.839+0000 7fadf3a19800 1 -- 172.21.15.62:0/1398217588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 msgr2=0x55924d50aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.839+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1398217588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50aad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fade401d050 tx=0x7fade404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.839+0000 7fadf3a19800 1 -- 172.21.15.62:0/1398217588 shutdown_connections 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.839+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1398217588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d50aad0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.839+0000 7fadf3a19800 1 -- 172.21.15.62:0/1398217588 >> 172.21.15.62:0/1398217588 conn(0x55924d504ba0 msgr2=0x55924d5f7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.839+0000 7fadf3a19800 1 -- 172.21.15.62:0/1398217588 shutdown_connections 2024-04-26T07:54:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.839+0000 7fadf3a19800 1 -- 172.21.15.62:0/1398217588 wait complete. 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.839+0000 7fadf3a19800 1 Processor -- start 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.840+0000 7fadf3a19800 1 -- start start 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.840+0000 7fadf3a19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d6057f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.840+0000 7fadf3a19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55924d511a40 con 0x55924d50b190 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.840+0000 7fadf1518640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d6057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.840+0000 7fadf1518640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d6057f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60308/0 (socket says 172.21.15.62:60308) 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.840+0000 7fadf1518640 1 -- 172.21.15.62:0/3892714099 learned_addr learned my addr 172.21.15.62:0/3892714099 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.840+0000 7fadf1518640 1 -- 172.21.15.62:0/3892714099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924d605d30 con 0x55924d50b190 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.840+0000 7fadf1518640 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d6057f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fade4005930 tx=0x7fade4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.841+0000 7facdde03640 1 -- 172.21.15.62:0/3892714099 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4073070 con 0x55924d50b190 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.841+0000 7facdde03640 1 -- 172.21.15.62:0/3892714099 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade405d570 con 0x55924d50b190 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.841+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55924d605fc0 con 0x55924d50b190 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.841+0000 7facdde03640 1 -- 172.21.15.62:0/3892714099 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4057070 con 0x55924d50b190 2024-04-26T07:54:32.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.841+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924d608c70 con 0x55924d50b190 2024-04-26T07:54:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.841+0000 7facdde03640 1 -- 172.21.15.62:0/3892714099 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fade4076070 con 0x55924d50b190 2024-04-26T07:54:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7facdde03640 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facd8036eb0 0x7facd8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7facdde03640 1 -- 172.21.15.62:0/3892714099 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fade408e420 con 0x55924d50b190 2024-04-26T07:54:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7fadf0d17640 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facd8036eb0 0x7facd8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d50dac0 0x55924d60ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d60cfb0 con 0x55924d50dac0 2024-04-26T07:54:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7fadf1d19640 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d50dac0 0x55924d60ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7fadf0d17640 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facd8036eb0 0x7facd8039370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fade8000f60 tx=0x7fade8001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7fadf1d19640 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d50dac0 0x55924d60ca30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.842+0000 7fadf1d19640 1 -- 172.21.15.62:0/3892714099 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadec00a4a0 con 0x55924d50dac0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.843+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d609fe0 con 0x55924d50dac0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.843+0000 7fadf1d19640 1 -- 172.21.15.62:0/3892714099 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadec00a4a0 con 0x55924d50dac0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.843+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d60f2a0 0x55924d611690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.843+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d611d80 con 0x55924d60f2a0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.843+0000 7fadf1518640 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d60f2a0 0x55924d611690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.843+0000 7fadf1518640 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d60f2a0 0x55924d611690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.844+0000 7fadf1518640 1 -- 172.21.15.62:0/3892714099 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fade4075030 con 0x55924d60f2a0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.844+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d60e250 con 0x55924d50dac0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.844+0000 7fadf1d19640 1 -- 172.21.15.62:0/3892714099 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadec00a4a0 con 0x55924d50dac0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.844+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d60e6f0 con 0x55924d50dac0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.844+0000 7fadf1d19640 1 -- 172.21.15.62:0/3892714099 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fadec00a4a0 con 0x55924d50dac0 2024-04-26T07:54:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf3a19800 1 Processor -- start 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf3a19800 1 -- start start 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf3a19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d620ec0 0x55924d6212e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf3a19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55924d3fd170 con 0x55924d620ec0 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf1d19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d620ec0 0x55924d6212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf1d19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d620ec0 0x55924d6212e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60324/0 (socket says 172.21.15.62:60324) 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf1d19640 1 -- 172.21.15.62:0/1548824281 learned_addr learned my addr 172.21.15.62:0/1548824281 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf1d19640 1 -- 172.21.15.62:0/1548824281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924d621820 con 0x55924d620ec0 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.845+0000 7fadf1d19640 1 --2- 172.21.15.62:0/1548824281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d620ec0 0x55924d6212e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55924d606bf0 tx=0x7fadec018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.846+0000 7facd6ffd640 1 -- 172.21.15.62:0/1548824281 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec014450 con 0x55924d620ec0 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.846+0000 7facd6ffd640 1 -- 172.21.15.62:0/1548824281 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec0145f0 con 0x55924d620ec0 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.846+0000 7fadf3a19800 1 -- 172.21.15.62:0/1548824281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55924d622290 con 0x55924d620ec0 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.846+0000 7facd6ffd640 1 -- 172.21.15.62:0/1548824281 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec014910 con 0x55924d620ec0 2024-04-26T07:54:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.846+0000 7fadf3a19800 1 -- 172.21.15.62:0/1548824281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924d622790 con 0x55924d620ec0 2024-04-26T07:54:32.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.846+0000 7facd6ffd640 1 -- 172.21.15.62:0/1548824281 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fadec011040 con 0x55924d620ec0 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7facd6ffd640 1 --2- 172.21.15.62:0/1548824281 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc8036eb0 0x7facc8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7facd6ffd640 1 -- 172.21.15.62:0/1548824281 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fadec01e070 con 0x55924d620ec0 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf1518640 1 --2- 172.21.15.62:0/1548824281 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc8036eb0 0x7facc8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf3a19800 1 Processor -- start 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf1518640 1 --2- 172.21.15.62:0/1548824281 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc8036eb0 0x7facc8039370 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55924d60d410 tx=0x7fade401d010 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf3a19800 1 -- start start 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf3a19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d62e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf3a19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55924d509350 con 0x55924d62e210 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf1d19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d62e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf1d19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d62e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60332/0 (socket says 172.21.15.62:60332) 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.847+0000 7fadf1d19640 1 -- 172.21.15.62:0/2293615153 learned_addr learned my addr 172.21.15.62:0/2293615153 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf1d19640 1 -- 172.21.15.62:0/2293615153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924d62ec00 con 0x55924d62e210 2024-04-26T07:54:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf1d19640 1 --2- 172.21.15.62:0/2293615153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d62e630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fadec018430 tx=0x7fadec041420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcdc8c99f3de844 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7facd4ff9640 1 -- 172.21.15.62:0/2293615153 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec046070 con 0x55924d62e210 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7facd4ff9640 1 -- 172.21.15.62:0/2293615153 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec0168f0 con 0x55924d62e210 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7facd4ff9640 1 -- 172.21.15.62:0/2293615153 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec013e00 con 0x55924d62e210 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf3a19800 1 -- 172.21.15.62:0/2293615153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 msgr2=0x55924d62e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf3a19800 1 --2- 172.21.15.62:0/2293615153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d62e630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fadec018430 tx=0x7fadec041420 comp rx=0 tx=0).stop 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf3a19800 1 -- 172.21.15.62:0/2293615153 shutdown_connections 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf3a19800 1 --2- 172.21.15.62:0/2293615153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d62e630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf3a19800 1 -- 172.21.15.62:0/2293615153 >> 172.21.15.62:0/2293615153 conn(0x55924d62a4e0 msgr2=0x55924d628540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf3a19800 1 -- 172.21.15.62:0/2293615153 shutdown_connections 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.848+0000 7fadf3a19800 1 -- 172.21.15.62:0/2293615153 wait complete. 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.849+0000 7fadf3a19800 1 Processor -- start 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.849+0000 7fadf3a19800 1 -- start start 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.849+0000 7fadf3a19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d6357b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.849+0000 7fadf3a19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55924d62f390 con 0x55924d62e210 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.849+0000 7fadf1d19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d6357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.849+0000 7fadf1d19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d6357b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60348/0 (socket says 172.21.15.62:60348) 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.849+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 learned_addr learned my addr 172.21.15.62:0/1911389776 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.849+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924d635cf0 con 0x55924d62e210 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.850+0000 7fadf1d19640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d6357b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fadec048010 tx=0x7fadec04cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.850+0000 7facc6ffd640 1 -- 172.21.15.62:0/1911389776 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec03b070 con 0x55924d62e210 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.850+0000 7facc6ffd640 1 -- 172.21.15.62:0/1911389776 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec02ba60 con 0x55924d62e210 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.850+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55924d635f80 con 0x55924d62e210 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.850+0000 7facc6ffd640 1 -- 172.21.15.62:0/1911389776 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec046040 con 0x55924d62e210 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.850+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924d638c30 con 0x55924d62e210 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7facc6ffd640 1 -- 172.21.15.62:0/1911389776 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fadec0133b0 con 0x55924d62e210 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7facc6ffd640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facbc036e60 0x7facbc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7facc6ffd640 1 -- 172.21.15.62:0/1911389776 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fadec033070 con 0x55924d62e210 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7fadf1518640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facbc036e60 0x7facbc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d641490 0x55924d643950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d6440a0 con 0x55924d641490 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7fadf1518640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facbc036e60 0x7facbc039320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55924d612180 tx=0x7fade4089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.851+0000 7fadf0d17640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d641490 0x55924d643950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf0d17640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d641490 0x55924d643950 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fade800f610 con 0x55924d641490 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf3a19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf3a19800 20 realm 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d6408e0 con 0x55924d641490 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fade800f610 con 0x55924d641490 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf3a19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf3a19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.852+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d644b90 con 0x55924d641490 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fade800f610 con 0x55924d641490 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf3a19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d645460 con 0x55924d641490 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fade800f610 con 0x55924d641490 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf3a19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d645e80 0x55924d648270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d648960 con 0x55924d645e80 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.853+0000 7fadf1d19640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d645e80 0x55924d648270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.854+0000 7fadf1d19640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d645e80 0x55924d648270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.854+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.854+0000 7fadf3a19800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.854+0000 7fadf3a19800 20 searching for the correct realm 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.854+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55924d64a960 0x55924d64ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.854+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.854+0000 7fadf1518640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55924d64a960 0x55924d64ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.854+0000 7fadf1518640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55924d64a960 0x55924d64ce20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.855+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.855+0000 7fadf1518640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fade409c040 0x7fade408e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.855+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x7fade409c040 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.855+0000 7fadf0d17640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fade409c040 0x7fade408e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.855+0000 7fadf0d17640 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fade409c040 0x7fade408e800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.856+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade800f610 con 0x7fade409c040 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.856+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.856+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.856+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d641490 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.856+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade800f610 con 0x55924d641490 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.856+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d641490 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.857+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.857+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.857+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.857+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.857+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.857+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x7fade409c040 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.857+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.857+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.858+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.858+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d641490 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.858+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.858+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.858+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.858+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d641490 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.859+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.859+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x7fade409c040 2024-04-26T07:54:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.859+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.859+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.859+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.859+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.859+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.859+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d641490 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d641490 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.860+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.861+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.861+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.861+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.861+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.861+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x7fade409c040 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.862+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.862+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d641490 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.862+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.862+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.862+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.862+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.862+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.863+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.863+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.863+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x7fade409c040 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.863+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.863+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d64a960 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.863+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.863+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d645e80 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x55924d641490 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d4f0 con 0x7fade409c040 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf3a19800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf3a19800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf3a19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf3a19800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf3a19800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf3a19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d649220 con 0x55924d641490 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.864+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d649610 con 0x55924d641490 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d64d970 con 0x55924d641490 2024-04-26T07:54:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 zone default found 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 4 Realm: () 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 zonegroup default 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d648e40 con 0x55924d645e80 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.865+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d64fd30 con 0x55924d64a960 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf3a19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d6500d0 con 0x55924d64a960 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf3a19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf3a19800 20 started sync module instance, tier type = 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf3a19800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.866+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d64f1c0 con 0x7fade409c040 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.867+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.867+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94086852048608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d64f1c0 con 0x7fade409c040 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.867+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d650b50 con 0x55924d641490 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.868+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94086852048608] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.869+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.869+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94086852053120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d64f1c0 con 0x55924d641490 2024-04-26T07:54:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.869+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d651560 con 0x55924d64a960 2024-04-26T07:54:32.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.870+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.870+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94086852055216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d651e30 con 0x55924d64a960 2024-04-26T07:54:32.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.870+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6528d0 con 0x7fade409c040 2024-04-26T07:54:32.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.870+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94086852053120] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.871+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.871+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94086852055216] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.871+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94086852060064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d652cc0 con 0x7fade409c040 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.871+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d651980 con 0x55924d641490 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.872+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.872+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94086852063696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d651980 con 0x55924d641490 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.872+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6540c0 con 0x55924d645e80 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.872+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94086852060064] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.873+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.873+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94086852063696] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.873+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94086852046096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6540c0 con 0x55924d645e80 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.873+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6535f0 con 0x55924d645e80 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.874+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94086852046096] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.874+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.874+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94086852066320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d654030 con 0x55924d645e80 2024-04-26T07:54:32.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.874+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d654fe0 con 0x55924d645e80 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.875+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94086852066320] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94086852070096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d655450 con 0x55924d645e80 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf3a19800 20 add_watcher() i=0 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf3a19800 20 add_watcher() i=1 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf3a19800 20 add_watcher() i=2 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf3a19800 20 add_watcher() i=3 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf3a19800 20 add_watcher() i=4 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf3a19800 20 add_watcher() i=5 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.876+0000 7fadf3a19800 20 add_watcher() i=6 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.877+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94086852070096] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.877+0000 7fadf3a19800 20 add_watcher() i=7 2024-04-26T07:54:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.877+0000 7fadf3a19800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.877+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d655450 con 0x55924d641490 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.877+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.877+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94086852071328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d655d20 con 0x55924d641490 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.878+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94086852071328] v27'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.878+0000 7faca77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.878+0000 7fadf3a19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.878+0000 7fadf3a19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.878+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6582f0 con 0x55924d641490 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.880+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.880+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d661790 con 0x55924d645e80 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.881+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.881+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d661790 con 0x55924d64a960 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.882+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.882+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d661fe0 con 0x55924d641490 2024-04-26T07:54:32.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.883+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.883+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d660de0 con 0x7fade409c040 2024-04-26T07:54:32.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.884+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.884+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d660de0 con 0x55924d64a960 2024-04-26T07:54:32.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.885+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.885+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d662b40 con 0x55924d641490 2024-04-26T07:54:32.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.886+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.886+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d662b40 con 0x55924d645e80 2024-04-26T07:54:32.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.887+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.887+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d662b40 con 0x7fade409c040 2024-04-26T07:54:32.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.888+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.888+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d662b40 con 0x55924d64a960 2024-04-26T07:54:32.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.889+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.889+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d662b40 con 0x7fade409c040 2024-04-26T07:54:32.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.890+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.890+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d662c40 con 0x55924d645e80 2024-04-26T07:54:32.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.891+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.891+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d662d40 con 0x7fade409c040 2024-04-26T07:54:32.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.892+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.893+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d662d40 con 0x55924d645e80 2024-04-26T07:54:32.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.894+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.894+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d641490 2024-04-26T07:54:32.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.895+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.895+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.896+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.896+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x7fade409c040 2024-04-26T07:54:32.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.897+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.897+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.898+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.898+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d641490 2024-04-26T07:54:32.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.899+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.899+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d641490 2024-04-26T07:54:32.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.900+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.900+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.901+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.901+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x7fade409c040 2024-04-26T07:54:32.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.902+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.902+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.903+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.903+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.906+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.906+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.909+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.909+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.912+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.912+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d645e80 2024-04-26T07:54:32.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.915+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.915+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.916+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.916+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d645e80 2024-04-26T07:54:32.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.917+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.917+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d64a960 2024-04-26T07:54:32.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.918+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.918+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x55924d645e80 2024-04-26T07:54:32.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.919+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.919+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d663170 con 0x7fade409c040 2024-04-26T07:54:32.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.921+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.921+0000 7faca67e4640 20 reqs_thread_entry: start 2024-04-26T07:54:32.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.921+0000 7fadf3a19800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.921+0000 7fadf3a19800 20 Filter name: none 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.921+0000 7fac17fff640 20 reqs_thread_entry: start 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.921+0000 7fadf3a19800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.921+0000 7fadf3a19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.921+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55924d68dfe0 con 0x55924d645e80 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.922+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.922+0000 7fadf3a19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.922+0000 7fadf3a19800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.922+0000 7fadf3a19800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T07:54:32.921 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T07:54:32.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.922+0000 7faca77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:32.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.922+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94086852071328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d660130 con 0x55924d641490 2024-04-26T07:54:32.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.924+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94086852071328] v27'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.924+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94086852048608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d660130 con 0x7fade409c040 2024-04-26T07:54:32.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.925+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94086852048608] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.925+0000 7fadf3a19800 20 remove_watcher() i=0 2024-04-26T07:54:32.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.925+0000 7fadf3a19800 2 removed watcher, disabling cache 2024-04-26T07:54:32.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.925+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94086852053120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d64f6e0 con 0x55924d641490 2024-04-26T07:54:32.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.926+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94086852053120] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.926+0000 7fadf3a19800 20 remove_watcher() i=1 2024-04-26T07:54:32.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.926+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94086852055216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d64f6e0 con 0x55924d64a960 2024-04-26T07:54:32.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.927+0000 7fadf1518640 1 -- 172.21.15.62:0/1911389776 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94086852055216] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade4075030 con 0x55924d64a960 2024-04-26T07:54:32.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.927+0000 7fadf3a19800 20 remove_watcher() i=2 2024-04-26T07:54:32.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.927+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94086852060064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6510b0 con 0x7fade409c040 2024-04-26T07:54:32.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.928+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94086852060064] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x7fade409c040 2024-04-26T07:54:32.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.928+0000 7fadf3a19800 20 remove_watcher() i=3 2024-04-26T07:54:32.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.928+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94086852063696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6523a0 con 0x55924d641490 2024-04-26T07:54:32.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.929+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94086852063696] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade802b040 con 0x55924d641490 2024-04-26T07:54:32.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.929+0000 7fadf3a19800 20 remove_watcher() i=4 2024-04-26T07:54:32.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.929+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94086852046096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6510b0 con 0x55924d645e80 2024-04-26T07:54:32.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.930+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94086852046096] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.930+0000 7fadf3a19800 20 remove_watcher() i=5 2024-04-26T07:54:32.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.930+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94086852066320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6531d0 con 0x55924d645e80 2024-04-26T07:54:32.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.931+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94086852066320] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.931+0000 7fadf3a19800 20 remove_watcher() i=6 2024-04-26T07:54:32.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.931+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94086852070096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55924d6510b0 con 0x55924d645e80 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf1d19640 1 -- 172.21.15.62:0/1911389776 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94086852070096] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadec02a070 con 0x55924d645e80 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 20 remove_watcher() i=7 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d645e80 msgr2=0x55924d648270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d645e80 0x55924d648270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d641490 msgr2=0x55924d643950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d641490 0x55924d643950 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fade409c040 msgr2=0x7fade408e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fade409c040 0x7fade408e800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55924d64a960 msgr2=0x55924d64ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55924d64a960 0x55924d64ce20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.932+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facbc036e60 msgr2=0x7facbc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facbc036e60 0x7facbc039320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55924d612180 tx=0x7fade4089000 comp rx=0 tx=0).stop 2024-04-26T07:54:32.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 msgr2=0x55924d6357b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf0d17640 1 -- 172.21.15.62:0/1911389776 reap_dead start 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d6357b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fadec048010 tx=0x7fadec04cf70 comp rx=0 tx=0).stop 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 shutdown_connections 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1911389776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d62e210 0x55924d6357b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 >> 172.21.15.62:0/1911389776 conn(0x55924d62a4e0 msgr2=0x55924d627b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 shutdown_connections 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1911389776 wait complete. 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1548824281 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc8036eb0 msgr2=0x7facc8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1548824281 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc8036eb0 0x7facc8039370 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55924d60d410 tx=0x7fade401d010 comp rx=0 tx=0).stop 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1548824281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d620ec0 msgr2=0x55924d6212e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1548824281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d620ec0 0x55924d6212e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55924d606bf0 tx=0x7fadec018830 comp rx=0 tx=0).stop 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1548824281 shutdown_connections 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1548824281 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc8036eb0 0x7facc8039370 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/1548824281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d620ec0 0x55924d6212e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1548824281 >> 172.21.15.62:0/1548824281 conn(0x55924d614f60 msgr2=0x55924d615360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1548824281 shutdown_connections 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/1548824281 wait complete. 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d60f2a0 msgr2=0x55924d611690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d60f2a0 0x55924d611690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d50dac0 msgr2=0x55924d60ca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d50dac0 0x55924d60ca30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.933+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facd8036eb0 msgr2=0x7facd8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facd8036eb0 0x7facd8039370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fade8000f60 tx=0x7fade8001370 comp rx=0 tx=0).stop 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 msgr2=0x55924d6057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d6057f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fade4005930 tx=0x7fade4003020 comp rx=0 tx=0).stop 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 shutdown_connections 2024-04-26T07:54:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55924d50dac0 0x55924d60ca30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55924d60f2a0 0x55924d611690 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facd8036eb0 0x7facd8039370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 --2- 172.21.15.62:0/3892714099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55924d50b190 0x55924d6057f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 >> 172.21.15.62:0/3892714099 conn(0x55924d504ba0 msgr2=0x55924d5f7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 shutdown_connections 2024-04-26T07:54:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.934+0000 7fadf3a19800 1 -- 172.21.15.62:0/3892714099 wait complete. 2024-04-26T07:54:32.940 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T07:54:32.940 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T07:54:32.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T07:54:32.940 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T07:54:32.984 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:32.984 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5baf25800 1 Processor -- start 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5baf25800 1 -- start start 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5baf25800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c351da7170 0x55c351da9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5baf25800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c351dad5b0 con 0x55c351da9aa0 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5baf25800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55c351c48e20 con 0x55c351da7170 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5b6cb7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c351da7170 0x55c351da9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5b6cb7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c351da7170 0x55c351da9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60364/0 (socket says 172.21.15.62:60364) 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5b64b6640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55c351da9aa0 0x55c351dabe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36416/0 (socket says 172.21.15.62:36416) 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.987+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3238798342 learned_addr learned my addr 172.21.15.62:0/3238798342 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.988+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3238798342 >> v1:172.21.15.1:6789/0 conn(0x55c351da9aa0 legacy=0x55c351dabe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.988+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3238798342 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c351dae790 con 0x55c351da7170 2024-04-26T07:54:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.989+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/3238798342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da9560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800a520 tx=0x7fc5a801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d3bd9fd54075e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5b5cb5640 1 -- 172.21.15.62:0/3238798342 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a8057070 con 0x55c351da7170 2024-04-26T07:54:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5b5cb5640 1 -- 172.21.15.62:0/3238798342 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a8052570 con 0x55c351da7170 2024-04-26T07:54:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5b5cb5640 1 -- 172.21.15.62:0/3238798342 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a804ae60 con 0x55c351da7170 2024-04-26T07:54:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5baf25800 1 -- 172.21.15.62:0/3238798342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 msgr2=0x55c351da9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3238798342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da9560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800a520 tx=0x7fc5a801d010 comp rx=0 tx=0).stop 2024-04-26T07:54:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5baf25800 1 -- 172.21.15.62:0/3238798342 shutdown_connections 2024-04-26T07:54:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3238798342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da9560 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5baf25800 1 -- 172.21.15.62:0/3238798342 >> 172.21.15.62:0/3238798342 conn(0x55c351da0b80 msgr2=0x55c351da2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5baf25800 1 -- 172.21.15.62:0/3238798342 shutdown_connections 2024-04-26T07:54:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:32.990+0000 7fc5baf25800 1 -- 172.21.15.62:0/3238798342 wait complete. 2024-04-26T07:54:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.004+0000 7fc5baf25800 1 Processor -- start 2024-04-26T07:54:33.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.004+0000 7fc5baf25800 1 -- start start 2024-04-26T07:54:33.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.004+0000 7fc5baf25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.004+0000 7fc5baf25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c351cf1cd0 con 0x55c351da7170 2024-04-26T07:54:33.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.004+0000 7fc5b6cb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.004+0000 7fc5b6cb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60366/0 (socket says 172.21.15.62:60366) 2024-04-26T07:54:33.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.004+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3622390106 learned_addr learned my addr 172.21.15.62:0/3622390106 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.005+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3622390106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c351da5070 con 0x55c351da7170 2024-04-26T07:54:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.005+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/3622390106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da6ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8055040 tx=0x7fc5a804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d621c2dfac7e60e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.005+0000 7fc4a4e09640 1 -- 172.21.15.62:0/3622390106 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a8057040 con 0x55c351da7170 2024-04-26T07:54:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.005+0000 7fc4a4e09640 1 -- 172.21.15.62:0/3622390106 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a8052720 con 0x55c351da7170 2024-04-26T07:54:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.005+0000 7fc4a4e09640 1 -- 172.21.15.62:0/3622390106 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a8052a20 con 0x55c351da7170 2024-04-26T07:54:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 -- 172.21.15.62:0/3622390106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 msgr2=0x55c351da6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3622390106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da6ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8055040 tx=0x7fc5a804c000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 -- 172.21.15.62:0/3622390106 shutdown_connections 2024-04-26T07:54:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3622390106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351da6ab0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 -- 172.21.15.62:0/3622390106 >> 172.21.15.62:0/3622390106 conn(0x55c351da0b80 msgr2=0x55c351e93570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 -- 172.21.15.62:0/3622390106 shutdown_connections 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 -- 172.21.15.62:0/3622390106 wait complete. 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 Processor -- start 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.006+0000 7fc5baf25800 1 -- start start 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.007+0000 7fc5baf25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351ea1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.007+0000 7fc5baf25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c351dada20 con 0x55c351da7170 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.007+0000 7fc5b6cb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351ea1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.007+0000 7fc5b6cb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351ea1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60374/0 (socket says 172.21.15.62:60374) 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.007+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/4066076893 learned_addr learned my addr 172.21.15.62:0/4066076893 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.007+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/4066076893 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c351ea1dc0 con 0x55c351da7170 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.007+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351ea1880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8052540 tx=0x7fc5a8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.008+0000 7fc4a3606640 1 -- 172.21.15.62:0/4066076893 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a8073070 con 0x55c351da7170 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.008+0000 7fc4a3606640 1 -- 172.21.15.62:0/4066076893 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a805d440 con 0x55c351da7170 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.008+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c351ea2050 con 0x55c351da7170 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.008+0000 7fc4a3606640 1 -- 172.21.15.62:0/4066076893 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a8057070 con 0x55c351da7170 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.008+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c351ea4d00 con 0x55c351da7170 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.009+0000 7fc4a3606640 1 -- 172.21.15.62:0/4066076893 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc5a8076070 con 0x55c351da7170 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.009+0000 7fc4a3606640 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc49c036eb0 0x7fc49c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.009+0000 7fc4a3606640 1 -- 172.21.15.62:0/4066076893 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fc5a808e310 con 0x55c351da7170 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.009+0000 7fc5b64b6640 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc49c036eb0 0x7fc49c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.009+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351da9aa0 0x55c351ea8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.009+0000 7fc5b74b8640 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351da9aa0 0x55c351ea8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.009+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ea9000 con 0x55c351da9aa0 2024-04-26T07:54:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.010+0000 7fc5b64b6640 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc49c036eb0 0x7fc49c039370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac001e40 tx=0x7fc5ac0013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.010+0000 7fc5b74b8640 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351da9aa0 0x55c351ea8ac0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.010+0000 7fc5b74b8640 1 -- 172.21.15.62:0/4066076893 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5b000a4a0 con 0x55c351da9aa0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.010+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ea98a0 con 0x55c351da9aa0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.010+0000 7fc5b74b8640 1 -- 172.21.15.62:0/4066076893 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5b000a4a0 con 0x55c351da9aa0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.011+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351eab1f0 0x55c351ead6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.011+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351eade40 con 0x55c351eab1f0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.011+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351eab1f0 0x55c351ead6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.011+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351eab1f0 0x55c351ead6b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.011+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/4066076893 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc5a8075030 con 0x55c351eab1f0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.012+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351eaa0f0 con 0x55c351da9aa0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.012+0000 7fc5b74b8640 1 -- 172.21.15.62:0/4066076893 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5b000a4a0 con 0x55c351da9aa0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.012+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351eaa590 con 0x55c351da9aa0 2024-04-26T07:54:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.012+0000 7fc5b74b8640 1 -- 172.21.15.62:0/4066076893 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc5b000a4a0 con 0x55c351da9aa0 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.012+0000 7fc5baf25800 1 Processor -- start 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc5baf25800 1 -- start start 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc5baf25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ebcf70 0x55c351ebd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc5baf25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c351c99170 con 0x55c351ebcf70 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc5b74b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ebcf70 0x55c351ebd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc5b74b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ebcf70 0x55c351ebd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60384/0 (socket says 172.21.15.62:60384) 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc5b74b8640 1 -- 172.21.15.62:0/1107687935 learned_addr learned my addr 172.21.15.62:0/1107687935 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc5b74b8640 1 -- 172.21.15.62:0/1107687935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c351ebd8d0 con 0x55c351ebcf70 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc5b74b8640 1 --2- 172.21.15.62:0/1107687935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ebcf70 0x55c351ebd390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55c351ea2930 tx=0x7fc5b0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.013+0000 7fc4a0e01640 1 -- 172.21.15.62:0/1107687935 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b0014450 con 0x55c351ebcf70 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.014+0000 7fc4a0e01640 1 -- 172.21.15.62:0/1107687935 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0014610 con 0x55c351ebcf70 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.014+0000 7fc5baf25800 1 -- 172.21.15.62:0/1107687935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c351ebe340 con 0x55c351ebcf70 2024-04-26T07:54:33.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.014+0000 7fc4a0e01640 1 -- 172.21.15.62:0/1107687935 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b0014930 con 0x55c351ebcf70 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.014+0000 7fc5baf25800 1 -- 172.21.15.62:0/1107687935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c351ebe780 con 0x55c351ebcf70 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.014+0000 7fc4a0e01640 1 -- 172.21.15.62:0/1107687935 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc5b0011040 con 0x55c351ebcf70 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.015+0000 7fc4a0e01640 1 --2- 172.21.15.62:0/1107687935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc490036eb0 0x7fc490039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.015+0000 7fc4a0e01640 1 -- 172.21.15.62:0/1107687935 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fc5b001e070 con 0x55c351ebcf70 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.015+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/1107687935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc490036eb0 0x7fc490039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.015+0000 7fc5baf25800 1 Processor -- start 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.015+0000 7fc5baf25800 1 -- start start 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.015+0000 7fc5baf25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.015+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/1107687935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc490036eb0 0x7fc490039370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80068b0 tx=0x7fc5a806ffc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.015+0000 7fc5baf25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c351da5330 con 0x55c351ecec50 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.016+0000 7fc5b74b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.016+0000 7fc5b74b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60386/0 (socket says 172.21.15.62:60386) 2024-04-26T07:54:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.016+0000 7fc5b74b8640 1 -- 172.21.15.62:0/1086659760 learned_addr learned my addr 172.21.15.62:0/1086659760 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.016+0000 7fc5b74b8640 1 -- 172.21.15.62:0/1086659760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c351ed1580 con 0x55c351ecec50 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.016+0000 7fc5b74b8640 1 --2- 172.21.15.62:0/1086659760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed1040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc5b004d0c0 tx=0x7fc5b002bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e48dc9fea1bea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.016+0000 7fc49a7fc640 1 -- 172.21.15.62:0/1086659760 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b002b350 con 0x55c351ecec50 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.016+0000 7fc49a7fc640 1 -- 172.21.15.62:0/1086659760 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0046070 con 0x55c351ecec50 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.016+0000 7fc49a7fc640 1 -- 172.21.15.62:0/1086659760 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b002cca0 con 0x55c351ecec50 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 -- 172.21.15.62:0/1086659760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 msgr2=0x55c351ed1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 --2- 172.21.15.62:0/1086659760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed1040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc5b004d0c0 tx=0x7fc5b002bca0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 -- 172.21.15.62:0/1086659760 shutdown_connections 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 --2- 172.21.15.62:0/1086659760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed1040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 -- 172.21.15.62:0/1086659760 >> 172.21.15.62:0/1086659760 conn(0x55c351e99930 msgr2=0x55c351e979e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 -- 172.21.15.62:0/1086659760 shutdown_connections 2024-04-26T07:54:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 -- 172.21.15.62:0/1086659760 wait complete. 2024-04-26T07:54:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 Processor -- start 2024-04-26T07:54:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 -- start start 2024-04-26T07:54:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5baf25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c351ed1990 con 0x55c351ecec50 2024-04-26T07:54:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.017+0000 7fc5b74b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc5b74b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60398/0 (socket says 172.21.15.62:60398) 2024-04-26T07:54:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 learned_addr learned my addr 172.21.15.62:0/3253704579 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c351ed6100 con 0x55c351ecec50 2024-04-26T07:54:33.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc5b74b8640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed5bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0048010 tx=0x7fc5b004d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc498ff9640 1 -- 172.21.15.62:0/3253704579 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b003e070 con 0x55c351ecec50 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc498ff9640 1 -- 172.21.15.62:0/3253704579 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0014ad0 con 0x55c351ecec50 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc498ff9640 1 -- 172.21.15.62:0/3253704579 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b0014db0 con 0x55c351ecec50 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c351ed6390 con 0x55c351ecec50 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.018+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c351ed9040 con 0x55c351ecec50 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.019+0000 7fc498ff9640 1 -- 172.21.15.62:0/3253704579 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc5b0041070 con 0x55c351ecec50 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.019+0000 7fc498ff9640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc480036eb0 0x7fc480039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.020+0000 7fc498ff9640 1 -- 172.21.15.62:0/3253704579 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fc5b000e040 con 0x55c351ecec50 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.020+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc480036eb0 0x7fc480039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.020+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc480036eb0 0x7fc480039370 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80823f0 tx=0x7fc5a808b000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.020+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.020+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351ee16c0 0x55c351ee3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.020+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ee42d0 con 0x55c351ee16c0 2024-04-26T07:54:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.020+0000 7fc5b64b6640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351ee16c0 0x55c351ee3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5b64b6640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351ee16c0 0x55c351ee3b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 20 realm 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ee0b10 con 0x55c351ee16c0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ee4dc0 con 0x55c351ee16c0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.021+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ee5690 con 0x55c351ee16c0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5baf25800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351ee5fd0 0x55c351ee83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ee8b70 con 0x55c351ee5fd0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5b74b8640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351ee5fd0 0x55c351ee83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5b74b8640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351ee5fd0 0x55c351ee83e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.022+0000 7fc5baf25800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.023+0000 7fc5baf25800 20 searching for the correct realm 2024-04-26T07:54:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.023+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c351eeab40 0x55c351eed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.023+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.023+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c351eeab40 0x55c351eed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.023+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c351eeab40 0x55c351eed000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.024+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.024+0000 7fc5b6cb7640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc5a8078060 0x7fc5a8077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.024+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x7fc5a8078060 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.024+0000 7fc5b64b6640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc5a8078060 0x7fc5a8077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.024+0000 7fc5b64b6640 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc5a8078060 0x7fc5a8077a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.024+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.024+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.025+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.025+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee16c0 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.025+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.025+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee16c0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.025+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.025+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.025+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.025+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.026+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.026+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x7fc5a8078060 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.026+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.026+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.026+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.026+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee16c0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.027+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.027+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.027+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.027+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee16c0 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.027+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.027+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x7fc5a8078060 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.027+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.027+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.028+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.028+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.028+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.028+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.028+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.028+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.028+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.028+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.029+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.029+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee16c0 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.029+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.029+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee16c0 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.029+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.029+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.029+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.029+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.030+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.030+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x7fc5a8078060 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.030+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.030+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee16c0 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.030+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.030+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.030+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.030+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.031+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.031+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.031+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.031+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x7fc5a8078060 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.031+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.031+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351eeab40 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.031+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.031+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee5fd0 2024-04-26T07:54:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x55c351ee16c0 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c351eed6d0 con 0x7fc5a8078060 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5baf25800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5baf25800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5baf25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5baf25800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5baf25800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5baf25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ee9530 con 0x55c351ee16c0 2024-04-26T07:54:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.032+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ee9dd0 con 0x55c351ee16c0 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ee9170 con 0x55c351ee16c0 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 zone default found 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 4 Realm: () 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:33.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 zonegroup default 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351eedb90 con 0x55c351ee5fd0 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.033+0000 7fc5baf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351eefe60 con 0x55c351eeab40 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef0200 con 0x55c351eeab40 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 20 started sync module instance, tier type = 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.034+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351eef2f0 con 0x7fc5a8078060 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.035+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.035+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94297381599248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351eef2f0 con 0x7fc5a8078060 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.035+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef0c60 con 0x55c351ee16c0 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.038+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.038+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94297381599248] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.038+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94297381603248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef0c10 con 0x55c351ee16c0 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.038+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef1a00 con 0x55c351eeab40 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.041+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.041+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94297381606736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef2250 con 0x55c351eeab40 2024-04-26T07:54:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.041+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef2aa0 con 0x7fc5a8078060 2024-04-26T07:54:33.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.041+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94297381603248] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.042+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94297381606736] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.042+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.042+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94297381605376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef2aa0 con 0x7fc5a8078060 2024-04-26T07:54:33.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.042+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef3340 con 0x55c351ee16c0 2024-04-26T07:54:33.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.045+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.045+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94297381612672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef3770 con 0x55c351ee16c0 2024-04-26T07:54:33.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.045+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef4260 con 0x55c351ee5fd0 2024-04-26T07:54:33.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.045+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94297381605376] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.046+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.046+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94297381616944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef4650 con 0x55c351ee5fd0 2024-04-26T07:54:33.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.046+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef5050 con 0x55c351ee5fd0 2024-04-26T07:54:33.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.049+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94297381616944] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.052+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94297381612672] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.052+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.052+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94297381610992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef4b60 con 0x55c351ee5fd0 2024-04-26T07:54:33.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.052+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef58f0 con 0x55c351ee5fd0 2024-04-26T07:54:33.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.053+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.053+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94297381622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef4b60 con 0x55c351ee5fd0 2024-04-26T07:54:33.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.053+0000 7fc5baf25800 20 add_watcher() i=0 2024-04-26T07:54:33.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.053+0000 7fc5baf25800 20 add_watcher() i=1 2024-04-26T07:54:33.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.053+0000 7fc5baf25800 20 add_watcher() i=2 2024-04-26T07:54:33.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.053+0000 7fc5baf25800 20 add_watcher() i=3 2024-04-26T07:54:33.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.053+0000 7fc5baf25800 20 add_watcher() i=4 2024-04-26T07:54:33.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.053+0000 7fc5baf25800 20 add_watcher() i=5 2024-04-26T07:54:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.054+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94297381622848] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.054+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94297381610992] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.054+0000 7fc5baf25800 20 add_watcher() i=6 2024-04-26T07:54:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.054+0000 7fc5baf25800 20 add_watcher() i=7 2024-04-26T07:54:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.054+0000 7fc5baf25800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.054+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef5860 con 0x55c351ee16c0 2024-04-26T07:54:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.055+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.055+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94297381613888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef5860 con 0x55c351ee16c0 2024-04-26T07:54:33.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.056+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94297381613888] v27'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.056+0000 7fc46d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.056+0000 7fc5baf25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:33.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.056+0000 7fc5baf25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:33.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.056+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f015f0 con 0x55c351ee16c0 2024-04-26T07:54:33.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.057+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.057+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f01cc0 con 0x55c351ee5fd0 2024-04-26T07:54:33.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.058+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.058+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f01cc0 con 0x55c351eeab40 2024-04-26T07:54:33.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.060+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.060+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f02760 con 0x55c351ee16c0 2024-04-26T07:54:33.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.061+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.061+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351efd280 con 0x7fc5a8078060 2024-04-26T07:54:33.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.063+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.063+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351efd280 con 0x55c351eeab40 2024-04-26T07:54:33.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.065+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.065+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee16c0 2024-04-26T07:54:33.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.067+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.067+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee5fd0 2024-04-26T07:54:33.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.068+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.068+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x7fc5a8078060 2024-04-26T07:54:33.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.069+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.069+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.072+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.072+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x7fc5a8078060 2024-04-26T07:54:33.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.074+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.074+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee5fd0 2024-04-26T07:54:33.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.076+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.076+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x7fc5a8078060 2024-04-26T07:54:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.077+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.077+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee5fd0 2024-04-26T07:54:33.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.078+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.078+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee16c0 2024-04-26T07:54:33.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.079+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.079+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.081+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.081+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x7fc5a8078060 2024-04-26T07:54:33.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.082+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.082+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.083+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.083+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee16c0 2024-04-26T07:54:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.084+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.084+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee16c0 2024-04-26T07:54:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.085+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.085+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.086+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.086+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x7fc5a8078060 2024-04-26T07:54:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.087+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.087+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.088+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.088+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.089+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.089+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.092+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.092+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.093+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.093+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee5fd0 2024-04-26T07:54:33.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.094+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.094+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.095+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.095+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee5fd0 2024-04-26T07:54:33.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.096+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.096+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351eeab40 2024-04-26T07:54:33.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.097+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.097+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x55c351ee5fd0 2024-04-26T07:54:33.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.099+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.099+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351f030c0 con 0x7fc5a8078060 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc3e7fff640 20 reqs_thread_entry: start 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc5baf25800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc5baf25800 20 Filter name: none 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc3e5ffb640 20 reqs_thread_entry: start 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc5baf25800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc5baf25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c351f2e5a0 con 0x55c351ee5fd0 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.100+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.101+0000 7fc5baf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.101+0000 7fc5baf25800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T07:54:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, user does not exist2024-04-26T07:54:33.101+0000 7fc5baf25800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:33.100 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-26T07:54:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.101+0000 7fc46d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.101+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94297381613888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351efc3c0 con 0x55c351ee16c0 2024-04-26T07:54:33.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.102+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94297381613888] v27'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.102+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94297381599248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef3140 con 0x7fc5a8078060 2024-04-26T07:54:33.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.103+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94297381599248] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.103+0000 7fc5baf25800 20 remove_watcher() i=0 2024-04-26T07:54:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.103+0000 7fc5baf25800 2 removed watcher, disabling cache 2024-04-26T07:54:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.103+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94297381603248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef3140 con 0x55c351ee16c0 2024-04-26T07:54:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.104+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94297381603248] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.104+0000 7fc5baf25800 20 remove_watcher() i=1 2024-04-26T07:54:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.104+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94297381606736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef07b0 con 0x55c351eeab40 2024-04-26T07:54:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.106+0000 7fc5b6cb7640 1 -- 172.21.15.62:0/3253704579 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94297381606736] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5a808b070 con 0x55c351eeab40 2024-04-26T07:54:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.106+0000 7fc5baf25800 20 remove_watcher() i=2 2024-04-26T07:54:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.106+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94297381605376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef3140 con 0x7fc5a8078060 2024-04-26T07:54:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.107+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94297381605376] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x7fc5a8078060 2024-04-26T07:54:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.107+0000 7fc5baf25800 20 remove_watcher() i=3 2024-04-26T07:54:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.107+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94297381612672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef1550 con 0x55c351ee16c0 2024-04-26T07:54:33.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.109+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94297381612672] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5ac00f670 con 0x55c351ee16c0 2024-04-26T07:54:33.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.109+0000 7fc5baf25800 20 remove_watcher() i=4 2024-04-26T07:54:33.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.109+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94297381616944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef1000 con 0x55c351ee5fd0 2024-04-26T07:54:33.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.110+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94297381616944] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.110+0000 7fc5baf25800 20 remove_watcher() i=5 2024-04-26T07:54:33.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.110+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94297381610992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef2c80 con 0x55c351ee5fd0 2024-04-26T07:54:33.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.111+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94297381610992] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.111+0000 7fc5baf25800 20 remove_watcher() i=6 2024-04-26T07:54:33.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.111+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94297381622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c351ef1550 con 0x55c351ee5fd0 2024-04-26T07:54:33.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5b74b8640 1 -- 172.21.15.62:0/3253704579 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94297381622848] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b0040030 con 0x55c351ee5fd0 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 20 remove_watcher() i=7 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351ee5fd0 msgr2=0x55c351ee83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351ee5fd0 0x55c351ee83e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351ee16c0 msgr2=0x55c351ee3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351ee16c0 0x55c351ee3b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc5a8078060 msgr2=0x7fc5a8077a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc5a8078060 0x7fc5a8077a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c351eeab40 msgr2=0x55c351eed000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c351eeab40 0x55c351eed000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc480036eb0 msgr2=0x7fc480039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc480036eb0 0x7fc480039370 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80823f0 tx=0x7fc5a808b000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 msgr2=0x55c351ed5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed5bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0048010 tx=0x7fc5b004d050 comp rx=0 tx=0).stop 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5b64b6640 1 -- 172.21.15.62:0/3253704579 reap_dead start 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 shutdown_connections 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 --2- 172.21.15.62:0/3253704579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ecec50 0x55c351ed5bc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 >> 172.21.15.62:0/3253704579 conn(0x55c351e99930 msgr2=0x55c351ec3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.112+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 shutdown_connections 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/3253704579 wait complete. 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/1107687935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc490036eb0 msgr2=0x7fc490039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/1107687935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc490036eb0 0x7fc490039370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80068b0 tx=0x7fc5a806ffc0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/1107687935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ebcf70 msgr2=0x55c351ebd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/1107687935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ebcf70 0x55c351ebd390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55c351ea2930 tx=0x7fc5b0018830 comp rx=0 tx=0).stop 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/1107687935 shutdown_connections 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/1107687935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc490036eb0 0x7fc490039370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/1107687935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351ebcf70 0x55c351ebd390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/1107687935 >> 172.21.15.62:0/1107687935 conn(0x55c351eb1010 msgr2=0x55c351eb1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/1107687935 shutdown_connections 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/1107687935 wait complete. 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351eab1f0 msgr2=0x55c351ead6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351eab1f0 0x55c351ead6b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351da9aa0 msgr2=0x55c351ea8ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351da9aa0 0x55c351ea8ac0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc49c036eb0 msgr2=0x7fc49c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc49c036eb0 0x7fc49c039370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac001e40 tx=0x7fc5ac0013a0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 msgr2=0x55c351ea1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351ea1880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8052540 tx=0x7fc5a8003020 comp rx=0 tx=0).stop 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 shutdown_connections 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c351da9aa0 0x55c351ea8ac0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55c351eab1f0 0x55c351ead6b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc49c036eb0 0x7fc49c039370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 --2- 172.21.15.62:0/4066076893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c351da7170 0x55c351ea1880 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.113+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 >> 172.21.15.62:0/4066076893 conn(0x55c351da0b80 msgr2=0x55c351da5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.114+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 shutdown_connections 2024-04-26T07:54:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.114+0000 7fc5baf25800 1 -- 172.21.15.62:0/4066076893 wait complete. 2024-04-26T07:54:33.119 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T07:54:33.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T07:54:33.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T07:54:33.121 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T07:54:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:33.166 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:33.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.168+0000 7f892512b800 1 Processor -- start 2024-04-26T07:54:33.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.168+0000 7f892512b800 1 -- start start 2024-04-26T07:54:33.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.168+0000 7f892512b800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5651c7754190 0x5651c7752740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.168+0000 7f892512b800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651c7753130 con 0x5651c7752c80 2024-04-26T07:54:33.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.168+0000 7f892512b800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5651c7680e20 con 0x5651c7754190 2024-04-26T07:54:33.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.169+0000 7f8920d52640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5651c7754190 0x5651c7752740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.169+0000 7f8920551640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5651c7752c80 0x5651c77e6590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36420/0 (socket says 172.21.15.62:36420) 2024-04-26T07:54:33.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.169+0000 7f8920551640 1 -- 172.21.15.62:0/1951594613 learned_addr learned my addr 172.21.15.62:0/1951594613 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:33.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.169+0000 7f891fd50640 1 -- 172.21.15.62:0/1951594613 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414669165 0 0) 0x5651c7753130 con 0x5651c7752c80 2024-04-26T07:54:33.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.169+0000 7f891fd50640 1 -- 172.21.15.62:0/1951594613 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8908001e10 con 0x5651c7752c80 2024-04-26T07:54:33.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.169+0000 7f8920d52640 1 -- 172.21.15.62:0/1951594613 >> v1:172.21.15.1:6789/0 conn(0x5651c7752c80 legacy=0x5651c77e6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.169+0000 7f8920d52640 1 -- 172.21.15.62:0/1951594613 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651c7753350 con 0x5651c7754190 2024-04-26T07:54:33.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f8920d52640 1 --2- 172.21.15.62:0/1951594613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7754190 0x5651c7752740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f891000a470 tx=0x7f891001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c820ad9294a2e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f891fd50640 1 -- 172.21.15.62:0/1951594613 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8910057070 con 0x5651c7754190 2024-04-26T07:54:33.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f891fd50640 1 -- 172.21.15.62:0/1951594613 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891004acd0 con 0x5651c7754190 2024-04-26T07:54:33.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f891fd50640 1 -- 172.21.15.62:0/1951594613 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8910052440 con 0x5651c7754190 2024-04-26T07:54:33.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f892512b800 1 -- 172.21.15.62:0/1951594613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7754190 msgr2=0x5651c7752740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f892512b800 1 --2- 172.21.15.62:0/1951594613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7754190 0x5651c7752740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f891000a470 tx=0x7f891001cdb0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f892512b800 1 -- 172.21.15.62:0/1951594613 shutdown_connections 2024-04-26T07:54:33.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f892512b800 1 --2- 172.21.15.62:0/1951594613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7754190 0x5651c7752740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f892512b800 1 -- 172.21.15.62:0/1951594613 >> 172.21.15.62:0/1951594613 conn(0x5651c77d9d20 msgr2=0x5651c77dc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f892512b800 1 -- 172.21.15.62:0/1951594613 shutdown_connections 2024-04-26T07:54:33.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.171+0000 7f892512b800 1 -- 172.21.15.62:0/1951594613 wait complete. 2024-04-26T07:54:33.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.184+0000 7f892512b800 1 Processor -- start 2024-04-26T07:54:33.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.184+0000 7f892512b800 1 -- start start 2024-04-26T07:54:33.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.184+0000 7f892512b800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.184+0000 7f892512b800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5651c7729cd0 con 0x5651c7752c80 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.185+0000 7f8920d52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.185+0000 7f8920d52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60424/0 (socket says 172.21.15.62:60424) 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.185+0000 7f8920d52640 1 -- 172.21.15.62:0/123996118 learned_addr learned my addr 172.21.15.62:0/123996118 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.185+0000 7f8920d52640 1 -- 172.21.15.62:0/123996118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651c78d2350 con 0x5651c7752c80 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.185+0000 7f8920d52640 1 --2- 172.21.15.62:0/123996118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d1d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8910000c00 tx=0x7f891004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be66d29fa7a7799 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.185+0000 7f880ee0d640 1 -- 172.21.15.62:0/123996118 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8910057040 con 0x5651c7752c80 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.185+0000 7f880ee0d640 1 -- 172.21.15.62:0/123996118 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8910063070 con 0x5651c7752c80 2024-04-26T07:54:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.185+0000 7f880ee0d640 1 -- 172.21.15.62:0/123996118 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8910052760 con 0x5651c7752c80 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 -- 172.21.15.62:0/123996118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 msgr2=0x5651c78d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 --2- 172.21.15.62:0/123996118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d1d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8910000c00 tx=0x7f891004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 -- 172.21.15.62:0/123996118 shutdown_connections 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 --2- 172.21.15.62:0/123996118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d1d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 -- 172.21.15.62:0/123996118 >> 172.21.15.62:0/123996118 conn(0x5651c77d9d20 msgr2=0x5651c78cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 -- 172.21.15.62:0/123996118 shutdown_connections 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 -- 172.21.15.62:0/123996118 wait complete. 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 Processor -- start 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.186+0000 7f892512b800 1 -- start start 2024-04-26T07:54:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f892512b800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f892512b800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5651c77e9f60 con 0x5651c7752c80 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f8920d52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f8920d52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60438/0 (socket says 172.21.15.62:60438) 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f8920d52640 1 -- 172.21.15.62:0/4062771614 learned_addr learned my addr 172.21.15.62:0/4062771614 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f8920d52640 1 -- 172.21.15.62:0/4062771614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651c78d9d30 con 0x5651c7752c80 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f8920d52640 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d97f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f891001baa0 tx=0x7f8910002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f880d60a640 1 -- 172.21.15.62:0/4062771614 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891006d070 con 0x5651c7752c80 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f880d60a640 1 -- 172.21.15.62:0/4062771614 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8910052cc0 con 0x5651c7752c80 2024-04-26T07:54:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.187+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651c78d9fc0 con 0x5651c7752c80 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.188+0000 7f880d60a640 1 -- 172.21.15.62:0/4062771614 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8910057050 con 0x5651c7752c80 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.188+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651c78dcc70 con 0x5651c7752c80 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.188+0000 7f880d60a640 1 -- 172.21.15.62:0/4062771614 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8910070070 con 0x5651c7752c80 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f880d60a640 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8808036eb0 0x7f8808039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f880d60a640 1 -- 172.21.15.62:0/4062771614 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f891008e250 con 0x5651c7752c80 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f8920551640 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8808036eb0 0x7f8808039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c7754190 0x5651c78e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c78e1000 con 0x5651c7754190 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f8921553640 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c7754190 0x5651c78e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f8920551640 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8808036eb0 0x7f8808039370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8914000f60 tx=0x7f89140010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f8921553640 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c7754190 0x5651c78e0a30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f8921553640 1 -- 172.21.15.62:0/4062771614 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891800a4a0 con 0x5651c7754190 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.189+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c78ddfe0 con 0x5651c7754190 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.190+0000 7f8921553640 1 -- 172.21.15.62:0/4062771614 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f891800a4a0 con 0x5651c7754190 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.190+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c78e3380 0x5651c78e5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.190+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c78e5e10 con 0x5651c78e3380 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.190+0000 7f8920d52640 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c78e3380 0x5651c78e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.190+0000 7f8920d52640 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c78e3380 0x5651c78e5770 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.191+0000 7f8920d52640 1 -- 172.21.15.62:0/4062771614 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8910079070 con 0x5651c78e3380 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.191+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c78e2330 con 0x5651c7754190 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.191+0000 7f8921553640 1 -- 172.21.15.62:0/4062771614 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f891800a4a0 con 0x5651c7754190 2024-04-26T07:54:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.191+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c78e2810 con 0x5651c7754190 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.191+0000 7f8921553640 1 -- 172.21.15.62:0/4062771614 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f891800a4a0 con 0x5651c7754190 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f892512b800 1 Processor -- start 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f892512b800 1 -- start start 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f892512b800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c78f4fb0 0x5651c78f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f892512b800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5651c76d1170 con 0x5651c78f4fb0 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f8921553640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c78f4fb0 0x5651c78f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f8921553640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c78f4fb0 0x5651c78f53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60442/0 (socket says 172.21.15.62:60442) 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f8921553640 1 -- 172.21.15.62:0/288813361 learned_addr learned my addr 172.21.15.62:0/288813361 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f8921553640 1 -- 172.21.15.62:0/288813361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651c78f5910 con 0x5651c78f4fb0 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.192+0000 7f8921553640 1 --2- 172.21.15.62:0/288813361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c78f4fb0 0x5651c78f53d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5651c78e1400 tx=0x7f8918018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.193+0000 7f88067fc640 1 -- 172.21.15.62:0/288813361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918014450 con 0x5651c78f4fb0 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.193+0000 7f88067fc640 1 -- 172.21.15.62:0/288813361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8918014610 con 0x5651c78f4fb0 2024-04-26T07:54:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.193+0000 7f88067fc640 1 -- 172.21.15.62:0/288813361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918014930 con 0x5651c78f4fb0 2024-04-26T07:54:33.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.193+0000 7f892512b800 1 -- 172.21.15.62:0/288813361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651c78f6380 con 0x5651c78f4fb0 2024-04-26T07:54:33.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.193+0000 7f892512b800 1 -- 172.21.15.62:0/288813361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651c78f6880 con 0x5651c78f4fb0 2024-04-26T07:54:33.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.193+0000 7f88067fc640 1 -- 172.21.15.62:0/288813361 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8918011040 con 0x5651c78f4fb0 2024-04-26T07:54:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f88067fc640 1 --2- 172.21.15.62:0/288813361 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87f8036eb0 0x7f87f8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f88067fc640 1 -- 172.21.15.62:0/288813361 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f891801e070 con 0x5651c78f4fb0 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f8920d52640 1 --2- 172.21.15.62:0/288813361 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87f8036eb0 0x7f87f8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f892512b800 1 Processor -- start 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f892512b800 1 -- start start 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f8920d52640 1 --2- 172.21.15.62:0/288813361 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87f8036eb0 0x7f87f8039370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5651c78e14c0 tx=0x7f891008c530 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f892512b800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c79026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f892512b800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5651c78d2610 con 0x5651c79022c0 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f8921553640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c79026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f8921553640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c79026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60448/0 (socket says 172.21.15.62:60448) 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.194+0000 7f8921553640 1 -- 172.21.15.62:0/389606804 learned_addr learned my addr 172.21.15.62:0/389606804 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f8921553640 1 -- 172.21.15.62:0/389606804 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651c7902cb0 con 0x5651c79022c0 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f8921553640 1 --2- 172.21.15.62:0/389606804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c79026e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f891804cff0 tx=0x7f891802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a56dc474fd5024f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f87f7fff640 1 -- 172.21.15.62:0/389606804 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180412b0 con 0x5651c79022c0 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f87f7fff640 1 -- 172.21.15.62:0/389606804 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8918014ad0 con 0x5651c79022c0 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f87f7fff640 1 -- 172.21.15.62:0/389606804 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918011bb0 con 0x5651c79022c0 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f892512b800 1 -- 172.21.15.62:0/389606804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 msgr2=0x5651c79026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f892512b800 1 --2- 172.21.15.62:0/389606804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c79026e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f891804cff0 tx=0x7f891802bf30 comp rx=0 tx=0).stop 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f892512b800 1 -- 172.21.15.62:0/389606804 shutdown_connections 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f892512b800 1 --2- 172.21.15.62:0/389606804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c79026e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f892512b800 1 -- 172.21.15.62:0/389606804 >> 172.21.15.62:0/389606804 conn(0x5651c78fe590 msgr2=0x5651c78fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f892512b800 1 -- 172.21.15.62:0/389606804 shutdown_connections 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.195+0000 7f892512b800 1 -- 172.21.15.62:0/389606804 wait complete. 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.196+0000 7f892512b800 1 Processor -- start 2024-04-26T07:54:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.196+0000 7f892512b800 1 -- start start 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.196+0000 7f892512b800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c7909820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.196+0000 7f892512b800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5651c7903440 con 0x5651c79022c0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.196+0000 7f8921553640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c7909820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.196+0000 7f8921553640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c7909820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60452/0 (socket says 172.21.15.62:60452) 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.196+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 learned_addr learned my addr 172.21.15.62:0/2335007612 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.196+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651c7909d60 con 0x5651c79022c0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.197+0000 7f8921553640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c7909820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f891804bf10 tx=0x7f891804cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.197+0000 7f87f67fc640 1 -- 172.21.15.62:0/2335007612 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180135c0 con 0x5651c79022c0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.197+0000 7f87f67fc640 1 -- 172.21.15.62:0/2335007612 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8918042040 con 0x5651c79022c0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.197+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651c790a050 con 0x5651c79022c0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.197+0000 7f87f67fc640 1 -- 172.21.15.62:0/2335007612 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180138b0 con 0x5651c79022c0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.197+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651c790cca0 con 0x5651c79022c0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.197+0000 7f87f67fc640 1 -- 172.21.15.62:0/2335007612 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f891804e1d0 con 0x5651c79022c0 2024-04-26T07:54:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.198+0000 7f87f67fc640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87ec036e60 0x7f87ec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.198+0000 7f87f67fc640 1 -- 172.21.15.62:0/2335007612 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f891800e040 con 0x5651c79022c0 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.198+0000 7f8920d52640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87ec036e60 0x7f87ec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.198+0000 7f8920d52640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87ec036e60 0x7f87ec039320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8910044610 tx=0x7f8910083000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.198+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.198+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c79153e0 0x5651c79178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.198+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c7917ff0 con 0x5651c79153e0 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.198+0000 7f8920551640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c79153e0 0x5651c79178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f8920551640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c79153e0 0x5651c79178a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8914009050 con 0x5651c79153e0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 20 realm 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c7914830 con 0x5651c79153e0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8914009050 con 0x5651c79153e0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c7918ae0 con 0x5651c79153e0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8914009050 con 0x5651c79153e0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.199+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c79193b0 con 0x5651c79153e0 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.200+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8914009050 con 0x5651c79153e0 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.200+0000 7f892512b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.200+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.200+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c7919dd0 0x5651c791c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.200+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c791c8b0 con 0x5651c7919dd0 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.200+0000 7f8921553640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c7919dd0 0x5651c791c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.200+0000 7f8921553640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c7919dd0 0x5651c791c1c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.201+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.201+0000 7f892512b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.201+0000 7f892512b800 20 searching for the correct realm 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.201+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5651c791e880 0x5651c7920d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.201+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.201+0000 7f8920d52640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5651c791e880 0x5651c7920d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.201+0000 7f8920d52640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5651c791e880 0x5651c7920d40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.202+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.202+0000 7f8920d52640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f891008a070 0x7f891008c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.202+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x7f891008a070 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.202+0000 7f8920551640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f891008a070 0x7f891008c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.202+0000 7f8920551640 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f891008a070 0x7f891008c9b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.202+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914009050 con 0x7f891008a070 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.202+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.203+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.203+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c79153e0 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.203+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914009050 con 0x5651c79153e0 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.203+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c79153e0 2024-04-26T07:54:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.203+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.203+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.204+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.204+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.204+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.204+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x7f891008a070 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.204+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914029040 con 0x7f891008a070 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.204+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.205+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.205+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c79153e0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.205+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.205+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.205+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.205+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c79153e0 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.205+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.205+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x7f891008a070 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.206+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8914029040 con 0x7f891008a070 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.206+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.206+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.206+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.206+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.206+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.207+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.207+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.207+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.207+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.207+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.207+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c79153e0 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.207+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.207+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c79153e0 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.208+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.208+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.208+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.208+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.208+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.208+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x7f891008a070 2024-04-26T07:54:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.208+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914029040 con 0x7f891008a070 2024-04-26T07:54:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.208+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c79153e0 2024-04-26T07:54:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.209+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.209+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.209+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.209+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.209+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.209+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.210+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.210+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x7f891008a070 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.210+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914029040 con 0x7f891008a070 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.210+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c791e880 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.210+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.210+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c7919dd0 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.210+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.210+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x5651c79153e0 2024-04-26T07:54:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5651c7921410 con 0x7f891008a070 2024-04-26T07:54:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914029040 con 0x7f891008a070 2024-04-26T07:54:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c791d270 con 0x5651c79153e0 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c791ceb0 con 0x5651c79153e0 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.211+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c791dc10 con 0x5651c79153e0 2024-04-26T07:54:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8914029040 con 0x5651c79153e0 2024-04-26T07:54:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 20 zone default found 2024-04-26T07:54:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 4 Realm: () 2024-04-26T07:54:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 20 zonegroup default 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c791d720 con 0x5651c7919dd0 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c7923c20 con 0x5651c791e880 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.212+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c7923fc0 con 0x5651c791e880 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.213+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.213+0000 7f892512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.213+0000 7f892512b800 20 started sync module instance, tier type = 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.213+0000 7f892512b800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.213+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7923060 con 0x7f891008a070 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.214+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.214+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94909240587696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7923060 con 0x7f891008a070 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.214+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7924980 con 0x5651c79153e0 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.215+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94909240587696] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.215+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.215+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94909240592048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7923060 con 0x5651c79153e0 2024-04-26T07:54:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.215+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c79253d0 con 0x5651c791e880 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.216+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94909240592048] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.216+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.216+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94909240585136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7922fd0 con 0x5651c791e880 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.216+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7926290 con 0x7f891008a070 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.217+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94909240585136] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.218+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.218+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94909240597984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c79266b0 con 0x7f891008a070 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.218+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7927070 con 0x5651c79153e0 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.219+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.219+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94909240601536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7927490 con 0x5651c79153e0 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.219+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7927ec0 con 0x5651c7919dd0 2024-04-26T07:54:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.219+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94909240597984] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.220+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.220+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94909240605136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7928260 con 0x5651c7919dd0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.220+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7928d50 con 0x5651c7919dd0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.220+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94909240601536] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.221+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.221+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94909240608800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7928d10 con 0x5651c7919dd0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.221+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c79297b0 con 0x5651c7919dd0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.221+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94909240605136] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94909240608800] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94909240611456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7926fe0 con 0x5651c7919dd0 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f892512b800 20 add_watcher() i=0 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f892512b800 20 add_watcher() i=1 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f892512b800 20 add_watcher() i=2 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f892512b800 20 add_watcher() i=3 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f892512b800 20 add_watcher() i=4 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f892512b800 20 add_watcher() i=5 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.222+0000 7f892512b800 20 add_watcher() i=6 2024-04-26T07:54:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.223+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94909240611456] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.223+0000 7f892512b800 20 add_watcher() i=7 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.223+0000 7f892512b800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.223+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c792c7a0 con 0x5651c79153e0 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.223+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.223+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94909240599040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7929c20 con 0x5651c79153e0 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.224+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94909240599040] v27'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.224+0000 7f87d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.224+0000 7f892512b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.224+0000 7f892512b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:33.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.224+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c79352d0 con 0x5651c79153e0 2024-04-26T07:54:33.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.226+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.226+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7935920 con 0x5651c7919dd0 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.227+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.227+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7935d80 con 0x5651c791e880 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.228+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.228+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c79365d0 con 0x5651c79153e0 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.229+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.229+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7930f80 con 0x7f891008a070 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.230+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.230+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7930f80 con 0x5651c791e880 2024-04-26T07:54:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.231+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.231+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7930f80 con 0x5651c79153e0 2024-04-26T07:54:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.232+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.232+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7931070 con 0x5651c7919dd0 2024-04-26T07:54:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.233+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.233+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937380 con 0x7f891008a070 2024-04-26T07:54:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.234+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.234+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937380 con 0x5651c791e880 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.235+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.235+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937380 con 0x7f891008a070 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.236+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.236+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937380 con 0x5651c7919dd0 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.238+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.238+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937380 con 0x7f891008a070 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.239+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.239+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937380 con 0x5651c7919dd0 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.240+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.240+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937380 con 0x5651c79153e0 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.241+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.241+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937380 con 0x5651c791e880 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.242+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.242+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937410 con 0x7f891008a070 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.243+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.243+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937410 con 0x5651c791e880 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.244+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.244+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937410 con 0x5651c79153e0 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.246+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.246+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937410 con 0x5651c79153e0 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.247+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.247+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937410 con 0x5651c791e880 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.248+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.248+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x7f891008a070 2024-04-26T07:54:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.249+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.249+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c791e880 2024-04-26T07:54:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.250+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.250+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c791e880 2024-04-26T07:54:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.251+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.251+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c791e880 2024-04-26T07:54:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.252+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.252+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c791e880 2024-04-26T07:54:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.253+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.253+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c7919dd0 2024-04-26T07:54:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.255+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.255+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c791e880 2024-04-26T07:54:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.256+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.256+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c7919dd0 2024-04-26T07:54:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.257+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.257+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c791e880 2024-04-26T07:54:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.258+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.258+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x5651c7919dd0 2024-04-26T07:54:33.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.259+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.259+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7937450 con 0x7f891008a070 2024-04-26T07:54:33.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.260+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f87d5fe3640 20 reqs_thread_entry: start 2024-04-26T07:54:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f892512b800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f892512b800 20 Filter name: none 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f87477fe640 20 reqs_thread_entry: start 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f892512b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f892512b800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5651c79627e0 con 0x5651c79153e0 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f892512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.261+0000 7f892512b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: 2024-04-26T07:54:33.261+0000 7f892512b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:unable to remove user, user does not exist 2024-04-26T07:54:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.262+0000 7f87d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.262+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94909240599040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c78c96c0 con 0x5651c79153e0 2024-04-26T07:54:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.263+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94909240599040] v27'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.263+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94909240587696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c78c96c0 con 0x7f891008a070 2024-04-26T07:54:33.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.264+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94909240587696] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.264+0000 7f892512b800 20 remove_watcher() i=0 2024-04-26T07:54:33.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.264+0000 7f892512b800 2 removed watcher, disabling cache 2024-04-26T07:54:33.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.264+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94909240592048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c78c96c0 con 0x5651c79153e0 2024-04-26T07:54:33.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.265+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94909240592048] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.265+0000 7f892512b800 20 remove_watcher() i=1 2024-04-26T07:54:33.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.265+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94909240585136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c78c96c0 con 0x5651c791e880 2024-04-26T07:54:33.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.266+0000 7f8920d52640 1 -- 172.21.15.62:0/2335007612 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94909240585136] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910079070 con 0x5651c791e880 2024-04-26T07:54:33.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.266+0000 7f892512b800 20 remove_watcher() i=2 2024-04-26T07:54:33.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.266+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94909240597984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c78c96c0 con 0x7f891008a070 2024-04-26T07:54:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.267+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94909240597984] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x7f891008a070 2024-04-26T07:54:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.267+0000 7f892512b800 20 remove_watcher() i=3 2024-04-26T07:54:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.267+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94909240601536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7926290 con 0x5651c79153e0 2024-04-26T07:54:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.268+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94909240601536] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914039040 con 0x5651c79153e0 2024-04-26T07:54:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.268+0000 7f892512b800 20 remove_watcher() i=4 2024-04-26T07:54:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.268+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94909240605136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7926290 con 0x5651c7919dd0 2024-04-26T07:54:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.269+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94909240605136] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.269+0000 7f892512b800 20 remove_watcher() i=5 2024-04-26T07:54:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.269+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94909240608800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7926290 con 0x5651c7919dd0 2024-04-26T07:54:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.270+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94909240608800] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.270+0000 7f892512b800 20 remove_watcher() i=6 2024-04-26T07:54:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.270+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94909240611456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5651c7926290 con 0x5651c7919dd0 2024-04-26T07:54:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f8921553640 1 -- 172.21.15.62:0/2335007612 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94909240611456] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891802a070 con 0x5651c7919dd0 2024-04-26T07:54:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 20 remove_watcher() i=7 2024-04-26T07:54:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c7919dd0 msgr2=0x5651c791c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c7919dd0 0x5651c791c1c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c79153e0 msgr2=0x5651c79178a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c79153e0 0x5651c79178a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f891008a070 msgr2=0x7f891008c9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f891008a070 0x7f891008c9b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5651c791e880 msgr2=0x5651c7920d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.271+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5651c791e880 0x5651c7920d40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87ec036e60 msgr2=0x7f87ec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87ec036e60 0x7f87ec039320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8910044610 tx=0x7f8910083000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 msgr2=0x5651c7909820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f8920551640 1 -- 172.21.15.62:0/2335007612 reap_dead start 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c7909820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f891804bf10 tx=0x7f891804cf80 comp rx=0 tx=0).stop 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 shutdown_connections 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 --2- 172.21.15.62:0/2335007612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c79022c0 0x5651c7909820 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 >> 172.21.15.62:0/2335007612 conn(0x5651c78fe590 msgr2=0x5651c78fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 shutdown_connections 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/2335007612 wait complete. 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/288813361 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87f8036eb0 msgr2=0x7f87f8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 --2- 172.21.15.62:0/288813361 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87f8036eb0 0x7f87f8039370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5651c78e14c0 tx=0x7f891008c530 comp rx=0 tx=0).stop 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/288813361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c78f4fb0 msgr2=0x5651c78f53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 --2- 172.21.15.62:0/288813361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c78f4fb0 0x5651c78f53d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5651c78e1400 tx=0x7f8918018830 comp rx=0 tx=0).stop 2024-04-26T07:54:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/288813361 shutdown_connections 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 --2- 172.21.15.62:0/288813361 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f87f8036eb0 0x7f87f8039370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 --2- 172.21.15.62:0/288813361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c78f4fb0 0x5651c78f53d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/288813361 >> 172.21.15.62:0/288813361 conn(0x5651c78e9050 msgr2=0x5651c78e9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/288813361 shutdown_connections 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.272+0000 7f892512b800 1 -- 172.21.15.62:0/288813361 wait complete. 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c78e3380 msgr2=0x5651c78e5770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c78e3380 0x5651c78e5770 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c7754190 msgr2=0x5651c78e0a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c7754190 0x5651c78e0a30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8808036eb0 msgr2=0x7f8808039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8808036eb0 0x7f8808039370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8914000f60 tx=0x7f89140010a0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 msgr2=0x5651c78d97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d97f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f891001baa0 tx=0x7f8910002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 shutdown_connections 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5651c7754190 0x5651c78e0a30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5651c78e3380 0x5651c78e5770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8808036eb0 0x7f8808039370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 --2- 172.21.15.62:0/4062771614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651c7752c80 0x5651c78d97f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 >> 172.21.15.62:0/4062771614 conn(0x5651c77d9d20 msgr2=0x5651c78cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 shutdown_connections 2024-04-26T07:54:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.273+0000 7f892512b800 1 -- 172.21.15.62:0/4062771614 wait complete. 2024-04-26T07:54:33.279 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T07:54:33.279 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T07:54:33.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T07:54:33.280 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-26T07:54:33.366 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:33.366 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.368+0000 7f3ea8c13800 1 Processor -- start 2024-04-26T07:54:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.368+0000 7f3ea8c13800 1 -- start start 2024-04-26T07:54:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea8c13800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55b95ae47b80 0x55b95ae50680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea8c13800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b95adbb270 con 0x55b95ae46040 2024-04-26T07:54:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea8c13800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55b95ace9e20 con 0x55b95ae47b80 2024-04-26T07:54:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea3a6d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55b95ae47b80 0x55b95ae50680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea426e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55b95ae46040 0x55b95ae46460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36430/0 (socket says 172.21.15.62:36430) 2024-04-26T07:54:33.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea426e640 1 -- 172.21.15.62:0/1373539442 learned_addr learned my addr 172.21.15.62:0/1373539442 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:33.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea326c640 1 -- 172.21.15.62:0/1373539442 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652181199 0 0) 0x55b95adbb270 con 0x55b95ae46040 2024-04-26T07:54:33.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea326c640 1 -- 172.21.15.62:0/1373539442 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e8c001e10 con 0x55b95ae46040 2024-04-26T07:54:33.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea3a6d640 1 -- 172.21.15.62:0/1373539442 >> v1:172.21.15.1:6789/0 conn(0x55b95ae46040 legacy=0x55b95ae46460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.369+0000 7f3ea3a6d640 1 -- 172.21.15.62:0/1373539442 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95ae51bd0 con 0x55b95ae47b80 2024-04-26T07:54:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.371+0000 7f3ea3a6d640 1 --2- 172.21.15.62:0/1373539442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae47b80 0x55b95ae50680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800a470 tx=0x7f3e9801cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543ac063696fe442 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.371+0000 7f3ea326c640 1 -- 172.21.15.62:0/1373539442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e98057070 con 0x55b95ae47b80 2024-04-26T07:54:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.371+0000 7f3ea326c640 1 -- 172.21.15.62:0/1373539442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9804acd0 con 0x55b95ae47b80 2024-04-26T07:54:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.371+0000 7f3ea326c640 1 -- 172.21.15.62:0/1373539442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e98052440 con 0x55b95ae47b80 2024-04-26T07:54:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.372+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1373539442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae47b80 msgr2=0x55b95ae50680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.372+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/1373539442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae47b80 0x55b95ae50680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800a470 tx=0x7f3e9801cdb0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.372+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1373539442 shutdown_connections 2024-04-26T07:54:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.372+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/1373539442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae47b80 0x55b95ae50680 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.372+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1373539442 >> 172.21.15.62:0/1373539442 conn(0x55b95ae41c00 msgr2=0x55b95ae44020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.372+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1373539442 shutdown_connections 2024-04-26T07:54:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.372+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1373539442 wait complete. 2024-04-26T07:54:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.385+0000 7f3ea8c13800 1 Processor -- start 2024-04-26T07:54:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.385+0000 7f3ea8c13800 1 -- start start 2024-04-26T07:54:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.385+0000 7f3ea8c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af3aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.385+0000 7f3ea8c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b95ad92cf0 con 0x55b95ae46040 2024-04-26T07:54:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.385+0000 7f3ea426e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af3aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.385+0000 7f3ea426e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af3aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60476/0 (socket says 172.21.15.62:60476) 2024-04-26T07:54:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.385+0000 7f3ea426e640 1 -- 172.21.15.62:0/2857782975 learned_addr learned my addr 172.21.15.62:0/2857782975 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.386+0000 7f3ea426e640 1 -- 172.21.15.62:0/2857782975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95af3b470 con 0x55b95ae46040 2024-04-26T07:54:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.386+0000 7f3ea426e640 1 --2- 172.21.15.62:0/2857782975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af3aea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e94001de0 tx=0x7f3e9400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04e5028e9aca41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.386+0000 7f3d9260c640 1 -- 172.21.15.62:0/2857782975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e94012020 con 0x55b95ae46040 2024-04-26T07:54:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.386+0000 7f3d9260c640 1 -- 172.21.15.62:0/2857782975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9400e5a0 con 0x55b95ae46040 2024-04-26T07:54:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.386+0000 7f3d9260c640 1 -- 172.21.15.62:0/2857782975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e9400e900 con 0x55b95ae46040 2024-04-26T07:54:33.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2857782975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 msgr2=0x55b95af3aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2857782975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af3aea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e94001de0 tx=0x7f3e9400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2857782975 shutdown_connections 2024-04-26T07:54:33.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2857782975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af3aea0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2857782975 >> 172.21.15.62:0/2857782975 conn(0x55b95ae41c00 msgr2=0x55b95af367c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2857782975 shutdown_connections 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2857782975 wait complete. 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 Processor -- start 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.387+0000 7f3ea8c13800 1 -- start start 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3ea8c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af42a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3ea8c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b95ae50e90 con 0x55b95ae46040 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3ea426e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3ea426e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af42a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60492/0 (socket says 172.21.15.62:60492) 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3ea426e640 1 -- 172.21.15.62:0/2313151163 learned_addr learned my addr 172.21.15.62:0/2313151163 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3ea426e640 1 -- 172.21.15.62:0/2313151163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95af42f50 con 0x55b95ae46040 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3ea426e640 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af42a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400c010 tx=0x7f3e94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3d90e09640 1 -- 172.21.15.62:0/2313151163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e94012030 con 0x55b95ae46040 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3d90e09640 1 -- 172.21.15.62:0/2313151163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9401a7a0 con 0x55b95ae46040 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3d90e09640 1 -- 172.21.15.62:0/2313151163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e9401a950 con 0x55b95ae46040 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.388+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b95af431e0 con 0x55b95ae46040 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.389+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b95af45e40 con 0x55b95ae46040 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.389+0000 7f3ea8c13800 1 Processor -- start 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.389+0000 7f3ea8c13800 1 -- start start 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.389+0000 7f3ea8c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af50690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.389+0000 7f3ea8c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b95ad3a170 con 0x55b95af50270 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.389+0000 7f3d90e09640 1 -- 172.21.15.62:0/2313151163 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3e94015020 con 0x55b95ae46040 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.389+0000 7f3d90e09640 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d8c036eb0 0x7f3d8c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3d90e09640 1 -- 172.21.15.62:0/2313151163 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f3e94020030 con 0x55b95ae46040 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3ea4a6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af50690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3ea4a6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af50690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60494/0 (socket says 172.21.15.62:60494) 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3ea4a6f640 1 -- 172.21.15.62:0/1010071061 learned_addr learned my addr 172.21.15.62:0/1010071061 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3ea426e640 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d8c036eb0 0x7f3d8c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3ea4a6f640 1 -- 172.21.15.62:0/1010071061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95af50bd0 con 0x55b95af50270 2024-04-26T07:54:33.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3ea426e640 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d8c036eb0 0x7f3d8c039370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e94018ac0 tx=0x7f3e94018950 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3ea4a6f640 1 --2- 172.21.15.62:0/1010071061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af50690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00a430 tx=0x7f3e9c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fd72be18fd1a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3d8a7fc640 1 -- 172.21.15.62:0/1010071061 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e9c015070 con 0x55b95af50270 2024-04-26T07:54:33.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3d8a7fc640 1 -- 172.21.15.62:0/1010071061 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9c001670 con 0x55b95af50270 2024-04-26T07:54:33.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.390+0000 7f3d8a7fc640 1 -- 172.21.15.62:0/1010071061 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e9c001990 con 0x55b95af50270 2024-04-26T07:54:33.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1010071061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 msgr2=0x55b95af50690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/1010071061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af50690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00a430 tx=0x7f3e9c00a8f0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1010071061 shutdown_connections 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/1010071061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af50690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1010071061 >> 172.21.15.62:0/1010071061 conn(0x55b95ae47b80 msgr2=0x55b95af4cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1010071061 shutdown_connections 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 -- 172.21.15.62:0/1010071061 wait complete. 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 Processor -- start 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 -- start start 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af57760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea8c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b95af51560 con 0x55b95af50270 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.391+0000 7f3ea4a6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af57760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3ea4a6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af57760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60510/0 (socket says 172.21.15.62:60510) 2024-04-26T07:54:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3ea4a6f640 1 -- 172.21.15.62:0/472377890 learned_addr learned my addr 172.21.15.62:0/472377890 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3ea4a6f640 1 -- 172.21.15.62:0/472377890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95af57ca0 con 0x55b95af50270 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3ea4a6f640 1 --2- 172.21.15.62:0/472377890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af57760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00a930 tx=0x7f3e9c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3d88ff9640 1 -- 172.21.15.62:0/472377890 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e9c020020 con 0x55b95af50270 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3d88ff9640 1 -- 172.21.15.62:0/472377890 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9c0108b0 con 0x55b95af50270 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3ea8c13800 1 -- 172.21.15.62:0/472377890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b95af57f30 con 0x55b95af50270 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3d88ff9640 1 -- 172.21.15.62:0/472377890 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e9c015040 con 0x55b95af50270 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.392+0000 7f3ea8c13800 1 -- 172.21.15.62:0/472377890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b95af5abe0 con 0x55b95af50270 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.393+0000 7f3d88ff9640 1 -- 172.21.15.62:0/472377890 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3e9c023020 con 0x55b95af50270 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.393+0000 7f3d88ff9640 1 --2- 172.21.15.62:0/472377890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d7c036e60 0x7f3d7c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.393+0000 7f3d88ff9640 1 -- 172.21.15.62:0/472377890 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f3e9c04c630 con 0x55b95af50270 2024-04-26T07:54:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.393+0000 7f3ea3a6d640 1 --2- 172.21.15.62:0/472377890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d7c036e60 0x7f3d7c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.393+0000 7f3ea8c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.393+0000 7f3ea8c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea8c13800 1 Processor -- start 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea3a6d640 1 --2- 172.21.15.62:0/472377890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d7c036e60 0x7f3d7c039320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e98054000 tx=0x7f3e9804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea8c13800 1 -- start start 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea8c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af71e70 0x55b95af72290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea8c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b95af3b7f0 con 0x55b95af71e70 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea426e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af71e70 0x55b95af72290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea426e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af71e70 0x55b95af72290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60516/0 (socket says 172.21.15.62:60516) 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea426e640 1 -- 172.21.15.62:0/4280436047 learned_addr learned my addr 172.21.15.62:0/4280436047 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea426e640 1 -- 172.21.15.62:0/4280436047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95af727d0 con 0x55b95af71e70 2024-04-26T07:54:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.394+0000 7f3ea426e640 1 --2- 172.21.15.62:0/4280436047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af71e70 0x55b95af72290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e9401a6f0 tx=0x7f3e9401aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.395+0000 7f3d68fe1640 1 -- 172.21.15.62:0/4280436047 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e94049070 con 0x55b95af71e70 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.395+0000 7f3d68fe1640 1 -- 172.21.15.62:0/4280436047 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9400c540 con 0x55b95af71e70 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.395+0000 7f3ea8c13800 1 -- 172.21.15.62:0/4280436047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b95af73240 con 0x55b95af71e70 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.395+0000 7f3d68fe1640 1 -- 172.21.15.62:0/4280436047 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e94017e60 con 0x55b95af71e70 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.395+0000 7f3ea8c13800 1 -- 172.21.15.62:0/4280436047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b95af73740 con 0x55b95af71e70 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.395+0000 7f3d68fe1640 1 -- 172.21.15.62:0/4280436047 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3e9400c820 con 0x55b95af71e70 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3d68fe1640 1 --2- 172.21.15.62:0/4280436047 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ce4036eb0 0x7f3ce4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3d68fe1640 1 -- 172.21.15.62:0/4280436047 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f3e94035040 con 0x55b95af71e70 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3ea3a6d640 1 --2- 172.21.15.62:0/4280436047 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ce4036eb0 0x7f3ce4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3d027fc640 20 reqs_thread_entry: start 2024-04-26T07:54:33.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b95af7f870 0x55b95af81ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b95af823b0 con 0x55b95af7f870 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3ea3a6d640 1 --2- 172.21.15.62:0/4280436047 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ce4036eb0 0x7f3ce4039370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3e9801cdf0 tx=0x7f3e98005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3ea4a6f640 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b95af7f870 0x55b95af81ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.396+0000 7f3ea4a6f640 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b95af7f870 0x55b95af81ce0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.397+0000 7f3ea4a6f640 1 -- 172.21.15.62:0/2313151163 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e9c00e070 con 0x55b95af7f870 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.397+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b95af84180 0x55b95af86570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.397+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:2 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b95af86cb0 con 0x55b95af84180 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.397+0000 7f3ea426e640 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b95af84180 0x55b95af86570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.397+0000 7f3ea426e640 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b95af84180 0x55b95af86570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.398+0000 7f3ea426e640 1 -- 172.21.15.62:0/2313151163 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(2 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e94042070 con 0x55b95af84180 2024-04-26T07:54:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.398+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b95af83680 con 0x55b95af84180 2024-04-26T07:54:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.399+0000 7f3ea426e640 1 -- 172.21.15.62:0/2313151163 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [stat,call,call,writefull 0~993] v27'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f3e94042070 con 0x55b95af84180 2024-04-26T07:54:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/472377890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d7c036e60 msgr2=0x7f3d7c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/472377890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d7c036e60 0x7f3d7c039320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e98054000 tx=0x7f3e9804e000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/472377890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 msgr2=0x55b95af57760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/472377890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af57760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00a930 tx=0x7f3e9c003370 comp rx=0 tx=0).stop 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/472377890 shutdown_connections 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/472377890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d7c036e60 0x7f3d7c039320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/472377890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af50270 0x55b95af57760 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/472377890 >> 172.21.15.62:0/472377890 conn(0x55b95ae47b80 msgr2=0x55b95af4a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/472377890 shutdown_connections 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/472377890 wait complete. 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/4280436047 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ce4036eb0 msgr2=0x7f3ce4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/4280436047 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ce4036eb0 0x7f3ce4039370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3e9801cdf0 tx=0x7f3e98005a00 comp rx=0 tx=0).stop 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/4280436047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af71e70 msgr2=0x55b95af72290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/4280436047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af71e70 0x55b95af72290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e9401a6f0 tx=0x7f3e9401aec0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/4280436047 shutdown_connections 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/4280436047 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3ce4036eb0 0x7f3ce4039370 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/4280436047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95af71e70 0x55b95af72290 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/4280436047 >> 172.21.15.62:0/4280436047 conn(0x55b95af66920 msgr2=0x55b95af67340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/4280436047 shutdown_connections 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.400+0000 7f3ea8c13800 1 -- 172.21.15.62:0/4280436047 wait complete. 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b95af84180 msgr2=0x55b95af86570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b95af84180 0x55b95af86570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b95af7f870 msgr2=0x55b95af81ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b95af7f870 0x55b95af81ce0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d8c036eb0 msgr2=0x7f3d8c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d8c036eb0 0x7f3d8c039370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e94018ac0 tx=0x7f3e94018950 comp rx=0 tx=0).stop 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 msgr2=0x55b95af42a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af42a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400c010 tx=0x7f3e94000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 shutdown_connections 2024-04-26T07:54:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b95af7f870 0x55b95af81ce0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b95af84180 0x55b95af86570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3d8c036eb0 0x7f3d8c039370 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 --2- 172.21.15.62:0/2313151163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b95ae46040 0x55b95af42a10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 >> 172.21.15.62:0/2313151163 conn(0x55b95ae41c00 msgr2=0x55b95af34fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 shutdown_connections 2024-04-26T07:54:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.401+0000 7f3ea8c13800 1 -- 172.21.15.62:0/2313151163 wait complete. 2024-04-26T07:54:33.411 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T07:54:33.411 DEBUG:tasks.util.rgw: json result: {'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T07:54:33.412 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-26T07:54:33.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-26T07:54:33.413 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-26T07:54:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.457+0000 7f186ab19800 1 Processor -- start 2024-04-26T07:54:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.457+0000 7f186ab19800 1 -- start start 2024-04-26T07:54:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.457+0000 7f186ab19800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564fa18dda60 0x564fa18dfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.457+0000 7f186ab19800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564fa18e0420 con 0x564fa18d9ab0 2024-04-26T07:54:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.457+0000 7f186ab19800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x564fa177ce20 con 0x564fa18dda60 2024-04-26T07:54:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.458+0000 7f1867e17640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564fa18dda60 0x564fa18dfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.458+0000 7f1868618640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x564fa18d9ab0 0x564fa18d9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36434/0 (socket says 172.21.15.62:36434) 2024-04-26T07:54:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.458+0000 7f1867e17640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564fa18dda60 0x564fa18dfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60532/0 (socket says 172.21.15.62:60532) 2024-04-26T07:54:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.458+0000 7f1868618640 1 -- 172.21.15.62:0/4156012264 learned_addr learned my addr 172.21.15.62:0/4156012264 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.458+0000 7f1867e17640 1 -- 172.21.15.62:0/4156012264 >> v1:172.21.15.1:6789/0 conn(0x564fa18d9ab0 legacy=0x564fa18d9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.458+0000 7f1867e17640 1 -- 172.21.15.62:0/4156012264 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa18e1650 con 0x564fa18dda60 2024-04-26T07:54:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.458+0000 7f1867616640 1 -- 172.21.15.62:0/4156012264 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646681267 0 0) 0x564fa18e0420 con 0x564fa18d9ab0 2024-04-26T07:54:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.460+0000 7f1867e17640 1 --2- 172.21.15.62:0/4156012264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18dda60 0x564fa18dfe50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f185c00a470 tx=0x7f185c01cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b129e02fa7756a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.460+0000 7f1867616640 1 -- 172.21.15.62:0/4156012264 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f185c057070 con 0x564fa18dda60 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.460+0000 7f1867616640 1 -- 172.21.15.62:0/4156012264 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185c052570 con 0x564fa18dda60 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.460+0000 7f1867616640 1 -- 172.21.15.62:0/4156012264 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f185c052870 con 0x564fa18dda60 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.461+0000 7f186ab19800 1 -- 172.21.15.62:0/4156012264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18dda60 msgr2=0x564fa18dfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.461+0000 7f186ab19800 1 --2- 172.21.15.62:0/4156012264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18dda60 0x564fa18dfe50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f185c00a470 tx=0x7f185c01cf20 comp rx=0 tx=0).stop 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.461+0000 7f186ab19800 1 -- 172.21.15.62:0/4156012264 shutdown_connections 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.461+0000 7f186ab19800 1 --2- 172.21.15.62:0/4156012264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18dda60 0x564fa18dfe50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.461+0000 7f186ab19800 1 -- 172.21.15.62:0/4156012264 >> 172.21.15.62:0/4156012264 conn(0x564fa18d4310 msgr2=0x564fa18d6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.461+0000 7f186ab19800 1 -- 172.21.15.62:0/4156012264 shutdown_connections 2024-04-26T07:54:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.461+0000 7f186ab19800 1 -- 172.21.15.62:0/4156012264 wait complete. 2024-04-26T07:54:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.473+0000 7f186ab19800 1 Processor -- start 2024-04-26T07:54:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.474+0000 7f186ab19800 1 -- start start 2024-04-26T07:54:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.474+0000 7f186ab19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa18d91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.474+0000 7f186ab19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fa1825cc0 con 0x564fa18d9ab0 2024-04-26T07:54:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.474+0000 7f1868618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa18d91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.474+0000 7f1868618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa18d91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60534/0 (socket says 172.21.15.62:60534) 2024-04-26T07:54:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.474+0000 7f1868618640 1 -- 172.21.15.62:0/1115432062 learned_addr learned my addr 172.21.15.62:0/1115432062 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.474+0000 7f1868618640 1 -- 172.21.15.62:0/1115432062 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa19cc5c0 con 0x564fa18d9ab0 2024-04-26T07:54:33.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.474+0000 7f1868618640 1 --2- 172.21.15.62:0/1115432062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa18d91b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f185800b240 tx=0x7f185800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09830388cae2fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f175660c640 1 -- 172.21.15.62:0/1115432062 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1858008070 con 0x564fa18d9ab0 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f175660c640 1 -- 172.21.15.62:0/1115432062 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185800d500 con 0x564fa18d9ab0 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f175660c640 1 -- 172.21.15.62:0/1115432062 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f185800d860 con 0x564fa18d9ab0 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f186ab19800 1 -- 172.21.15.62:0/1115432062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 msgr2=0x564fa18d91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f186ab19800 1 --2- 172.21.15.62:0/1115432062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa18d91b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f185800b240 tx=0x7f185800b700 comp rx=0 tx=0).stop 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f186ab19800 1 -- 172.21.15.62:0/1115432062 shutdown_connections 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f186ab19800 1 --2- 172.21.15.62:0/1115432062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa18d91b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f186ab19800 1 -- 172.21.15.62:0/1115432062 >> 172.21.15.62:0/1115432062 conn(0x564fa18d4310 msgr2=0x564fa19c62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f186ab19800 1 -- 172.21.15.62:0/1115432062 shutdown_connections 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.475+0000 7f186ab19800 1 -- 172.21.15.62:0/1115432062 wait complete. 2024-04-26T07:54:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.476+0000 7f186ab19800 1 Processor -- start 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.476+0000 7f186ab19800 1 -- start start 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.476+0000 7f186ab19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa19d5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.476+0000 7f186ab19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fa18e08f0 con 0x564fa18d9ab0 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.476+0000 7f1868618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa19d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.476+0000 7f1868618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa19d5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60548/0 (socket says 172.21.15.62:60548) 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.476+0000 7f1868618640 1 -- 172.21.15.62:0/4034170653 learned_addr learned my addr 172.21.15.62:0/4034170653 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.476+0000 7f1868618640 1 -- 172.21.15.62:0/4034170653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa19d5d70 con 0x564fa18d9ab0 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.477+0000 7f1868618640 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa19d5830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x564fa18d87e0 tx=0x7f1858000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.477+0000 7f1754e09640 1 -- 172.21.15.62:0/4034170653 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1858019870 con 0x564fa18d9ab0 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.477+0000 7f1754e09640 1 -- 172.21.15.62:0/4034170653 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1858019a10 con 0x564fa18d9ab0 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.477+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fa19d6000 con 0x564fa18d9ab0 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.477+0000 7f1754e09640 1 -- 172.21.15.62:0/4034170653 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1858019d30 con 0x564fa18d9ab0 2024-04-26T07:54:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.477+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa19d8cb0 con 0x564fa18d9ab0 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.478+0000 7f1754e09640 1 -- 172.21.15.62:0/4034170653 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1858017040 con 0x564fa18d9ab0 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.478+0000 7f1754e09640 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1750036eb0 0x7f1750039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.478+0000 7f1754e09640 1 -- 172.21.15.62:0/4034170653 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f1858015020 con 0x564fa18d9ab0 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.478+0000 7f1867e17640 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1750036eb0 0x7f1750039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.478+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa18dda60 0x564fa19dca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.478+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa19dcff0 con 0x564fa18dda60 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.478+0000 7f1868e19640 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa18dda60 0x564fa19dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.478+0000 7f1867e17640 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1750036eb0 0x7f1750039370 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f185c054000 tx=0x7f185c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.479+0000 7f1868e19640 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa18dda60 0x564fa19dca70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.479+0000 7f1868e19640 1 -- 172.21.15.62:0/4034170653 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f186000a4a0 con 0x564fa18dda60 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.479+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa19da040 con 0x564fa18dda60 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.479+0000 7f1868e19640 1 -- 172.21.15.62:0/4034170653 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f186000a4a0 con 0x564fa18dda60 2024-04-26T07:54:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.479+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa19df320 0x564fa19e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.479+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa19e1e00 con 0x564fa19df320 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.479+0000 7f1868618640 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa19df320 0x564fa19e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.480+0000 7f1868618640 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa19df320 0x564fa19e1710 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.480+0000 7f1868618640 1 -- 172.21.15.62:0/4034170653 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f185802d070 con 0x564fa19df320 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.480+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa19de2d0 con 0x564fa18dda60 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.480+0000 7f1868e19640 1 -- 172.21.15.62:0/4034170653 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f186000a4a0 con 0x564fa18dda60 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.480+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa19de7b0 con 0x564fa18dda60 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.481+0000 7f1868e19640 1 -- 172.21.15.62:0/4034170653 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f186000a4a0 con 0x564fa18dda60 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.481+0000 7f186ab19800 1 Processor -- start 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.481+0000 7f186ab19800 1 -- start start 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.481+0000 7f186ab19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19f0f70 0x564fa19f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.481+0000 7f186ab19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fa17cd170 con 0x564fa19f0f70 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.481+0000 7f1868e19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19f0f70 0x564fa19f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.481+0000 7f1868e19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19f0f70 0x564fa19f1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60556/0 (socket says 172.21.15.62:60556) 2024-04-26T07:54:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.481+0000 7f1868e19640 1 -- 172.21.15.62:0/1585173747 learned_addr learned my addr 172.21.15.62:0/1585173747 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.482+0000 7f1868e19640 1 -- 172.21.15.62:0/1585173747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa19f18d0 con 0x564fa19f0f70 2024-04-26T07:54:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.482+0000 7f1868e19640 1 --2- 172.21.15.62:0/1585173747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19f0f70 0x564fa19f1390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x564fa19dd3d0 tx=0x7f1860018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.482+0000 7f174dffb640 1 -- 172.21.15.62:0/1585173747 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1860014450 con 0x564fa19f0f70 2024-04-26T07:54:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.482+0000 7f174dffb640 1 -- 172.21.15.62:0/1585173747 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1860014610 con 0x564fa19f0f70 2024-04-26T07:54:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.482+0000 7f186ab19800 1 -- 172.21.15.62:0/1585173747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fa19f2340 con 0x564fa19f0f70 2024-04-26T07:54:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.482+0000 7f174dffb640 1 -- 172.21.15.62:0/1585173747 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1860014930 con 0x564fa19f0f70 2024-04-26T07:54:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.482+0000 7f186ab19800 1 -- 172.21.15.62:0/1585173747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa19f2840 con 0x564fa19f0f70 2024-04-26T07:54:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f174dffb640 1 -- 172.21.15.62:0/1585173747 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1860011040 con 0x564fa19f0f70 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f174dffb640 1 --2- 172.21.15.62:0/1585173747 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1740036eb0 0x7f1740039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f174dffb640 1 -- 172.21.15.62:0/1585173747 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f186001e070 con 0x564fa19f0f70 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f1868618640 1 --2- 172.21.15.62:0/1585173747 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1740036eb0 0x7f1740039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f186ab19800 1 Processor -- start 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f1868618640 1 --2- 172.21.15.62:0/1585173747 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1740036eb0 0x7f1740039370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x564fa19dd470 tx=0x7f185804b980 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f186ab19800 1 -- start start 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f186ab19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa19fe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.483+0000 7f186ab19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fa19d0d50 con 0x564fa19fe1f0 2024-04-26T07:54:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.484+0000 7f1868e19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa19fe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.484+0000 7f1868e19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa19fe610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60562/0 (socket says 172.21.15.62:60562) 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.484+0000 7f1868e19640 1 -- 172.21.15.62:0/3607374159 learned_addr learned my addr 172.21.15.62:0/3607374159 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.484+0000 7f1868e19640 1 -- 172.21.15.62:0/3607374159 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa19febe0 con 0x564fa19fe1f0 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.484+0000 7f1868e19640 1 --2- 172.21.15.62:0/3607374159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa19fe610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f186004cf00 tx=0x7f186004d1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a039d61beba1f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.484+0000 7f17477fe640 1 -- 172.21.15.62:0/3607374159 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1860013e00 con 0x564fa19fe1f0 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.484+0000 7f17477fe640 1 -- 172.21.15.62:0/3607374159 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18600167c0 con 0x564fa19fe1f0 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.484+0000 7f17477fe640 1 -- 172.21.15.62:0/3607374159 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1860014ad0 con 0x564fa19fe1f0 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 -- 172.21.15.62:0/3607374159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 msgr2=0x564fa19fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 --2- 172.21.15.62:0/3607374159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa19fe610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f186004cf00 tx=0x7f186004d1b0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 -- 172.21.15.62:0/3607374159 shutdown_connections 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 --2- 172.21.15.62:0/3607374159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa19fe610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 -- 172.21.15.62:0/3607374159 >> 172.21.15.62:0/3607374159 conn(0x564fa19fa500 msgr2=0x564fa19f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 -- 172.21.15.62:0/3607374159 shutdown_connections 2024-04-26T07:54:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 -- 172.21.15.62:0/3607374159 wait complete. 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 Processor -- start 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 -- start start 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa1a057b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f186ab19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fa19ff3b0 con 0x564fa19fe1f0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f1868e19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa1a057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f1868e19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa1a057b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60566/0 (socket says 172.21.15.62:60566) 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.485+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 learned_addr learned my addr 172.21.15.62:0/334148652 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.486+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa1a05cf0 con 0x564fa19fe1f0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.486+0000 7f1868e19640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa1a057b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f186004d1f0 tx=0x7f186004ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.486+0000 7f1745ffb640 1 -- 172.21.15.62:0/334148652 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f186003b070 con 0x564fa19fe1f0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.486+0000 7f1745ffb640 1 -- 172.21.15.62:0/334148652 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186002b560 con 0x564fa19fe1f0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.486+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fa1a05f80 con 0x564fa19fe1f0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.486+0000 7f1745ffb640 1 -- 172.21.15.62:0/334148652 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f186002b840 con 0x564fa19fe1f0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.486+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa1a08c30 con 0x564fa19fe1f0 2024-04-26T07:54:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f1745ffb640 1 -- 172.21.15.62:0/334148652 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f186004e370 con 0x564fa19fe1f0 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f1745ffb640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1738036eb0 0x7f1738039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f1745ffb640 1 -- 172.21.15.62:0/334148652 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f1860033070 con 0x564fa19fe1f0 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f1868618640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1738036eb0 0x7f1738039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa1a11440 0x564fa1a13900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a14050 con 0x564fa1a11440 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f1867e17640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa1a11440 0x564fa1a13900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.487+0000 7f1868618640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1738036eb0 0x7f1738039370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f185800bc50 tx=0x7f1858034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f1867e17640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa1a11440 0x564fa1a13900 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 20 realm 2024-04-26T07:54:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a14420 con 0x564fa1a11440 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a14cf0 con 0x564fa1a11440 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.488+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a15090 con 0x564fa1a11440 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.489+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.489+0000 7f186ab19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.489+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.489+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa1a15b40 0x564fa1a17f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.489+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a186b0 con 0x564fa1a15b40 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.489+0000 7f1868e19640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa1a15b40 0x564fa1a17f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.489+0000 7f1868e19640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa1a15b40 0x564fa1a17f50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.490+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.490+0000 7f186ab19800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.490+0000 7f186ab19800 20 searching for the correct realm 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.490+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fa1a1a750 0x564fa1a1cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.490+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.490+0000 7f1868618640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fa1a1a750 0x564fa1a1cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.490+0000 7f1868618640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fa1a1a750 0x564fa1a1cc10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.491+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185802d070 con 0x564fa1a1a750 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.491+0000 7f1868618640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1858018810 0x7f185804d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.491+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x7f1858018810 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.491+0000 7f1867e17640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1858018810 0x7f185804d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.491+0000 7f1867e17640 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1858018810 0x7f185804d740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.491+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.491+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.492+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.492+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a11440 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.492+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.492+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a11440 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.492+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.492+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.492+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.492+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.493+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.493+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x7f1858018810 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.493+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.493+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.493+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185802d070 con 0x564fa1a1a750 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.493+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a11440 2024-04-26T07:54:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.493+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.493+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.494+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.494+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a11440 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.494+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.494+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x7f1858018810 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.495+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.495+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.495+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.495+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.495+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.495+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.495+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a11440 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a11440 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.496+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.497+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.497+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.497+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.497+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x7f1858018810 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.497+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.497+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a11440 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.498+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.498+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.498+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.498+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.498+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.498+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.499+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.499+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x7f1858018810 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.499+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.499+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a1a750 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.499+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.499+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a15b40 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x564fa1a11440 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d2e0 con 0x7f1858018810 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f186ab19800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f186ab19800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f186ab19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f186ab19800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f186ab19800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f186ab19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.500+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a19150 con 0x564fa1a11440 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a18d30 con 0x564fa1a11440 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a19a30 con 0x564fa1a11440 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 20 zone default found 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 4 Realm: () 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 20 zonegroup default 2024-04-26T07:54:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1d760 con 0x564fa1a15b40 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.501+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1f990 con 0x564fa1a1a750 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1fd30 con 0x564fa1a1a750 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 20 started sync module instance, tier type = 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.502+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1edd0 con 0x7f1858018810 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.503+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.503+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94900014150384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a1edd0 con 0x7f1858018810 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.503+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a206f0 con 0x564fa1a11440 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.504+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94900014150384] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.505+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.505+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94900014148352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a206f0 con 0x564fa1a11440 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.505+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a210f0 con 0x564fa1a1a750 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.506+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.506+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94900014156800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a21990 con 0x564fa1a1a750 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.506+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a22430 con 0x7f1858018810 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.506+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94900014148352] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.507+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94900014156800] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.508+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.508+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94900014159072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a20240 con 0x7f1858018810 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.508+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a22d00 con 0x564fa1a11440 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.509+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.509+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94900014163920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a230e0 con 0x564fa1a11440 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.509+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a23be0 con 0x564fa1a15b40 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.511+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94900014159072] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.511+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.511+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94900014167760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a23ba0 con 0x564fa1a15b40 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.511+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a24610 con 0x564fa1a15b40 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.513+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.513+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94900014170432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a24ac0 con 0x564fa1a15b40 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.513+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a25580 con 0x564fa1a15b40 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.513+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94900014163920] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94900014167760] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94900014170432] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94900014161696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a22bf0 con 0x564fa1a15b40 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f186ab19800 20 add_watcher() i=0 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f186ab19800 20 add_watcher() i=1 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f186ab19800 20 add_watcher() i=2 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f186ab19800 20 add_watcher() i=3 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f186ab19800 20 add_watcher() i=4 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f186ab19800 20 add_watcher() i=5 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.514+0000 7f186ab19800 20 add_watcher() i=6 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.515+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94900014161696] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.515+0000 7f186ab19800 20 add_watcher() i=7 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.515+0000 7f186ab19800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.515+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a246a0 con 0x564fa1a11440 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.516+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.516+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94900014174384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a246a0 con 0x564fa1a11440 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.517+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94900014174384] v27'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.517+0000 7f171e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.517+0000 7f186ab19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.517+0000 7f186ab19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.517+0000 7f186ab19800 5 note: GC not initialized 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.517+0000 7f171d7e2640 20 reqs_thread_entry: start 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f186ab19800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f186ab19800 20 Filter name: none 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f168effd640 20 reqs_thread_entry: start 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5bb60 con 0x564fa1a11440 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5bb60 con 0x7f1858018810 2024-04-26T07:54:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5bb20 con 0x564fa1a11440 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.518+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5bb20 con 0x564fa1a1a750 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c070 con 0x564fa1a1a750 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c470 con 0x564fa1a1a750 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c470 con 0x564fa1a11440 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.519+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c470 con 0x564fa1a11440 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.520+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.520+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c470 con 0x564fa1a1a750 2024-04-26T07:54:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.520+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.520+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c470 con 0x564fa1a1a750 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.520+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.520+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c450 con 0x564fa1a15b40 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.520+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.520+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c450 con 0x564fa1a11440 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.521+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.521+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x7f1858018810 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.521+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.521+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a1a750 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.521+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.521+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.521+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.521+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a1a750 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a11440 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a1a750 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.522+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.523+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.523+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x7f1858018810 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.523+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.523+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a11440 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a11440 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a1a750 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a11440 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.524+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a11440 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a1a750 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a1a750 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a1a750 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.525+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.526+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.527+0000 7f171e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.527+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94900014174384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a11440 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.528+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94900014174384] v27'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.528+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94900014150384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x7f1858018810 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.529+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94900014150384] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.529+0000 7f186ab19800 20 remove_watcher() i=0 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.529+0000 7f186ab19800 2 removed watcher, disabling cache 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.529+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94900014148352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a11440 2024-04-26T07:54:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.530+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94900014148352] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.530+0000 7f186ab19800 20 remove_watcher() i=1 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.530+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94900014156800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a1a750 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.531+0000 7f1868618640 1 -- 172.21.15.62:0/334148652 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94900014156800] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185805c040 con 0x564fa1a1a750 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.531+0000 7f186ab19800 20 remove_watcher() i=2 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.531+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94900014159072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x7f1858018810 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.532+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94900014159072] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x7f1858018810 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.532+0000 7f186ab19800 20 remove_watcher() i=3 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.532+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94900014163920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a11440 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.533+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94900014163920] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f185c05a040 con 0x564fa1a11440 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.533+0000 7f186ab19800 20 remove_watcher() i=4 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.533+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94900014167760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.534+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94900014167760] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.534+0000 7f186ab19800 20 remove_watcher() i=5 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.534+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94900014170432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.535+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94900014170432] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.535+0000 7f186ab19800 20 remove_watcher() i=6 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.535+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94900014161696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fa1a5c410 con 0x564fa1a15b40 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f1868e19640 1 -- 172.21.15.62:0/334148652 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94900014161696] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186002a070 con 0x564fa1a15b40 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 20 remove_watcher() i=7 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa1a15b40 msgr2=0x564fa1a17f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa1a15b40 0x564fa1a17f50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa1a11440 msgr2=0x564fa1a13900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa1a11440 0x564fa1a13900 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1858018810 msgr2=0x7f185804d740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1858018810 0x7f185804d740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fa1a1a750 msgr2=0x564fa1a1cc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fa1a1a750 0x564fa1a1cc10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1738036eb0 msgr2=0x7f1738039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1738036eb0 0x7f1738039370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f185800bc50 tx=0x7f1858034000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 msgr2=0x564fa1a057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/334148652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19fe1f0 0x564fa1a057b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f186004d1f0 tx=0x7f186004ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 reap_dead start 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f1867e17640 1 -- 172.21.15.62:0/334148652 reap_dead start 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 shutdown_connections 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 >> 172.21.15.62:0/334148652 conn(0x564fa19fa500 msgr2=0x564fa19f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 shutdown_connections 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/334148652 wait complete. 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/1585173747 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1740036eb0 msgr2=0x7f1740039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/1585173747 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1740036eb0 0x7f1740039370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x564fa19dd470 tx=0x7f185804b980 comp rx=0 tx=0).stop 2024-04-26T07:54:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/1585173747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19f0f70 msgr2=0x564fa19f1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/1585173747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19f0f70 0x564fa19f1390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x564fa19dd3d0 tx=0x7f1860018830 comp rx=0 tx=0).stop 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/1585173747 shutdown_connections 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/1585173747 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1740036eb0 0x7f1740039370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 --2- 172.21.15.62:0/1585173747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa19f0f70 0x564fa19f1390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/1585173747 >> 172.21.15.62:0/1585173747 conn(0x564fa19e5010 msgr2=0x564fa19e5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/1585173747 shutdown_connections 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.536+0000 7f186ab19800 1 -- 172.21.15.62:0/1585173747 wait complete. 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa19df320 msgr2=0x564fa19e1710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa19df320 0x564fa19e1710 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa18dda60 msgr2=0x564fa19dca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa18dda60 0x564fa19dca70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1750036eb0 msgr2=0x7f1750039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1750036eb0 0x7f1750039370 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f185c054000 tx=0x7f185c04e000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 msgr2=0x564fa19d5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa19d5830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x564fa18d87e0 tx=0x7f1858000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 shutdown_connections 2024-04-26T07:54:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fa18dda60 0x564fa19dca70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fa19df320 0x564fa19e1710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1750036eb0 0x7f1750039370 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 --2- 172.21.15.62:0/4034170653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fa18d9ab0 0x564fa19d5830 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 >> 172.21.15.62:0/4034170653 conn(0x564fa18d4310 msgr2=0x564fa19c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 shutdown_connections 2024-04-26T07:54:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.537+0000 7f186ab19800 1 -- 172.21.15.62:0/4034170653 wait complete. 2024-04-26T07:54:33.567 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[],"summary":[]} 2024-04-26T07:54:33.567 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-26T07:54:33.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:54:33.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:54:33.568 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:54:33.652 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:33.652 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:33.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.654+0000 7f7507d33800 1 Processor -- start 2024-04-26T07:54:33.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.654+0000 7f7507d33800 1 -- start start 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.654+0000 7f7507d33800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ea71a60740 0x55ea71a60b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.654+0000 7f7507d33800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea71a611e0 con 0x55ea71a618b0 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.654+0000 7f7507d33800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55ea71902e20 con 0x55ea71a60740 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.655+0000 7f75039f5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ea71a60740 0x55ea71a60b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.655+0000 7f75031f4640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55ea71a618b0 0x55ea71a61d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36438/0 (socket says 172.21.15.62:36438) 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.655+0000 7f75031f4640 1 -- 172.21.15.62:0/2159984489 learned_addr learned my addr 172.21.15.62:0/2159984489 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.655+0000 7f75039f5640 1 -- 172.21.15.62:0/2159984489 >> v1:172.21.15.1:6789/0 conn(0x55ea71a618b0 legacy=0x55ea71a61d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.655+0000 7f75029f3640 1 -- 172.21.15.62:0/2159984489 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2857897568 0 0) 0x55ea71a611e0 con 0x55ea71a618b0 2024-04-26T07:54:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.655+0000 7f75039f5640 1 -- 172.21.15.62:0/2159984489 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea71a62470 con 0x55ea71a60740 2024-04-26T07:54:33.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.657+0000 7f75039f5640 1 --2- 172.21.15.62:0/2159984489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71a60b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74f400a470 tx=0x7f74f401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a212fa328fae9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.657+0000 7f75029f3640 1 -- 172.21.15.62:0/2159984489 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f4057070 con 0x55ea71a60740 2024-04-26T07:54:33.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.657+0000 7f75029f3640 1 -- 172.21.15.62:0/2159984489 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f404adc0 con 0x55ea71a60740 2024-04-26T07:54:33.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.657+0000 7f75029f3640 1 -- 172.21.15.62:0/2159984489 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f4052590 con 0x55ea71a60740 2024-04-26T07:54:33.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.658+0000 7f7507d33800 1 -- 172.21.15.62:0/2159984489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 msgr2=0x55ea71a60b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.658+0000 7f7507d33800 1 --2- 172.21.15.62:0/2159984489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71a60b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74f400a470 tx=0x7f74f401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:33.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.658+0000 7f7507d33800 1 -- 172.21.15.62:0/2159984489 shutdown_connections 2024-04-26T07:54:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.658+0000 7f7507d33800 1 --2- 172.21.15.62:0/2159984489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71a60b60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.658+0000 7f7507d33800 1 -- 172.21.15.62:0/2159984489 >> 172.21.15.62:0/2159984489 conn(0x55ea71a5bd20 msgr2=0x55ea71a5e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.658+0000 7f7507d33800 1 -- 172.21.15.62:0/2159984489 shutdown_connections 2024-04-26T07:54:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.658+0000 7f7507d33800 1 -- 172.21.15.62:0/2159984489 wait complete. 2024-04-26T07:54:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.670+0000 7f7507d33800 1 Processor -- start 2024-04-26T07:54:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.670+0000 7f7507d33800 1 -- start start 2024-04-26T07:54:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.670+0000 7f7507d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71b51ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.670+0000 7f7507d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ea719abcd0 con 0x55ea71a60740 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.671+0000 7f75039f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71b51ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.671+0000 7f75039f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71b51ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60572/0 (socket says 172.21.15.62:60572) 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.671+0000 7f75039f5640 1 -- 172.21.15.62:0/886995303 learned_addr learned my addr 172.21.15.62:0/886995303 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.671+0000 7f75039f5640 1 -- 172.21.15.62:0/886995303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea71b52170 con 0x55ea71a60740 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.671+0000 7f75039f5640 1 --2- 172.21.15.62:0/886995303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71b51ba0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f74f4055040 tx=0x7f74f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7bacb703245317 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.671+0000 7f73f1e0b640 1 -- 172.21.15.62:0/886995303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f4057040 con 0x55ea71a60740 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.671+0000 7f73f1e0b640 1 -- 172.21.15.62:0/886995303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f4063070 con 0x55ea71a60740 2024-04-26T07:54:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.671+0000 7f73f1e0b640 1 -- 172.21.15.62:0/886995303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f405d790 con 0x55ea71a60740 2024-04-26T07:54:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 -- 172.21.15.62:0/886995303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 msgr2=0x55ea71b51ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 --2- 172.21.15.62:0/886995303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71b51ba0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f74f4055040 tx=0x7f74f404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 -- 172.21.15.62:0/886995303 shutdown_connections 2024-04-26T07:54:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 --2- 172.21.15.62:0/886995303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea71b51ba0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 -- 172.21.15.62:0/886995303 >> 172.21.15.62:0/886995303 conn(0x55ea71a5bd20 msgr2=0x55ea71b4d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 -- 172.21.15.62:0/886995303 shutdown_connections 2024-04-26T07:54:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 -- 172.21.15.62:0/886995303 wait complete. 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 Processor -- start 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.672+0000 7f7507d33800 1 -- start start 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f7507d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea719d5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f7507d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ea71a69d80 con 0x55ea71a60740 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f75039f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea719d5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f75039f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea719d5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60586/0 (socket says 172.21.15.62:60586) 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f75039f5640 1 -- 172.21.15.62:0/408634551 learned_addr learned my addr 172.21.15.62:0/408634551 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f75039f5640 1 -- 172.21.15.62:0/408634551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea719d64b0 con 0x55ea71a60740 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f75039f5640 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea719d5f70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f74f4060040 tx=0x7f74f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f73ebfff640 1 -- 172.21.15.62:0/408634551 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f4057050 con 0x55ea71a60740 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f73ebfff640 1 -- 172.21.15.62:0/408634551 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f405dcd0 con 0x55ea71a60740 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea719d4700 con 0x55ea71a60740 2024-04-26T07:54:33.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.673+0000 7f73ebfff640 1 -- 172.21.15.62:0/408634551 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f4052440 con 0x55ea71a60740 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.674+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea719d4c80 con 0x55ea71a60740 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.674+0000 7f73ebfff640 1 -- 172.21.15.62:0/408634551 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f74f4052600 con 0x55ea71a60740 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.674+0000 7f73ebfff640 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73ec036eb0 0x7f73ec039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.674+0000 7f73ebfff640 1 -- 172.21.15.62:0/408634551 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f74f408e310 con 0x55ea71a60740 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.675+0000 7f75031f4640 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73ec036eb0 0x7f73ec039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.675+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71a618b0 0x55ea71b62a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.675+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b62fd0 con 0x55ea71a618b0 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.675+0000 7f75041f6640 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71a618b0 0x55ea71b62a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.675+0000 7f75031f4640 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73ec036eb0 0x7f73ec039370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74f8000c00 tx=0x7f74f80013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.675+0000 7f75041f6640 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71a618b0 0x55ea71b62a90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.675+0000 7f75041f6640 1 -- 172.21.15.62:0/408634551 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74fc00a4a0 con 0x55ea71a618b0 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.675+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea719d5130 con 0x55ea71a618b0 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.676+0000 7f75041f6640 1 -- 172.21.15.62:0/408634551 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74fc00a4a0 con 0x55ea71a618b0 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.676+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b65240 0x55ea71b67630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.676+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b67d00 con 0x55ea71b65240 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.676+0000 7f75039f5640 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b65240 0x55ea71b67630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.676+0000 7f75039f5640 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b65240 0x55ea71b67630 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.677+0000 7f75039f5640 1 -- 172.21.15.62:0/408634551 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f74f4078070 con 0x55ea71b65240 2024-04-26T07:54:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.677+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b641f0 con 0x55ea71a618b0 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.677+0000 7f75041f6640 1 -- 172.21.15.62:0/408634551 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74fc00a4a0 con 0x55ea71a618b0 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.677+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b64690 con 0x55ea71a618b0 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.677+0000 7f75041f6640 1 -- 172.21.15.62:0/408634551 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74fc00a4a0 con 0x55ea71a618b0 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.677+0000 7f7507d33800 1 Processor -- start 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f7507d33800 1 -- start start 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f7507d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b76e90 0x55ea71b772b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f7507d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ea71953170 con 0x55ea71b76e90 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f75041f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b76e90 0x55ea71b772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f75041f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b76e90 0x55ea71b772b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60594/0 (socket says 172.21.15.62:60594) 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f75041f6640 1 -- 172.21.15.62:0/2222099696 learned_addr learned my addr 172.21.15.62:0/2222099696 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f75041f6640 1 -- 172.21.15.62:0/2222099696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea71b777f0 con 0x55ea71b76e90 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f75041f6640 1 --2- 172.21.15.62:0/2222099696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b76e90 0x55ea71b772b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55ea719d5710 tx=0x7f74fc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f73e97fa640 1 -- 172.21.15.62:0/2222099696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc014450 con 0x55ea71b76e90 2024-04-26T07:54:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f73e97fa640 1 -- 172.21.15.62:0/2222099696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc0145f0 con 0x55ea71b76e90 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f7507d33800 1 -- 172.21.15.62:0/2222099696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea71b78260 con 0x55ea71b76e90 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.678+0000 7f73e97fa640 1 -- 172.21.15.62:0/2222099696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc014910 con 0x55ea71b76e90 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.679+0000 7f7507d33800 1 -- 172.21.15.62:0/2222099696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea71b78760 con 0x55ea71b76e90 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.679+0000 7f73e97fa640 1 -- 172.21.15.62:0/2222099696 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f74fc011040 con 0x55ea71b76e90 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.679+0000 7f73e97fa640 1 --2- 172.21.15.62:0/2222099696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73dc036eb0 0x7f73dc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.679+0000 7f73e97fa640 1 -- 172.21.15.62:0/2222099696 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f74fc01e070 con 0x55ea71b76e90 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.679+0000 7f75039f5640 1 --2- 172.21.15.62:0/2222099696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73dc036eb0 0x7f73dc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f7507d33800 1 Processor -- start 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f75039f5640 1 --2- 172.21.15.62:0/2222099696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73dc036eb0 0x7f73dc039370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55ea71b633e0 tx=0x7f74f408c630 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f7507d33800 1 -- start start 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f7507d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b84520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f7507d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ea71b52430 con 0x55ea71b84100 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f75041f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b84520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f75041f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b84520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60598/0 (socket says 172.21.15.62:60598) 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f75041f6640 1 -- 172.21.15.62:0/3175590204 learned_addr learned my addr 172.21.15.62:0/3175590204 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.680+0000 7f75041f6640 1 -- 172.21.15.62:0/3175590204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea71b84af0 con 0x55ea71b84100 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f75041f6640 1 --2- 172.21.15.62:0/3175590204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b84520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f74fc04cee0 tx=0x7f74fc011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7550b7c437606ce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f73e2ffd640 1 -- 172.21.15.62:0/3175590204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc041080 con 0x55ea71b84100 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f73e2ffd640 1 -- 172.21.15.62:0/3175590204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc013cb0 con 0x55ea71b84100 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f73e2ffd640 1 -- 172.21.15.62:0/3175590204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc02ba60 con 0x55ea71b84100 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f7507d33800 1 -- 172.21.15.62:0/3175590204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 msgr2=0x55ea71b84520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f7507d33800 1 --2- 172.21.15.62:0/3175590204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b84520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f74fc04cee0 tx=0x7f74fc011700 comp rx=0 tx=0).stop 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f7507d33800 1 -- 172.21.15.62:0/3175590204 shutdown_connections 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f7507d33800 1 --2- 172.21.15.62:0/3175590204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b84520 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f7507d33800 1 -- 172.21.15.62:0/3175590204 >> 172.21.15.62:0/3175590204 conn(0x55ea71b804b0 msgr2=0x55ea71b7e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f7507d33800 1 -- 172.21.15.62:0/3175590204 shutdown_connections 2024-04-26T07:54:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f7507d33800 1 -- 172.21.15.62:0/3175590204 wait complete. 2024-04-26T07:54:33.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.681+0000 7f7507d33800 1 Processor -- start 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f7507d33800 1 -- start start 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f7507d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b8b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f7507d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ea71b85250 con 0x55ea71b84100 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f75041f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b8b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f75041f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b8b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60600/0 (socket says 172.21.15.62:60600) 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 learned_addr learned my addr 172.21.15.62:0/1544425927 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea71b8bc90 con 0x55ea71b84100 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f75041f6640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b8b750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f74fc04cee0 tx=0x7f74fc04ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f73e17fa640 1 -- 172.21.15.62:0/1544425927 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc0135c0 con 0x55ea71b84100 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f73e17fa640 1 -- 172.21.15.62:0/1544425927 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc031070 con 0x55ea71b84100 2024-04-26T07:54:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea71b8bf20 con 0x55ea71b84100 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f73e17fa640 1 -- 172.21.15.62:0/1544425927 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc02b350 con 0x55ea71b84100 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.682+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea71b8ebd0 con 0x55ea71b84100 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.683+0000 7f73e17fa640 1 -- 172.21.15.62:0/1544425927 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f74fc033030 con 0x55ea71b84100 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.683+0000 7f73e17fa640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73cc036eb0 0x7f73cc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.683+0000 7f73e17fa640 1 -- 172.21.15.62:0/1544425927 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f74fc00e040 con 0x55ea71b84100 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.683+0000 7f75039f5640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73cc036eb0 0x7f73cc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71b973e0 0x55ea71b998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b99ff0 con 0x55ea71b973e0 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f75039f5640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73cc036eb0 0x7f73cc039370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74f405efd0 tx=0x7f74f407d050 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f75031f4640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71b973e0 0x55ea71b998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f75031f4640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71b973e0 0x55ea71b998a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74f800f5f0 con 0x55ea71b973e0 2024-04-26T07:54:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f7507d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f7507d33800 20 realm 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.684+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b96830 con 0x55ea71b973e0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74f800f5f0 con 0x55ea71b973e0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b9aad0 con 0x55ea71b973e0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74f800f5f0 con 0x55ea71b973e0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b9b3a0 con 0x55ea71b973e0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74f800f5f0 con 0x55ea71b973e0 2024-04-26T07:54:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b9bca0 0x55ea71b9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b9e810 con 0x55ea71b9bca0 2024-04-26T07:54:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.685+0000 7f75041f6640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b9bca0 0x55ea71b9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.686+0000 7f75041f6640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b9bca0 0x55ea71b9e0b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.686+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.686+0000 7f7507d33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.686+0000 7f7507d33800 20 searching for the correct realm 2024-04-26T07:54:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.686+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ea71ba08c0 0x55ea71ba2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.686+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.686+0000 7f75039f5640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ea71ba08c0 0x55ea71ba2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.686+0000 7f75039f5640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ea71ba08c0 0x55ea71ba2d80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.687+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.687+0000 7f75039f5640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f74f4088040 0x7f74f405e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.687+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x7f74f4088040 2024-04-26T07:54:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.687+0000 7f75031f4640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f74f4088040 0x7f74f405e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.687+0000 7f75031f4640 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f74f4088040 0x7f74f405e900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.688+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f800f5f0 con 0x7f74f4088040 2024-04-26T07:54:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.688+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.688+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.688+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b973e0 2024-04-26T07:54:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.688+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f800f5f0 con 0x55ea71b973e0 2024-04-26T07:54:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.688+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b973e0 2024-04-26T07:54:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.689+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.689+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.689+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.689+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.690+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.690+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x7f74f4088040 2024-04-26T07:54:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.690+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.690+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.690+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.690+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b973e0 2024-04-26T07:54:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.690+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.690+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.691+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.691+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b973e0 2024-04-26T07:54:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.691+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.691+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x7f74f4088040 2024-04-26T07:54:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.691+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.691+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.691+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.691+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.692+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.692+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.692+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.692+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.692+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.692+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.693+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.693+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b973e0 2024-04-26T07:54:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.693+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.693+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b973e0 2024-04-26T07:54:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.693+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.693+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.693+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.693+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.694+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.694+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x7f74f4088040 2024-04-26T07:54:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.694+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.694+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b973e0 2024-04-26T07:54:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.694+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.694+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.695+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.695+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.695+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.695+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.695+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.695+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x7f74f4088040 2024-04-26T07:54:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.696+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.696+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71ba08c0 2024-04-26T07:54:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.696+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.696+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b9bca0 2024-04-26T07:54:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.696+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.696+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x55ea71b973e0 2024-04-26T07:54:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.696+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.696+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba3450 con 0x7f74f4088040 2024-04-26T07:54:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b9f2c0 con 0x55ea71b973e0 2024-04-26T07:54:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b9f710 con 0x55ea71b973e0 2024-04-26T07:54:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b9fbf0 con 0x55ea71b973e0 2024-04-26T07:54:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 zone default found 2024-04-26T07:54:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 4 Realm: () 2024-04-26T07:54:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 zonegroup default 2024-04-26T07:54:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.697+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba38d0 con 0x55ea71b9bca0 2024-04-26T07:54:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.698+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.698+0000 7f7507d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.698+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.698+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71b9eed0 con 0x55ea71ba08c0 2024-04-26T07:54:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.698+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.698+0000 7f7507d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.698+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.698+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba5bc0 con 0x55ea71ba08c0 2024-04-26T07:54:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.699+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.699+0000 7f7507d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.699+0000 7f7507d33800 20 started sync module instance, tier type = 2024-04-26T07:54:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.699+0000 7f7507d33800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.699+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba4f90 con 0x7f74f4088040 2024-04-26T07:54:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.700+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.700+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94465418745008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba4f90 con 0x7f74f4088040 2024-04-26T07:54:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.700+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba6710 con 0x55ea71b973e0 2024-04-26T07:54:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.701+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94465418745008] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.701+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.701+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94465418748384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba4f90 con 0x55ea71b973e0 2024-04-26T07:54:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.701+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba71c0 con 0x55ea71ba08c0 2024-04-26T07:54:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.702+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94465418748384] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.702+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.702+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94465418742496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba4f00 con 0x55ea71ba08c0 2024-04-26T07:54:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.702+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba8080 con 0x7f74f4088040 2024-04-26T07:54:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.704+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94465418742496] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.704+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.704+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94465418755024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba84a0 con 0x7f74f4088040 2024-04-26T07:54:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.704+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba8e60 con 0x55ea71b973e0 2024-04-26T07:54:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.705+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.706+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94465418758576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba9280 con 0x55ea71b973e0 2024-04-26T07:54:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.706+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba9d30 con 0x55ea71b9bca0 2024-04-26T07:54:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.706+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94465418755024] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.706+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.707+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94465418756080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71baa120 con 0x55ea71b9bca0 2024-04-26T07:54:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.707+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71baab20 con 0x55ea71b9bca0 2024-04-26T07:54:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.707+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94465418758576] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.707+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94465418756080] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.708+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.708+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94465418759632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71baa630 con 0x55ea71b9bca0 2024-04-26T07:54:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.708+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71baaff0 con 0x55ea71b9bca0 2024-04-26T07:54:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94465418759632] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94465418767168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71baaf60 con 0x55ea71b9bca0 2024-04-26T07:54:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f7507d33800 20 add_watcher() i=0 2024-04-26T07:54:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f7507d33800 20 add_watcher() i=1 2024-04-26T07:54:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f7507d33800 20 add_watcher() i=2 2024-04-26T07:54:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f7507d33800 20 add_watcher() i=3 2024-04-26T07:54:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f7507d33800 20 add_watcher() i=4 2024-04-26T07:54:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f7507d33800 20 add_watcher() i=5 2024-04-26T07:54:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.709+0000 7f7507d33800 20 add_watcher() i=6 2024-04-26T07:54:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.710+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94465418767168] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.710+0000 7f7507d33800 20 add_watcher() i=7 2024-04-26T07:54:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.710+0000 7f7507d33800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.710+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba9870 con 0x55ea71b973e0 2024-04-26T07:54:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.710+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.710+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94465418769376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba9870 con 0x55ea71b973e0 2024-04-26T07:54:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.711+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94465418769376] v27'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.711+0000 7f73b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.711+0000 7f7507d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.711+0000 7f7507d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.711+0000 7f7507d33800 5 note: GC not initialized 2024-04-26T07:54:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.711+0000 7f73b8fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.711+0000 7f7507d33800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.711+0000 7f7507d33800 20 Filter name: none 2024-04-26T07:54:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.712+0000 7f73327fc640 20 reqs_thread_entry: start 2024-04-26T07:54:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.712+0000 7f7507d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.712+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea71be17e0 con 0x55ea71b973e0 2024-04-26T07:54:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.712+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.712+0000 7f7507d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:could not fetch user info: no user info saved 2024-04-26T07:54:33.750 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T07:54:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.713+0000 7f73b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.713+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94465418769376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71be17a0 con 0x55ea71b973e0 2024-04-26T07:54:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.714+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94465418769376] v27'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.714+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94465418745008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71be17a0 con 0x7f74f4088040 2024-04-26T07:54:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.715+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94465418745008] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.715+0000 7f7507d33800 20 remove_watcher() i=0 2024-04-26T07:54:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.715+0000 7f7507d33800 2 removed watcher, disabling cache 2024-04-26T07:54:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.715+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94465418748384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71be17a0 con 0x55ea71b973e0 2024-04-26T07:54:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.716+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94465418748384] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.716+0000 7f7507d33800 20 remove_watcher() i=1 2024-04-26T07:54:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.716+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94465418742496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71be17a0 con 0x55ea71ba08c0 2024-04-26T07:54:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.717+0000 7f75039f5640 1 -- 172.21.15.62:0/1544425927 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94465418742496] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f4095040 con 0x55ea71ba08c0 2024-04-26T07:54:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.717+0000 7f7507d33800 20 remove_watcher() i=2 2024-04-26T07:54:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.717+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94465418755024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba4ae0 con 0x7f74f4088040 2024-04-26T07:54:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.718+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94465418755024] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x7f74f4088040 2024-04-26T07:54:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.718+0000 7f7507d33800 20 remove_watcher() i=3 2024-04-26T07:54:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.718+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94465418758576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba7bd0 con 0x55ea71b973e0 2024-04-26T07:54:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.719+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94465418758576] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f802b040 con 0x55ea71b973e0 2024-04-26T07:54:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.719+0000 7f7507d33800 20 remove_watcher() i=4 2024-04-26T07:54:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.719+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94465418756080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba4ae0 con 0x55ea71b9bca0 2024-04-26T07:54:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.720+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94465418756080] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.720+0000 7f7507d33800 20 remove_watcher() i=5 2024-04-26T07:54:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.720+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94465418759632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba89b0 con 0x55ea71b9bca0 2024-04-26T07:54:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.721+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94465418759632] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.721+0000 7f7507d33800 20 remove_watcher() i=6 2024-04-26T07:54:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.721+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94465418767168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea71ba4ae0 con 0x55ea71b9bca0 2024-04-26T07:54:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f75041f6640 1 -- 172.21.15.62:0/1544425927 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94465418767168] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74fc02a070 con 0x55ea71b9bca0 2024-04-26T07:54:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 20 remove_watcher() i=7 2024-04-26T07:54:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b9bca0 msgr2=0x55ea71b9e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b9bca0 0x55ea71b9e0b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71b973e0 msgr2=0x55ea71b998a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71b973e0 0x55ea71b998a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f74f4088040 msgr2=0x7f74f405e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f74f4088040 0x7f74f405e900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ea71ba08c0 msgr2=0x55ea71ba2d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ea71ba08c0 0x55ea71ba2d80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73cc036eb0 msgr2=0x7f73cc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73cc036eb0 0x7f73cc039370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74f405efd0 tx=0x7f74f407d050 comp rx=0 tx=0).stop 2024-04-26T07:54:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 msgr2=0x55ea71b8b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f75031f4640 1 -- 172.21.15.62:0/1544425927 reap_dead start 2024-04-26T07:54:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b8b750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f74fc04cee0 tx=0x7f74fc04ce70 comp rx=0 tx=0).stop 2024-04-26T07:54:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 shutdown_connections 2024-04-26T07:54:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/1544425927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b84100 0x55ea71b8b750 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 >> 172.21.15.62:0/1544425927 conn(0x55ea71b804b0 msgr2=0x55ea71b85970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 shutdown_connections 2024-04-26T07:54:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/1544425927 wait complete. 2024-04-26T07:54:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/2222099696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73dc036eb0 msgr2=0x7f73dc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/2222099696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73dc036eb0 0x7f73dc039370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55ea71b633e0 tx=0x7f74f408c630 comp rx=0 tx=0).stop 2024-04-26T07:54:33.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/2222099696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b76e90 msgr2=0x55ea71b772b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/2222099696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b76e90 0x55ea71b772b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55ea719d5710 tx=0x7f74fc018830 comp rx=0 tx=0).stop 2024-04-26T07:54:33.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/2222099696 shutdown_connections 2024-04-26T07:54:33.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/2222099696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73dc036eb0 0x7f73dc039370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 --2- 172.21.15.62:0/2222099696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71b76e90 0x55ea71b772b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/2222099696 >> 172.21.15.62:0/2222099696 conn(0x55ea71b6af30 msgr2=0x55ea71b6b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/2222099696 shutdown_connections 2024-04-26T07:54:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.722+0000 7f7507d33800 1 -- 172.21.15.62:0/2222099696 wait complete. 2024-04-26T07:54:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b65240 msgr2=0x55ea71b67630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b65240 0x55ea71b67630 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71a618b0 msgr2=0x55ea71b62a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71a618b0 0x55ea71b62a90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73ec036eb0 msgr2=0x7f73ec039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73ec036eb0 0x7f73ec039370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74f8000c00 tx=0x7f74f80013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 msgr2=0x55ea719d5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea719d5f70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f74f4060040 tx=0x7f74f4002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 shutdown_connections 2024-04-26T07:54:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ea71a618b0 0x55ea71b62a90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ea71b65240 0x55ea71b67630 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f73ec036eb0 0x7f73ec039370 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 --2- 172.21.15.62:0/408634551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ea71a60740 0x55ea719d5f70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 >> 172.21.15.62:0/408634551 conn(0x55ea71a5bd20 msgr2=0x55ea71b4bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 shutdown_connections 2024-04-26T07:54:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.723+0000 7f7507d33800 1 -- 172.21.15.62:0/408634551 wait complete. 2024-04-26T07:54:33.763 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-26T07:54:33.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-26T07:54:33.763 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-04-26T07:54:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.850+0000 7fcf62936800 1 Processor -- start 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.850+0000 7fcf62936800 1 -- start start 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.850+0000 7fcf62936800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fc458799b0 0x55fc4587bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.850+0000 7fcf62936800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc4587c370 con 0x55fc45875520 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.850+0000 7fcf62936800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55fc45718e20 con 0x55fc458799b0 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.850+0000 7fcf5decb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fc458799b0 0x55fc4587bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.850+0000 7fcf5e6cc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55fc45875520 0x55fc45875940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36444/0 (socket says 172.21.15.62:36444) 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.850+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2893321980 learned_addr learned my addr 172.21.15.62:0/2893321980 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.851+0000 7fcf5decb640 1 -- 172.21.15.62:0/2893321980 >> v1:172.21.15.1:6789/0 conn(0x55fc45875520 legacy=0x55fc45875940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.851+0000 7fcf5decb640 1 -- 172.21.15.62:0/2893321980 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc4587d5a0 con 0x55fc458799b0 2024-04-26T07:54:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.852+0000 7fcf5decb640 1 --2- 172.21.15.62:0/2893321980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc458799b0 0x55fc4587bda0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a470 tx=0x7fcf5401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635bad06a20c058a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf5d6ca640 1 -- 172.21.15.62:0/2893321980 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54057070 con 0x55fc458799b0 2024-04-26T07:54:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf5d6ca640 1 -- 172.21.15.62:0/2893321980 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54052570 con 0x55fc458799b0 2024-04-26T07:54:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf5d6ca640 1 -- 172.21.15.62:0/2893321980 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54052870 con 0x55fc458799b0 2024-04-26T07:54:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf62936800 1 -- 172.21.15.62:0/2893321980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc458799b0 msgr2=0x55fc4587bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf62936800 1 --2- 172.21.15.62:0/2893321980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc458799b0 0x55fc4587bda0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a470 tx=0x7fcf5401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf62936800 1 -- 172.21.15.62:0/2893321980 shutdown_connections 2024-04-26T07:54:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf62936800 1 --2- 172.21.15.62:0/2893321980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc458799b0 0x55fc4587bda0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf62936800 1 -- 172.21.15.62:0/2893321980 >> 172.21.15.62:0/2893321980 conn(0x55fc45870b40 msgr2=0x55fc45872f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf62936800 1 -- 172.21.15.62:0/2893321980 shutdown_connections 2024-04-26T07:54:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.853+0000 7fcf62936800 1 -- 172.21.15.62:0/2893321980 wait complete. 2024-04-26T07:54:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.866+0000 7fcf62936800 1 Processor -- start 2024-04-26T07:54:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.866+0000 7fcf62936800 1 -- start start 2024-04-26T07:54:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.866+0000 7fcf62936800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc45966bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.866+0000 7fcf62936800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc457c1c70 con 0x55fc45875520 2024-04-26T07:54:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.866+0000 7fcf5e6cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc45966bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.866+0000 7fcf5e6cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc45966bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60618/0 (socket says 172.21.15.62:60618) 2024-04-26T07:54:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.866+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/764113906 learned_addr learned my addr 172.21.15.62:0/764113906 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.867+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/764113906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc459671c0 con 0x55fc45875520 2024-04-26T07:54:33.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.867+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/764113906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc45966bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf50001e10 tx=0x7fcf5000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24422919562854b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.867+0000 7fce4c608640 1 -- 172.21.15.62:0/764113906 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf50012020 con 0x55fc45875520 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.867+0000 7fce4c608640 1 -- 172.21.15.62:0/764113906 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5000e5a0 con 0x55fc45875520 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.867+0000 7fce4c608640 1 -- 172.21.15.62:0/764113906 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf5000e8e0 con 0x55fc45875520 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 -- 172.21.15.62:0/764113906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 msgr2=0x55fc45966bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 --2- 172.21.15.62:0/764113906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc45966bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf50001e10 tx=0x7fcf5000b780 comp rx=0 tx=0).stop 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 -- 172.21.15.62:0/764113906 shutdown_connections 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 --2- 172.21.15.62:0/764113906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc45966bf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 -- 172.21.15.62:0/764113906 >> 172.21.15.62:0/764113906 conn(0x55fc45870b40 msgr2=0x55fc45962510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 -- 172.21.15.62:0/764113906 shutdown_connections 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 -- 172.21.15.62:0/764113906 wait complete. 2024-04-26T07:54:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 Processor -- start 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 -- start start 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc4596bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf62936800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc4587c840 con 0x55fc45875520 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf5e6cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc4596bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf5e6cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc4596bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60630/0 (socket says 172.21.15.62:60630) 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.868+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/722386526 learned_addr learned my addr 172.21.15.62:0/722386526 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.869+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/722386526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc4596a2e0 con 0x55fc45875520 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.869+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc4596bbf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000b7c0 tx=0x7fcf50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.869+0000 7fce4ae05640 1 -- 172.21.15.62:0/722386526 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf50012030 con 0x55fc45875520 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.869+0000 7fce4ae05640 1 -- 172.21.15.62:0/722386526 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf50001470 con 0x55fc45875520 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.869+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc4596a570 con 0x55fc45875520 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.869+0000 7fce4ae05640 1 -- 172.21.15.62:0/722386526 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf5001a8d0 con 0x55fc45875520 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.869+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc4596aa90 con 0x55fc45875520 2024-04-26T07:54:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.870+0000 7fce4ae05640 1 -- 172.21.15.62:0/722386526 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcf50015020 con 0x55fc45875520 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.870+0000 7fce4ae05640 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce44036eb0 0x7fce44039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.870+0000 7fce4ae05640 1 -- 172.21.15.62:0/722386526 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fcf50020030 con 0x55fc45875520 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.870+0000 7fcf5decb640 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce44036eb0 0x7fce44039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.871+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc458799b0 0x55fc45978de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.871+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc45979320 con 0x55fc458799b0 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.871+0000 7fcf5eecd640 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc458799b0 0x55fc45978de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.871+0000 7fcf5decb640 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce44036eb0 0x7fce44039370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf54054000 tx=0x7fcf5404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.871+0000 7fcf5eecd640 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc458799b0 0x55fc45978de0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.871+0000 7fcf5eecd640 1 -- 172.21.15.62:0/722386526 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5800a4a0 con 0x55fc458799b0 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.871+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc45979750 con 0x55fc458799b0 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.872+0000 7fcf5eecd640 1 -- 172.21.15.62:0/722386526 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf5800a4a0 con 0x55fc458799b0 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.872+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc4597b560 0x55fc4597d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.872+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc4597e020 con 0x55fc4597b560 2024-04-26T07:54:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.872+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc4597b560 0x55fc4597d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.872+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc4597b560 0x55fc4597d950 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.873+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/722386526 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf5002ed60 con 0x55fc4597b560 2024-04-26T07:54:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.873+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc4597a510 con 0x55fc458799b0 2024-04-26T07:54:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.873+0000 7fcf5eecd640 1 -- 172.21.15.62:0/722386526 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf5800a4a0 con 0x55fc458799b0 2024-04-26T07:54:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.873+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc4597a990 con 0x55fc458799b0 2024-04-26T07:54:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.873+0000 7fcf5eecd640 1 -- 172.21.15.62:0/722386526 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf5800a4a0 con 0x55fc458799b0 2024-04-26T07:54:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf62936800 1 Processor -- start 2024-04-26T07:54:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf62936800 1 -- start start 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf62936800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4598d130 0x55fc4598d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf62936800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc45769170 con 0x55fc4598d130 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf5eecd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4598d130 0x55fc4598d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf5eecd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4598d130 0x55fc4598d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60640/0 (socket says 172.21.15.62:60640) 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2467686854 learned_addr learned my addr 172.21.15.62:0/2467686854 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2467686854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc4598da90 con 0x55fc4598d130 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.874+0000 7fcf5eecd640 1 --2- 172.21.15.62:0/2467686854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4598d130 0x55fc4598d550 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55fc4596c1e0 tx=0x7fcf58018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.875+0000 7fce43fff640 1 -- 172.21.15.62:0/2467686854 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf58014450 con 0x55fc4598d130 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.875+0000 7fce43fff640 1 -- 172.21.15.62:0/2467686854 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf580145f0 con 0x55fc4598d130 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.875+0000 7fcf62936800 1 -- 172.21.15.62:0/2467686854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc4598e500 con 0x55fc4598d130 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.875+0000 7fce43fff640 1 -- 172.21.15.62:0/2467686854 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf58014910 con 0x55fc4598d130 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.875+0000 7fcf62936800 1 -- 172.21.15.62:0/2467686854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc4598ea00 con 0x55fc4598d130 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.875+0000 7fce43fff640 1 -- 172.21.15.62:0/2467686854 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcf58011040 con 0x55fc4598d130 2024-04-26T07:54:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fce43fff640 1 --2- 172.21.15.62:0/2467686854 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce38036f00 0x7fce380393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fce43fff640 1 -- 172.21.15.62:0/2467686854 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fcf5801e070 con 0x55fc4598d130 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/2467686854 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce38036f00 0x7fce380393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf62936800 1 Processor -- start 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf62936800 1 -- start start 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/2467686854 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce38036f00 0x7fce380393c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55fc4596aef0 tx=0x7fcf5004b190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf62936800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc4599a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf62936800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc45967540 con 0x55fc4599a460 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf5eecd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc4599a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf5eecd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc4599a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60652/0 (socket says 172.21.15.62:60652) 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.876+0000 7fcf5eecd640 1 -- 172.21.15.62:0/4041365108 learned_addr learned my addr 172.21.15.62:0/4041365108 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf5eecd640 1 -- 172.21.15.62:0/4041365108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc4599ae50 con 0x55fc4599a460 2024-04-26T07:54:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf5eecd640 1 --2- 172.21.15.62:0/4041365108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc4599a880 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcf5804cf00 tx=0x7fcf580410d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e693444a029d263 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fce41ffb640 1 -- 172.21.15.62:0/4041365108 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf580168f0 con 0x55fc4599a460 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fce41ffb640 1 -- 172.21.15.62:0/4041365108 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58013c50 con 0x55fc4599a460 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fce41ffb640 1 -- 172.21.15.62:0/4041365108 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf58014ab0 con 0x55fc4599a460 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf62936800 1 -- 172.21.15.62:0/4041365108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 msgr2=0x55fc4599a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf62936800 1 --2- 172.21.15.62:0/4041365108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc4599a880 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcf5804cf00 tx=0x7fcf580410d0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf62936800 1 -- 172.21.15.62:0/4041365108 shutdown_connections 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf62936800 1 --2- 172.21.15.62:0/4041365108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc4599a880 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf62936800 1 -- 172.21.15.62:0/4041365108 >> 172.21.15.62:0/4041365108 conn(0x55fc45996730 msgr2=0x55fc45994790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf62936800 1 -- 172.21.15.62:0/4041365108 shutdown_connections 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.877+0000 7fcf62936800 1 -- 172.21.15.62:0/4041365108 wait complete. 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf62936800 1 Processor -- start 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf62936800 1 -- start start 2024-04-26T07:54:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf62936800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc459a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf62936800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc4599b5e0 con 0x55fc4599a460 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf5eecd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc459a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf5eecd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc459a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60668/0 (socket says 172.21.15.62:60668) 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 learned_addr learned my addr 172.21.15.62:0/2367929922 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc459a1f30 con 0x55fc4599a460 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.878+0000 7fcf5eecd640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc459a19f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcf5804cf00 tx=0x7fcf5804ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.879+0000 7fce2ffff640 1 -- 172.21.15.62:0/2367929922 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf58013a20 con 0x55fc4599a460 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.879+0000 7fce2ffff640 1 -- 172.21.15.62:0/2367929922 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf580472c0 con 0x55fc4599a460 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.879+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc459a21c0 con 0x55fc4599a460 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.879+0000 7fce2ffff640 1 -- 172.21.15.62:0/2367929922 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf580475a0 con 0x55fc4599a460 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.879+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc459a4e70 con 0x55fc4599a460 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.879+0000 7fce2ffff640 1 -- 172.21.15.62:0/2367929922 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcf58047740 con 0x55fc4599a460 2024-04-26T07:54:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.879+0000 7fce2ffff640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce28036e60 0x7fce28039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.880+0000 7fce2ffff640 1 -- 172.21.15.62:0/2367929922 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fcf5800e040 con 0x55fc4599a460 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.880+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce28036e60 0x7fce28039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.880+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce28036e60 0x7fce28039320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf5001a6f0 tx=0x7fcf50035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.880+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.880+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc459ad770 0x55fc459afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.880+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b0380 con 0x55fc459ad770 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.880+0000 7fcf5decb640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc459ad770 0x55fc459afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf5decb640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc459ad770 0x55fc459afc30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 realm 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b0750 con 0x55fc459ad770 2024-04-26T07:54:33.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:33.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b1020 con 0x55fc459ad770 2024-04-26T07:54:33.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b13c0 con 0x55fc459ad770 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc459b2120 0x55fc459b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.881+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b4ad0 con 0x55fc459b2120 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.882+0000 7fcf5eecd640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc459b2120 0x55fc459b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.882+0000 7fcf5eecd640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc459b2120 0x55fc459b4510 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.883+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.883+0000 7fcf62936800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.883+0000 7fcf62936800 20 searching for the correct realm 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.883+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc459b6aa0 0x55fc459b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.883+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459b6aa0 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.883+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc459b6aa0 0x55fc459b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.883+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc459b6aa0 0x55fc459b8f60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.884+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.884+0000 7fcf5e6cc640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fcf50017050 0x7fcf5003f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.884+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x7fcf50017050 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.884+0000 7fcf5decb640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fcf50017050 0x7fcf5003f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.884+0000 7fcf5decb640 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fcf50017050 0x7fcf5003f700 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.884+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.884+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459b2120 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.885+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.885+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459ad770 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.885+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.885+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459ad770 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.885+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.885+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459b2120 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.885+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.885+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459b2120 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.886+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.886+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x7fcf50017050 2024-04-26T07:54:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.886+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.886+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459b6aa0 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.886+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.886+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459ad770 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.886+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.886+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459b2120 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.887+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.887+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459ad770 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.887+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.887+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x7fcf50017050 2024-04-26T07:54:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.887+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.887+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9630 con 0x55fc459b6aa0 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.887+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.887+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b6aa0 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.888+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.888+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b2120 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.888+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.888+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b6aa0 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.888+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.888+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b6aa0 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.888+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.888+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459ad770 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.889+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.889+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459ad770 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.889+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.889+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b2120 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.889+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.889+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b6aa0 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.889+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.889+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x7fcf50017050 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.890+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.890+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459ad770 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.890+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.890+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b2120 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.890+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.890+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b6aa0 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.890+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.890+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b2120 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.891+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.891+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x7fcf50017050 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.891+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.891+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b6aa0 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459b2120 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x55fc459ad770 2024-04-26T07:54:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf50058040 con 0x7fcf50017050 2024-04-26T07:54:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf62936800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf62936800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf62936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf62936800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf62936800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf62936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.892+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b5490 con 0x55fc459ad770 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b5d30 con 0x55fc459ad770 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b50d0 con 0x55fc459ad770 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 20 zone default found 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 4 Realm: () 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 20 zonegroup default 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.893+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459b9af0 con 0x55fc459b2120 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bbdc0 con 0x55fc459b6aa0 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bc160 con 0x55fc459b6aa0 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 20 started sync module instance, tier type = 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.894+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bb250 con 0x7fcf50017050 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.895+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.895+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94541987952512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bb250 con 0x7fcf50017050 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.895+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bcbb0 con 0x55fc459ad770 2024-04-26T07:54:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.896+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94541987952512] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.897+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.897+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94541987956416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bb250 con 0x55fc459ad770 2024-04-26T07:54:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.897+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bd600 con 0x55fc459b6aa0 2024-04-26T07:54:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.898+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94541987956416] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.898+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.898+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94541987949984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bb1c0 con 0x55fc459b6aa0 2024-04-26T07:54:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.898+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459be3c0 con 0x7fcf50017050 2024-04-26T07:54:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.899+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94541987949984] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.899+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.899+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94541987961376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459be7b0 con 0x7fcf50017050 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.899+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bf1d0 con 0x55fc459ad770 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.900+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.900+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94541987966144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bf190 con 0x55fc459ad770 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.900+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c00f0 con 0x55fc459b2120 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.900+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94541987961376] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.901+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.901+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94541987966144] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.901+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94541987970112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bf5c0 con 0x55fc459b2120 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.901+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c0ab0 con 0x55fc459b2120 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.902+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94541987970112] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.902+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.902+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94541987962432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c0ab0 con 0x55fc459b2120 2024-04-26T07:54:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.902+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c1470 con 0x55fc459b2120 2024-04-26T07:54:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94541987962432] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94541987975104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c13e0 con 0x55fc459b2120 2024-04-26T07:54:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf62936800 20 add_watcher() i=0 2024-04-26T07:54:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf62936800 20 add_watcher() i=1 2024-04-26T07:54:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf62936800 20 add_watcher() i=2 2024-04-26T07:54:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf62936800 20 add_watcher() i=3 2024-04-26T07:54:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf62936800 20 add_watcher() i=4 2024-04-26T07:54:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf62936800 20 add_watcher() i=5 2024-04-26T07:54:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.903+0000 7fcf62936800 20 add_watcher() i=6 2024-04-26T07:54:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.904+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94541987975104] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.904+0000 7fcf62936800 20 add_watcher() i=7 2024-04-26T07:54:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.904+0000 7fcf62936800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.904+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c47e0 con 0x55fc459ad770 2024-04-26T07:54:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.904+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.904+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94541987972608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c1ca0 con 0x55fc459ad770 2024-04-26T07:54:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.905+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94541987972608] v27'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.905+0000 7fce14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.905+0000 7fcf62936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.905+0000 7fcf62936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 5 note: GC not initialized 2024-04-26T07:54:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcd8f7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:33.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:33.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 20 Filter name: none 2024-04-26T07:54:33.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcd8d7fa640 20 reqs_thread_entry: start 2024-04-26T07:54:33.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:33.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459f8020 con 0x55fc459ad770 2024-04-26T07:54:33.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-26T07:54:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-26T07:54:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.906+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459f6660 con 0x55fc459ad770 2024-04-26T07:54:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-04-26T07:54:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T07:54:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-04-26T07:54:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 20 rados->read ofs=0 len=0 2024-04-26T07:54:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459f6660 con 0x55fc459b2120 2024-04-26T07:54:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-04-26T07:54:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T07:54:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-26T07:54:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-26T07:54:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.907+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459f6fc0 con 0x55fc459ad770 2024-04-26T07:54:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.908+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v27'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.908+0000 7fcf62936800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.908+0000 7fcf62936800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.908+0000 7fcf62936800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.908+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94541988194976 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459fbb20 con 0x55fc459ad770 2024-04-26T07:54:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== watch-notify(notify (1) cookie 94541987966144 notify 115964116992 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55fc459f7360 con 0x55fc459ad770 2024-04-26T07:54:33.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fce41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94541987966144 notifier 4284 bl.length()=567 2024-04-26T07:54:33.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fce41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:33.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fce41ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:33.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.4 [notify cookie 94541988194976 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fce41ffb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fce24003ea0 con 0x55fc459ad770 2024-04-26T07:54:33.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== watch-notify(notify_complete (2) cookie 94541988194976 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fc459f7c40 con 0x55fc459ad770 2024-04-26T07:54:33.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.909+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459f6aa0 con 0x55fc459ad770 2024-04-26T07:54:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf62936800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-26T07:54:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf62936800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T07:54:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf62936800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-26T07:54:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94541988194976 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459fbf50 con 0x7fcf50017050 2024-04-26T07:54:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== watch-notify(notify (1) cookie 94541987961376 notify 115964116992 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55fc459f7c40 con 0x7fcf50017050 2024-04-26T07:54:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fce41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94541987961376 notifier 4284 bl.length()=169 2024-04-26T07:54:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fce41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-26T07:54:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fce41ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T07:54:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fce41ffb640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fce24003ea0 con 0x7fcf50017050 2024-04-26T07:54:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(69 notify.3 [notify cookie 94541988194976 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== watch-notify(notify_complete (2) cookie 94541988194976 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fc4587d5a0 con 0x7fcf50017050 2024-04-26T07:54:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.911+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459f9c00 con 0x55fc459b2120 2024-04-26T07:54:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.912+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.912+0000 7fcf62936800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-26T07:54:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.912+0000 7fcf62936800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T07:54:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.912+0000 7fcf62936800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-26T07:54:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94541988206064 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc459f9c00 con 0x7fcf50017050 2024-04-26T07:54:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== watch-notify(notify (1) cookie 94541987961376 notify 115964116993 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55fc4587d5a0 con 0x7fcf50017050 2024-04-26T07:54:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fce417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94541987961376 notifier 4284 bl.length()=177 2024-04-26T07:54:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fce417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-26T07:54:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fce417fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T07:54:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fce417fa640 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcd94003400 con 0x7fcf50017050 2024-04-26T07:54:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(72 notify.3 [notify cookie 94541988206064 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.913+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== watch-notify(notify_complete (2) cookie 94541988206064 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcf54090510 con 0x7fcf50017050 2024-04-26T07:54:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:33.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.914+0000 7fce14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:33.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.914+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94541987972608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c4320 con 0x55fc459ad770 2024-04-26T07:54:33.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.915+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94541987972608] v27'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.915+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94541987952512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c0600 con 0x7fcf50017050 2024-04-26T07:54:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.916+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94541987952512] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.916+0000 7fcf62936800 20 remove_watcher() i=0 2024-04-26T07:54:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.916+0000 7fcf62936800 2 removed watcher, disabling cache 2024-04-26T07:54:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.916+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94541987956416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c0600 con 0x55fc459ad770 2024-04-26T07:54:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.917+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94541987956416] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.917+0000 7fcf62936800 20 remove_watcher() i=1 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.917+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94541987949984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bc6c0 con 0x55fc459b6aa0 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.918+0000 7fcf5e6cc640 1 -- 172.21.15.62:0/2367929922 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94541987949984] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5000d450 con 0x55fc459b6aa0 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.918+0000 7fcf62936800 20 remove_watcher() i=2 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.918+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94541987961376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c0600 con 0x7fcf50017050 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.919+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94541987961376] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x7fcf50017050 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.919+0000 7fcf62936800 20 remove_watcher() i=3 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.919+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94541987966144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459bda20 con 0x55fc459ad770 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.920+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94541987966144] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5405a040 con 0x55fc459ad770 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.920+0000 7fcf62936800 20 remove_watcher() i=4 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.920+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94541987970112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c0600 con 0x55fc459b2120 2024-04-26T07:54:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.921+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94541987970112] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.921+0000 7fcf62936800 20 remove_watcher() i=5 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.921+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94541987962432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459becc0 con 0x55fc459b2120 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.922+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94541987962432] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.922+0000 7fcf62936800 20 remove_watcher() i=6 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.922+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94541987975104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc459c0600 con 0x55fc459b2120 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.923+0000 7fcf5eecd640 1 -- 172.21.15.62:0/2367929922 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94541987975104] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5802a070 con 0x55fc459b2120 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.923+0000 7fcf62936800 20 remove_watcher() i=7 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.923+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc459b2120 msgr2=0x55fc459b4510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.923+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc459b2120 0x55fc459b4510 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.923+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc459ad770 msgr2=0x55fc459afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.923+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc459ad770 0x55fc459afc30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fcf50017050 msgr2=0x7fcf5003f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fcf50017050 0x7fcf5003f700 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc459b6aa0 msgr2=0x55fc459b8f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc459b6aa0 0x55fc459b8f60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce28036e60 msgr2=0x7fce28039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce28036e60 0x7fce28039320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf5001a6f0 tx=0x7fcf50035000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 msgr2=0x55fc459a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf5decb640 1 -- 172.21.15.62:0/2367929922 reap_dead start 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc459a19f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcf5804cf00 tx=0x7fcf5804ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 shutdown_connections 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2367929922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4599a460 0x55fc459a19f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 >> 172.21.15.62:0/2367929922 conn(0x55fc45996730 msgr2=0x55fc45993d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 shutdown_connections 2024-04-26T07:54:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2367929922 wait complete. 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2467686854 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce38036f00 msgr2=0x7fce380393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2467686854 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce38036f00 0x7fce380393c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55fc4596aef0 tx=0x7fcf5004b190 comp rx=0 tx=0).stop 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2467686854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4598d130 msgr2=0x55fc4598d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2467686854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4598d130 0x55fc4598d550 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55fc4596c1e0 tx=0x7fcf58018830 comp rx=0 tx=0).stop 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2467686854 shutdown_connections 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2467686854 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce38036f00 0x7fce380393c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 --2- 172.21.15.62:0/2467686854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc4598d130 0x55fc4598d550 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2467686854 >> 172.21.15.62:0/2467686854 conn(0x55fc459811d0 msgr2=0x55fc459815d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2467686854 shutdown_connections 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.924+0000 7fcf62936800 1 -- 172.21.15.62:0/2467686854 wait complete. 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc4597b560 msgr2=0x55fc4597d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc4597b560 0x55fc4597d950 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc458799b0 msgr2=0x55fc45978de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc458799b0 0x55fc45978de0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce44036eb0 msgr2=0x7fce44039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce44036eb0 0x7fce44039370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf54054000 tx=0x7fcf5404e000 comp rx=0 tx=0).stop 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 msgr2=0x55fc4596bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc4596bbf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000b7c0 tx=0x7fcf50000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 shutdown_connections 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc458799b0 0x55fc45978de0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fc4597b560 0x55fc4597d950 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce44036eb0 0x7fce44039370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 --2- 172.21.15.62:0/722386526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc45875520 0x55fc4596bbf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 >> 172.21.15.62:0/722386526 conn(0x55fc45870b40 msgr2=0x55fc457e8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 shutdown_connections 2024-04-26T07:54:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:33.925+0000 7fcf62936800 1 -- 172.21.15.62:0/722386526 wait complete. 2024-04-26T07:54:33.948 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:33.948 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-26T07:54:33.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-26T07:54:33.948 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-04-26T07:54:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.001+0000 7f9b58f75800 1 Processor -- start 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.001+0000 7f9b58f75800 1 -- start start 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.001+0000 7f9b58f75800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56193d14aca0 0x56193d14d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.001+0000 7f9b58f75800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56193d14d5d0 con 0x56193d147190 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.001+0000 7f9b58f75800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x56193cfe8e20 con 0x56193d14aca0 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.002+0000 7f9b56273640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56193d14aca0 0x56193d14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.002+0000 7f9b56a74640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x56193d147190 0x56193d149580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36454/0 (socket says 172.21.15.62:36454) 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.002+0000 7f9b56a74640 1 -- 172.21.15.62:0/3812592099 learned_addr learned my addr 172.21.15.62:0/3812592099 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.002+0000 7f9b56273640 1 -- 172.21.15.62:0/3812592099 >> v1:172.21.15.1:6789/0 conn(0x56193d147190 legacy=0x56193d149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.002+0000 7f9b56273640 1 -- 172.21.15.62:0/3812592099 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193d14e7b0 con 0x56193d14aca0 2024-04-26T07:54:34.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b56273640 1 --2- 172.21.15.62:0/3812592099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d14aca0 0x56193d14d090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00a470 tx=0x7f9b4c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415995b83b83b8d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b55a72640 1 -- 172.21.15.62:0/3812592099 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b4c057070 con 0x56193d14aca0 2024-04-26T07:54:34.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b55a72640 1 -- 172.21.15.62:0/3812592099 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4c052570 con 0x56193d14aca0 2024-04-26T07:54:34.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b55a72640 1 -- 172.21.15.62:0/3812592099 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b4c052870 con 0x56193d14aca0 2024-04-26T07:54:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b58f75800 1 -- 172.21.15.62:0/3812592099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d14aca0 msgr2=0x56193d14d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3812592099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d14aca0 0x56193d14d090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00a470 tx=0x7f9b4c01ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b58f75800 1 -- 172.21.15.62:0/3812592099 shutdown_connections 2024-04-26T07:54:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3812592099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d14aca0 0x56193d14d090 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b58f75800 1 -- 172.21.15.62:0/3812592099 >> 172.21.15.62:0/3812592099 conn(0x56193d140ba0 msgr2=0x56193d142fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b58f75800 1 -- 172.21.15.62:0/3812592099 shutdown_connections 2024-04-26T07:54:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.004+0000 7f9b58f75800 1 -- 172.21.15.62:0/3812592099 wait complete. 2024-04-26T07:54:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.017+0000 7f9b58f75800 1 Processor -- start 2024-04-26T07:54:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.017+0000 7f9b58f75800 1 -- start start 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.017+0000 7f9b58f75800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d23c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.017+0000 7f9b58f75800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56193d091cf0 con 0x56193d147190 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.018+0000 7f9b56a74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d23c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.018+0000 7f9b56a74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d23c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60686/0 (socket says 172.21.15.62:60686) 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.018+0000 7f9b56a74640 1 -- 172.21.15.62:0/2734708467 learned_addr learned my addr 172.21.15.62:0/2734708467 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.018+0000 7f9b56a74640 1 -- 172.21.15.62:0/2734708467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193d23cc40 con 0x56193d147190 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.018+0000 7f9b56a74640 1 --2- 172.21.15.62:0/2734708467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d23c670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001de0 tx=0x7f9b4800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ace3979a708238b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.018+0000 7f9a44e09640 1 -- 172.21.15.62:0/2734708467 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b48012020 con 0x56193d147190 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.018+0000 7f9a44e09640 1 -- 172.21.15.62:0/2734708467 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4800e5a0 con 0x56193d147190 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.018+0000 7f9a44e09640 1 -- 172.21.15.62:0/2734708467 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b4800e8c0 con 0x56193d147190 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.019+0000 7f9b58f75800 1 -- 172.21.15.62:0/2734708467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 msgr2=0x56193d23c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.019+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2734708467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d23c670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001de0 tx=0x7f9b4800b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.019+0000 7f9b58f75800 1 -- 172.21.15.62:0/2734708467 shutdown_connections 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.019+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2734708467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d23c670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.019+0000 7f9b58f75800 1 -- 172.21.15.62:0/2734708467 >> 172.21.15.62:0/2734708467 conn(0x56193d140ba0 msgr2=0x56193d1450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.019+0000 7f9b58f75800 1 -- 172.21.15.62:0/2734708467 shutdown_connections 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.019+0000 7f9b58f75800 1 -- 172.21.15.62:0/2734708467 wait complete. 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b58f75800 1 Processor -- start 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b58f75800 1 -- start start 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b58f75800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d2419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b58f75800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56193d14daa0 con 0x56193d147190 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b56a74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d2419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b56a74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d2419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60694/0 (socket says 172.21.15.62:60694) 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b56a74640 1 -- 172.21.15.62:0/2780130409 learned_addr learned my addr 172.21.15.62:0/2780130409 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b56a74640 1 -- 172.21.15.62:0/2780130409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193d241f20 con 0x56193d147190 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.020+0000 7f9b56a74640 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d2419e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001de0 tx=0x7f9b48000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.021+0000 7f9a43606640 1 -- 172.21.15.62:0/2780130409 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b48012030 con 0x56193d147190 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.021+0000 7f9a43606640 1 -- 172.21.15.62:0/2780130409 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4801a7a0 con 0x56193d147190 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.021+0000 7f9a43606640 1 -- 172.21.15.62:0/2780130409 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b4801aac0 con 0x56193d147190 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.021+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56193d2421b0 con 0x56193d147190 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.021+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193d244e60 con 0x56193d147190 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.021+0000 7f9a43606640 1 -- 172.21.15.62:0/2780130409 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9b48015020 con 0x56193d147190 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9a43606640 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a3c036e60 0x7f9a3c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9a43606640 1 -- 172.21.15.62:0/2780130409 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9b48020070 con 0x56193d147190 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9b56273640 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a3c036e60 0x7f9a3c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d14aca0 0x56193d248c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d2491a0 con 0x56193d14aca0 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9b57275640 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d14aca0 0x56193d248c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9b56273640 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a3c036e60 0x7f9a3c039320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c054000 tx=0x7f9b4c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9b57275640 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d14aca0 0x56193d248c20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9b57275640 1 -- 172.21.15.62:0/2780130409 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b5000a4a0 con 0x56193d14aca0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.022+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d2461f0 con 0x56193d14aca0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.023+0000 7f9b57275640 1 -- 172.21.15.62:0/2780130409 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b5000a4a0 con 0x56193d14aca0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.023+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d24b500 0x56193d24d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.023+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d24df90 con 0x56193d24b500 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.023+0000 7f9b56a74640 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d24b500 0x56193d24d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.023+0000 7f9b56a74640 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d24b500 0x56193d24d8f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.024+0000 7f9b56a74640 1 -- 172.21.15.62:0/2780130409 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b48024980 con 0x56193d24b500 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.024+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d24a4b0 con 0x56193d14aca0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.024+0000 7f9b57275640 1 -- 172.21.15.62:0/2780130409 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b5000a4a0 con 0x56193d14aca0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.024+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d24a940 con 0x56193d14aca0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.024+0000 7f9b57275640 1 -- 172.21.15.62:0/2780130409 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b5000a4a0 con 0x56193d14aca0 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.025+0000 7f9b58f75800 1 Processor -- start 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.025+0000 7f9b58f75800 1 -- start start 2024-04-26T07:54:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.025+0000 7f9b58f75800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d25d170 0x56193d25d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.025+0000 7f9b58f75800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56193d039170 con 0x56193d25d170 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.025+0000 7f9b57275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d25d170 0x56193d25d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.025+0000 7f9b57275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d25d170 0x56193d25d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60700/0 (socket says 172.21.15.62:60700) 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.025+0000 7f9b57275640 1 -- 172.21.15.62:0/4086709857 learned_addr learned my addr 172.21.15.62:0/4086709857 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.025+0000 7f9b57275640 1 -- 172.21.15.62:0/4086709857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193d25dad0 con 0x56193d25d170 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.026+0000 7f9b57275640 1 --2- 172.21.15.62:0/4086709857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d25d170 0x56193d25d590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x56193d249560 tx=0x7f9b50018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.026+0000 7f9a40e01640 1 -- 172.21.15.62:0/4086709857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b50014450 con 0x56193d25d170 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.026+0000 7f9a40e01640 1 -- 172.21.15.62:0/4086709857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b50014610 con 0x56193d25d170 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.026+0000 7f9a40e01640 1 -- 172.21.15.62:0/4086709857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b50014930 con 0x56193d25d170 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.026+0000 7f9b58f75800 1 -- 172.21.15.62:0/4086709857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56193d25e540 con 0x56193d25d170 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.027+0000 7f9b58f75800 1 -- 172.21.15.62:0/4086709857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193d25ea40 con 0x56193d25d170 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.027+0000 7f9a40e01640 1 -- 172.21.15.62:0/4086709857 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9b50011040 con 0x56193d25d170 2024-04-26T07:54:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.027+0000 7f9a40e01640 1 --2- 172.21.15.62:0/4086709857 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a30036eb0 0x7f9a30039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.027+0000 7f9a40e01640 1 -- 172.21.15.62:0/4086709857 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9b5001e070 con 0x56193d25d170 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b56a74640 1 --2- 172.21.15.62:0/4086709857 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a30036eb0 0x7f9a30039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b58f75800 1 Processor -- start 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b58f75800 1 -- start start 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b56a74640 1 --2- 172.21.15.62:0/4086709857 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a30036eb0 0x7f9a30039370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x56193d249620 tx=0x7f9b48024c50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b58f75800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d26a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b58f75800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56193d23cf90 con 0x56193d26a3f0 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b57275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d26a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b57275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d26a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60708/0 (socket says 172.21.15.62:60708) 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b57275640 1 -- 172.21.15.62:0/1990429401 learned_addr learned my addr 172.21.15.62:0/1990429401 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.028+0000 7f9b57275640 1 -- 172.21.15.62:0/1990429401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193d26ade0 con 0x56193d26a3f0 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9b57275640 1 --2- 172.21.15.62:0/1990429401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d26a810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b5004d070 tx=0x7f9b50041420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c06cd2474f3553a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9a3a7fc640 1 -- 172.21.15.62:0/1990429401 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b50046070 con 0x56193d26a3f0 2024-04-26T07:54:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9a3a7fc640 1 -- 172.21.15.62:0/1990429401 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b5004e070 con 0x56193d26a3f0 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9a3a7fc640 1 -- 172.21.15.62:0/1990429401 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b50046210 con 0x56193d26a3f0 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9b58f75800 1 -- 172.21.15.62:0/1990429401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 msgr2=0x56193d26a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9b58f75800 1 --2- 172.21.15.62:0/1990429401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d26a810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b5004d070 tx=0x7f9b50041420 comp rx=0 tx=0).stop 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9b58f75800 1 -- 172.21.15.62:0/1990429401 shutdown_connections 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9b58f75800 1 --2- 172.21.15.62:0/1990429401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d26a810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9b58f75800 1 -- 172.21.15.62:0/1990429401 >> 172.21.15.62:0/1990429401 conn(0x56193d266750 msgr2=0x56193d2647b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9b58f75800 1 -- 172.21.15.62:0/1990429401 shutdown_connections 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.029+0000 7f9b58f75800 1 -- 172.21.15.62:0/1990429401 wait complete. 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.030+0000 7f9b58f75800 1 Processor -- start 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.030+0000 7f9b58f75800 1 -- start start 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.030+0000 7f9b58f75800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d2719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.030+0000 7f9b58f75800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56193d26b550 con 0x56193d26a3f0 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.030+0000 7f9b57275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d2719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.030+0000 7f9b57275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d2719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60718/0 (socket says 172.21.15.62:60718) 2024-04-26T07:54:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.030+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 learned_addr learned my addr 172.21.15.62:0/3253420896 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.030+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193d271f30 con 0x56193d26a3f0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.031+0000 7f9b57275640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d2719f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b50041460 tx=0x7f9b5004cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.031+0000 7f9a38ff9640 1 -- 172.21.15.62:0/3253420896 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b50046070 con 0x56193d26a3f0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.031+0000 7f9a38ff9640 1 -- 172.21.15.62:0/3253420896 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b50022dc0 con 0x56193d26a3f0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.031+0000 7f9a38ff9640 1 -- 172.21.15.62:0/3253420896 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b500134e0 con 0x56193d26a3f0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.031+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56193d2721c0 con 0x56193d26a3f0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.031+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193d274e70 con 0x56193d26a3f0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.031+0000 7f9a38ff9640 1 -- 172.21.15.62:0/3253420896 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9b50013680 con 0x56193d26a3f0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.032+0000 7f9a38ff9640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a20036eb0 0x7f9a20039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.032+0000 7f9a38ff9640 1 -- 172.21.15.62:0/3253420896 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9b5000e040 con 0x56193d26a3f0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.032+0000 7f9b56a74640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a20036eb0 0x7f9a20039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.032+0000 7f9b56a74640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a20036eb0 0x7f9a20039370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001400 tx=0x7f9b48035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.032+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.032+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d27d490 0x56193d27f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.032+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d2800a0 con 0x56193d27d490 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.032+0000 7f9b56273640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d27d490 0x56193d27f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b56273640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d27d490 0x56193d27f950 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 20 realm 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d280470 con 0x56193d27d490 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d280d40 con 0x56193d27d490 2024-04-26T07:54:34.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.033+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d2810e0 con 0x56193d27d490 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.034+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.034+0000 7f9b58f75800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.034+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.034+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d281e40 0x56193d284230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.034+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d284840 con 0x56193d281e40 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.034+0000 7f9b57275640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d281e40 0x56193d284230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.034+0000 7f9b57275640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d281e40 0x56193d284230 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.035+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.035+0000 7f9b58f75800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.035+0000 7f9b58f75800 20 searching for the correct realm 2024-04-26T07:54:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.035+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56193d2867b0 0x56193d288c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.035+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.035+0000 7f9b56a74640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56193d2867b0 0x56193d288c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.035+0000 7f9b56a74640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56193d2867b0 0x56193d288c70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.036+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.036+0000 7f9b56a74640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9b48017050 0x7f9b4804b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.036+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x7f9b48017050 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.036+0000 7f9b56273640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9b48017050 0x7f9b4804b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.036+0000 7f9b56273640 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9b48017050 0x7f9b4804b820 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.036+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.036+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.037+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.037+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d27d490 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.037+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.037+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d27d490 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.038+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.038+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.038+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.038+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.038+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.038+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x7f9b48017050 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.038+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.038+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.039+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.039+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d27d490 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.039+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.039+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.039+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.039+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d27d490 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.039+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.040+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x7f9b48017050 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.040+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.040+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.040+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.040+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.040+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.040+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d27d490 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d27d490 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.041+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.042+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.042+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.042+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.042+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x7f9b48017050 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.042+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.042+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d27d490 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.042+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.042+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.043+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.043+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.043+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.043+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.043+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.043+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x7f9b48017050 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.044+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.044+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d2867b0 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.044+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.044+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d281e40 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.044+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.044+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x56193d27d490 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.044+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.044+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56193d289340 con 0x7f9b48017050 2024-04-26T07:54:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d285d20 con 0x56193d27d490 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d285590 con 0x56193d27d490 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d284cd0 con 0x56193d27d490 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 zone default found 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 4 Realm: () 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 zonegroup default 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.045+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d289c70 con 0x56193d281e40 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d28bf20 con 0x56193d2867b0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d28c2c0 con 0x56193d2867b0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 20 started sync module instance, tier type = 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.046+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28b3b0 con 0x7f9b48017050 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.047+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.047+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94666400250032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28b3b0 con 0x7f9b48017050 2024-04-26T07:54:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.047+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28cc80 con 0x56193d27d490 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.048+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94666400250032] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.048+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.048+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94666400254384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28b3b0 con 0x56193d27d490 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.048+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28d6f0 con 0x56193d2867b0 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.050+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94666400254384] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.050+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.050+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94666400247552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28b320 con 0x56193d2867b0 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.050+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28e4b0 con 0x7f9b48017050 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.051+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94666400247552] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.051+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.051+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94666400258784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28e8a0 con 0x7f9b48017050 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.051+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28f2a0 con 0x56193d27d490 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.052+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.052+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94666400263600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28f1d0 con 0x56193d27d490 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.052+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94666400258784] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.052+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d2901d0 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.055+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94666400263600] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.055+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.055+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94666400265872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28f1d0 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.055+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d290aa0 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.056+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.056+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94666400269808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d290ec0 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.056+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d291710 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.056+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94666400265872] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94666400272064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d291790 con 0x56193d281e40 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b58f75800 20 add_watcher() i=0 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b58f75800 20 add_watcher() i=1 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b58f75800 20 add_watcher() i=2 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94666400269808] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b58f75800 20 add_watcher() i=3 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b58f75800 20 add_watcher() i=4 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b58f75800 20 add_watcher() i=5 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.057+0000 7f9b58f75800 20 add_watcher() i=6 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.058+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94666400272064] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.058+0000 7f9b58f75800 20 add_watcher() i=7 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.058+0000 7f9b58f75800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.058+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d2947c0 con 0x56193d27d490 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.058+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.058+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94666400273120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d291bb0 con 0x56193d27d490 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.059+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94666400273120] v27'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.059+0000 7f9a0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.059+0000 7f9b58f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.059+0000 7f9b58f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9b58f75800 5 note: GC not initialized 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9987fff640 20 reqs_thread_entry: start 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9b58f75800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9b58f75800 20 Filter name: none 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9985ffb640 20 reqs_thread_entry: start 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9b58f75800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d2c7cd0 con 0x56193d281e40 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.060+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d2c6310 con 0x56193d27d490 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 20 rados_obj.operate() r=0 bl.length=7 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56193d2c6700 con 0x56193d27d490 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.061+0000 7f9b58f75800 20 get_user_info_from_index found 0 xattrs 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.063+0000 7f9a0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.063+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94666400273120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d27a850 con 0x56193d27d490 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.064+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94666400273120] v27'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.064+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94666400250032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d2912e0 con 0x7f9b48017050 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.065+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94666400250032] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.065+0000 7f9b58f75800 20 remove_watcher() i=0 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.065+0000 7f9b58f75800 2 removed watcher, disabling cache 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.065+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94666400254384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d2912e0 con 0x56193d27d490 2024-04-26T07:54:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.066+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94666400254384] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.066+0000 7f9b58f75800 20 remove_watcher() i=1 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.066+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94666400247552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28c9b0 con 0x56193d2867b0 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.067+0000 7f9b56a74640 1 -- 172.21.15.62:0/3253420896 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94666400247552] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b48024980 con 0x56193d2867b0 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.067+0000 7f9b58f75800 20 remove_watcher() i=2 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.067+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94666400258784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d2912e0 con 0x7f9b48017050 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.068+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94666400258784] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x7f9b48017050 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.068+0000 7f9b58f75800 20 remove_watcher() i=3 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.068+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94666400263600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28af00 con 0x56193d27d490 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.069+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94666400263600] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4c05a040 con 0x56193d27d490 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.069+0000 7f9b58f75800 20 remove_watcher() i=4 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.069+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94666400265872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28dae0 con 0x56193d281e40 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.070+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94666400265872] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.070+0000 7f9b58f75800 20 remove_watcher() i=5 2024-04-26T07:54:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.070+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94666400269808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d2912e0 con 0x56193d281e40 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.071+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94666400269808] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.071+0000 7f9b58f75800 20 remove_watcher() i=6 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.071+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94666400272064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56193d28edb0 con 0x56193d281e40 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b57275640 1 -- 172.21.15.62:0/3253420896 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94666400272064] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x56193d281e40 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 20 remove_watcher() i=7 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d281e40 msgr2=0x56193d284230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d281e40 0x56193d284230 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d27d490 msgr2=0x56193d27f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d27d490 0x56193d27f950 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9b48017050 msgr2=0x7f9b4804b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9b48017050 0x7f9b4804b820 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56193d2867b0 msgr2=0x56193d288c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56193d2867b0 0x56193d288c70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a20036eb0 msgr2=0x7f9a20039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a20036eb0 0x7f9a20039370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001400 tx=0x7f9b48035000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 msgr2=0x56193d2719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b56273640 1 -- 172.21.15.62:0/3253420896 reap_dead start 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d2719f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b50041460 tx=0x7f9b5004cfd0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 shutdown_connections 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 --2- 172.21.15.62:0/3253420896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d26a3f0 0x56193d2719f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 >> 172.21.15.62:0/3253420896 conn(0x56193d266750 msgr2=0x56193d263db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 shutdown_connections 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.072+0000 7f9b58f75800 1 -- 172.21.15.62:0/3253420896 wait complete. 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/4086709857 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a30036eb0 msgr2=0x7f9a30039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/4086709857 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a30036eb0 0x7f9a30039370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x56193d249620 tx=0x7f9b48024c50 comp rx=0 tx=0).stop 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/4086709857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d25d170 msgr2=0x56193d25d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/4086709857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d25d170 0x56193d25d590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x56193d249560 tx=0x7f9b50018830 comp rx=0 tx=0).stop 2024-04-26T07:54:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/4086709857 shutdown_connections 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/4086709857 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a30036eb0 0x7f9a30039370 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/4086709857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d25d170 0x56193d25d590 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/4086709857 >> 172.21.15.62:0/4086709857 conn(0x56193d251210 msgr2=0x56193d251610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/4086709857 shutdown_connections 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/4086709857 wait complete. 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d24b500 msgr2=0x56193d24d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d24b500 0x56193d24d8f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d14aca0 msgr2=0x56193d248c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d14aca0 0x56193d248c20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a3c036e60 msgr2=0x7f9a3c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a3c036e60 0x7f9a3c039320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c054000 tx=0x7f9b4c04e000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 msgr2=0x56193d2419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d2419e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001de0 tx=0x7f9b48000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 shutdown_connections 2024-04-26T07:54:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56193d14aca0 0x56193d248c20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56193d24b500 0x56193d24d8f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9a3c036e60 0x7f9a3c039320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 --2- 172.21.15.62:0/2780130409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56193d147190 0x56193d2419e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 >> 172.21.15.62:0/2780130409 conn(0x56193d140ba0 msgr2=0x56193d145090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 shutdown_connections 2024-04-26T07:54:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.073+0000 7f9b58f75800 1 -- 172.21.15.62:0/2780130409 wait complete. 2024-04-26T07:54:34.085 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-04-26T07:54:34.085 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:54:34.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:54:34.085 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:54:34.129 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:34.129 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:34.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f678d328800 1 Processor -- start 2024-04-26T07:54:34.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f678d328800 1 -- start start 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f678d328800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5597edfba110 0x5597edfbc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f678d328800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5597edfc0550 con 0x5597edfbca40 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f678d328800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5597ede5be20 con 0x5597edfba110 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f6789028640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5597edfba110 0x5597edfbc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f6789028640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5597edfba110 0x5597edfbc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60720/0 (socket says 172.21.15.62:60720) 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f6789028640 1 -- 172.21.15.62:0/1228489168 learned_addr learned my addr 172.21.15.62:0/1228489168 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.132+0000 7f6788827640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5597edfbca40 0x5597edfbee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36464/0 (socket says 172.21.15.62:36464) 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.133+0000 7f6789028640 1 -- 172.21.15.62:0/1228489168 >> v1:172.21.15.1:6789/0 conn(0x5597edfbca40 legacy=0x5597edfbee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.133+0000 7f6789028640 1 -- 172.21.15.62:0/1228489168 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597edfc1730 con 0x5597edfba110 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f6789028640 1 --2- 172.21.15.62:0/1228489168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfbc500 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f677c005fd0 tx=0x7f677c01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4edf66772070f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f6783fff640 1 -- 172.21.15.62:0/1228489168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f677c052540 con 0x5597edfba110 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f6783fff640 1 -- 172.21.15.62:0/1228489168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c04e070 con 0x5597edfba110 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f6783fff640 1 -- 172.21.15.62:0/1228489168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f677c052890 con 0x5597edfba110 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f678d328800 1 -- 172.21.15.62:0/1228489168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 msgr2=0x5597edfbc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f678d328800 1 --2- 172.21.15.62:0/1228489168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfbc500 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f677c005fd0 tx=0x7f677c01cd80 comp rx=0 tx=0).stop 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f678d328800 1 -- 172.21.15.62:0/1228489168 shutdown_connections 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f678d328800 1 --2- 172.21.15.62:0/1228489168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfbc500 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f678d328800 1 -- 172.21.15.62:0/1228489168 >> 172.21.15.62:0/1228489168 conn(0x5597edfb3ba0 msgr2=0x5597edfb5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f678d328800 1 -- 172.21.15.62:0/1228489168 shutdown_connections 2024-04-26T07:54:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.135+0000 7f678d328800 1 -- 172.21.15.62:0/1228489168 wait complete. 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.148+0000 7f678d328800 1 Processor -- start 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.148+0000 7f678d328800 1 -- start start 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.148+0000 7f678d328800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfb9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.148+0000 7f678d328800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597edf04cd0 con 0x5597edfba110 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.148+0000 7f6789028640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfb9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.148+0000 7f6789028640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfb9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60730/0 (socket says 172.21.15.62:60730) 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.148+0000 7f6789028640 1 -- 172.21.15.62:0/93834474 learned_addr learned my addr 172.21.15.62:0/93834474 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.149+0000 7f6789028640 1 -- 172.21.15.62:0/93834474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597edfb8010 con 0x5597edfba110 2024-04-26T07:54:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.149+0000 7f6789028640 1 --2- 172.21.15.62:0/93834474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfb9a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f677c01ba70 tx=0x7f677c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaf806bed742d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.149+0000 7f6677606640 1 -- 172.21.15.62:0/93834474 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f677c052820 con 0x5597edfba110 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.149+0000 7f6677606640 1 -- 172.21.15.62:0/93834474 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c062070 con 0x5597edfba110 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.149+0000 7f6677606640 1 -- 172.21.15.62:0/93834474 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f677c052b10 con 0x5597edfba110 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 -- 172.21.15.62:0/93834474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 msgr2=0x5597edfb9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 --2- 172.21.15.62:0/93834474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfb9a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f677c01ba70 tx=0x7f677c04c000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 -- 172.21.15.62:0/93834474 shutdown_connections 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 --2- 172.21.15.62:0/93834474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597edfb9a50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 -- 172.21.15.62:0/93834474 >> 172.21.15.62:0/93834474 conn(0x5597edfb3ba0 msgr2=0x5597ee0a6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 -- 172.21.15.62:0/93834474 shutdown_connections 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 -- 172.21.15.62:0/93834474 wait complete. 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 Processor -- start 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 -- start start 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597ee0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.150+0000 7f678d328800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597edfc09c0 con 0x5597edfba110 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f6789028640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597ee0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f6789028640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597ee0b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60734/0 (socket says 172.21.15.62:60734) 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f6789028640 1 -- 172.21.15.62:0/3110760685 learned_addr learned my addr 172.21.15.62:0/3110760685 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f6789028640 1 -- 172.21.15.62:0/3110760685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee0b4e20 con 0x5597edfba110 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f6789028640 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597ee0b48e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f677c00a190 tx=0x7f677c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f6675e03640 1 -- 172.21.15.62:0/3110760685 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f677c071570 con 0x5597edfba110 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f6675e03640 1 -- 172.21.15.62:0/3110760685 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c058040 con 0x5597edfba110 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597ee0b50b0 con 0x5597edfba110 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f6675e03640 1 -- 172.21.15.62:0/3110760685 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f677c071880 con 0x5597edfba110 2024-04-26T07:54:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.151+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ee0b7d60 con 0x5597edfba110 2024-04-26T07:54:34.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.152+0000 7f6675e03640 1 -- 172.21.15.62:0/3110760685 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f677c050070 con 0x5597edfba110 2024-04-26T07:54:34.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.152+0000 7f6675e03640 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6670036e60 0x7f6670039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.152+0000 7f6675e03640 1 -- 172.21.15.62:0/3110760685 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f677c08ebf0 con 0x5597edfba110 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.152+0000 7f6788827640 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6670036e60 0x7f6670039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.152+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597edfbca40 0x5597ee0bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.152+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0bc0f0 con 0x5597edfbca40 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.153+0000 7f6789829640 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597edfbca40 0x5597ee0bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.153+0000 7f6788827640 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6670036e60 0x7f6670039320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6774000f60 tx=0x7f6774001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.153+0000 7f6789829640 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597edfbca40 0x5597ee0bbb20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.153+0000 7f6789829640 1 -- 172.21.15.62:0/3110760685 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67840083e0 con 0x5597edfbca40 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.153+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0b90d0 con 0x5597edfbca40 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.153+0000 7f6789829640 1 -- 172.21.15.62:0/3110760685 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67840083e0 con 0x5597edfbca40 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.153+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0be450 0x5597ee0c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.153+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0c0f30 con 0x5597ee0be450 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.154+0000 7f6789028640 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0be450 0x5597ee0c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.154+0000 7f6789028640 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0be450 0x5597ee0c0840 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.154+0000 7f6789028640 1 -- 172.21.15.62:0/3110760685 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0be450 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.154+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0bd400 con 0x5597edfbca40 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.155+0000 7f6789829640 1 -- 172.21.15.62:0/3110760685 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67840083e0 con 0x5597edfbca40 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.155+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0bd8a0 con 0x5597edfbca40 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.155+0000 7f6789829640 1 -- 172.21.15.62:0/3110760685 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67840083e0 con 0x5597edfbca40 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.155+0000 7f678d328800 1 Processor -- start 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.155+0000 7f678d328800 1 -- start start 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.155+0000 7f678d328800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0d00d0 0x5597ee0d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.155+0000 7f678d328800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597edeac170 con 0x5597ee0d00d0 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f6789829640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0d00d0 0x5597ee0d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f6789829640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0d00d0 0x5597ee0d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60738/0 (socket says 172.21.15.62:60738) 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f6789829640 1 -- 172.21.15.62:0/1371481806 learned_addr learned my addr 172.21.15.62:0/1371481806 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f6789829640 1 -- 172.21.15.62:0/1371481806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee0d0a30 con 0x5597ee0d00d0 2024-04-26T07:54:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f6789829640 1 --2- 172.21.15.62:0/1371481806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0d00d0 0x5597ee0d04f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5597ee0b57b0 tx=0x7f678400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f666effd640 1 -- 172.21.15.62:0/1371481806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6784007d00 con 0x5597ee0d00d0 2024-04-26T07:54:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f666effd640 1 -- 172.21.15.62:0/1371481806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678401e020 con 0x5597ee0d00d0 2024-04-26T07:54:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f678d328800 1 -- 172.21.15.62:0/1371481806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597ee0d14a0 con 0x5597ee0d00d0 2024-04-26T07:54:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f666effd640 1 -- 172.21.15.62:0/1371481806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6784019420 con 0x5597ee0d00d0 2024-04-26T07:54:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.156+0000 7f678d328800 1 -- 172.21.15.62:0/1371481806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ee0d19a0 con 0x5597ee0d00d0 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.157+0000 7f666effd640 1 -- 172.21.15.62:0/1371481806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6784016040 con 0x5597ee0d00d0 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.157+0000 7f666effd640 1 --2- 172.21.15.62:0/1371481806 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6660036e60 0x7f6660039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.157+0000 7f666effd640 1 -- 172.21.15.62:0/1371481806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f678401f030 con 0x5597ee0d00d0 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.157+0000 7f6789028640 1 --2- 172.21.15.62:0/1371481806 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6660036e60 0x7f6660039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f678d328800 1 Processor -- start 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f678d328800 1 -- start start 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f6789028640 1 --2- 172.21.15.62:0/1371481806 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6660036e60 0x7f6660039320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5597ee0bc5c0 tx=0x7f677c0514b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f678d328800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f678d328800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597edfb82d0 con 0x5597ee0dd4a0 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f6789829640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f6789829640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0dd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60742/0 (socket says 172.21.15.62:60742) 2024-04-26T07:54:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f6789829640 1 -- 172.21.15.62:0/1230886565 learned_addr learned my addr 172.21.15.62:0/1230886565 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f6789829640 1 -- 172.21.15.62:0/1230886565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee0dde90 con 0x5597ee0dd4a0 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.158+0000 7f6789829640 1 --2- 172.21.15.62:0/1230886565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0dd8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6784008a40 tx=0x7f678404d170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839404cc4740197a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f666cff9640 1 -- 172.21.15.62:0/1230886565 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678401d070 con 0x5597ee0dd4a0 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f666cff9640 1 -- 172.21.15.62:0/1230886565 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6784017cd0 con 0x5597ee0dd4a0 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f666cff9640 1 -- 172.21.15.62:0/1230886565 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67840183b0 con 0x5597ee0dd4a0 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 -- 172.21.15.62:0/1230886565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 msgr2=0x5597ee0dd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 --2- 172.21.15.62:0/1230886565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0dd8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6784008a40 tx=0x7f678404d170 comp rx=0 tx=0).stop 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 -- 172.21.15.62:0/1230886565 shutdown_connections 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 --2- 172.21.15.62:0/1230886565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0dd8c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 -- 172.21.15.62:0/1230886565 >> 172.21.15.62:0/1230886565 conn(0x5597ee0d97b0 msgr2=0x5597ee0d7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 -- 172.21.15.62:0/1230886565 shutdown_connections 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 -- 172.21.15.62:0/1230886565 wait complete. 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 Processor -- start 2024-04-26T07:54:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.159+0000 7f678d328800 1 -- start start 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.160+0000 7f678d328800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.160+0000 7f678d328800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597ee0de5e0 con 0x5597ee0dd4a0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.160+0000 7f6789829640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.160+0000 7f6789829640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0e49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60754/0 (socket says 172.21.15.62:60754) 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.160+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 learned_addr learned my addr 172.21.15.62:0/2192907367 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.160+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ee0e4f30 con 0x5597ee0dd4a0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.160+0000 7f6789829640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0e49f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6784014830 tx=0x7f678404ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.161+0000 7f665effd640 1 -- 172.21.15.62:0/2192907367 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6784019610 con 0x5597ee0dd4a0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.161+0000 7f665effd640 1 -- 172.21.15.62:0/2192907367 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67840197b0 con 0x5597ee0dd4a0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.161+0000 7f665effd640 1 -- 172.21.15.62:0/2192907367 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6784019ab0 con 0x5597ee0dd4a0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.161+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597ee0e51c0 con 0x5597ee0dd4a0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.161+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ee0e7e70 con 0x5597ee0dd4a0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.161+0000 7f665effd640 1 -- 172.21.15.62:0/2192907367 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f678404e350 con 0x5597ee0dd4a0 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f665effd640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6654036e60 0x7f6654039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f665effd640 1 -- 172.21.15.62:0/2192907367 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f6784039c60 con 0x5597ee0dd4a0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f6789028640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6654036e60 0x7f6654039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597ee0f04b0 0x5597ee0f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0f30c0 con 0x5597ee0f04b0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f6788827640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597ee0f04b0 0x5597ee0f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f6789028640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6654036e60 0x7f6654039320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f677c053fb0 tx=0x7f677c08f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.162+0000 7f6788827640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597ee0f04b0 0x5597ee0f2970 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f677400f610 con 0x5597ee0f04b0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 realm 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0ef940 con 0x5597ee0f04b0 2024-04-26T07:54:34.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f677400f610 con 0x5597ee0f04b0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0f3bc0 con 0x5597ee0f04b0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f677400f610 con 0x5597ee0f04b0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0f4490 con 0x5597ee0f04b0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f677400f610 con 0x5597ee0f04b0 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0f4d40 0x5597ee0f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0f7870 con 0x5597ee0f4d40 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.163+0000 7f6789829640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0f4d40 0x5597ee0f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.164+0000 7f6789829640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0f4d40 0x5597ee0f7130 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.164+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.164+0000 7f678d328800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.164+0000 7f678d328800 20 searching for the correct realm 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.164+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5597ee0f9920 0x5597ee0fbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.164+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.164+0000 7f6789028640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5597ee0f9920 0x5597ee0fbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.165+0000 7f6789028640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5597ee0f9920 0x5597ee0fbde0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.165+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.165+0000 7f6789028640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f677c052030 0x7f677c0657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.165+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x7f677c052030 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.165+0000 7f6788827640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f677c052030 0x7f677c0657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.165+0000 7f6788827640 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f677c052030 0x7f677c0657d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.166+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677400f610 con 0x7f677c052030 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.166+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.166+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.166+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.166+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677400f610 con 0x5597ee0f04b0 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.166+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.167+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.167+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.167+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.167+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.167+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.167+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x7f677c052030 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.168+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.168+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.168+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.168+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.168+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.168+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.168+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.168+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.169+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.169+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x7f677c052030 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.169+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.169+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.169+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.169+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.169+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.169+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.170+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.171+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.171+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.171+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.171+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.171+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x7f677c052030 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.171+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.171+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.171+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.172+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.172+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.172+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.172+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.172+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.173+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.173+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x7f677c052030 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.173+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.173+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f9920 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.173+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.173+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f4d40 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc4b0 con 0x7f677c052030 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0f8320 con 0x5597ee0f04b0 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.174+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0f8740 con 0x5597ee0f04b0 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0f8c20 con 0x5597ee0f04b0 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 20 zone default found 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 4 Realm: () 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 20 zonegroup default 2024-04-26T07:54:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fc930 con 0x5597ee0f4d40 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.175+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0f7f50 con 0x5597ee0f9920 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f678d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fec40 con 0x5597ee0f9920 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f678d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f678d328800 20 started sync module instance, tier type = 2024-04-26T07:54:34.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f678d328800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.176+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fdff0 con 0x7f677c052030 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.177+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.177+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94111022441744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fdff0 con 0x7f677c052030 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.177+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0ff740 con 0x5597ee0f04b0 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.178+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94111022441744] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.178+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.178+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94111022445072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fdff0 con 0x5597ee0f04b0 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.178+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee1001f0 con 0x5597ee0f9920 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.179+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94111022445072] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.179+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.179+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94111022439232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fdf60 con 0x5597ee0f9920 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.179+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee1010b0 con 0x7f677c052030 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.180+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94111022439232] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.180+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.180+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94111022451712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee101020 con 0x7f677c052030 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.180+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee101f70 con 0x5597ee0f04b0 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.181+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.181+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94111022455488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee102390 con 0x5597ee0f04b0 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.181+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee102dd0 con 0x5597ee0f4d40 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.181+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94111022451712] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.182+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94111022455488] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.182+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.182+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94111022459040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee101ee0 con 0x5597ee0f4d40 2024-04-26T07:54:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.182+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee103670 con 0x5597ee0f4d40 2024-04-26T07:54:34.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.183+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.183+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94111022461376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee103a90 con 0x5597ee0f4d40 2024-04-26T07:54:34.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.183+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee1042e0 con 0x5597ee0f4d40 2024-04-26T07:54:34.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94111022459040] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94111022463632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee104360 con 0x5597ee0f4d40 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f678d328800 20 add_watcher() i=0 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f678d328800 20 add_watcher() i=1 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f678d328800 20 add_watcher() i=2 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f678d328800 20 add_watcher() i=3 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f678d328800 20 add_watcher() i=4 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f678d328800 20 add_watcher() i=5 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94111022461376] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.184+0000 7f678d328800 20 add_watcher() i=6 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.185+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94111022463632] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.185+0000 7f678d328800 20 add_watcher() i=7 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.185+0000 7f678d328800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:34.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.185+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee107390 con 0x5597ee0f04b0 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.186+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.186+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94111022464688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee104850 con 0x5597ee0f04b0 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94111022464688] v27'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f663f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f678d328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f678d328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f678d328800 5 note: GC not initialized 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f663e7e4640 20 reqs_thread_entry: start 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f678d328800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f678d328800 20 Filter name: none 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f65affff640 20 reqs_thread_entry: start 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f678d328800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.187+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597ee13a4b0 con 0x5597ee0f04b0 2024-04-26T07:54:34.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.188+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.188+0000 7f678d328800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:34.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.188+0000 7f663f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.189+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94111022464688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee1392e0 con 0x5597ee0f04b0 2024-04-26T07:54:34.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.189+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94111022464688] v27'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.189+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94111022441744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee103eb0 con 0x7f677c052030 2024-04-26T07:54:34.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.190+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94111022441744] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.190+0000 7f678d328800 20 remove_watcher() i=0 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.190+0000 7f678d328800 2 removed watcher, disabling cache 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.190+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94111022445072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee103eb0 con 0x5597ee0f04b0 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.192+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94111022445072] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.192+0000 7f678d328800 20 remove_watcher() i=1 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.192+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94111022439232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0ff210 con 0x5597ee0f9920 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.193+0000 7f6789028640 1 -- 172.21.15.62:0/2192907367 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94111022439232] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677c077020 con 0x5597ee0f9920 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.193+0000 7f678d328800 20 remove_watcher() i=2 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.193+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94111022451712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee103eb0 con 0x7f677c052030 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.194+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94111022451712] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x7f677c052030 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.194+0000 7f678d328800 20 remove_watcher() i=3 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.194+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94111022455488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fdb40 con 0x5597ee0f04b0 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.195+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94111022455488] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f677402b040 con 0x5597ee0f04b0 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.195+0000 7f678d328800 20 remove_watcher() i=4 2024-04-26T07:54:34.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.195+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94111022459040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee100c00 con 0x5597ee0f4d40 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.196+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94111022459040] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.196+0000 7f678d328800 20 remove_watcher() i=5 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.196+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94111022461376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee103eb0 con 0x5597ee0f4d40 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.197+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94111022461376] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.197+0000 7f678d328800 20 remove_watcher() i=6 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.197+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94111022463632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597ee0fdb40 con 0x5597ee0f4d40 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f6789829640 1 -- 172.21.15.62:0/2192907367 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94111022463632] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6784035020 con 0x5597ee0f4d40 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 20 remove_watcher() i=7 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0f4d40 msgr2=0x5597ee0f7130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0f4d40 0x5597ee0f7130 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597ee0f04b0 msgr2=0x5597ee0f2970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597ee0f04b0 0x5597ee0f2970 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f677c052030 msgr2=0x7f677c0657d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f677c052030 0x7f677c0657d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5597ee0f9920 msgr2=0x5597ee0fbde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5597ee0f9920 0x5597ee0fbde0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6654036e60 msgr2=0x7f6654039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6654036e60 0x7f6654039320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f677c053fb0 tx=0x7f677c08f000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 msgr2=0x5597ee0e49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f6788827640 1 -- 172.21.15.62:0/2192907367 reap_dead start 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0e49f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6784014830 tx=0x7f678404ce30 comp rx=0 tx=0).stop 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 shutdown_connections 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/2192907367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0dd4a0 0x5597ee0e49f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 >> 172.21.15.62:0/2192907367 conn(0x5597ee0d97b0 msgr2=0x5597ee0d6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 shutdown_connections 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/2192907367 wait complete. 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/1371481806 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6660036e60 msgr2=0x7f6660039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/1371481806 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6660036e60 0x7f6660039320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5597ee0bc5c0 tx=0x7f677c0514b0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 -- 172.21.15.62:0/1371481806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0d00d0 msgr2=0x5597ee0d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.198+0000 7f678d328800 1 --2- 172.21.15.62:0/1371481806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0d00d0 0x5597ee0d04f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5597ee0b57b0 tx=0x7f678400aea0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/1371481806 shutdown_connections 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/1371481806 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6660036e60 0x7f6660039320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/1371481806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597ee0d00d0 0x5597ee0d04f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/1371481806 >> 172.21.15.62:0/1371481806 conn(0x5597ee0c4170 msgr2=0x5597ee0c4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/1371481806 shutdown_connections 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/1371481806 wait complete. 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0be450 msgr2=0x5597ee0c0840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0be450 0x5597ee0c0840 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597edfbca40 msgr2=0x5597ee0bbb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597edfbca40 0x5597ee0bbb20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6670036e60 msgr2=0x7f6670039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6670036e60 0x7f6670039320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6774000f60 tx=0x7f6774001370 comp rx=0 tx=0).stop 2024-04-26T07:54:34.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 msgr2=0x5597ee0b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597ee0b48e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f677c00a190 tx=0x7f677c003330 comp rx=0 tx=0).stop 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 shutdown_connections 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5597edfbca40 0x5597ee0bbb20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5597ee0be450 0x5597ee0c0840 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6670036e60 0x7f6670039320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 --2- 172.21.15.62:0/3110760685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597edfba110 0x5597ee0b48e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 >> 172.21.15.62:0/3110760685 conn(0x5597edfb3ba0 msgr2=0x5597edfb8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 shutdown_connections 2024-04-26T07:54:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.199+0000 7f678d328800 1 -- 172.21.15.62:0/3110760685 wait complete. 2024-04-26T07:54:34.206 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:34.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-26T07:54:34.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-26T07:54:34.206 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-26T07:54:34.250 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:34.250 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a7ab2e800 1 Processor -- start 2024-04-26T07:54:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a7ab2e800 1 -- start start 2024-04-26T07:54:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a7ab2e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564731956170 0x564731958560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a7ab2e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56473195c5b0 con 0x564731958aa0 2024-04-26T07:54:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a7ab2e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5647317f7e20 con 0x564731956170 2024-04-26T07:54:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a76867640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564731956170 0x564731958560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a76867640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564731956170 0x564731958560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60764/0 (socket says 172.21.15.62:60764) 2024-04-26T07:54:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a76867640 1 -- 172.21.15.62:0/2243594509 learned_addr learned my addr 172.21.15.62:0/2243594509 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.253+0000 7f2a76066640 1 --1- 172.21.15.62:0/2243594509 >> v1:172.21.15.1:6789/0 conn(0x564731958aa0 0x56473195ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36480/0 (socket says 172.21.15.62:36480) 2024-04-26T07:54:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.254+0000 7f2a76867640 1 -- 172.21.15.62:0/2243594509 >> v1:172.21.15.1:6789/0 conn(0x564731958aa0 legacy=0x56473195ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.254+0000 7f2a76867640 1 -- 172.21.15.62:0/2243594509 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473195d790 con 0x564731956170 2024-04-26T07:54:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.255+0000 7f2a76867640 1 --2- 172.21.15.62:0/2243594509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731958560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800a520 tx=0x7f2a6801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7228c5f6dd185bbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a75865640 1 -- 172.21.15.62:0/2243594509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a68057070 con 0x564731956170 2024-04-26T07:54:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a75865640 1 -- 172.21.15.62:0/2243594509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a68052570 con 0x564731956170 2024-04-26T07:54:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a75865640 1 -- 172.21.15.62:0/2243594509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a6804ae60 con 0x564731956170 2024-04-26T07:54:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2243594509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 msgr2=0x564731958560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2243594509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731958560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800a520 tx=0x7f2a6801d010 comp rx=0 tx=0).stop 2024-04-26T07:54:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2243594509 shutdown_connections 2024-04-26T07:54:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2243594509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731958560 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2243594509 >> 172.21.15.62:0/2243594509 conn(0x56473194fb80 msgr2=0x564731951fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2243594509 shutdown_connections 2024-04-26T07:54:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.256+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2243594509 wait complete. 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.269+0000 7f2a7ab2e800 1 Processor -- start 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.269+0000 7f2a7ab2e800 1 -- start start 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.269+0000 7f2a7ab2e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a46bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.269+0000 7f2a7ab2e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5647318a0cd0 con 0x564731956170 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.270+0000 7f2a76867640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a46bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.270+0000 7f2a76867640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a46bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60774/0 (socket says 172.21.15.62:60774) 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.270+0000 7f2a76867640 1 -- 172.21.15.62:0/1724665165 learned_addr learned my addr 172.21.15.62:0/1724665165 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.270+0000 7f2a76867640 1 -- 172.21.15.62:0/1724665165 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564731a471c0 con 0x564731956170 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.270+0000 7f2a76867640 1 --2- 172.21.15.62:0/1724665165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a46bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a6801d050 tx=0x7f2a6804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f492a429bc6f286 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.270+0000 7f2964e09640 1 -- 172.21.15.62:0/1724665165 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a68057040 con 0x564731956170 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.270+0000 7f2964e09640 1 -- 172.21.15.62:0/1724665165 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a68052720 con 0x564731956170 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.270+0000 7f2964e09640 1 -- 172.21.15.62:0/1724665165 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a68052a40 con 0x564731956170 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1724665165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 msgr2=0x564731a46bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1724665165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a46bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a6801d050 tx=0x7f2a6804c000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1724665165 shutdown_connections 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1724665165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a46bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1724665165 >> 172.21.15.62:0/1724665165 conn(0x56473194fb80 msgr2=0x564731a42510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1724665165 shutdown_connections 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1724665165 wait complete. 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 Processor -- start 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.271+0000 7f2a7ab2e800 1 -- start start 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2a7ab2e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a4e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2a7ab2e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56473195ca20 con 0x564731956170 2024-04-26T07:54:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2a76867640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a4e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2a76867640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a4e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60786/0 (socket says 172.21.15.62:60786) 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2a76867640 1 -- 172.21.15.62:0/2983150899 learned_addr learned my addr 172.21.15.62:0/2983150899 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2a76867640 1 -- 172.21.15.62:0/2983150899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564731a4eb30 con 0x564731956170 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2a76867640 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a4e5f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a68005930 tx=0x7f2a68003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2963606640 1 -- 172.21.15.62:0/2983150899 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a68073070 con 0x564731956170 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2963606640 1 -- 172.21.15.62:0/2983150899 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6805d570 con 0x564731956170 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564731a4edc0 con 0x564731956170 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.272+0000 7f2963606640 1 -- 172.21.15.62:0/2983150899 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a68057070 con 0x564731956170 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.273+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564731a51a20 con 0x564731956170 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.273+0000 7f2963606640 1 -- 172.21.15.62:0/2983150899 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2a68076070 con 0x564731956170 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.273+0000 7f2963606640 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f295c036e60 0x7f295c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.273+0000 7f2963606640 1 -- 172.21.15.62:0/2983150899 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2a6808e5b0 con 0x564731956170 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.274+0000 7f2a76066640 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f295c036e60 0x7f295c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.274+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731958aa0 0x564731a557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.274+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a55db0 con 0x564731958aa0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.274+0000 7f2a77068640 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731958aa0 0x564731a557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.274+0000 7f2a76066640 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f295c036e60 0x7f295c039320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c000f60 tx=0x7f2a6c001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.274+0000 7f2a77068640 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731958aa0 0x564731a557e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.274+0000 7f2a77068640 1 -- 172.21.15.62:0/2983150899 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a7000a4a0 con 0x564731958aa0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.274+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a52d90 con 0x564731958aa0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.275+0000 7f2a77068640 1 -- 172.21.15.62:0/2983150899 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a7000a4a0 con 0x564731958aa0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.275+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a580c0 0x564731a5a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.275+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a5ab50 con 0x564731a580c0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.275+0000 7f2a76867640 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a580c0 0x564731a5a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.275+0000 7f2a76867640 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a580c0 0x564731a5a4b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.276+0000 7f2a76867640 1 -- 172.21.15.62:0/2983150899 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a580c0 2024-04-26T07:54:34.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.276+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a57070 con 0x564731958aa0 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.276+0000 7f2a77068640 1 -- 172.21.15.62:0/2983150899 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a7000a4a0 con 0x564731958aa0 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.276+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a57550 con 0x564731958aa0 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.276+0000 7f2a77068640 1 -- 172.21.15.62:0/2983150899 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a7000a4a0 con 0x564731958aa0 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.276+0000 7f2a7ab2e800 1 Processor -- start 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a7ab2e800 1 -- start start 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a7ab2e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a69d00 0x564731a6a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a7ab2e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564731848170 con 0x564731a69d00 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a77068640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a69d00 0x564731a6a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a77068640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a69d00 0x564731a6a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60796/0 (socket says 172.21.15.62:60796) 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a77068640 1 -- 172.21.15.62:0/2274754346 learned_addr learned my addr 172.21.15.62:0/2274754346 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a77068640 1 -- 172.21.15.62:0/2274754346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564731a6a660 con 0x564731a69d00 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a77068640 1 --2- 172.21.15.62:0/2274754346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a69d00 0x564731a6a120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564731a4f470 tx=0x7f2a700188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2960e01640 1 -- 172.21.15.62:0/2274754346 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a70014450 con 0x564731a69d00 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2960e01640 1 -- 172.21.15.62:0/2274754346 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a700145f0 con 0x564731a69d00 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2274754346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564731a6b0d0 con 0x564731a69d00 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.277+0000 7f2960e01640 1 -- 172.21.15.62:0/2274754346 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a700148d0 con 0x564731a69d00 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.278+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2274754346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564731a6b5d0 con 0x564731a69d00 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.278+0000 7f2960e01640 1 -- 172.21.15.62:0/2274754346 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2a70011040 con 0x564731a69d00 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.278+0000 7f2960e01640 1 --2- 172.21.15.62:0/2274754346 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2950036eb0 0x7f2950039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2960e01640 1 -- 172.21.15.62:0/2274754346 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2a7001e070 con 0x564731a69d00 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a76867640 1 --2- 172.21.15.62:0/2274754346 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2950036eb0 0x7f2950039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a7ab2e800 1 Processor -- start 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a7ab2e800 1 -- start start 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a76867640 1 --2- 172.21.15.62:0/2274754346 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2950036eb0 0x7f2950039370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x564731a56200 tx=0x7f2a6801d010 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a7ab2e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a77450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a7ab2e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564731a47480 con 0x564731a77030 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a77068640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a77450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a77068640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a77450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60804/0 (socket says 172.21.15.62:60804) 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a77068640 1 -- 172.21.15.62:0/4177730986 learned_addr learned my addr 172.21.15.62:0/4177730986 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.279+0000 7f2a77068640 1 -- 172.21.15.62:0/4177730986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564731a77a20 con 0x564731a77030 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a77068640 1 --2- 172.21.15.62:0/4177730986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a77450 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a7004cf00 tx=0x7f2a70011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15ef22ddb624e6d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f295a7fc640 1 -- 172.21.15.62:0/4177730986 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a700411b0 con 0x564731a77030 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f295a7fc640 1 -- 172.21.15.62:0/4177730986 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a70013c90 con 0x564731a77030 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f295a7fc640 1 -- 172.21.15.62:0/4177730986 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a7002ba60 con 0x564731a77030 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/4177730986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 msgr2=0x564731a77450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/4177730986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a77450 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a7004cf00 tx=0x7f2a70011700 comp rx=0 tx=0).stop 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/4177730986 shutdown_connections 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/4177730986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a77450 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/4177730986 >> 172.21.15.62:0/4177730986 conn(0x564731a73340 msgr2=0x564731a713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/4177730986 shutdown_connections 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/4177730986 wait complete. 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.280+0000 7f2a7ab2e800 1 Processor -- start 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2a7ab2e800 1 -- start start 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2a7ab2e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a7e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2a7ab2e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564731a78170 con 0x564731a77030 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2a77068640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a7e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2a77068640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a7e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60818/0 (socket says 172.21.15.62:60818) 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 learned_addr learned my addr 172.21.15.62:0/1155694126 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564731a7eb40 con 0x564731a77030 2024-04-26T07:54:34.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2a77068640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a7e600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a70048010 tx=0x7f2a7004ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2958ff9640 1 -- 172.21.15.62:0/1155694126 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a7002b560 con 0x564731a77030 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.281+0000 7f2958ff9640 1 -- 172.21.15.62:0/1155694126 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7002b700 con 0x564731a77030 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.282+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564731a7edd0 con 0x564731a77030 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.282+0000 7f2958ff9640 1 -- 172.21.15.62:0/1155694126 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a7004e470 con 0x564731a77030 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.282+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564731a81a80 con 0x564731a77030 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.282+0000 7f2958ff9640 1 -- 172.21.15.62:0/1155694126 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2a7004ebe0 con 0x564731a77030 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.282+0000 7f2958ff9640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2940036eb0 0x7f2940039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.282+0000 7f2958ff9640 1 -- 172.21.15.62:0/1155694126 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2a7000e040 con 0x564731a77030 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.283+0000 7f2a76867640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2940036eb0 0x7f2940039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.283+0000 7f2a76867640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2940036eb0 0x7f2940039370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a680803f0 tx=0x7f2a6808a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.283+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.283+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731a8a2f0 0x564731a8c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.283+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a8cf00 con 0x564731a8a2f0 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.283+0000 7f2a76066640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731a8a2f0 0x564731a8c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.283+0000 7f2a76066640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731a8a2f0 0x564731a8c7b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 realm 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a89740 con 0x564731a8a2f0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a8d9f0 con 0x564731a8a2f0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a8e2c0 con 0x564731a8a2f0 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.284+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.285+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a8ece0 0x564731a910d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.285+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a917c0 con 0x564731a8ece0 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.285+0000 7f2a77068640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a8ece0 0x564731a910d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.285+0000 7f2a77068640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a8ece0 0x564731a910d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.285+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.286+0000 7f2a7ab2e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.286+0000 7f2a7ab2e800 20 searching for the correct realm 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.286+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564731a93770 0x564731a95c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.286+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.286+0000 7f2a76867640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564731a93770 0x564731a95c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.286+0000 7f2a76867640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564731a93770 0x564731a95c30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.287+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.287+0000 7f2a76867640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2a6809d040 0x7f2a6808f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.287+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x7f2a6809d040 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.287+0000 7f2a76066640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2a6809d040 0x7f2a6808f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.287+0000 7f2a76066640 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2a6809d040 0x7f2a6808f960 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.287+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.287+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8a2f0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8a2f0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.288+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.289+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x7f2a6809d040 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.289+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.289+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.289+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.289+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8a2f0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.289+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.289+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8a2f0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x7f2a6809d040 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.290+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.291+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.291+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.291+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.291+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.291+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.291+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8a2f0 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.292+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.292+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8a2f0 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.292+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.292+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.292+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.292+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.292+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.292+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x7f2a6809d040 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.293+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.293+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8a2f0 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.293+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.293+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.293+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.293+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.293+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.293+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.294+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.294+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x7f2a6809d040 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.294+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.294+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a93770 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.294+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.294+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8ece0 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.294+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.294+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x564731a8a2f0 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564731a96300 con 0x7f2a6809d040 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a92180 con 0x564731a8a2f0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a91dc0 con 0x564731a8a2f0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.295+0000 7f2a7ab2e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a92b60 con 0x564731a8a2f0 2024-04-26T07:54:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 zone default found 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 4 Realm: () 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 zonegroup default 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a92670 con 0x564731a8ece0 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a98b40 con 0x564731a93770 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.296+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.297+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a98ee0 con 0x564731a93770 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.297+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.297+0000 7f2a7ab2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.297+0000 7f2a7ab2e800 20 started sync module instance, tier type = 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.297+0000 7f2a7ab2e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.297+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a97fd0 con 0x7f2a6809d040 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.298+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.298+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863775859968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a97fd0 con 0x7f2a6809d040 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.298+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a99920 con 0x564731a8a2f0 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.299+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863775859968] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.299+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.299+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863775863792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a97fd0 con 0x564731a8a2f0 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.299+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9a390 con 0x564731a93770 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.300+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863775863792] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.301+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.301+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863775857440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a97f40 con 0x564731a93770 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.301+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9b150 con 0x7f2a6809d040 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.302+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863775857440] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.302+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.302+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863775868800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9b540 con 0x7f2a6809d040 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.302+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9bf40 con 0x564731a8a2f0 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.303+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.303+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863775873616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9c380 con 0x564731a8a2f0 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.303+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9ce90 con 0x564731a8ece0 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.303+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863775868800] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.304+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863775873616] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.304+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.304+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863775874672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9aba0 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.304+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9d730 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.305+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.305+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863775879728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9db80 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.305+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9e6a0 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.305+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863775874672] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863775879728] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863775883632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9e660 con 0x564731a8ece0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a7ab2e800 20 add_watcher() i=0 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a7ab2e800 20 add_watcher() i=1 2024-04-26T07:54:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a7ab2e800 20 add_watcher() i=2 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a7ab2e800 20 add_watcher() i=3 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a7ab2e800 20 add_watcher() i=4 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a7ab2e800 20 add_watcher() i=5 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.306+0000 7f2a7ab2e800 20 add_watcher() i=6 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.307+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863775883632] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.307+0000 7f2a7ab2e800 20 add_watcher() i=7 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.307+0000 7f2a7ab2e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.307+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731a9d650 con 0x564731a8a2f0 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.307+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.307+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863775877440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9d650 con 0x564731a8a2f0 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.308+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863775877440] v27'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f292d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f2a7ab2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f2a7ab2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f2a7ab2e800 5 note: GC not initialized 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f28a7fff640 20 reqs_thread_entry: start 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f2a7ab2e800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f2a7ab2e800 20 Filter name: none 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f28a5ffb640 20 reqs_thread_entry: start 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f2a7ab2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f2a7ab2e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.309+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731ad4d90 con 0x564731a8a2f0 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.310+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.310+0000 7f2a7ab2e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.310+0000 7f2a7ab2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.310+0000 7f2a7ab2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.310+0000 7f2a7ab2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.310+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731ad7820 con 0x7f2a6809d040 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.310+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.310+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731adaf60 con 0x564731a8a2f0 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.311+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v27'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.311+0000 7f2a7ab2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.311+0000 7f2a7ab2e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.311+0000 7f2a7ab2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.311+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94863776131536 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564731ad9af0 con 0x564731a8a2f0 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.312+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94863775873616 notify 115964116993 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f2a6c018040 con 0x564731a8a2f0 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.312+0000 7f295a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94863775873616 notifier 4305 bl.length()=567 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.312+0000 7f295a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.312+0000 7f295a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.312+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 notify.4 [notify cookie 94863776131536 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.312+0000 7f295a7fc640 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f293c003ea0 con 0x564731a8a2f0 2024-04-26T07:54:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.312+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.312+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94863776131536 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2a6c009050 con 0x564731a8a2f0 2024-04-26T07:54:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:34.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.313+0000 7f292d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.313+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863775877440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731ad9af0 con 0x564731a8a2f0 2024-04-26T07:54:34.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.314+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94863775877440] v27'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.314+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863775859968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731ad9af0 con 0x7f2a6809d040 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.315+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94863775859968] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.315+0000 7f2a7ab2e800 20 remove_watcher() i=0 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.315+0000 7f2a7ab2e800 2 removed watcher, disabling cache 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.315+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863775863792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731ad9af0 con 0x564731a8a2f0 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.316+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94863775863792] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.316+0000 7f2a7ab2e800 20 remove_watcher() i=1 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.316+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863775857440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731ad9af0 con 0x564731a93770 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.317+0000 7f2a76867640 1 -- 172.21.15.62:0/1155694126 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94863775857440] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6808cd70 con 0x564731a93770 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.317+0000 7f2a7ab2e800 20 remove_watcher() i=2 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.317+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863775868800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a98500 con 0x7f2a6809d040 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.318+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94863775868800] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x7f2a6809d040 2024-04-26T07:54:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.318+0000 7f2a7ab2e800 20 remove_watcher() i=3 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.318+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863775873616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a993f0 con 0x564731a8a2f0 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.319+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94863775873616] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6c00f610 con 0x564731a8a2f0 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.319+0000 7f2a7ab2e800 20 remove_watcher() i=4 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.319+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863775874672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a97b20 con 0x564731a8ece0 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.320+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94863775874672] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.320+0000 7f2a7ab2e800 20 remove_watcher() i=5 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.320+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863775879728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a9a780 con 0x564731a8ece0 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.321+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94863775879728] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.321+0000 7f2a7ab2e800 20 remove_watcher() i=6 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.321+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863775883632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564731a993f0 con 0x564731a8ece0 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a77068640 1 -- 172.21.15.62:0/1155694126 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94863775883632] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a7002a070 con 0x564731a8ece0 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 20 remove_watcher() i=7 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a8ece0 msgr2=0x564731a910d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a8ece0 0x564731a910d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731a8a2f0 msgr2=0x564731a8c7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731a8a2f0 0x564731a8c7b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2a6809d040 msgr2=0x7f2a6808f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2a6809d040 0x7f2a6808f960 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564731a93770 msgr2=0x564731a95c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564731a93770 0x564731a95c30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2940036eb0 msgr2=0x7f2940039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2940036eb0 0x7f2940039370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a680803f0 tx=0x7f2a6808a000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 msgr2=0x564731a7e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a7e600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a70048010 tx=0x7f2a7004ce60 comp rx=0 tx=0).stop 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a76066640 1 -- 172.21.15.62:0/1155694126 reap_dead start 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 shutdown_connections 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/1155694126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a77030 0x564731a7e600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 >> 172.21.15.62:0/1155694126 conn(0x564731a73340 msgr2=0x564731a709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 shutdown_connections 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.322+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/1155694126 wait complete. 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2274754346 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2950036eb0 msgr2=0x7f2950039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2274754346 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2950036eb0 0x7f2950039370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x564731a56200 tx=0x7f2a6801d010 comp rx=0 tx=0).stop 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2274754346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a69d00 msgr2=0x564731a6a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2274754346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a69d00 0x564731a6a120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564731a4f470 tx=0x7f2a700188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2274754346 shutdown_connections 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2274754346 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2950036eb0 0x7f2950039370 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2274754346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731a69d00 0x564731a6a120 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2274754346 >> 172.21.15.62:0/2274754346 conn(0x564731a5dda0 msgr2=0x564731a5e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2274754346 shutdown_connections 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2274754346 wait complete. 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a580c0 msgr2=0x564731a5a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a580c0 0x564731a5a4b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731958aa0 msgr2=0x564731a557e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731958aa0 0x564731a557e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f295c036e60 msgr2=0x7f295c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f295c036e60 0x7f295c039320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c000f60 tx=0x7f2a6c001370 comp rx=0 tx=0).stop 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 msgr2=0x564731a4e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a4e5f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a68005930 tx=0x7f2a68003020 comp rx=0 tx=0).stop 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 shutdown_connections 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564731958aa0 0x564731a557e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564731a580c0 0x564731a5a4b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f295c036e60 0x7f295c039320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 --2- 172.21.15.62:0/2983150899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564731956170 0x564731a4e5f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 >> 172.21.15.62:0/2983150899 conn(0x56473194fb80 msgr2=0x564731a40d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 shutdown_connections 2024-04-26T07:54:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.323+0000 7f2a7ab2e800 1 -- 172.21.15.62:0/2983150899 wait complete. 2024-04-26T07:54:34.352 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:34.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:54:34.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:54:34.352 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:54:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:34.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.398+0000 7f9f06c3f800 1 Processor -- start 2024-04-26T07:54:34.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.398+0000 7f9f06c3f800 1 -- start start 2024-04-26T07:54:34.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.398+0000 7f9f06c3f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55d75f2ade30 0x55d75f3425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.398+0000 7f9f06c3f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d75f2ae2e0 con 0x55d75f2af170 2024-04-26T07:54:34.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.398+0000 7f9f06c3f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55d75f1dbe20 con 0x55d75f2ade30 2024-04-26T07:54:34.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.399+0000 7f9f03f3d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55d75f2ade30 0x55d75f3425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.399+0000 7f9f0473e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55d75f2af170 0x55d75f2ad720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36488/0 (socket says 172.21.15.62:36488) 2024-04-26T07:54:34.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.399+0000 7f9f0473e640 1 -- 172.21.15.62:0/3622085674 learned_addr learned my addr 172.21.15.62:0/3622085674 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:34.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.399+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3622085674 >> v1:172.21.15.1:6789/0 conn(0x55d75f2af170 legacy=0x55d75f2ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.399+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3622085674 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d75f2ae4e0 con 0x55d75f2ade30 2024-04-26T07:54:34.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.401+0000 7f9f03f3d640 1 --2- 172.21.15.62:0/3622085674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f3425c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00a470 tx=0x7f9eec01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fe9c392f8c576d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.401+0000 7f9f0373c640 1 -- 172.21.15.62:0/3622085674 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eec057070 con 0x55d75f2ade30 2024-04-26T07:54:34.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.401+0000 7f9f0373c640 1 -- 172.21.15.62:0/3622085674 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec052570 con 0x55d75f2ade30 2024-04-26T07:54:34.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.401+0000 7f9f0373c640 1 -- 172.21.15.62:0/3622085674 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eec052870 con 0x55d75f2ade30 2024-04-26T07:54:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.402+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3622085674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 msgr2=0x55d75f3425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.402+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3622085674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f3425c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00a470 tx=0x7f9eec01ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.402+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3622085674 shutdown_connections 2024-04-26T07:54:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.402+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3622085674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f3425c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.402+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3622085674 >> 172.21.15.62:0/3622085674 conn(0x55d75f334d20 msgr2=0x55d75f337140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.402+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3622085674 shutdown_connections 2024-04-26T07:54:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.402+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3622085674 wait complete. 2024-04-26T07:54:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.414+0000 7f9f06c3f800 1 Processor -- start 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.414+0000 7f9f06c3f800 1 -- start start 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.415+0000 7f9f06c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f42ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.415+0000 7f9f06c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d75f284cd0 con 0x55d75f2ade30 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.415+0000 7f9f0473e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f42ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.415+0000 7f9f0473e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f42ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60834/0 (socket says 172.21.15.62:60834) 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.415+0000 7f9f0473e640 1 -- 172.21.15.62:0/3026074064 learned_addr learned my addr 172.21.15.62:0/3026074064 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.415+0000 7f9f0473e640 1 -- 172.21.15.62:0/3026074064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d75f42d3e0 con 0x55d75f2ade30 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.415+0000 7f9f0473e640 1 --2- 172.21.15.62:0/3026074064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f42ce10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4001610 tx=0x7f9ef4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca9b8fca2bb5c60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9df260c640 1 -- 172.21.15.62:0/3026074064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef40044e0 con 0x55d75f2ade30 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9df260c640 1 -- 172.21.15.62:0/3026074064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef4004680 con 0x55d75f2ade30 2024-04-26T07:54:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9df260c640 1 -- 172.21.15.62:0/3026074064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef4004a00 con 0x55d75f2ade30 2024-04-26T07:54:34.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3026074064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 msgr2=0x55d75f42ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3026074064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f42ce10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4001610 tx=0x7f9ef4001ad0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3026074064 shutdown_connections 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3026074064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f42ce10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3026074064 >> 172.21.15.62:0/3026074064 conn(0x55d75f334d20 msgr2=0x55d75f428730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3026074064 shutdown_connections 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.416+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3026074064 wait complete. 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f06c3f800 1 Processor -- start 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f06c3f800 1 -- start start 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f06c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f434980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f06c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d75f342e00 con 0x55d75f2ade30 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f0473e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f434980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f0473e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f434980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60846/0 (socket says 172.21.15.62:60846) 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f0473e640 1 -- 172.21.15.62:0/1247949275 learned_addr learned my addr 172.21.15.62:0/1247949275 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f0473e640 1 -- 172.21.15.62:0/1247949275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d75f434ec0 con 0x55d75f2ade30 2024-04-26T07:54:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9f0473e640 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f434980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55d75f42dba0 tx=0x7f9ef4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.417+0000 7f9df0e09640 1 -- 172.21.15.62:0/1247949275 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef4022020 con 0x55d75f2ade30 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.418+0000 7f9df0e09640 1 -- 172.21.15.62:0/1247949275 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef4014870 con 0x55d75f2ade30 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.418+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d75f435150 con 0x55d75f2ade30 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.418+0000 7f9df0e09640 1 -- 172.21.15.62:0/1247949275 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef4014b90 con 0x55d75f2ade30 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.418+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d75f437e00 con 0x55d75f2ade30 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.418+0000 7f9df0e09640 1 -- 172.21.15.62:0/1247949275 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9ef4025020 con 0x55d75f2ade30 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9df0e09640 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dec036e60 0x7f9dec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9df0e09640 1 -- 172.21.15.62:0/1247949275 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9ef4018030 con 0x55d75f2ade30 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9f03f3d640 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dec036e60 0x7f9dec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f2af170 0x55d75f43bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f43c190 con 0x55d75f2af170 2024-04-26T07:54:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9f04f3f640 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f2af170 0x55d75f43bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9f03f3d640 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dec036e60 0x7f9dec039320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9eec054000 tx=0x7f9eec04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9f04f3f640 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f2af170 0x55d75f43bbc0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9f04f3f640 1 -- 172.21.15.62:0/1247949275 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9efc0083e0 con 0x55d75f2af170 2024-04-26T07:54:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.419+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f439150 con 0x55d75f2af170 2024-04-26T07:54:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.420+0000 7f9f04f3f640 1 -- 172.21.15.62:0/1247949275 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9efc0083e0 con 0x55d75f2af170 2024-04-26T07:54:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.420+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f43e4a0 0x55d75f440890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.420+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f440f60 con 0x55d75f43e4a0 2024-04-26T07:54:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.420+0000 7f9f0473e640 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f43e4a0 0x55d75f440890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.420+0000 7f9f0473e640 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f43e4a0 0x55d75f440890 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.421+0000 7f9f0473e640 1 -- 172.21.15.62:0/1247949275 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f43e4a0 2024-04-26T07:54:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.421+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f43d450 con 0x55d75f2af170 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.421+0000 7f9f04f3f640 1 -- 172.21.15.62:0/1247949275 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9efc0083e0 con 0x55d75f2af170 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.421+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f43d8f0 con 0x55d75f2af170 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.421+0000 7f9f04f3f640 1 -- 172.21.15.62:0/1247949275 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9efc0083e0 con 0x55d75f2af170 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.421+0000 7f9f06c3f800 1 Processor -- start 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f06c3f800 1 -- start start 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f06c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f450100 0x55d75f450520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f06c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d75f22c170 con 0x55d75f450100 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f04f3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f450100 0x55d75f450520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f04f3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f450100 0x55d75f450520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60850/0 (socket says 172.21.15.62:60850) 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3238883114 learned_addr learned my addr 172.21.15.62:0/3238883114 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3238883114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d75f450a60 con 0x55d75f450100 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f04f3f640 1 --2- 172.21.15.62:0/3238883114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f450100 0x55d75f450520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55d75f435850 tx=0x7f9efc00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9de9ffb640 1 -- 172.21.15.62:0/3238883114 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9efc007d00 con 0x55d75f450100 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9de9ffb640 1 -- 172.21.15.62:0/3238883114 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9efc01e020 con 0x55d75f450100 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3238883114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d75f4514d0 con 0x55d75f450100 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.422+0000 7f9de9ffb640 1 -- 172.21.15.62:0/3238883114 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9efc019420 con 0x55d75f450100 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.423+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3238883114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d75f4519d0 con 0x55d75f450100 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.423+0000 7f9de9ffb640 1 -- 172.21.15.62:0/3238883114 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9efc016040 con 0x55d75f450100 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.423+0000 7f9de9ffb640 1 --2- 172.21.15.62:0/3238883114 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9ddc036eb0 0x7f9ddc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.423+0000 7f9de9ffb640 1 -- 172.21.15.62:0/3238883114 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9efc01f030 con 0x55d75f450100 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.423+0000 7f9f0473e640 1 --2- 172.21.15.62:0/3238883114 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9ddc036eb0 0x7f9ddc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f06c3f800 1 Processor -- start 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f0473e640 1 --2- 172.21.15.62:0/3238883114 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9ddc036eb0 0x7f9ddc039370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55d75f43c5d0 tx=0x7f9ef4026f10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f06c3f800 1 -- start start 2024-04-26T07:54:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f06c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f45d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f06c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d75f42d760 con 0x55d75f45d3e0 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f04f3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f45d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f04f3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f45d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60852/0 (socket says 172.21.15.62:60852) 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f04f3f640 1 -- 172.21.15.62:0/2995335735 learned_addr learned my addr 172.21.15.62:0/2995335735 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f04f3f640 1 -- 172.21.15.62:0/2995335735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d75f45ddd0 con 0x55d75f45d3e0 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.424+0000 7f9f04f3f640 1 --2- 172.21.15.62:0/2995335735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f45d800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9efc022a00 tx=0x7f9efc015cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfc34c179e91480 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9de37fe640 1 -- 172.21.15.62:0/2995335735 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9efc01d070 con 0x55d75f45d3e0 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9de37fe640 1 -- 172.21.15.62:0/2995335735 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9efc023540 con 0x55d75f45d3e0 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9de37fe640 1 -- 172.21.15.62:0/2995335735 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9efc019c50 con 0x55d75f45d3e0 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 -- 172.21.15.62:0/2995335735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 msgr2=0x55d75f45d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/2995335735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f45d800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9efc022a00 tx=0x7f9efc015cd0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 -- 172.21.15.62:0/2995335735 shutdown_connections 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/2995335735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f45d800 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 -- 172.21.15.62:0/2995335735 >> 172.21.15.62:0/2995335735 conn(0x55d75f459740 msgr2=0x55d75f4577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 -- 172.21.15.62:0/2995335735 shutdown_connections 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 -- 172.21.15.62:0/2995335735 wait complete. 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 Processor -- start 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.425+0000 7f9f06c3f800 1 -- start start 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f06c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f4649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f06c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d75f45e4e0 con 0x55d75f45d3e0 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f04f3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f4649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f04f3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f4649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60860/0 (socket says 172.21.15.62:60860) 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 learned_addr learned my addr 172.21.15.62:0/3898355253 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d75f464f10 con 0x55d75f45d3e0 2024-04-26T07:54:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f04f3f640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f4649d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9efc04c160 tx=0x7f9efc04d180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9de1ffb640 1 -- 172.21.15.62:0/3898355253 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9efc03d070 con 0x55d75f45d3e0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9de1ffb640 1 -- 172.21.15.62:0/3898355253 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9efc022a80 con 0x55d75f45d3e0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d75f4651a0 con 0x55d75f45d3e0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9de1ffb640 1 -- 172.21.15.62:0/3898355253 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9efc017960 con 0x55d75f45d3e0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.426+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d75f467e50 con 0x55d75f45d3e0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.427+0000 7f9de1ffb640 1 -- 172.21.15.62:0/3898355253 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9efc022cb0 con 0x55d75f45d3e0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.427+0000 7f9de1ffb640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dd4036eb0 0x7f9dd4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.427+0000 7f9de1ffb640 1 -- 172.21.15.62:0/3898355253 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9efc039c40 con 0x55d75f45d3e0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.427+0000 7f9f0473e640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dd4036eb0 0x7f9dd4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.427+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.427+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f4704a0 0x55d75f472960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.427+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4730b0 con 0x55d75f4704a0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f03f3d640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f4704a0 0x55d75f472960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f0473e640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dd4036eb0 0x7f9dd4039370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ef401dfd0 tx=0x7f9ef4041000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f03f3d640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f4704a0 0x55d75f472960 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f06c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f06c3f800 20 realm 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f473480 con 0x55d75f4704a0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f06c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.428+0000 7f9f06c3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f473d50 con 0x55d75f4704a0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4740f0 con 0x55d75f4704a0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f474ba0 0x55d75f476fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f477710 con 0x55d75f474ba0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.429+0000 7f9f04f3f640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f474ba0 0x55d75f476fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.430+0000 7f9f04f3f640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f474ba0 0x55d75f476fb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.430+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.430+0000 7f9f06c3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.430+0000 7f9f06c3f800 20 searching for the correct realm 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.430+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d75f4797c0 0x55d75f47bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.430+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f4797c0 2024-04-26T07:54:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.430+0000 7f9f0473e640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d75f4797c0 0x55d75f47bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.430+0000 7f9f0473e640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d75f4797c0 0x55d75f47bc80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.431+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.431+0000 7f9f0473e640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ef4027020 0x7f9ef4026590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.431+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x7f9ef4027020 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.431+0000 7f9f03f3d640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ef4027020 0x7f9ef4026590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.431+0000 7f9f03f3d640 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ef4027020 0x7f9ef4026590 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.432+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.432+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f474ba0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.432+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.432+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f4704a0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.432+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.432+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f4704a0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.432+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.432+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f474ba0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.433+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.433+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f474ba0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.433+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.433+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x7f9ef4027020 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.433+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.433+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f4797c0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.433+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.433+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f4704a0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.434+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.434+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f474ba0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.434+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.434+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f4704a0 2024-04-26T07:54:34.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.434+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.434+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x7f9ef4027020 2024-04-26T07:54:34.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.434+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.434+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f4797c0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.435+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.435+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c350 con 0x55d75f4797c0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.435+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.435+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f474ba0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.435+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.435+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4797c0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4797c0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4704a0 2024-04-26T07:54:34.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4704a0 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f474ba0 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.436+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.437+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4797c0 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.437+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.437+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x7f9ef4027020 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.437+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.437+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4704a0 2024-04-26T07:54:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.437+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.437+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f474ba0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4797c0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f474ba0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x7f9ef4027020 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4797c0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.438+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f474ba0 2024-04-26T07:54:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x55d75f4704a0 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ef405c040 con 0x7f9ef4027020 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f06c3f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f06c3f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f06c3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f06c3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f06c3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f06c3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.439+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4781c0 con 0x55d75f4704a0 2024-04-26T07:54:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f478610 con 0x55d75f4704a0 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f478af0 con 0x55d75f4704a0 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 20 zone default found 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 4 Realm: () 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 20 zonegroup default 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.440+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47c7d0 con 0x55d75f474ba0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f477e00 con 0x55d75f4797c0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47eaf0 con 0x55d75f4797c0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 20 started sync module instance, tier type = 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.441+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47de90 con 0x7f9ef4027020 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.442+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.442+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94383504876432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47de90 con 0x7f9ef4027020 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.442+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47f600 con 0x55d75f4704a0 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.443+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94383504876432] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.443+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.443+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94383504879856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47de90 con 0x55d75f4704a0 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.443+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4800c0 con 0x55d75f4797c0 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.444+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94383504879856] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.444+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.445+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94383504873952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47de00 con 0x55d75f4797c0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.445+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f480f80 con 0x7f9ef4027020 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.445+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.446+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94383504886992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f481820 con 0x7f9ef4027020 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.446+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4822d0 con 0x55d75f4704a0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.446+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94383504873952] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.447+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.447+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94383504884912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4822d0 con 0x55d75f4704a0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.447+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f482ce0 con 0x55d75f474ba0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.447+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94383504886992] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.448+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.448+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94383504888688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f482ce0 con 0x55d75f474ba0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.448+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f483730 con 0x55d75f474ba0 2024-04-26T07:54:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.448+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94383504884912] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.449+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94383504888688] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.449+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.449+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94383504894000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f483240 con 0x55d75f474ba0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.449+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f483c40 con 0x55d75f474ba0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94383504894000] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94383504891312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f483c00 con 0x55d75f474ba0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f06c3f800 20 add_watcher() i=0 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f06c3f800 20 add_watcher() i=1 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f06c3f800 20 add_watcher() i=2 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f06c3f800 20 add_watcher() i=3 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f06c3f800 20 add_watcher() i=4 2024-04-26T07:54:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f06c3f800 20 add_watcher() i=5 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.450+0000 7f9f06c3f800 20 add_watcher() i=6 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.451+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94383504891312] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.451+0000 7f9f06c3f800 20 add_watcher() i=7 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.451+0000 7f9f06c3f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.451+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f487060 con 0x55d75f4704a0 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.451+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.451+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94383504898336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f484510 con 0x55d75f4704a0 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.452+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94383504898336] v27'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.452+0000 7f9dba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.452+0000 7f9f06c3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.452+0000 7f9f06c3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.453+0000 7f9f06c3f800 5 note: GC not initialized 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.453+0000 7f9db97e2640 20 reqs_thread_entry: start 2024-04-26T07:54:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.453+0000 7f9f06c3f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.453+0000 7f9f06c3f800 20 Filter name: none 2024-04-26T07:54:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.453+0000 7f9d2affd640 20 reqs_thread_entry: start 2024-04-26T07:54:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.453+0000 7f9f06c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.453+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4ba2e0 con 0x55d75f4704a0 2024-04-26T07:54:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.454+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.454+0000 7f9f06c3f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.454+0000 7f9dba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.454+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94383504898336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f486920 con 0x55d75f4704a0 2024-04-26T07:54:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.455+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94383504898336] v27'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.455+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94383504876432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4838f0 con 0x7f9ef4027020 2024-04-26T07:54:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.456+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94383504876432] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.456+0000 7f9f06c3f800 20 remove_watcher() i=0 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.456+0000 7f9f06c3f800 2 removed watcher, disabling cache 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.456+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94383504879856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f4838f0 con 0x55d75f4704a0 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.458+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94383504879856] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.458+0000 7f9f06c3f800 20 remove_watcher() i=1 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.458+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94383504873952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47f0f0 con 0x55d75f4797c0 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.459+0000 7f9f0473e640 1 -- 172.21.15.62:0/3898355253 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94383504873952] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef401b070 con 0x55d75f4797c0 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.459+0000 7f9f06c3f800 20 remove_watcher() i=2 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.459+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94383504886992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47f0f0 con 0x7f9ef4027020 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.460+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94383504886992] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x7f9ef4027020 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.460+0000 7f9f06c3f800 20 remove_watcher() i=3 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.460+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94383504884912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47f0f0 con 0x55d75f4704a0 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.461+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94383504884912] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eec05a040 con 0x55d75f4704a0 2024-04-26T07:54:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.461+0000 7f9f06c3f800 20 remove_watcher() i=4 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.461+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94383504888688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47f0f0 con 0x55d75f474ba0 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.462+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94383504888688] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.462+0000 7f9f06c3f800 20 remove_watcher() i=5 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.462+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94383504894000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f481370 con 0x55d75f474ba0 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.463+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94383504894000] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.463+0000 7f9f06c3f800 20 remove_watcher() i=6 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.463+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94383504891312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d75f47f0f0 con 0x55d75f474ba0 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f04f3f640 1 -- 172.21.15.62:0/3898355253 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94383504891312] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9efc036070 con 0x55d75f474ba0 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 20 remove_watcher() i=7 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f474ba0 msgr2=0x55d75f476fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f474ba0 0x55d75f476fb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f4704a0 msgr2=0x55d75f472960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f4704a0 0x55d75f472960 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ef4027020 msgr2=0x7f9ef4026590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ef4027020 0x7f9ef4026590 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d75f4797c0 msgr2=0x55d75f47bc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d75f4797c0 0x55d75f47bc80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dd4036eb0 msgr2=0x7f9dd4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dd4036eb0 0x7f9dd4039370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ef401dfd0 tx=0x7f9ef4041000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 msgr2=0x55d75f4649d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3898355253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f45d3e0 0x55d75f4649d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9efc04c160 tx=0x7f9efc04d180 comp rx=0 tx=0).stop 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f03f3d640 1 -- 172.21.15.62:0/3898355253 reap_dead start 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 shutdown_connections 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 >> 172.21.15.62:0/3898355253 conn(0x55d75f459740 msgr2=0x55d75f456da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 shutdown_connections 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3898355253 wait complete. 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3238883114 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9ddc036eb0 msgr2=0x7f9ddc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3238883114 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9ddc036eb0 0x7f9ddc039370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55d75f43c5d0 tx=0x7f9ef4026f10 comp rx=0 tx=0).stop 2024-04-26T07:54:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3238883114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f450100 msgr2=0x55d75f450520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.464+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3238883114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f450100 0x55d75f450520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55d75f435850 tx=0x7f9efc00aec0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3238883114 shutdown_connections 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3238883114 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9ddc036eb0 0x7f9ddc039370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/3238883114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f450100 0x55d75f450520 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3238883114 >> 172.21.15.62:0/3238883114 conn(0x55d75f4441a0 msgr2=0x55d75f4445a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3238883114 shutdown_connections 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/3238883114 wait complete. 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f43e4a0 msgr2=0x55d75f440890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f43e4a0 0x55d75f440890 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f2af170 msgr2=0x55d75f43bbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f2af170 0x55d75f43bbc0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dec036e60 msgr2=0x7f9dec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dec036e60 0x7f9dec039320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9eec054000 tx=0x7f9eec04e000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 msgr2=0x55d75f434980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f434980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55d75f42dba0 tx=0x7f9ef4000f40 comp rx=0 tx=0).stop 2024-04-26T07:54:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 shutdown_connections 2024-04-26T07:54:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d75f2af170 0x55d75f43bbc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d75f43e4a0 0x55d75f440890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dec036e60 0x7f9dec039320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 --2- 172.21.15.62:0/1247949275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d75f2ade30 0x55d75f434980 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 >> 172.21.15.62:0/1247949275 conn(0x55d75f334d20 msgr2=0x55d75f426f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 shutdown_connections 2024-04-26T07:54:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.465+0000 7f9f06c3f800 1 -- 172.21.15.62:0/1247949275 wait complete. 2024-04-26T07:54:34.475 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:34.475 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-26T07:54:34.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-26T07:54:34.475 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-26T07:54:34.519 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:34.519 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:34.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f054252d800 1 Processor -- start 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f054252d800 1 -- start start 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f054252d800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55bc27689c80 0x55bc2768c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f054252d800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc2768c5b0 con 0x55bc27686170 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f054252d800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55bc27527e20 con 0x55bc27689c80 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f053d97e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55bc27689c80 0x55bc2768c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f053e17f640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55bc27686170 0x55bc27688560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36500/0 (socket says 172.21.15.62:36500) 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f053d97e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55bc27689c80 0x55bc2768c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60872/0 (socket says 172.21.15.62:60872) 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.522+0000 7f053e17f640 1 -- 172.21.15.62:0/2203965446 learned_addr learned my addr 172.21.15.62:0/2203965446 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.523+0000 7f053d97e640 1 -- 172.21.15.62:0/2203965446 >> v1:172.21.15.1:6789/0 conn(0x55bc27686170 legacy=0x55bc27688560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.523+0000 7f053d97e640 1 -- 172.21.15.62:0/2203965446 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2768d790 con 0x55bc27689c80 2024-04-26T07:54:34.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.524+0000 7f053d97e640 1 --2- 172.21.15.62:0/2203965446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27689c80 0x55bc2768c070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f053400a470 tx=0x7f053401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab336574c9c8adf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f053d17d640 1 -- 172.21.15.62:0/2203965446 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0534057070 con 0x55bc27689c80 2024-04-26T07:54:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f053d17d640 1 -- 172.21.15.62:0/2203965446 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0534052570 con 0x55bc27689c80 2024-04-26T07:54:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f053d17d640 1 -- 172.21.15.62:0/2203965446 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0534052870 con 0x55bc27689c80 2024-04-26T07:54:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f054252d800 1 -- 172.21.15.62:0/2203965446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27689c80 msgr2=0x55bc2768c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f054252d800 1 --2- 172.21.15.62:0/2203965446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27689c80 0x55bc2768c070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f053400a470 tx=0x7f053401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f054252d800 1 -- 172.21.15.62:0/2203965446 shutdown_connections 2024-04-26T07:54:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f054252d800 1 --2- 172.21.15.62:0/2203965446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27689c80 0x55bc2768c070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f054252d800 1 -- 172.21.15.62:0/2203965446 >> 172.21.15.62:0/2203965446 conn(0x55bc2767fb80 msgr2=0x55bc27681fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f054252d800 1 -- 172.21.15.62:0/2203965446 shutdown_connections 2024-04-26T07:54:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.525+0000 7f054252d800 1 -- 172.21.15.62:0/2203965446 wait complete. 2024-04-26T07:54:34.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.538+0000 7f054252d800 1 Processor -- start 2024-04-26T07:54:34.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.538+0000 7f054252d800 1 -- start start 2024-04-26T07:54:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.538+0000 7f054252d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc27776c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.538+0000 7f054252d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bc275d0cd0 con 0x55bc27686170 2024-04-26T07:54:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.538+0000 7f053e17f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc27776c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.538+0000 7f053e17f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc27776c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60884/0 (socket says 172.21.15.62:60884) 2024-04-26T07:54:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.538+0000 7f053e17f640 1 -- 172.21.15.62:0/3478690654 learned_addr learned my addr 172.21.15.62:0/3478690654 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.538+0000 7f053e17f640 1 -- 172.21.15.62:0/3478690654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc27777250 con 0x55bc27686170 2024-04-26T07:54:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.539+0000 7f053e17f640 1 --2- 172.21.15.62:0/3478690654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc27776c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0530001de0 tx=0x7f053000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b2814fddc71219 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.539+0000 7f042c608640 1 -- 172.21.15.62:0/3478690654 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0530012020 con 0x55bc27686170 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.539+0000 7f042c608640 1 -- 172.21.15.62:0/3478690654 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053000e5a0 con 0x55bc27686170 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.539+0000 7f042c608640 1 -- 172.21.15.62:0/3478690654 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f053000e8c0 con 0x55bc27686170 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 -- 172.21.15.62:0/3478690654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 msgr2=0x55bc27776c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 --2- 172.21.15.62:0/3478690654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc27776c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0530001de0 tx=0x7f053000b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 -- 172.21.15.62:0/3478690654 shutdown_connections 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 --2- 172.21.15.62:0/3478690654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc27776c80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 -- 172.21.15.62:0/3478690654 >> 172.21.15.62:0/3478690654 conn(0x55bc2767fb80 msgr2=0x55bc277725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 -- 172.21.15.62:0/3478690654 shutdown_connections 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 -- 172.21.15.62:0/3478690654 wait complete. 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 Processor -- start 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 -- start start 2024-04-26T07:54:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc2777e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f054252d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bc2768ca80 con 0x55bc27686170 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f053e17f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc2777e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f053e17f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc2777e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60892/0 (socket says 172.21.15.62:60892) 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.540+0000 7f053e17f640 1 -- 172.21.15.62:0/2883717713 learned_addr learned my addr 172.21.15.62:0/2883717713 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.541+0000 7f053e17f640 1 -- 172.21.15.62:0/2883717713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2777ed00 con 0x55bc27686170 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.541+0000 7f053e17f640 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc2777e7c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f053000c010 tx=0x7f0530000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.541+0000 7f042ae05640 1 -- 172.21.15.62:0/2883717713 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0530012070 con 0x55bc27686170 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.541+0000 7f042ae05640 1 -- 172.21.15.62:0/2883717713 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053001a7a0 con 0x55bc27686170 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.541+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc2777ef90 con 0x55bc27686170 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.541+0000 7f042ae05640 1 -- 172.21.15.62:0/2883717713 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f053001aa80 con 0x55bc27686170 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.541+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc27781c40 con 0x55bc27686170 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.542+0000 7f042ae05640 1 -- 172.21.15.62:0/2883717713 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0530015020 con 0x55bc27686170 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.542+0000 7f042ae05640 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0424036e60 0x7f0424039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.542+0000 7f042ae05640 1 -- 172.21.15.62:0/2883717713 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f0530020070 con 0x55bc27686170 2024-04-26T07:54:34.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.542+0000 7f053d97e640 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0424036e60 0x7f0424039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.542+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc27689c80 0x55bc27785a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.542+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc27785f80 con 0x55bc27689c80 2024-04-26T07:54:34.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.542+0000 7f053e980640 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc27689c80 0x55bc27785a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.543+0000 7f053d97e640 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0424036e60 0x7f0424039320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0534054000 tx=0x7f053404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.543+0000 7f053e980640 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc27689c80 0x55bc27785a00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.543+0000 7f053e980640 1 -- 172.21.15.62:0/2883717713 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f053800a4a0 con 0x55bc27689c80 2024-04-26T07:54:34.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.543+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc27782fd0 con 0x55bc27689c80 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.543+0000 7f053e980640 1 -- 172.21.15.62:0/2883717713 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f053800a4a0 con 0x55bc27689c80 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.543+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277882e0 0x55bc2778a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.543+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc2778ad70 con 0x55bc277882e0 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.543+0000 7f053e17f640 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277882e0 0x55bc2778a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.544+0000 7f053e17f640 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277882e0 0x55bc2778a6d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.544+0000 7f053e17f640 1 -- 172.21.15.62:0/2883717713 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f053002b070 con 0x55bc277882e0 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.544+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc27787290 con 0x55bc27689c80 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.544+0000 7f053e980640 1 -- 172.21.15.62:0/2883717713 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f053800a4a0 con 0x55bc27689c80 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.544+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc27787770 con 0x55bc27689c80 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.545+0000 7f053e980640 1 -- 172.21.15.62:0/2883717713 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f053800a4a0 con 0x55bc27689c80 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.545+0000 7f054252d800 1 Processor -- start 2024-04-26T07:54:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.545+0000 7f054252d800 1 -- start start 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.545+0000 7f054252d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27685d10 0x55bc27684180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.545+0000 7f054252d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bc27578170 con 0x55bc27685d10 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.545+0000 7f053e980640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27685d10 0x55bc27684180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.545+0000 7f053e980640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27685d10 0x55bc27684180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60896/0 (socket says 172.21.15.62:60896) 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.545+0000 7f053e980640 1 -- 172.21.15.62:0/1253326213 learned_addr learned my addr 172.21.15.62:0/1253326213 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.546+0000 7f053e980640 1 -- 172.21.15.62:0/1253326213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc276846c0 con 0x55bc27685d10 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.546+0000 7f053e980640 1 --2- 172.21.15.62:0/1253326213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27685d10 0x55bc27684180 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55bc27786340 tx=0x7f0538018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.546+0000 7f0423fff640 1 -- 172.21.15.62:0/1253326213 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0538014450 con 0x55bc27685d10 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.546+0000 7f0423fff640 1 -- 172.21.15.62:0/1253326213 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05380145f0 con 0x55bc27685d10 2024-04-26T07:54:34.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.546+0000 7f054252d800 1 -- 172.21.15.62:0/1253326213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc27684950 con 0x55bc27685d10 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.546+0000 7f0423fff640 1 -- 172.21.15.62:0/1253326213 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05380148d0 con 0x55bc27685d10 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.546+0000 7f054252d800 1 -- 172.21.15.62:0/1253326213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc27684e50 con 0x55bc27685d10 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f0423fff640 1 -- 172.21.15.62:0/1253326213 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0538011040 con 0x55bc27685d10 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f0423fff640 1 --2- 172.21.15.62:0/1253326213 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0418036eb0 0x7f0418039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f0423fff640 1 -- 172.21.15.62:0/1253326213 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f053801e070 con 0x55bc27685d10 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f053e17f640 1 --2- 172.21.15.62:0/1253326213 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0418036eb0 0x7f0418039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f054252d800 1 Processor -- start 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f054252d800 1 -- start start 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f053e17f640 1 --2- 172.21.15.62:0/1253326213 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0418036eb0 0x7f0418039370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55bc27786400 tx=0x7f0530019f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f054252d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277a9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.547+0000 7f054252d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bc277775d0 con 0x55bc277a9450 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.548+0000 7f053e980640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.548+0000 7f053e980640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277a9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60902/0 (socket says 172.21.15.62:60902) 2024-04-26T07:54:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.548+0000 7f053e980640 1 -- 172.21.15.62:0/882339479 learned_addr learned my addr 172.21.15.62:0/882339479 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.548+0000 7f053e980640 1 -- 172.21.15.62:0/882339479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc277a9e40 con 0x55bc277a9450 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.548+0000 7f053e980640 1 --2- 172.21.15.62:0/882339479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277a9870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0538018430 tx=0x7f0538041420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3592214f45c0a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.548+0000 7f0421ffb640 1 -- 172.21.15.62:0/882339479 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0538013dc0 con 0x55bc277a9450 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.548+0000 7f0421ffb640 1 -- 172.21.15.62:0/882339479 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053804e070 con 0x55bc277a9450 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.548+0000 7f0421ffb640 1 -- 172.21.15.62:0/882339479 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0538014be0 con 0x55bc277a9450 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 -- 172.21.15.62:0/882339479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 msgr2=0x55bc277a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 --2- 172.21.15.62:0/882339479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277a9870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0538018430 tx=0x7f0538041420 comp rx=0 tx=0).stop 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 -- 172.21.15.62:0/882339479 shutdown_connections 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 --2- 172.21.15.62:0/882339479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277a9870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 -- 172.21.15.62:0/882339479 >> 172.21.15.62:0/882339479 conn(0x55bc277a5720 msgr2=0x55bc277a3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 -- 172.21.15.62:0/882339479 shutdown_connections 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 -- 172.21.15.62:0/882339479 wait complete. 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 Processor -- start 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 -- start start 2024-04-26T07:54:34.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f054252d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bc277aa560 con 0x55bc277a9450 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f053e980640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f053e980640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60908/0 (socket says 172.21.15.62:60908) 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.549+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 learned_addr learned my addr 172.21.15.62:0/3729574041 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.550+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc277b0e70 con 0x55bc277a9450 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.550+0000 7f053e980640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277b0930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0538018430 tx=0x7f053804cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.550+0000 7f040ffff640 1 -- 172.21.15.62:0/3729574041 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f053803b070 con 0x55bc277a9450 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.550+0000 7f040ffff640 1 -- 172.21.15.62:0/3729574041 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0538022bb0 con 0x55bc277a9450 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.550+0000 7f040ffff640 1 -- 172.21.15.62:0/3729574041 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05380133b0 con 0x55bc277a9450 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.550+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc277b1100 con 0x55bc277a9450 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.550+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc277b3db0 con 0x55bc277a9450 2024-04-26T07:54:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.551+0000 7f040ffff640 1 -- 172.21.15.62:0/3729574041 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0538013550 con 0x55bc277a9450 2024-04-26T07:54:34.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.551+0000 7f040ffff640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0408036e60 0x7f0408039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.551+0000 7f040ffff640 1 -- 172.21.15.62:0/3729574041 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f053800e040 con 0x55bc277a9450 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.551+0000 7f053e17f640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0408036e60 0x7f0408039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.551+0000 7f053e17f640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0408036e60 0x7f0408039320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0530044650 tx=0x7f0530033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.551+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.551+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc277bc480 0x55bc277be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277bf090 con 0x55bc277bc480 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f053d97e640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc277bc480 0x55bc277be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f053d97e640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc277bc480 0x55bc277be940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 20 realm 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277bf460 con 0x55bc277bc480 2024-04-26T07:54:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.552+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277bfd30 con 0x55bc277bc480 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f054252d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c00d0 con 0x55bc277bc480 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f054252d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277c0e30 0x55bc277c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c37e0 con 0x55bc277c0e30 2024-04-26T07:54:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f053e980640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277c0e30 0x55bc277c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.553+0000 7f053e980640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277c0e30 0x55bc277c3220 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.554+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.554+0000 7f054252d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.554+0000 7f054252d800 20 searching for the correct realm 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.554+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55bc277c57b0 0x55bc277c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.554+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.554+0000 7f053e17f640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55bc277c57b0 0x55bc277c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.554+0000 7f053e17f640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55bc277c57b0 0x55bc277c7c70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.555+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.555+0000 7f053e17f640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0530017050 0x7f053000d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.555+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x7f0530017050 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.555+0000 7f053d97e640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0530017050 0x7f053000d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.555+0000 7f053d97e640 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0530017050 0x7f053000d8e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.555+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.555+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.556+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.556+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277bc480 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.556+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.556+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277bc480 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.556+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.556+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.557+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.557+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.557+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.557+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x7f0530017050 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.557+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.557+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.557+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.557+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277bc480 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.558+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.558+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.558+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.558+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277bc480 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.558+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.558+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x7f0530017050 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.558+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.558+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.559+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.559+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.559+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.559+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.559+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.559+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.560+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.560+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.560+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.560+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277bc480 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.560+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.560+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277bc480 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.560+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.560+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.561+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.561+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.561+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.561+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x7f0530017050 2024-04-26T07:54:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.561+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.561+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277bc480 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.561+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.561+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.562+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.562+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.562+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.562+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.562+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.562+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x7f0530017050 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.562+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.562+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c57b0 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277c0e30 2024-04-26T07:54:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x55bc277bc480 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c8340 con 0x7f0530017050 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f054252d800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f054252d800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f054252d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f054252d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f054252d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.563+0000 7f054252d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c41a0 con 0x55bc277bc480 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c3de0 con 0x55bc277bc480 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c4b40 con 0x55bc277bc480 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 zone default found 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 4 Realm: () 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 zonegroup default 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.564+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c87c0 con 0x55bc277c0e30 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277caa90 con 0x55bc277c57b0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cae30 con 0x55bc277c57b0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 20 started sync module instance, tier type = 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.565+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c9ed0 con 0x7f0530017050 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.566+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.566+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94266604692480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c9ed0 con 0x7f0530017050 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.566+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cb830 con 0x55bc277bc480 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.567+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94266604692480] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.568+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.568+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94266604696384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c9ed0 con 0x55bc277bc480 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.568+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cc280 con 0x55bc277c57b0 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.569+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94266604696384] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.569+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.569+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94266604689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c9e40 con 0x55bc277c57b0 2024-04-26T07:54:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.569+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cd140 con 0x7f0530017050 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.570+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.570+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94266604689952] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.570+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94266604702864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cd560 con 0x7f0530017050 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.570+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cde30 con 0x55bc277bc480 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.571+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94266604702864] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.571+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.571+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94266604703920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cd980 con 0x55bc277bc480 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.571+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277ce840 con 0x55bc277c0e30 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.572+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.572+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94266604708752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cf0e0 con 0x55bc277c0e30 2024-04-26T07:54:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.572+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cfb60 con 0x55bc277c0e30 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.573+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.573+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94266604713552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cfb20 con 0x55bc277c0e30 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.573+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277d0b10 con 0x55bc277c0e30 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.573+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94266604708752] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94266604703920] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94266604713552] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94266604704976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277d0b10 con 0x55bc277c0e30 2024-04-26T07:54:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f054252d800 20 add_watcher() i=0 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f054252d800 20 add_watcher() i=1 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f054252d800 20 add_watcher() i=2 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f054252d800 20 add_watcher() i=3 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f054252d800 20 add_watcher() i=4 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f054252d800 20 add_watcher() i=5 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.574+0000 7f054252d800 20 add_watcher() i=6 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.575+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94266604704976] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.575+0000 7f054252d800 20 add_watcher() i=7 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.575+0000 7f054252d800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.575+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cfbf0 con 0x55bc277bc480 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.575+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.575+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94266604710960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cfbf0 con 0x55bc277bc480 2024-04-26T07:54:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.576+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94266604710960] v27'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.576+0000 7f03f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.576+0000 7f054252d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.576+0000 7f054252d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 5 note: GC not initialized 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f036f7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 20 Filter name: none 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f036d7fa640 20 reqs_thread_entry: start 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc27806c10 con 0x55bc277bc480 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.577+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc278096a0 con 0x7f0530017050 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.578+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.578+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc2780ce60 con 0x55bc277bc480 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v27'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f054252d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f054252d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f054252d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94266604964016 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bc2780b990 con 0x55bc277bc480 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94266604703920 notify 115964116994 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55bc2768d790 con 0x55bc277bc480 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f0421ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94266604703920 notifier 4319 bl.length()=567 2024-04-26T07:54:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f0421ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 notify.4 [notify cookie 94266604964016 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f0421ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.579+0000 7f0421ffb640 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f0404003ea0 con 0x55bc277bc480 2024-04-26T07:54:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.580+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.580+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94266604964016 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f053405db10 con 0x55bc277bc480 2024-04-26T07:54:34.589 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:34.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.581+0000 7f03f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.581+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94266604710960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc2780b990 con 0x55bc277bc480 2024-04-26T07:54:34.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.581+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94266604710960] v27'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.581+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94266604692480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc2780b990 con 0x7f0530017050 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.582+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94266604692480] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.582+0000 7f054252d800 20 remove_watcher() i=0 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.582+0000 7f054252d800 2 removed watcher, disabling cache 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.583+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94266604696384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc2780b990 con 0x55bc277bc480 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.584+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94266604696384] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.584+0000 7f054252d800 20 remove_watcher() i=1 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.584+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94266604689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc2780b990 con 0x55bc277c57b0 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.585+0000 7f053e17f640 1 -- 172.21.15.62:0/3729574041 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94266604689952] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053002b070 con 0x55bc277c57b0 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.585+0000 7f054252d800 20 remove_watcher() i=2 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.585+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94266604702864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cb340 con 0x7f0530017050 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.585+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94266604702864] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x7f0530017050 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.586+0000 7f054252d800 20 remove_watcher() i=3 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.586+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94266604703920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c9a20 con 0x55bc277bc480 2024-04-26T07:54:34.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.587+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94266604703920] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053405a040 con 0x55bc277bc480 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.587+0000 7f054252d800 20 remove_watcher() i=4 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.587+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94266604708752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277cb340 con 0x55bc277c0e30 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.588+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94266604708752] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.588+0000 7f054252d800 20 remove_watcher() i=5 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.588+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94266604713552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277c9a20 con 0x55bc277c0e30 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.589+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94266604713552] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.589+0000 7f054252d800 20 remove_watcher() i=6 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.589+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94266604704976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bc277ce390 con 0x55bc277c0e30 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.589+0000 7f053e980640 1 -- 172.21.15.62:0/3729574041 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94266604704976] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f053802a070 con 0x55bc277c0e30 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.589+0000 7f054252d800 20 remove_watcher() i=7 2024-04-26T07:54:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277c0e30 msgr2=0x55bc277c3220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277c0e30 0x55bc277c3220 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc277bc480 msgr2=0x55bc277be940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc277bc480 0x55bc277be940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0530017050 msgr2=0x7f053000d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0530017050 0x7f053000d8e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55bc277c57b0 msgr2=0x55bc277c7c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55bc277c57b0 0x55bc277c7c70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0408036e60 msgr2=0x7f0408039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0408036e60 0x7f0408039320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0530044650 tx=0x7f0530033000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 msgr2=0x55bc277b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/3729574041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc277a9450 0x55bc277b0930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0538018430 tx=0x7f053804cfd0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 reap_dead start 2024-04-26T07:54:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f053d97e640 1 -- 172.21.15.62:0/3729574041 reap_dead start 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 shutdown_connections 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 >> 172.21.15.62:0/3729574041 conn(0x55bc277a5720 msgr2=0x55bc277a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 shutdown_connections 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/3729574041 wait complete. 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/1253326213 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0418036eb0 msgr2=0x7f0418039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/1253326213 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0418036eb0 0x7f0418039370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55bc27786400 tx=0x7f0530019f90 comp rx=0 tx=0).stop 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/1253326213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27685d10 msgr2=0x55bc27684180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/1253326213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27685d10 0x55bc27684180 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55bc27786340 tx=0x7f0538018830 comp rx=0 tx=0).stop 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/1253326213 shutdown_connections 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/1253326213 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0418036eb0 0x7f0418039370 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 --2- 172.21.15.62:0/1253326213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27685d10 0x55bc27684180 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/1253326213 >> 172.21.15.62:0/1253326213 conn(0x55bc2778dfc0 msgr2=0x55bc2778e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/1253326213 shutdown_connections 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.590+0000 7f054252d800 1 -- 172.21.15.62:0/1253326213 wait complete. 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277882e0 msgr2=0x55bc2778a6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277882e0 0x55bc2778a6d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc27689c80 msgr2=0x55bc27785a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc27689c80 0x55bc27785a00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0424036e60 msgr2=0x7f0424039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0424036e60 0x7f0424039320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0534054000 tx=0x7f053404e000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 msgr2=0x55bc2777e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc2777e7c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f053000c010 tx=0x7f0530000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 shutdown_connections 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bc27689c80 0x55bc27785a00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55bc277882e0 0x55bc2778a6d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0424036e60 0x7f0424039320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 --2- 172.21.15.62:0/2883717713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bc27686170 0x55bc2777e7c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 >> 172.21.15.62:0/2883717713 conn(0x55bc2767fb80 msgr2=0x55bc27770da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 shutdown_connections 2024-04-26T07:54:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.591+0000 7f054252d800 1 -- 172.21.15.62:0/2883717713 wait complete. 2024-04-26T07:54:34.601 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:34.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:54:34.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:54:34.601 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:54:34.645 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:34.645 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.648+0000 7f8797e3f800 1 Processor -- start 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.648+0000 7f8797e3f800 1 -- start start 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.648+0000 7f8797e3f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56273b8a9740 0x56273b8a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.648+0000 7f8797e3f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56273b8aa1e0 con 0x56273b8aa8b0 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.648+0000 7f8797e3f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x56273b74be20 con 0x56273b8a9740 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.648+0000 7f879593e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56273b8a9740 0x56273b8a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.648+0000 7f879513d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x56273b8aa8b0 0x56273b8aad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36514/0 (socket says 172.21.15.62:36514) 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.648+0000 7f879513d640 1 -- 172.21.15.62:0/37350707 learned_addr learned my addr 172.21.15.62:0/37350707 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.649+0000 7f879593e640 1 -- 172.21.15.62:0/37350707 >> v1:172.21.15.1:6789/0 conn(0x56273b8aa8b0 legacy=0x56273b8aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.649+0000 7f879493c640 1 -- 172.21.15.62:0/37350707 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270666011 0 0) 0x56273b8aa1e0 con 0x56273b8aa8b0 2024-04-26T07:54:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.649+0000 7f879593e640 1 -- 172.21.15.62:0/37350707 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273b8ab470 con 0x56273b8a9740 2024-04-26T07:54:34.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.650+0000 7f879593e640 1 --2- 172.21.15.62:0/37350707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b8a9b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f878800a470 tx=0x7f878801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe63872e77082cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f879493c640 1 -- 172.21.15.62:0/37350707 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788057070 con 0x56273b8a9740 2024-04-26T07:54:34.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f879493c640 1 -- 172.21.15.62:0/37350707 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878804adc0 con 0x56273b8a9740 2024-04-26T07:54:34.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f879493c640 1 -- 172.21.15.62:0/37350707 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788052590 con 0x56273b8a9740 2024-04-26T07:54:34.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f8797e3f800 1 -- 172.21.15.62:0/37350707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 msgr2=0x56273b8a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f8797e3f800 1 --2- 172.21.15.62:0/37350707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b8a9b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f878800a470 tx=0x7f878801ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:34.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f8797e3f800 1 -- 172.21.15.62:0/37350707 shutdown_connections 2024-04-26T07:54:34.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f8797e3f800 1 --2- 172.21.15.62:0/37350707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b8a9b60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f8797e3f800 1 -- 172.21.15.62:0/37350707 >> 172.21.15.62:0/37350707 conn(0x56273b8a4d20 msgr2=0x56273b8a7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f8797e3f800 1 -- 172.21.15.62:0/37350707 shutdown_connections 2024-04-26T07:54:34.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.651+0000 7f8797e3f800 1 -- 172.21.15.62:0/37350707 wait complete. 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.664+0000 7f8797e3f800 1 Processor -- start 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.664+0000 7f8797e3f800 1 -- start start 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.664+0000 7f8797e3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b99ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.664+0000 7f8797e3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56273b7f4cd0 con 0x56273b8a9740 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.664+0000 7f879593e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b99ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.664+0000 7f879593e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b99ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60932/0 (socket says 172.21.15.62:60932) 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.664+0000 7f879593e640 1 -- 172.21.15.62:0/3190595150 learned_addr learned my addr 172.21.15.62:0/3190595150 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.664+0000 7f879593e640 1 -- 172.21.15.62:0/3190595150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273b99b0d0 con 0x56273b8a9740 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.665+0000 7f879593e640 1 --2- 172.21.15.62:0/3190595150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b99ab00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8788055040 tx=0x7f878804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82c6116528612a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.665+0000 7f8683e07640 1 -- 172.21.15.62:0/3190595150 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788063070 con 0x56273b8a9740 2024-04-26T07:54:34.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.665+0000 7f8683e07640 1 -- 172.21.15.62:0/3190595150 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878805d5a0 con 0x56273b8a9740 2024-04-26T07:54:34.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.665+0000 7f8683e07640 1 -- 172.21.15.62:0/3190595150 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788057040 con 0x56273b8a9740 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.665+0000 7f8797e3f800 1 -- 172.21.15.62:0/3190595150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 msgr2=0x56273b99ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.665+0000 7f8797e3f800 1 --2- 172.21.15.62:0/3190595150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b99ab00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8788055040 tx=0x7f878804c000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 -- 172.21.15.62:0/3190595150 shutdown_connections 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 --2- 172.21.15.62:0/3190595150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b99ab00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 -- 172.21.15.62:0/3190595150 >> 172.21.15.62:0/3190595150 conn(0x56273b8a4d20 msgr2=0x56273b996420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 -- 172.21.15.62:0/3190595150 shutdown_connections 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 -- 172.21.15.62:0/3190595150 wait complete. 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 Processor -- start 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 -- start start 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b9a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f8797e3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56273b8b2d80 con 0x56273b8a9740 2024-04-26T07:54:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f879593e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b9a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f879593e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b9a24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60940/0 (socket says 172.21.15.62:60940) 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.666+0000 7f879593e640 1 -- 172.21.15.62:0/2095043262 learned_addr learned my addr 172.21.15.62:0/2095043262 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.667+0000 7f879593e640 1 -- 172.21.15.62:0/2095043262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273b9a2a20 con 0x56273b8a9740 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.667+0000 7f879593e640 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b9a24e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8788000c00 tx=0x7f8788002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.667+0000 7f8682604640 1 -- 172.21.15.62:0/2095043262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788057050 con 0x56273b8a9740 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.667+0000 7f8682604640 1 -- 172.21.15.62:0/2095043262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878805dd30 con 0x56273b8a9740 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.667+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56273b9a2cb0 con 0x56273b8a9740 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.667+0000 7f8682604640 1 -- 172.21.15.62:0/2095043262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788063040 con 0x56273b8a9740 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.667+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273b9a5960 con 0x56273b8a9740 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.668+0000 7f8682604640 1 -- 172.21.15.62:0/2095043262 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8788052590 con 0x56273b8a9740 2024-04-26T07:54:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.668+0000 7f8682604640 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f867c036e60 0x7f867c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.668+0000 7f8682604640 1 -- 172.21.15.62:0/2095043262 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f878808de90 con 0x56273b8a9740 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.668+0000 7f879513d640 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f867c036e60 0x7f867c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.668+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b8aa8b0 0x56273b9a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.668+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9a9ca0 con 0x56273b8aa8b0 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.668+0000 7f879613f640 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b8aa8b0 0x56273b9a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.668+0000 7f879513d640 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f867c036e60 0x7f867c039320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f878c000c00 tx=0x7f878c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.669+0000 7f879613f640 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b8aa8b0 0x56273b9a9720 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.669+0000 7f879613f640 1 -- 172.21.15.62:0/2095043262 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f879000a4a0 con 0x56273b8aa8b0 2024-04-26T07:54:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.669+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9a6cb0 con 0x56273b8aa8b0 2024-04-26T07:54:34.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.669+0000 7f879613f640 1 -- 172.21.15.62:0/2095043262 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f879000a4a0 con 0x56273b8aa8b0 2024-04-26T07:54:34.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.669+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9ac000 0x56273b9ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.669+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9aea50 con 0x56273b9ac000 2024-04-26T07:54:34.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.669+0000 7f879593e640 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9ac000 0x56273b9ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.670+0000 7f879593e640 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9ac000 0x56273b9ae3f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.670+0000 7f879593e640 1 -- 172.21.15.62:0/2095043262 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f878805a040 con 0x56273b9ac000 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.670+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9aaf80 con 0x56273b8aa8b0 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.671+0000 7f879613f640 1 -- 172.21.15.62:0/2095043262 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f879000a4a0 con 0x56273b8aa8b0 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.671+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ab460 con 0x56273b8aa8b0 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.671+0000 7f879613f640 1 -- 172.21.15.62:0/2095043262 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f879000a4a0 con 0x56273b8aa8b0 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.671+0000 7f8797e3f800 1 Processor -- start 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.671+0000 7f8797e3f800 1 -- start start 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.671+0000 7f8797e3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b81f290 0x56273b81d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.671+0000 7f8797e3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56273b79c170 con 0x56273b81f290 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f879613f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b81f290 0x56273b81d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f879613f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b81f290 0x56273b81d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60950/0 (socket says 172.21.15.62:60950) 2024-04-26T07:54:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f879613f640 1 -- 172.21.15.62:0/3569039625 learned_addr learned my addr 172.21.15.62:0/3569039625 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f879613f640 1 -- 172.21.15.62:0/3569039625 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273b81dc40 con 0x56273b81f290 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f879613f640 1 --2- 172.21.15.62:0/3569039625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b81f290 0x56273b81d700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56273b9aa080 tx=0x7f8790018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f867b7fe640 1 -- 172.21.15.62:0/3569039625 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8790014450 con 0x56273b81f290 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f867b7fe640 1 -- 172.21.15.62:0/3569039625 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87900145f0 con 0x56273b81f290 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f8797e3f800 1 -- 172.21.15.62:0/3569039625 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56273b81ded0 con 0x56273b81f290 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f867b7fe640 1 -- 172.21.15.62:0/3569039625 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87900148d0 con 0x56273b81f290 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.672+0000 7f8797e3f800 1 -- 172.21.15.62:0/3569039625 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273b81e3d0 con 0x56273b81f290 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.673+0000 7f867b7fe640 1 -- 172.21.15.62:0/3569039625 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8790011040 con 0x56273b81f290 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.673+0000 7f867b7fe640 1 --2- 172.21.15.62:0/3569039625 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8670036eb0 0x7f8670039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.673+0000 7f867b7fe640 1 -- 172.21.15.62:0/3569039625 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f879001e070 con 0x56273b81f290 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.673+0000 7f879593e640 1 --2- 172.21.15.62:0/3569039625 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8670036eb0 0x7f8670039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.673+0000 7f8797e3f800 1 Processor -- start 2024-04-26T07:54:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.673+0000 7f8797e3f800 1 -- start start 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.673+0000 7f879593e640 1 --2- 172.21.15.62:0/3569039625 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8670036eb0 0x7f8670039370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f878808c2e0 tx=0x7f87880677b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f8797e3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f8797e3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56273b99b390 con 0x56273b9cd0e0 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f879613f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f879613f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60960/0 (socket says 172.21.15.62:60960) 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f879613f640 1 -- 172.21.15.62:0/3654026336 learned_addr learned my addr 172.21.15.62:0/3654026336 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f879613f640 1 -- 172.21.15.62:0/3654026336 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273b9cdad0 con 0x56273b9cd0e0 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f879613f640 1 --2- 172.21.15.62:0/3654026336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9cd500 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f879004d040 tx=0x7f8790041420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d18cfce5b8485c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f86797fa640 1 -- 172.21.15.62:0/3654026336 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87900168f0 con 0x56273b9cd0e0 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f86797fa640 1 -- 172.21.15.62:0/3654026336 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8790013c90 con 0x56273b9cd0e0 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.674+0000 7f86797fa640 1 -- 172.21.15.62:0/3654026336 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8790014a70 con 0x56273b9cd0e0 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 -- 172.21.15.62:0/3654026336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 msgr2=0x56273b9cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 --2- 172.21.15.62:0/3654026336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9cd500 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f879004d040 tx=0x7f8790041420 comp rx=0 tx=0).stop 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 -- 172.21.15.62:0/3654026336 shutdown_connections 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 --2- 172.21.15.62:0/3654026336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9cd500 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 -- 172.21.15.62:0/3654026336 >> 172.21.15.62:0/3654026336 conn(0x56273b9c93b0 msgr2=0x56273b9c7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 -- 172.21.15.62:0/3654026336 shutdown_connections 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 -- 172.21.15.62:0/3654026336 wait complete. 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 Processor -- start 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 -- start start 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9d4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f8797e3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56273b9ce220 con 0x56273b9cd0e0 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.675+0000 7f879613f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f879613f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9d4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60968/0 (socket says 172.21.15.62:60968) 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 learned_addr learned my addr 172.21.15.62:0/1407891946 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273b9d4a90 con 0x56273b9cd0e0 2024-04-26T07:54:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f879613f640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9d4550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f879004bf60 tx=0x7f879004cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f86677fe640 1 -- 172.21.15.62:0/1407891946 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8790022a80 con 0x56273b9cd0e0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f86677fe640 1 -- 172.21.15.62:0/1407891946 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8790022c20 con 0x56273b9cd0e0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56273b9d4d20 con 0x56273b9cd0e0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f86677fe640 1 -- 172.21.15.62:0/1407891946 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87900133b0 con 0x56273b9cd0e0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.676+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273b9d79d0 con 0x56273b9cd0e0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.677+0000 7f86677fe640 1 -- 172.21.15.62:0/1407891946 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f87900135a0 con 0x56273b9cd0e0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.677+0000 7f86677fe640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8660036e50 0x7f8660039310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.677+0000 7f86677fe640 1 -- 172.21.15.62:0/1407891946 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f879000e040 con 0x56273b9cd0e0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.677+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.677+0000 7f879593e640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8660036e50 0x7f8660039310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.677+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b9e0070 0x56273b9e2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.677+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9e2c60 con 0x56273b9e0070 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f879513d640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b9e0070 0x56273b9e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f879593e640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8660036e50 0x7f8660039310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f878808c540 tx=0x7f8788080000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f879513d640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b9e0070 0x56273b9e2510 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f878c00f5f0 con 0x56273b9e0070 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f8797e3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f8797e3f800 20 realm 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9df540 con 0x56273b9e0070 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f878c00f5f0 con 0x56273b9e0070 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f8797e3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f8797e3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.678+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9e3740 con 0x56273b9e0070 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f878c00f5f0 con 0x56273b9e0070 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f8797e3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9e4010 con 0x56273b9e0070 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f878c00f5f0 con 0x56273b9e0070 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f8797e3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9e4950 0x56273b9e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9e74c0 con 0x56273b9e4950 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.679+0000 7f879613f640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9e4950 0x56273b9e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.680+0000 7f879613f640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9e4950 0x56273b9e6d60 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.680+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.680+0000 7f8797e3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.680+0000 7f8797e3f800 20 searching for the correct realm 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.680+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56273b9e9570 0x56273b9eba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.680+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.680+0000 7f879593e640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56273b9e9570 0x56273b9eba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.680+0000 7f879593e640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56273b9e9570 0x56273b9eba30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.681+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.681+0000 7f879593e640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8788094070 0x7f878806f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.681+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x7f8788094070 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.681+0000 7f879513d640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8788094070 0x7f878806f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.681+0000 7f879513d640 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8788094070 0x7f878806f360 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.681+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c00f5f0 con 0x7f8788094070 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.682+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.682+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.682+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e0070 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.682+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c00f5f0 con 0x56273b9e0070 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.682+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e0070 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.682+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.682+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.683+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.683+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.683+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.683+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x7f8788094070 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.683+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.683+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.683+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.683+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e0070 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.684+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.684+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.684+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.684+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e0070 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.684+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.684+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x7f8788094070 2024-04-26T07:54:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.685+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.685+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.685+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.685+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.685+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.685+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.685+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.685+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.686+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.686+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.686+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.686+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e0070 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.686+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.686+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e0070 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.686+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.686+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.687+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.687+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.687+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.687+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x7f8788094070 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.687+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.687+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e0070 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.687+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.687+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.688+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.688+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.688+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.688+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.688+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.688+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x7f8788094070 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.689+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.689+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e9570 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.689+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.689+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e4950 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.689+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.689+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x56273b9e0070 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.689+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.689+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec100 con 0x7f8788094070 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9e7f70 con 0x56273b9e0070 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9e8360 con 0x56273b9e0070 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9e87f0 con 0x56273b9e0070 2024-04-26T07:54:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 zone default found 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 4 Realm: () 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 zonegroup default 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.690+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ec580 con 0x56273b9e4950 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ee390 con 0x56273b9e9570 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ee820 con 0x56273b9e9570 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 20 started sync module instance, tier type = 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.691+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ed7a0 con 0x7f8788094070 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.692+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.692+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94726503980192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ed7a0 con 0x7f8788094070 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.692+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ef340 con 0x56273b9e0070 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.693+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94726503980192] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.694+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.694+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94726503984720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ed7a0 con 0x56273b9e0070 2024-04-26T07:54:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.694+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9efdf0 con 0x56273b9e9570 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.695+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94726503984720] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.695+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.695+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94726503977712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f0190 con 0x56273b9e9570 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.695+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f0be0 con 0x7f8788094070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.696+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.696+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94726503990992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f0ba0 con 0x7f8788094070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.696+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f1ba0 con 0x56273b9e0070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.696+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94726503977712] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.697+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.697+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94726503995088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f1ba0 con 0x56273b9e0070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.697+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f25b0 con 0x56273b9e4950 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.697+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94726503990992] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.698+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94726503995088] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.698+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.698+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94726503987456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f2100 con 0x56273b9e4950 2024-04-26T07:54:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.698+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f2e50 con 0x56273b9e4950 2024-04-26T07:54:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.699+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.699+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94726503999904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f3270 con 0x56273b9e4950 2024-04-26T07:54:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.699+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f3ac0 con 0x56273b9e4950 2024-04-26T07:54:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.699+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94726503987456] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94726503999904] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94726504000960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f3690 con 0x56273b9e4950 2024-04-26T07:54:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f8797e3f800 20 add_watcher() i=0 2024-04-26T07:54:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f8797e3f800 20 add_watcher() i=1 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f8797e3f800 20 add_watcher() i=2 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f8797e3f800 20 add_watcher() i=3 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f8797e3f800 20 add_watcher() i=4 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f8797e3f800 20 add_watcher() i=5 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.700+0000 7f8797e3f800 20 add_watcher() i=6 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.701+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94726504000960] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.701+0000 7f8797e3f800 20 add_watcher() i=7 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.701+0000 7f8797e3f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.701+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f6850 con 0x56273b9e0070 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.701+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.702+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94726504014400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f3690 con 0x56273b9e0070 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94726504014400] v27'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f86477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f8797e3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f8797e3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f8797e3f800 5 note: GC not initialized 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f86467fc640 20 reqs_thread_entry: start 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f8797e3f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f8797e3f800 20 Filter name: none 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f85b7fff640 20 reqs_thread_entry: start 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f8797e3f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.703+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56273ba29c30 con 0x56273b9e0070 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.704+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.704+0000 7f8797e3f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.705+0000 7f86477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.705+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94726504014400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f5800 con 0x56273b9e0070 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.706+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94726504014400] v27'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.706+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94726503980192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9f6240 con 0x7f8788094070 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.707+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94726503980192] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.707+0000 7f8797e3f800 20 remove_watcher() i=0 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.707+0000 7f8797e3f800 2 removed watcher, disabling cache 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.707+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94726503984720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9edca0 con 0x56273b9e0070 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.708+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94726503984720] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.708+0000 7f8797e3f800 20 remove_watcher() i=1 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.708+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94726503977712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9edca0 con 0x56273b9e9570 2024-04-26T07:54:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.709+0000 7f879593e640 1 -- 172.21.15.62:0/1407891946 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94726503977712] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878805a040 con 0x56273b9e9570 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.709+0000 7f8797e3f800 20 remove_watcher() i=2 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.709+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94726503990992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ed2f0 con 0x7f8788094070 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.710+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94726503990992] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x7f8788094070 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.710+0000 7f8797e3f800 20 remove_watcher() i=3 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.710+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94726503995088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9edca0 con 0x56273b9e0070 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.711+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94726503995088] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c02b040 con 0x56273b9e0070 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.711+0000 7f8797e3f800 20 remove_watcher() i=4 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.711+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94726503987456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ed2f0 con 0x56273b9e4950 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.712+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94726503987456] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.712+0000 7f8797e3f800 20 remove_watcher() i=5 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.712+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94726503999904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9edca0 con 0x56273b9e4950 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.713+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94726503999904] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.713+0000 7f8797e3f800 20 remove_watcher() i=6 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.713+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94726504000960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56273b9ef900 con 0x56273b9e4950 2024-04-26T07:54:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f879613f640 1 -- 172.21.15.62:0/1407891946 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94726504000960] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879002a070 con 0x56273b9e4950 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 20 remove_watcher() i=7 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9e4950 msgr2=0x56273b9e6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9e4950 0x56273b9e6d60 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b9e0070 msgr2=0x56273b9e2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b9e0070 0x56273b9e2510 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8788094070 msgr2=0x7f878806f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8788094070 0x7f878806f360 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56273b9e9570 msgr2=0x56273b9eba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56273b9e9570 0x56273b9eba30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8660036e50 msgr2=0x7f8660039310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8660036e50 0x7f8660039310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f878808c540 tx=0x7f8788080000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 msgr2=0x56273b9d4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9d4550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f879004bf60 tx=0x7f879004cfd0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f879513d640 1 -- 172.21.15.62:0/1407891946 reap_dead start 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 shutdown_connections 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/1407891946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b9cd0e0 0x56273b9d4550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 >> 172.21.15.62:0/1407891946 conn(0x56273b9c93b0 msgr2=0x56273b9c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 shutdown_connections 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/1407891946 wait complete. 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/3569039625 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8670036eb0 msgr2=0x7f8670039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/3569039625 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8670036eb0 0x7f8670039370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f878808c2e0 tx=0x7f87880677b0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 -- 172.21.15.62:0/3569039625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b81f290 msgr2=0x56273b81d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.714+0000 7f8797e3f800 1 --2- 172.21.15.62:0/3569039625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b81f290 0x56273b81d700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56273b9aa080 tx=0x7f8790018830 comp rx=0 tx=0).stop 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/3569039625 shutdown_connections 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/3569039625 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8670036eb0 0x7f8670039370 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/3569039625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b81f290 0x56273b81d700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/3569039625 >> 172.21.15.62:0/3569039625 conn(0x56273b9b1c60 msgr2=0x56273b9b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/3569039625 shutdown_connections 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/3569039625 wait complete. 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9ac000 msgr2=0x56273b9ae3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9ac000 0x56273b9ae3f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b8aa8b0 msgr2=0x56273b9a9720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b8aa8b0 0x56273b9a9720 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f867c036e60 msgr2=0x7f867c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f867c036e60 0x7f867c039320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f878c000c00 tx=0x7f878c0013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 msgr2=0x56273b9a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b9a24e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8788000c00 tx=0x7f8788002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 shutdown_connections 2024-04-26T07:54:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56273b8aa8b0 0x56273b9a9720 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56273b9ac000 0x56273b9ae3f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f867c036e60 0x7f867c039320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 --2- 172.21.15.62:0/2095043262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56273b8a9740 0x56273b9a24e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 >> 172.21.15.62:0/2095043262 conn(0x56273b8a4d20 msgr2=0x56273b994c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 shutdown_connections 2024-04-26T07:54:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.715+0000 7f8797e3f800 1 -- 172.21.15.62:0/2095043262 wait complete. 2024-04-26T07:54:34.724 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:34.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-26T07:54:34.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-26T07:54:34.724 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-04-26T07:54:34.772 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:34.773 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.775+0000 7f57ce32e800 1 Processor -- start 2024-04-26T07:54:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.775+0000 7f57ce32e800 1 -- start start 2024-04-26T07:54:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.775+0000 7f57ce32e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f83c471990 0x55f83c471db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.775+0000 7f57ce32e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f83c4723e0 con 0x55f83c474980 2024-04-26T07:54:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.775+0000 7f57ce32e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55f83c315e20 con 0x55f83c471990 2024-04-26T07:54:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.775+0000 7f57ca067640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f83c471990 0x55f83c471db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.775+0000 7f57c9866640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55f83c474980 0x55f83c474e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36518/0 (socket says 172.21.15.62:36518) 2024-04-26T07:54:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.775+0000 7f57c9866640 1 -- 172.21.15.62:0/2327732871 learned_addr learned my addr 172.21.15.62:0/2327732871 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:34.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.776+0000 7f57ca067640 1 -- 172.21.15.62:0/2327732871 >> v1:172.21.15.1:6789/0 conn(0x55f83c474980 legacy=0x55f83c474e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.776+0000 7f57ca067640 1 -- 172.21.15.62:0/2327732871 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83c475540 con 0x55f83c471990 2024-04-26T07:54:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57ca067640 1 --2- 172.21.15.62:0/2327732871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c471db0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00a470 tx=0x7f57bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2b9fc2975d6654 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57c9065640 1 -- 172.21.15.62:0/2327732871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc057070 con 0x55f83c471990 2024-04-26T07:54:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57c9065640 1 -- 172.21.15.62:0/2327732871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc04adc0 con 0x55f83c471990 2024-04-26T07:54:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57c9065640 1 -- 172.21.15.62:0/2327732871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc052590 con 0x55f83c471990 2024-04-26T07:54:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57ce32e800 1 -- 172.21.15.62:0/2327732871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 msgr2=0x55f83c471db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57ce32e800 1 --2- 172.21.15.62:0/2327732871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c471db0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00a470 tx=0x7f57bc01ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57ce32e800 1 -- 172.21.15.62:0/2327732871 shutdown_connections 2024-04-26T07:54:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57ce32e800 1 --2- 172.21.15.62:0/2327732871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c471db0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57ce32e800 1 -- 172.21.15.62:0/2327732871 >> 172.21.15.62:0/2327732871 conn(0x55f83c46d340 msgr2=0x55f83c46f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57ce32e800 1 -- 172.21.15.62:0/2327732871 shutdown_connections 2024-04-26T07:54:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.778+0000 7f57ce32e800 1 -- 172.21.15.62:0/2327732871 wait complete. 2024-04-26T07:54:34.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.791+0000 7f57ce32e800 1 Processor -- start 2024-04-26T07:54:34.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.791+0000 7f57ce32e800 1 -- start start 2024-04-26T07:54:34.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.791+0000 7f57ce32e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c564e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.791+0000 7f57ce32e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f83c3becf0 con 0x55f83c471990 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.791+0000 7f57ca067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c564e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.792+0000 7f57ca067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c564e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60986/0 (socket says 172.21.15.62:60986) 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.792+0000 7f57ca067640 1 -- 172.21.15.62:0/1834014119 learned_addr learned my addr 172.21.15.62:0/1834014119 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.792+0000 7f57ca067640 1 -- 172.21.15.62:0/1834014119 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83c565440 con 0x55f83c471990 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.792+0000 7f57ca067640 1 --2- 172.21.15.62:0/1834014119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c564e70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f57bc055040 tx=0x7f57bc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c43c484395ed17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.792+0000 7f56b8608640 1 -- 172.21.15.62:0/1834014119 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc057040 con 0x55f83c471990 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.792+0000 7f56b8608640 1 -- 172.21.15.62:0/1834014119 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc063070 con 0x55f83c471990 2024-04-26T07:54:34.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.792+0000 7f56b8608640 1 -- 172.21.15.62:0/1834014119 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc05d790 con 0x55f83c471990 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 -- 172.21.15.62:0/1834014119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 msgr2=0x55f83c564e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1834014119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c564e70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f57bc055040 tx=0x7f57bc04c000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 -- 172.21.15.62:0/1834014119 shutdown_connections 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1834014119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c564e70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 -- 172.21.15.62:0/1834014119 >> 172.21.15.62:0/1834014119 conn(0x55f83c46d340 msgr2=0x55f83c560790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 -- 172.21.15.62:0/1834014119 shutdown_connections 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 -- 172.21.15.62:0/1834014119 wait complete. 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 Processor -- start 2024-04-26T07:54:34.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 -- start start 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c4742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.793+0000 7f57ce32e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f83c47ce50 con 0x55f83c471990 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f57ca067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c4742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f57ca067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c4742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60990/0 (socket says 172.21.15.62:60990) 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f57ca067640 1 -- 172.21.15.62:0/1490576482 learned_addr learned my addr 172.21.15.62:0/1490576482 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f57ca067640 1 -- 172.21.15.62:0/1490576482 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83c4729b0 con 0x55f83c471990 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f57ca067640 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c4742c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00a470 tx=0x7f57bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f56b6e05640 1 -- 172.21.15.62:0/1490576482 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc057050 con 0x55f83c471990 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f56b6e05640 1 -- 172.21.15.62:0/1490576482 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc05dc90 con 0x55f83c471990 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f56b6e05640 1 -- 172.21.15.62:0/1490576482 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc052440 con 0x55f83c471990 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f83c472c40 con 0x55f83c471990 2024-04-26T07:54:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.794+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83c4731c0 con 0x55f83c471990 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.795+0000 7f56b6e05640 1 -- 172.21.15.62:0/1490576482 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f57bc052670 con 0x55f83c471990 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.795+0000 7f56b6e05640 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56b0036e60 0x7f56b0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.795+0000 7f56b6e05640 1 -- 172.21.15.62:0/1490576482 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f57bc08e370 con 0x55f83c471990 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.795+0000 7f57c9866640 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56b0036e60 0x7f56b0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.795+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c474980 0x55f83c575f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.795+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c576480 con 0x55f83c474980 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.796+0000 7f57ca868640 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c474980 0x55f83c575f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.796+0000 7f57c9866640 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56b0036e60 0x7f56b0039320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57c0000f60 tx=0x7f57c00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.796+0000 7f57ca868640 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c474980 0x55f83c575f40 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.796+0000 7f57ca868640 1 -- 172.21.15.62:0/1490576482 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c400a4a0 con 0x55f83c474980 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.796+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c576cd0 con 0x55f83c474980 2024-04-26T07:54:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.796+0000 7f57ca868640 1 -- 172.21.15.62:0/1490576482 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f57c400a4a0 con 0x55f83c474980 2024-04-26T07:54:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.796+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c578700 0x55f83c57ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.796+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c57b320 con 0x55f83c578700 2024-04-26T07:54:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.797+0000 7f57ca067640 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c578700 0x55f83c57ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.797+0000 7f57ca067640 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c578700 0x55f83c57ab90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.797+0000 7f57ca067640 1 -- 172.21.15.62:0/1490576482 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c578700 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.797+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c577550 con 0x55f83c474980 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.798+0000 7f57ca868640 1 -- 172.21.15.62:0/1490576482 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f57c400a4a0 con 0x55f83c474980 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.798+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c577a30 con 0x55f83c474980 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.798+0000 7f57ca868640 1 -- 172.21.15.62:0/1490576482 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f57c400a4a0 con 0x55f83c474980 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.798+0000 7f57ce32e800 1 Processor -- start 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.798+0000 7f57ce32e800 1 -- start start 2024-04-26T07:54:34.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.798+0000 7f57ce32e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c58a3b0 0x55f83c58a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.798+0000 7f57ce32e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f83c474800 con 0x55f83c58a3b0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f57ca868640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c58a3b0 0x55f83c58a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f57ca868640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c58a3b0 0x55f83c58a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:60996/0 (socket says 172.21.15.62:60996) 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f57ca868640 1 -- 172.21.15.62:0/343431038 learned_addr learned my addr 172.21.15.62:0/343431038 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f57ca868640 1 -- 172.21.15.62:0/343431038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83c58ad10 con 0x55f83c58a3b0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f57ca868640 1 --2- 172.21.15.62:0/343431038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c58a3b0 0x55f83c58a7d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55f83c473c20 tx=0x7f57c4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f56affff640 1 -- 172.21.15.62:0/343431038 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c4014450 con 0x55f83c58a3b0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f56affff640 1 -- 172.21.15.62:0/343431038 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c4014610 con 0x55f83c58a3b0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f56affff640 1 -- 172.21.15.62:0/343431038 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c4014930 con 0x55f83c58a3b0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f57ce32e800 1 -- 172.21.15.62:0/343431038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f83c58b780 con 0x55f83c58a3b0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.799+0000 7f57ce32e800 1 -- 172.21.15.62:0/343431038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83c58bc80 con 0x55f83c58a3b0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.800+0000 7f56affff640 1 -- 172.21.15.62:0/343431038 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f57c4011040 con 0x55f83c58a3b0 2024-04-26T07:54:34.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.800+0000 7f56affff640 1 --2- 172.21.15.62:0/343431038 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56a4036eb0 0x7f56a4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.800+0000 7f56affff640 1 -- 172.21.15.62:0/343431038 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f57c401e070 con 0x55f83c58a3b0 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.800+0000 7f57ca067640 1 --2- 172.21.15.62:0/343431038 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56a4036eb0 0x7f56a4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ce32e800 1 Processor -- start 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ce32e800 1 -- start start 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ca067640 1 --2- 172.21.15.62:0/343431038 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56a4036eb0 0x7f56a4039370 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55f83c473750 tx=0x7f57bc08c650 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ce32e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c597a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ce32e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f83c366170 con 0x55f83c597670 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ca868640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c597a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ca868640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c597a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32774/0 (socket says 172.21.15.62:32774) 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ca868640 1 -- 172.21.15.62:0/1210561186 learned_addr learned my addr 172.21.15.62:0/1210561186 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ca868640 1 -- 172.21.15.62:0/1210561186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83c598060 con 0x55f83c597670 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.801+0000 7f57ca868640 1 --2- 172.21.15.62:0/1210561186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c597a90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f57c404cf20 tx=0x7f57c4011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665ca93a81638ba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f56adffb640 1 -- 172.21.15.62:0/1210561186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c403d050 con 0x55f83c597670 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f56adffb640 1 -- 172.21.15.62:0/1210561186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c400dd90 con 0x55f83c597670 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f56adffb640 1 -- 172.21.15.62:0/1210561186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c4016910 con 0x55f83c597670 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 -- 172.21.15.62:0/1210561186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 msgr2=0x55f83c597a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1210561186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c597a90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f57c404cf20 tx=0x7f57c4011ef0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 -- 172.21.15.62:0/1210561186 shutdown_connections 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1210561186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c597a90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 -- 172.21.15.62:0/1210561186 >> 172.21.15.62:0/1210561186 conn(0x55f83c593990 msgr2=0x55f83c5919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 -- 172.21.15.62:0/1210561186 shutdown_connections 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 -- 172.21.15.62:0/1210561186 wait complete. 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 Processor -- start 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.802+0000 7f57ce32e800 1 -- start start 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ce32e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c59eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ce32e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f83c598660 con 0x55f83c597670 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ca868640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c59eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ca868640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c59eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32784/0 (socket says 172.21.15.62:32784) 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 learned_addr learned my addr 172.21.15.62:0/3115353712 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83c59f020 con 0x55f83c597670 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ca868640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c59eae0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57c4043040 tx=0x7f57c404ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f569bfff640 1 -- 172.21.15.62:0/3115353712 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c403b070 con 0x55f83c597670 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f569bfff640 1 -- 172.21.15.62:0/3115353712 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c40135c0 con 0x55f83c597670 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f83c59f2b0 con 0x55f83c597670 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f569bfff640 1 -- 172.21.15.62:0/3115353712 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c404e3d0 con 0x55f83c597670 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.803+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83c5a1f60 con 0x55f83c597670 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.804+0000 7f569bfff640 1 -- 172.21.15.62:0/3115353712 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f57c4046d10 con 0x55f83c597670 2024-04-26T07:54:34.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.804+0000 7f569bfff640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5694036eb0 0x7f5694039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.804+0000 7f569bfff640 1 -- 172.21.15.62:0/3115353712 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f57c4033070 con 0x55f83c597670 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.804+0000 7f57ca067640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5694036eb0 0x7f5694039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c5aa690 0x55f83c5acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5ad2a0 con 0x55f83c5aa690 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57ca067640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5694036eb0 0x7f5694039370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57bc08e2e0 tx=0x7f57bc084000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57c9866640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c5aa690 0x55f83c5acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57c9866640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c5aa690 0x55f83c5acb50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x55f83c5aa690 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57ce32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57ce32e800 20 realm 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.805+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5a9ae0 con 0x55f83c5aa690 2024-04-26T07:54:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x55f83c5aa690 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5add90 con 0x55f83c5aa690 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x55f83c5aa690 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5ae660 con 0x55f83c5aa690 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f57c0009050 con 0x55f83c5aa690 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c5aefa0 0x55f83c5b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.806+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b1b20 con 0x55f83c5aefa0 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.807+0000 7f57ca868640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c5aefa0 0x55f83c5b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.807+0000 7f57ca868640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c5aefa0 0x55f83c5b1390 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.807+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.807+0000 7f57ce32e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.807+0000 7f57ce32e800 20 searching for the correct realm 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.807+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f83c5b3af0 0x55f83c5b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.807+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.807+0000 7f57ca067640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f83c5b3af0 0x55f83c5b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.808+0000 7f57ca067640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f83c5b3af0 0x55f83c5b5fb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.808+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.808+0000 7f57ca067640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f57bc09c040 0x7f57bc08f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.808+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x7f57bc09c040 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.808+0000 7f57c9866640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f57bc09c040 0x7f57bc08f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.809+0000 7f57c9866640 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f57bc09c040 0x7f57bc08f6a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.809+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x7f57bc09c040 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.809+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.809+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.809+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aa690 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.809+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x55f83c5aa690 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.809+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aa690 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.810+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.810+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.810+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.810+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.810+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.810+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x7f57bc09c040 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.810+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0029040 con 0x7f57bc09c040 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.810+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.811+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.811+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aa690 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.811+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.811+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.811+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.811+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aa690 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.812+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.812+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x7f57bc09c040 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.812+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f57c0029040 con 0x7f57bc09c040 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.812+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.812+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.812+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.812+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.812+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.813+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.813+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.813+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.813+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.813+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.813+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aa690 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.813+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.813+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aa690 2024-04-26T07:54:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.814+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.814+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.814+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.814+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.814+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.814+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x7f57bc09c040 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.815+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0029040 con 0x7f57bc09c040 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.815+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aa690 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.815+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.815+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.815+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.815+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.816+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.816+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.816+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.816+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x7f57bc09c040 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.816+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0029040 con 0x7f57bc09c040 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.816+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5b3af0 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.816+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.816+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aefa0 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.817+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.817+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x55f83c5aa690 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.817+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.817+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6680 con 0x7f57bc09c040 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.817+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0029040 con 0x7f57bc09c040 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b24e0 con 0x55f83c5aa690 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b2d80 con 0x55f83c5aa690 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b2120 con 0x55f83c5aa690 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f57c0029040 con 0x55f83c5aa690 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 zone default found 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 4 Realm: () 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 zonegroup default 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.818+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b6b60 con 0x55f83c5aefa0 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b8e30 con 0x55f83c5b3af0 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b91d0 con 0x55f83c5b3af0 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 20 started sync module instance, tier type = 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.819+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b82c0 con 0x7f57bc09c040 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.820+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x7f57bc09c040 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.820+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94524652881904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b82c0 con 0x7f57bc09c040 2024-04-26T07:54:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.820+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b9be0 con 0x55f83c5aa690 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.821+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94524652881904] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x7f57bc09c040 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.821+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.822+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94524652886288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b82c0 con 0x55f83c5aa690 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.822+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5ba5f0 con 0x55f83c5b3af0 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.823+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94524652886288] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.823+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.823+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94524652879376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b8230 con 0x55f83c5b3af0 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.823+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bb4e0 con 0x7f57bc09c040 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.824+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94524652879376] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.824+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x7f57bc09c040 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.824+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94524652892208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bb900 con 0x7f57bc09c040 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.824+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bc1d0 con 0x55f83c5aa690 2024-04-26T07:54:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.825+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.825+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94524652894464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bbd20 con 0x55f83c5aa690 2024-04-26T07:54:34.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.825+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bd140 con 0x55f83c5aefa0 2024-04-26T07:54:34.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.825+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94524652892208] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x7f57bc09c040 2024-04-26T07:54:34.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.826+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.826+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94524652899344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bd100 con 0x55f83c5aefa0 2024-04-26T07:54:34.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.826+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bdb90 con 0x55f83c5aefa0 2024-04-26T07:54:34.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.826+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94524652894464] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.827+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94524652899344] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.827+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.827+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94524652893264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bc5f0 con 0x55f83c5aefa0 2024-04-26T07:54:34.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.827+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5be080 con 0x55f83c5aefa0 2024-04-26T07:54:34.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94524652893264] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94524652903312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bdfb0 con 0x55f83c5aefa0 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 20 add_watcher() i=0 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 20 add_watcher() i=1 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 20 add_watcher() i=2 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 20 add_watcher() i=3 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 20 add_watcher() i=4 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 20 add_watcher() i=5 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 20 add_watcher() i=6 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94524652903312] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 20 add_watcher() i=7 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.829+0000 7f57ce32e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.830+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bd730 con 0x55f83c5aa690 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.830+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.830+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94524652905584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bd730 con 0x55f83c5aa690 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.831+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94524652905584] v27'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.831+0000 7f5680fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.831+0000 7f57ce32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.831+0000 7f57ce32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.831+0000 7f57ce32e800 5 note: GC not initialized 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.831+0000 7f55fb7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.831+0000 7f57ce32e800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.831+0000 7f57ce32e800 20 Filter name: none 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f55f97fa640 20 reqs_thread_entry: start 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5f4d10 con 0x55f83c5aa690 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5f5780 con 0x55f83c5aefa0 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T07:54:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.832+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5fb130 con 0x55f83c5aa690 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v27'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f57ce32e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f57ce32e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f57ce32e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94524653153184 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5f6820 con 0x55f83c5aa690 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94524652894464 notify 115964116995 ret 0) ==== 720+0+0 (crc 0 0 0) 0x55f83c4723e0 con 0x55f83c5aa690 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f56adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94524652894464 notifier 4333 bl.length()=678 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f56adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f56adffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 notify.4 [notify cookie 94524653153184 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f56adffb640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f5690003ea0 con 0x55f83c5aa690 2024-04-26T07:54:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.834+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.835+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94524653153184 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f57c002da70 con 0x55f83c5aa690 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.835+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5faba0 con 0x55f83c5aefa0 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ce32e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ce32e800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ce32e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94524653153184 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5f6370 con 0x55f83c5b3af0 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== watch-notify(notify (1) cookie 94524652879376 notify 115964116992 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f57bc0a4040 con 0x55f83c5b3af0 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f56adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94524652879376 notifier 4333 bl.length()=177 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f56adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f56adffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(68 notify.2 [notify cookie 94524653153184 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f56adffb640 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f5690003ea0 con 0x55f83c5b3af0 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.836+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== watch-notify(notify_complete (2) cookie 94524653153184 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f83c4731c0 con 0x55f83c5b3af0 2024-04-26T07:54:34.845 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T07:54:34.833930Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.837+0000 7f5680fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.837+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94524652905584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5f6c50 con 0x55f83c5aa690 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.838+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94524652905584] v27'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.838+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94524652881904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5be400 con 0x7f57bc09c040 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.839+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94524652881904] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x7f57bc09c040 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.839+0000 7f57ce32e800 20 remove_watcher() i=0 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.839+0000 7f57ce32e800 2 removed watcher, disabling cache 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.839+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94524652886288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b87f0 con 0x55f83c5aa690 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.840+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94524652886288] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.840+0000 7f57ce32e800 20 remove_watcher() i=1 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.840+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94524652879376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b9910 con 0x55f83c5b3af0 2024-04-26T07:54:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.841+0000 7f57ca067640 1 -- 172.21.15.62:0/3115353712 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94524652879376] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc078070 con 0x55f83c5b3af0 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.841+0000 7f57ce32e800 20 remove_watcher() i=2 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.841+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94524652892208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b7e10 con 0x7f57bc09c040 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.842+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94524652892208] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x7f57bc09c040 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.842+0000 7f57ce32e800 20 remove_watcher() i=3 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.842+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94524652894464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b7e10 con 0x55f83c5aa690 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.843+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94524652894464] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0039040 con 0x55f83c5aa690 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.843+0000 7f57ce32e800 20 remove_watcher() i=4 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.843+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94524652899344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5bb900 con 0x55f83c5aefa0 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.844+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94524652899344] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.844+0000 7f57ce32e800 20 remove_watcher() i=5 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.844+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94524652893264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b7e10 con 0x55f83c5aefa0 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.845+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94524652893264] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.845+0000 7f57ce32e800 20 remove_watcher() i=6 2024-04-26T07:54:34.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.845+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94524652903312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f83c5b7e10 con 0x55f83c5aefa0 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ca868640 1 -- 172.21.15.62:0/3115353712 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94524652903312] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c402a070 con 0x55f83c5aefa0 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 20 remove_watcher() i=7 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c5aefa0 msgr2=0x55f83c5b1390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c5aefa0 0x55f83c5b1390 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c5aa690 msgr2=0x55f83c5acb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c5aa690 0x55f83c5acb50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f57bc09c040 msgr2=0x7f57bc08f6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f57bc09c040 0x7f57bc08f6a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f83c5b3af0 msgr2=0x55f83c5b5fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f83c5b3af0 0x55f83c5b5fb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5694036eb0 msgr2=0x7f5694039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5694036eb0 0x7f5694039370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57bc08e2e0 tx=0x7f57bc084000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 msgr2=0x55f83c59eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 --2- 172.21.15.62:0/3115353712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c597670 0x55f83c59eae0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57c4043040 tx=0x7f57c404ceb0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 reap_dead start 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57c9866640 1 -- 172.21.15.62:0/3115353712 reap_dead start 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 shutdown_connections 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.846+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 >> 172.21.15.62:0/3115353712 conn(0x55f83c593990 msgr2=0x55f83c590ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 shutdown_connections 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/3115353712 wait complete. 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/343431038 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56a4036eb0 msgr2=0x7f56a4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/343431038 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56a4036eb0 0x7f56a4039370 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55f83c473750 tx=0x7f57bc08c650 comp rx=0 tx=0).stop 2024-04-26T07:54:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/343431038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c58a3b0 msgr2=0x55f83c58a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/343431038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c58a3b0 0x55f83c58a7d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55f83c473c20 tx=0x7f57c4018830 comp rx=0 tx=0).stop 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/343431038 shutdown_connections 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/343431038 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56a4036eb0 0x7f56a4039370 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/343431038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c58a3b0 0x55f83c58a7d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/343431038 >> 172.21.15.62:0/343431038 conn(0x55f83c57e4c0 msgr2=0x55f83c57e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/343431038 shutdown_connections 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/343431038 wait complete. 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c578700 msgr2=0x55f83c57ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c578700 0x55f83c57ab90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c474980 msgr2=0x55f83c575f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c474980 0x55f83c575f40 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56b0036e60 msgr2=0x7f56b0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56b0036e60 0x7f56b0039320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57c0000f60 tx=0x7f57c00012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 msgr2=0x55f83c4742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c4742c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00a470 tx=0x7f57bc002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 shutdown_connections 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f83c474980 0x55f83c575f40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f83c578700 0x55f83c57ab90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f56b0036e60 0x7f56b0039320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 --2- 172.21.15.62:0/1490576482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f83c471990 0x55f83c4742c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.847+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 >> 172.21.15.62:0/1490576482 conn(0x55f83c46d340 msgr2=0x55f83c55ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.848+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 shutdown_connections 2024-04-26T07:54:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.848+0000 7f57ce32e800 1 -- 172.21.15.62:0/1490576482 wait complete. 2024-04-26T07:54:34.856 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T07:54:34.833930Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:34.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:54:34.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:54:34.856 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:54:34.901 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:34.901 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.903+0000 7f9858c13800 1 Processor -- start 2024-04-26T07:54:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.903+0000 7f9858c13800 1 -- start start 2024-04-26T07:54:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.903+0000 7f9858c13800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557d1c54efa0 0x557d1c54f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.903+0000 7f9858c13800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d1c4c4280 con 0x557d1c54f900 2024-04-26T07:54:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.903+0000 7f9858c13800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x557d1c3f2e20 con 0x557d1c54efa0 2024-04-26T07:54:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.904+0000 7f9854347640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557d1c54efa0 0x557d1c54f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.904+0000 7f9853b46640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x557d1c54f900 0x557d1c54fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36520/0 (socket says 172.21.15.62:36520) 2024-04-26T07:54:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.904+0000 7f9853b46640 1 -- 172.21.15.62:0/4218067157 learned_addr learned my addr 172.21.15.62:0/4218067157 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.904+0000 7f9854347640 1 -- 172.21.15.62:0/4218067157 >> v1:172.21.15.1:6789/0 conn(0x557d1c54f900 legacy=0x557d1c54fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.904+0000 7f9854347640 1 -- 172.21.15.62:0/4218067157 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1c5504c0 con 0x557d1c54efa0 2024-04-26T07:54:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.904+0000 7f9853345640 1 -- 172.21.15.62:0/4218067157 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265682741 0 0) 0x557d1c4c4280 con 0x557d1c54f900 2024-04-26T07:54:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.906+0000 7f9854347640 1 --2- 172.21.15.62:0/4218067157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c54f3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f984400a470 tx=0x7f984401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c647b75c03a87e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.906+0000 7f9853345640 1 -- 172.21.15.62:0/4218067157 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844057070 con 0x557d1c54efa0 2024-04-26T07:54:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.906+0000 7f9853345640 1 -- 172.21.15.62:0/4218067157 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844052570 con 0x557d1c54efa0 2024-04-26T07:54:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.906+0000 7f9853345640 1 -- 172.21.15.62:0/4218067157 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844052870 con 0x557d1c54efa0 2024-04-26T07:54:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.906+0000 7f9858c13800 1 -- 172.21.15.62:0/4218067157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 msgr2=0x557d1c54f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.906+0000 7f9858c13800 1 --2- 172.21.15.62:0/4218067157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c54f3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f984400a470 tx=0x7f984401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.907+0000 7f9858c13800 1 -- 172.21.15.62:0/4218067157 shutdown_connections 2024-04-26T07:54:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.907+0000 7f9858c13800 1 --2- 172.21.15.62:0/4218067157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c54f3c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.907+0000 7f9858c13800 1 -- 172.21.15.62:0/4218067157 >> 172.21.15.62:0/4218067157 conn(0x557d1c54ab80 msgr2=0x557d1c54cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.907+0000 7f9858c13800 1 -- 172.21.15.62:0/4218067157 shutdown_connections 2024-04-26T07:54:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.907+0000 7f9858c13800 1 -- 172.21.15.62:0/4218067157 wait complete. 2024-04-26T07:54:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.919+0000 7f9858c13800 1 Processor -- start 2024-04-26T07:54:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.919+0000 7f9858c13800 1 -- start start 2024-04-26T07:54:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.919+0000 7f9858c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c643ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.919+0000 7f9858c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557d1c49bcd0 con 0x557d1c54efa0 2024-04-26T07:54:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.920+0000 7f9854347640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c643ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.920+0000 7f9854347640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c643ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32798/0 (socket says 172.21.15.62:32798) 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.920+0000 7f9854347640 1 -- 172.21.15.62:0/108453980 learned_addr learned my addr 172.21.15.62:0/108453980 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.920+0000 7f9854347640 1 -- 172.21.15.62:0/108453980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1c6444c0 con 0x557d1c54efa0 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.920+0000 7f9854347640 1 --2- 172.21.15.62:0/108453980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c643ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9844055040 tx=0x7f984404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c306eb7eeaa94f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.920+0000 7f974260c640 1 -- 172.21.15.62:0/108453980 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844057070 con 0x557d1c54efa0 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.920+0000 7f974260c640 1 -- 172.21.15.62:0/108453980 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844063070 con 0x557d1c54efa0 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.920+0000 7f974260c640 1 -- 172.21.15.62:0/108453980 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844052720 con 0x557d1c54efa0 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 -- 172.21.15.62:0/108453980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 msgr2=0x557d1c643ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 --2- 172.21.15.62:0/108453980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c643ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9844055040 tx=0x7f984404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 -- 172.21.15.62:0/108453980 shutdown_connections 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 --2- 172.21.15.62:0/108453980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c643ef0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 -- 172.21.15.62:0/108453980 >> 172.21.15.62:0/108453980 conn(0x557d1c54ab80 msgr2=0x557d1c63f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 -- 172.21.15.62:0/108453980 shutdown_connections 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 -- 172.21.15.62:0/108453980 wait complete. 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 Processor -- start 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 -- start start 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.921+0000 7f9858c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c64b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9858c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557d1c550a50 con 0x557d1c54efa0 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9854347640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c64b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9854347640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c64b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32802/0 (socket says 172.21.15.62:32802) 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9854347640 1 -- 172.21.15.62:0/4225392611 learned_addr learned my addr 172.21.15.62:0/4225392611 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9854347640 1 -- 172.21.15.62:0/4225392611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1c64beb0 con 0x557d1c54efa0 2024-04-26T07:54:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9854347640 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c64b970 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9844060040 tx=0x7f9844002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9740e09640 1 -- 172.21.15.62:0/4225392611 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844052e30 con 0x557d1c54efa0 2024-04-26T07:54:34.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9740e09640 1 -- 172.21.15.62:0/4225392611 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984406c070 con 0x557d1c54efa0 2024-04-26T07:54:34.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9740e09640 1 -- 172.21.15.62:0/4225392611 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984405e5f0 con 0x557d1c54efa0 2024-04-26T07:54:34.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d1c64c140 con 0x557d1c54efa0 2024-04-26T07:54:34.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.922+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d1c64edf0 con 0x557d1c54efa0 2024-04-26T07:54:34.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.923+0000 7f9740e09640 1 -- 172.21.15.62:0/4225392611 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f984405e790 con 0x557d1c54efa0 2024-04-26T07:54:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.923+0000 7f9740e09640 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f973c036eb0 0x7f973c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.923+0000 7f9740e09640 1 -- 172.21.15.62:0/4225392611 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f984408ef80 con 0x557d1c54efa0 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.924+0000 7f9853b46640 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f973c036eb0 0x7f973c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.924+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c54f900 0x557d1c652bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.924+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c6530f0 con 0x557d1c54f900 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.924+0000 7f9854b48640 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c54f900 0x557d1c652bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.924+0000 7f9853b46640 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f973c036eb0 0x7f973c039370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9848000c00 tx=0x7f98480013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.924+0000 7f9854b48640 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c54f900 0x557d1c652bb0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.924+0000 7f9854b48640 1 -- 172.21.15.62:0/4225392611 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f984c00a4a0 con 0x557d1c54f900 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.924+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c650160 con 0x557d1c54f900 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.925+0000 7f9854b48640 1 -- 172.21.15.62:0/4225392611 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f984c00a4a0 con 0x557d1c54f900 2024-04-26T07:54:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.925+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c6553e0 0x557d1c6577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.925+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c657ec0 con 0x557d1c6553e0 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.925+0000 7f9854347640 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c6553e0 0x557d1c6577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.925+0000 7f9854347640 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c6553e0 0x557d1c6577d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.925+0000 7f9854347640 1 -- 172.21.15.62:0/4225392611 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9844071990 con 0x557d1c6553e0 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.925+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c654390 con 0x557d1c54f900 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.926+0000 7f9854b48640 1 -- 172.21.15.62:0/4225392611 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f984c00a4a0 con 0x557d1c54f900 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.926+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c654870 con 0x557d1c54f900 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.926+0000 7f9854b48640 1 -- 172.21.15.62:0/4225392611 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f984c00a4a0 con 0x557d1c54f900 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.926+0000 7f9858c13800 1 Processor -- start 2024-04-26T07:54:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.926+0000 7f9858c13800 1 -- start start 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9858c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c667030 0x557d1c667450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9858c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557d1c443170 con 0x557d1c667030 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9854b48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c667030 0x557d1c667450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9854b48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c667030 0x557d1c667450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32810/0 (socket says 172.21.15.62:32810) 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9854b48640 1 -- 172.21.15.62:0/1935071459 learned_addr learned my addr 172.21.15.62:0/1935071459 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9854b48640 1 -- 172.21.15.62:0/1935071459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1c667990 con 0x557d1c667030 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9854b48640 1 --2- 172.21.15.62:0/1935071459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c667030 0x557d1c667450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x557d1c6534b0 tx=0x7f984c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9739ffb640 1 -- 172.21.15.62:0/1935071459 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c014450 con 0x557d1c667030 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9739ffb640 1 -- 172.21.15.62:0/1935071459 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984c014610 con 0x557d1c667030 2024-04-26T07:54:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9739ffb640 1 -- 172.21.15.62:0/1935071459 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c014930 con 0x557d1c667030 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9858c13800 1 -- 172.21.15.62:0/1935071459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d1c668400 con 0x557d1c667030 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.927+0000 7f9858c13800 1 -- 172.21.15.62:0/1935071459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d1c668900 con 0x557d1c667030 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.928+0000 7f9739ffb640 1 -- 172.21.15.62:0/1935071459 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f984c011040 con 0x557d1c667030 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.928+0000 7f9739ffb640 1 --2- 172.21.15.62:0/1935071459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f972c036eb0 0x7f972c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.928+0000 7f9739ffb640 1 -- 172.21.15.62:0/1935071459 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f984c01e070 con 0x557d1c667030 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.928+0000 7f9854347640 1 --2- 172.21.15.62:0/1935071459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f972c036eb0 0x7f972c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9858c13800 1 Processor -- start 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9858c13800 1 -- start start 2024-04-26T07:54:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9854347640 1 --2- 172.21.15.62:0/1935071459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f972c036eb0 0x7f972c039370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x557d1c653550 tx=0x7f984407ae90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9858c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c6746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9858c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557d1c644780 con 0x557d1c6742b0 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9854b48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c6746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9854b48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c6746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32812/0 (socket says 172.21.15.62:32812) 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9854b48640 1 -- 172.21.15.62:0/3729958738 learned_addr learned my addr 172.21.15.62:0/3729958738 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9854b48640 1 -- 172.21.15.62:0/3729958738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1c674ca0 con 0x557d1c6742b0 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.929+0000 7f9854b48640 1 --2- 172.21.15.62:0/3729958738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c6746d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f984c04cf20 tx=0x7f984c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9674923224843e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f972b7fe640 1 -- 172.21.15.62:0/3729958738 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c03d050 con 0x557d1c6742b0 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f972b7fe640 1 -- 172.21.15.62:0/3729958738 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984c00dd90 con 0x557d1c6742b0 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f972b7fe640 1 -- 172.21.15.62:0/3729958738 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c016910 con 0x557d1c6742b0 2024-04-26T07:54:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 -- 172.21.15.62:0/3729958738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 msgr2=0x557d1c6746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 --2- 172.21.15.62:0/3729958738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c6746d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f984c04cf20 tx=0x7f984c011ef0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 -- 172.21.15.62:0/3729958738 shutdown_connections 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 --2- 172.21.15.62:0/3729958738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c6746d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 -- 172.21.15.62:0/3729958738 >> 172.21.15.62:0/3729958738 conn(0x557d1c670610 msgr2=0x557d1c66e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 -- 172.21.15.62:0/3729958738 shutdown_connections 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 -- 172.21.15.62:0/3729958738 wait complete. 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 Processor -- start 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.930+0000 7f9858c13800 1 -- start start 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9858c13800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c67b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9858c13800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557d1c675410 con 0x557d1c6742b0 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9854b48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c67b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9854b48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c67b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32816/0 (socket says 172.21.15.62:32816) 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 learned_addr learned my addr 172.21.15.62:0/1527789169 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1c67bd80 con 0x557d1c6742b0 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9854b48640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c67b840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f984c043040 tx=0x7f984c04ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9729ffb640 1 -- 172.21.15.62:0/1527789169 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c03b070 con 0x557d1c6742b0 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9729ffb640 1 -- 172.21.15.62:0/1527789169 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984c0135c0 con 0x557d1c6742b0 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d1c67c010 con 0x557d1c6742b0 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9729ffb640 1 -- 172.21.15.62:0/1527789169 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c04e3d0 con 0x557d1c6742b0 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.931+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d1c67ecc0 con 0x557d1c6742b0 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.932+0000 7f9729ffb640 1 -- 172.21.15.62:0/1527789169 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f984c046d10 con 0x557d1c6742b0 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.932+0000 7f9729ffb640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f971c036eb0 0x7f971c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.932+0000 7f9729ffb640 1 -- 172.21.15.62:0/1527789169 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f984c033070 con 0x557d1c6742b0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.932+0000 7f9854347640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f971c036eb0 0x7f971c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c6874e0 0x557d1c6899a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c68a0f0 con 0x557d1c6874e0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9853b46640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c6874e0 0x557d1c6899a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9854347640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f971c036eb0 0x7f971c039370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9844071ca0 tx=0x7f9844087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9853b46640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c6874e0 0x557d1c6899a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f984800f5f0 con 0x557d1c6874e0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9858c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9858c13800 20 realm 2024-04-26T07:54:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.933+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c686930 con 0x557d1c6874e0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f984800f5f0 con 0x557d1c6874e0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c68abd0 con 0x557d1c6874e0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f984800f5f0 con 0x557d1c6874e0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c68b4a0 con 0x557d1c6874e0 2024-04-26T07:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f984800f5f0 con 0x557d1c6874e0 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c68bda0 0x557d1c68e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c68e910 con 0x557d1c68bda0 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.934+0000 7f9854b48640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c68bda0 0x557d1c68e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.935+0000 7f9854b48640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c68bda0 0x557d1c68e1b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.935+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.935+0000 7f9858c13800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.935+0000 7f9858c13800 20 searching for the correct realm 2024-04-26T07:54:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.935+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557d1c6909c0 0x557d1c692e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.935+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.935+0000 7f9854347640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557d1c6909c0 0x557d1c692e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.935+0000 7f9854347640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557d1c6909c0 0x557d1c692e80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.936+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.936+0000 7f9854347640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f984409f040 0x7f984408d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.936+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x7f984409f040 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.936+0000 7f9853b46640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f984409f040 0x7f984408d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.936+0000 7f9853b46640 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f984409f040 0x7f984408d6b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.937+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984800f5f0 con 0x7f984409f040 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.937+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.937+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.937+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6874e0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.937+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984800f5f0 con 0x557d1c6874e0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.937+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6874e0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.938+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.938+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.938+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.938+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.938+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.938+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x7f984409f040 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.939+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.939+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.939+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.939+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6874e0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.939+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.939+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.939+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.939+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6874e0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.940+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.940+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x7f984409f040 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.940+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.940+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.940+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.940+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.940+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.940+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.941+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.941+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.941+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.941+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.941+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.941+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6874e0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.941+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.941+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6874e0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.942+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.942+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.942+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.942+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.942+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.942+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x7f984409f040 2024-04-26T07:54:34.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.942+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.942+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6874e0 2024-04-26T07:54:34.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.943+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.943+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.943+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.943+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.943+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.943+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.943+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.943+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x7f984409f040 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.944+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.944+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6909c0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.944+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.944+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c68bda0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.944+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.944+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x557d1c6874e0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557d1c693550 con 0x7f984409f040 2024-04-26T07:54:34.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:34.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:34.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c68f3c0 con 0x557d1c6874e0 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c68f840 con 0x557d1c6874e0 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.945+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c68fd20 con 0x557d1c6874e0 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 20 zone default found 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 4 Realm: () 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 20 zonegroup default 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c6939d0 con 0x557d1c68bda0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c68f000 con 0x557d1c6909c0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.946+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c695d00 con 0x557d1c6909c0 2024-04-26T07:54:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.947+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.947+0000 7f9858c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.947+0000 7f9858c13800 20 started sync module instance, tier type = 2024-04-26T07:54:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.947+0000 7f9858c13800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.947+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c695090 con 0x7f984409f040 2024-04-26T07:54:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.948+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.948+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93995835938224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c695090 con 0x7f984409f040 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.948+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c696780 con 0x557d1c6874e0 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.949+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93995835938224] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.949+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.949+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93995835942064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c695090 con 0x557d1c6874e0 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.949+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c6971d0 con 0x557d1c6909c0 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.950+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93995835942064] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.950+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.950+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93995835935712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c695000 con 0x557d1c6909c0 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.950+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c698040 con 0x7f984409f040 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.951+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93995835935712] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.951+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.951+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93995835947920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c697fb0 con 0x7f984409f040 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.952+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c698f00 con 0x557d1c6874e0 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.952+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.952+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93995835951696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c699320 con 0x557d1c6874e0 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.952+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c699df0 con 0x557d1c68bda0 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.953+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93995835947920] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.953+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93995835951696] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.954+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.954+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93995835950128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c699320 con 0x557d1c68bda0 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.954+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c69a2e0 con 0x557d1c68bda0 2024-04-26T07:54:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.955+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.955+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93995835956656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c69a790 con 0x557d1c68bda0 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.955+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c69b230 con 0x557d1c68bda0 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.955+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93995835950128] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93995835952752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c69b230 con 0x557d1c68bda0 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93995835956656] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9858c13800 20 add_watcher() i=0 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9858c13800 20 add_watcher() i=1 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9858c13800 20 add_watcher() i=2 2024-04-26T07:54:34.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9858c13800 20 add_watcher() i=3 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9858c13800 20 add_watcher() i=4 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9858c13800 20 add_watcher() i=5 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.956+0000 7f9858c13800 20 add_watcher() i=6 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.957+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93995835952752] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.957+0000 7f9858c13800 20 add_watcher() i=7 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.957+0000 7f9858c13800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.957+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c69e260 con 0x557d1c6874e0 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.957+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.957+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93995835960704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c69b680 con 0x557d1c6874e0 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.958+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93995835960704] v27'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.958+0000 7f970a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.958+0000 7f9858c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.958+0000 7f9858c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.958+0000 7f9858c13800 5 note: GC not initialized 2024-04-26T07:54:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.958+0000 7f97097e2640 20 reqs_thread_entry: start 2024-04-26T07:54:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.959+0000 7f9858c13800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.959+0000 7f9858c13800 20 Filter name: none 2024-04-26T07:54:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.959+0000 7f967affd640 20 reqs_thread_entry: start 2024-04-26T07:54:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.959+0000 7f9858c13800 20 rados->read ofs=0 len=0 2024-04-26T07:54:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.959+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d1c6d1420 con 0x557d1c6874e0 2024-04-26T07:54:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.959+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.959+0000 7f9858c13800 20 rados_obj.operate() r=0 bl.length=502 2024-04-26T07:54:34.976 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T07:54:34.833930Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:34.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.960+0000 7f970a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.960+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93995835960704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c6cfe90 con 0x557d1c6874e0 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.961+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93995835960704] v27'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.961+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93995835938224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c6d0340 con 0x7f984409f040 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.962+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93995835938224] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.962+0000 7f9858c13800 20 remove_watcher() i=0 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.962+0000 7f9858c13800 2 removed watcher, disabling cache 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.962+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93995835942064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c6955b0 con 0x557d1c6874e0 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.963+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93995835942064] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.963+0000 7f9858c13800 20 remove_watcher() i=1 2024-04-26T07:54:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.963+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93995835935712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c6955b0 con 0x557d1c6909c0 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.964+0000 7f9854347640 1 -- 172.21.15.62:0/1527789169 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93995835935712] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984409c070 con 0x557d1c6909c0 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.964+0000 7f9858c13800 20 remove_watcher() i=2 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.964+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93995835947920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c694be0 con 0x7f984409f040 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.965+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93995835947920] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x7f984409f040 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.965+0000 7f9858c13800 20 remove_watcher() i=3 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.965+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93995835951696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c694be0 con 0x557d1c6874e0 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.966+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93995835951696] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984802b040 con 0x557d1c6874e0 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.966+0000 7f9858c13800 20 remove_watcher() i=4 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.966+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93995835950128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c698a50 con 0x557d1c68bda0 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.967+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93995835950128] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.967+0000 7f9858c13800 20 remove_watcher() i=5 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.967+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93995835956656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c694be0 con 0x557d1c68bda0 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.968+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93995835956656] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.968+0000 7f9858c13800 20 remove_watcher() i=6 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.968+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93995835952752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557d1c698430 con 0x557d1c68bda0 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.968+0000 7f9854b48640 1 -- 172.21.15.62:0/1527789169 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93995835952752] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c02a070 con 0x557d1c68bda0 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 20 remove_watcher() i=7 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c68bda0 msgr2=0x557d1c68e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c68bda0 0x557d1c68e1b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c6874e0 msgr2=0x557d1c6899a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c6874e0 0x557d1c6899a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f984409f040 msgr2=0x7f984408d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f984409f040 0x7f984408d6b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557d1c6909c0 msgr2=0x557d1c692e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557d1c6909c0 0x557d1c692e80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f971c036eb0 msgr2=0x7f971c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f971c036eb0 0x7f971c039370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9844071ca0 tx=0x7f9844087000 comp rx=0 tx=0).stop 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 msgr2=0x557d1c67b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1527789169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c6742b0 0x557d1c67b840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f984c043040 tx=0x7f984c04ceb0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 reap_dead start 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9853b46640 1 -- 172.21.15.62:0/1527789169 reap_dead start 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 shutdown_connections 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 >> 172.21.15.62:0/1527789169 conn(0x557d1c670610 msgr2=0x557d1c66dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 shutdown_connections 2024-04-26T07:54:34.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1527789169 wait complete. 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1935071459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f972c036eb0 msgr2=0x7f972c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1935071459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f972c036eb0 0x7f972c039370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x557d1c653550 tx=0x7f984407ae90 comp rx=0 tx=0).stop 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1935071459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c667030 msgr2=0x557d1c667450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1935071459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c667030 0x557d1c667450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x557d1c6534b0 tx=0x7f984c018830 comp rx=0 tx=0).stop 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1935071459 shutdown_connections 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1935071459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f972c036eb0 0x7f972c039370 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 --2- 172.21.15.62:0/1935071459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c667030 0x557d1c667450 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1935071459 >> 172.21.15.62:0/1935071459 conn(0x557d1c65b0d0 msgr2=0x557d1c65b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1935071459 shutdown_connections 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.969+0000 7f9858c13800 1 -- 172.21.15.62:0/1935071459 wait complete. 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c6553e0 msgr2=0x557d1c6577d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c6553e0 0x557d1c6577d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c54f900 msgr2=0x557d1c652bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c54f900 0x557d1c652bb0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f973c036eb0 msgr2=0x7f973c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f973c036eb0 0x7f973c039370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9848000c00 tx=0x7f98480013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 msgr2=0x557d1c64b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c64b970 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9844060040 tx=0x7f9844002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 shutdown_connections 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557d1c54f900 0x557d1c652bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557d1c6553e0 0x557d1c6577d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f973c036eb0 0x7f973c039370 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 --2- 172.21.15.62:0/4225392611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d1c54efa0 0x557d1c64b970 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 >> 172.21.15.62:0/4225392611 conn(0x557d1c54ab80 msgr2=0x557d1c63e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 shutdown_connections 2024-04-26T07:54:34.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:34.970+0000 7f9858c13800 1 -- 172.21.15.62:0/4225392611 wait complete. 2024-04-26T07:54:34.989 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T07:54:34.833930Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:34.989 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-26T07:54:34.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-26T07:54:34.989 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-04-26T07:54:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.038+0000 7f16e3b25800 1 Processor -- start 2024-04-26T07:54:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16e3b25800 1 -- start start 2024-04-26T07:54:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16e3b25800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55d995890150 0x55d99588e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16e3b25800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d99588f0f0 con 0x55d99588ec40 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16e3b25800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55d9957bce20 con 0x55d995890150 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16df8b7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55d995890150 0x55d99588e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16df0b6640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55d99588ec40 0x55d9959225d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36534/0 (socket says 172.21.15.62:36534) 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16df0b6640 1 -- 172.21.15.62:0/1667816037 learned_addr learned my addr 172.21.15.62:0/1667816037 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16df8b7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55d995890150 0x55d99588e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32824/0 (socket says 172.21.15.62:32824) 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16df8b7640 1 -- 172.21.15.62:0/1667816037 >> v1:172.21.15.1:6789/0 conn(0x55d99588ec40 legacy=0x55d9959225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16de8b5640 1 -- 172.21.15.62:0/1667816037 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048850740 0 0) 0x55d99588f0f0 con 0x55d99588ec40 2024-04-26T07:54:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.039+0000 7f16df8b7640 1 -- 172.21.15.62:0/1667816037 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99588f2f0 con 0x55d995890150 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.041+0000 7f16df8b7640 1 --2- 172.21.15.62:0/1667816037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995890150 0x55d99588e700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f16d000a470 tx=0x7f16d001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57341911dde4d540 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.041+0000 7f16de8b5640 1 -- 172.21.15.62:0/1667816037 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d0057070 con 0x55d995890150 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.041+0000 7f16de8b5640 1 -- 172.21.15.62:0/1667816037 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d004adc0 con 0x55d995890150 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.041+0000 7f16de8b5640 1 -- 172.21.15.62:0/1667816037 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d0052590 con 0x55d995890150 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.042+0000 7f16e3b25800 1 -- 172.21.15.62:0/1667816037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995890150 msgr2=0x55d99588e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.042+0000 7f16e3b25800 1 --2- 172.21.15.62:0/1667816037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995890150 0x55d99588e700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f16d000a470 tx=0x7f16d001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.042+0000 7f16e3b25800 1 -- 172.21.15.62:0/1667816037 shutdown_connections 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.042+0000 7f16e3b25800 1 --2- 172.21.15.62:0/1667816037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995890150 0x55d99588e700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.042+0000 7f16e3b25800 1 -- 172.21.15.62:0/1667816037 >> 172.21.15.62:0/1667816037 conn(0x55d995915d60 msgr2=0x55d995918180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.042+0000 7f16e3b25800 1 -- 172.21.15.62:0/1667816037 shutdown_connections 2024-04-26T07:54:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.042+0000 7f16e3b25800 1 -- 172.21.15.62:0/1667816037 wait complete. 2024-04-26T07:54:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.055+0000 7f16e3b25800 1 Processor -- start 2024-04-26T07:54:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.055+0000 7f16e3b25800 1 -- start start 2024-04-26T07:54:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.055+0000 7f16e3b25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a0de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.055+0000 7f16e3b25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d995865d00 con 0x55d99588ec40 2024-04-26T07:54:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.055+0000 7f16df8b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a0de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.055+0000 7f16df8b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a0de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32832/0 (socket says 172.21.15.62:32832) 2024-04-26T07:54:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.055+0000 7f16df8b7640 1 -- 172.21.15.62:0/1048439781 learned_addr learned my addr 172.21.15.62:0/1048439781 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.055+0000 7f16df8b7640 1 -- 172.21.15.62:0/1048439781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d995a0e3f0 con 0x55d99588ec40 2024-04-26T07:54:35.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.056+0000 7f16df8b7640 1 --2- 172.21.15.62:0/1048439781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a0de20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f16d0055040 tx=0x7f16d004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579eb098083e3469 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.056+0000 7f15cde0b640 1 -- 172.21.15.62:0/1048439781 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d0057040 con 0x55d99588ec40 2024-04-26T07:54:35.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.056+0000 7f15cde0b640 1 -- 172.21.15.62:0/1048439781 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d0063070 con 0x55d99588ec40 2024-04-26T07:54:35.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.056+0000 7f15cde0b640 1 -- 172.21.15.62:0/1048439781 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d005d790 con 0x55d99588ec40 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 -- 172.21.15.62:0/1048439781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 msgr2=0x55d995a0de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 --2- 172.21.15.62:0/1048439781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a0de20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f16d0055040 tx=0x7f16d004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 -- 172.21.15.62:0/1048439781 shutdown_connections 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 --2- 172.21.15.62:0/1048439781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a0de20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 -- 172.21.15.62:0/1048439781 >> 172.21.15.62:0/1048439781 conn(0x55d995915d60 msgr2=0x55d995a09740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 -- 172.21.15.62:0/1048439781 shutdown_connections 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 -- 172.21.15.62:0/1048439781 wait complete. 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 Processor -- start 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 -- start start 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16e3b25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d995925fa0 con 0x55d99588ec40 2024-04-26T07:54:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16df8b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16df8b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32844/0 (socket says 172.21.15.62:32844) 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.057+0000 7f16df8b7640 1 -- 172.21.15.62:0/2079927800 learned_addr learned my addr 172.21.15.62:0/2079927800 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.058+0000 7f16df8b7640 1 -- 172.21.15.62:0/2079927800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d995a15df0 con 0x55d99588ec40 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.058+0000 7f16df8b7640 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a158b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f16d000a470 tx=0x7f16d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.058+0000 7f15c7fff640 1 -- 172.21.15.62:0/2079927800 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d0057050 con 0x55d99588ec40 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.058+0000 7f15c7fff640 1 -- 172.21.15.62:0/2079927800 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d005dc90 con 0x55d99588ec40 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.058+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d995a16080 con 0x55d99588ec40 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.058+0000 7f15c7fff640 1 -- 172.21.15.62:0/2079927800 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d0052440 con 0x55d99588ec40 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.058+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d995a18ce0 con 0x55d99588ec40 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.059+0000 7f15c7fff640 1 -- 172.21.15.62:0/2079927800 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f16d00525e0 con 0x55d99588ec40 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.059+0000 7f15c7fff640 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15c8036eb0 0x7f15c8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.059+0000 7f15c7fff640 1 -- 172.21.15.62:0/2079927800 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f16d008e300 con 0x55d99588ec40 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.059+0000 7f16df0b6640 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15c8036eb0 0x7f15c8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.059+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995890150 0x55d995a1caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.059+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a1cfe0 con 0x55d995890150 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.059+0000 7f16e00b8640 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995890150 0x55d995a1caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.060+0000 7f16df0b6640 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15c8036eb0 0x7f15c8039370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16d4000c00 tx=0x7f16d40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.060+0000 7f16e00b8640 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995890150 0x55d995a1caa0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.060+0000 7f16e00b8640 1 -- 172.21.15.62:0/2079927800 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16d800a4a0 con 0x55d995890150 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.060+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a1a050 con 0x55d995890150 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.060+0000 7f16e00b8640 1 -- 172.21.15.62:0/2079927800 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16d800a4a0 con 0x55d995890150 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.060+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a1f340 0x55d995a21730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.060+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a21dd0 con 0x55d995a1f340 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.060+0000 7f16df8b7640 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a1f340 0x55d995a21730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.061+0000 7f16df8b7640 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a1f340 0x55d995a21730 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.061+0000 7f16df8b7640 1 -- 172.21.15.62:0/2079927800 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16d0078070 con 0x55d995a1f340 2024-04-26T07:54:35.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.061+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a1e2c0 con 0x55d995890150 2024-04-26T07:54:35.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.061+0000 7f16e00b8640 1 -- 172.21.15.62:0/2079927800 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16d800a4a0 con 0x55d995890150 2024-04-26T07:54:35.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.061+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a1e7a0 con 0x55d995890150 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.062+0000 7f16e00b8640 1 -- 172.21.15.62:0/2079927800 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16d800a4a0 con 0x55d995890150 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.062+0000 7f16e3b25800 1 Processor -- start 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.062+0000 7f16e3b25800 1 -- start start 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.062+0000 7f16e3b25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a30f40 0x55d995a31360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.062+0000 7f16e3b25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d99580d170 con 0x55d995a30f40 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.062+0000 7f16e00b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a30f40 0x55d995a31360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.062+0000 7f16e00b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a30f40 0x55d995a31360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32850/0 (socket says 172.21.15.62:32850) 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.062+0000 7f16e00b8640 1 -- 172.21.15.62:0/369730925 learned_addr learned my addr 172.21.15.62:0/369730925 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.063+0000 7f16e00b8640 1 -- 172.21.15.62:0/369730925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d995a318a0 con 0x55d995a30f40 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.063+0000 7f16e00b8640 1 --2- 172.21.15.62:0/369730925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a30f40 0x55d995a31360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55d995a1d3c0 tx=0x7f16d8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.063+0000 7f15c57fa640 1 -- 172.21.15.62:0/369730925 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d8014450 con 0x55d995a30f40 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.063+0000 7f15c57fa640 1 -- 172.21.15.62:0/369730925 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d80145f0 con 0x55d995a30f40 2024-04-26T07:54:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.063+0000 7f16e3b25800 1 -- 172.21.15.62:0/369730925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d995a32310 con 0x55d995a30f40 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.063+0000 7f15c57fa640 1 -- 172.21.15.62:0/369730925 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d80148d0 con 0x55d995a30f40 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.063+0000 7f16e3b25800 1 -- 172.21.15.62:0/369730925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d995a32810 con 0x55d995a30f40 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f15c57fa640 1 -- 172.21.15.62:0/369730925 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f16d8011040 con 0x55d995a30f40 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f15c57fa640 1 --2- 172.21.15.62:0/369730925 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15b8036eb0 0x7f15b8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f15c57fa640 1 -- 172.21.15.62:0/369730925 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f16d801e070 con 0x55d995a30f40 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f16df8b7640 1 --2- 172.21.15.62:0/369730925 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15b8036eb0 0x7f15b8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f16e3b25800 1 Processor -- start 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f16e3b25800 1 -- start start 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f16df8b7640 1 --2- 172.21.15.62:0/369730925 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15b8036eb0 0x7f15b8039370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f16d004c040 tx=0x7f16d008c620 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f16e3b25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a3e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.064+0000 7f16e3b25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d995a0e6b0 con 0x55d995a3e1c0 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.065+0000 7f16e00b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a3e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.065+0000 7f16e00b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a3e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32866/0 (socket says 172.21.15.62:32866) 2024-04-26T07:54:35.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.065+0000 7f16e00b8640 1 -- 172.21.15.62:0/378946543 learned_addr learned my addr 172.21.15.62:0/378946543 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.065+0000 7f16e00b8640 1 -- 172.21.15.62:0/378946543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d995a3ebb0 con 0x55d995a3e1c0 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.065+0000 7f16e00b8640 1 --2- 172.21.15.62:0/378946543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a3e5e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f16d804d040 tx=0x7f16d8041420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbdf7474476e68e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.065+0000 7f15beffd640 1 -- 172.21.15.62:0/378946543 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d80168f0 con 0x55d995a3e1c0 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.065+0000 7f15beffd640 1 -- 172.21.15.62:0/378946543 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d8013c90 con 0x55d995a3e1c0 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.065+0000 7f15beffd640 1 -- 172.21.15.62:0/378946543 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d8014a70 con 0x55d995a3e1c0 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 -- 172.21.15.62:0/378946543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 msgr2=0x55d995a3e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 --2- 172.21.15.62:0/378946543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a3e5e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f16d804d040 tx=0x7f16d8041420 comp rx=0 tx=0).stop 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 -- 172.21.15.62:0/378946543 shutdown_connections 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 --2- 172.21.15.62:0/378946543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a3e5e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 -- 172.21.15.62:0/378946543 >> 172.21.15.62:0/378946543 conn(0x55d995a3a520 msgr2=0x55d995a38580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 -- 172.21.15.62:0/378946543 shutdown_connections 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 -- 172.21.15.62:0/378946543 wait complete. 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 Processor -- start 2024-04-26T07:54:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 -- start start 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e3b25800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d995a3f320 con 0x55d995a3e1c0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e00b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e00b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32882/0 (socket says 172.21.15.62:32882) 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.066+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 learned_addr learned my addr 172.21.15.62:0/2543859910 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.067+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d995a45d20 con 0x55d995a3e1c0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.067+0000 7f16e00b8640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a457e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f16d804bf60 tx=0x7f16d804cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.067+0000 7f15bd7fa640 1 -- 172.21.15.62:0/2543859910 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d8013e40 con 0x55d995a3e1c0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.067+0000 7f15bd7fa640 1 -- 172.21.15.62:0/2543859910 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d8022a80 con 0x55d995a3e1c0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.067+0000 7f15bd7fa640 1 -- 172.21.15.62:0/2543859910 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d8022d60 con 0x55d995a3e1c0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.067+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d995a45fb0 con 0x55d995a3e1c0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.067+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d995a48c60 con 0x55d995a3e1c0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.068+0000 7f15bd7fa640 1 -- 172.21.15.62:0/2543859910 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f16d80133b0 con 0x55d995a3e1c0 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.068+0000 7f15bd7fa640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15a8036eb0 0x7f15a8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.068+0000 7f15bd7fa640 1 -- 172.21.15.62:0/2543859910 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f16d800e040 con 0x55d995a3e1c0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.068+0000 7f16df8b7640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15a8036eb0 0x7f15a8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.068+0000 7f16df8b7640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15a8036eb0 0x7f15a8039370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f16d0044700 tx=0x7f16d0086000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.068+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.068+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995a512c0 0x55d995a53780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.068+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a53ed0 con 0x55d995a512c0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16df0b6640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995a512c0 0x55d995a53780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16df0b6640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995a512c0 0x55d995a53780 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16d400f5f0 con 0x55d995a512c0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16e3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16e3b25800 20 realm 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a50710 con 0x55d995a512c0 2024-04-26T07:54:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16d400f5f0 con 0x55d995a512c0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16e3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16e3b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.069+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a549c0 con 0x55d995a512c0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16d400f5f0 con 0x55d995a512c0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a55290 con 0x55d995a512c0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16d400f5f0 con 0x55d995a512c0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e3b25800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a55cb0 0x55d995a580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a58810 con 0x55d995a55cb0 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e00b8640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a55cb0 0x55d995a580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.070+0000 7f16e00b8640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a55cb0 0x55d995a580a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.071+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.071+0000 7f16e3b25800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.071+0000 7f16e3b25800 20 searching for the correct realm 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.071+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d995a5a7c0 0x55d995a5cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.071+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.071+0000 7f16df8b7640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d995a5a7c0 0x55d995a5cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.071+0000 7f16df8b7640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d995a5a7c0 0x55d995a5cc80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.072+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.072+0000 7f16df8b7640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f16d0088050 0x7f16d0066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.072+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x7f16d0088050 2024-04-26T07:54:35.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.072+0000 7f16df0b6640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f16d0088050 0x7f16d0066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.072+0000 7f16df0b6640 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f16d0088050 0x7f16d0066380 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.072+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d400f5f0 con 0x7f16d0088050 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.072+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.073+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.073+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a512c0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.073+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d400f5f0 con 0x55d995a512c0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.073+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a512c0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.073+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.073+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.073+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.073+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.074+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.074+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x7f16d0088050 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.074+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.074+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.074+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.074+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a512c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.074+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.074+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.075+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.075+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a512c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.075+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.075+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x7f16d0088050 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.075+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.075+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.075+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.075+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.076+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.076+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.076+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.076+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.076+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.076+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.077+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.077+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a512c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.077+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.077+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a512c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.077+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.077+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.077+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.077+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.078+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.078+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x7f16d0088050 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.078+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.078+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a512c0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.078+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.078+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.078+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.078+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.079+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.079+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.079+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.079+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x7f16d0088050 2024-04-26T07:54:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.079+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.079+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a5a7c0 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.080+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.080+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a55cb0 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.080+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.080+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x55d995a512c0 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.080+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.080+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d350 con 0x7f16d0088050 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a591d0 con 0x55d995a512c0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a58de0 con 0x55d995a512c0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a59b00 con 0x55d995a512c0 2024-04-26T07:54:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 zone default found 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 4 Realm: () 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 zonegroup default 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.081+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5d7d0 con 0x55d995a55cb0 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5fa50 con 0x55d995a5a7c0 2024-04-26T07:54:35.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5fdf0 con 0x55d995a5a7c0 2024-04-26T07:54:35.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 20 started sync module instance, tier type = 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.082+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5ee90 con 0x7f16d0088050 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.083+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.083+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94393006945200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5ee90 con 0x7f16d0088050 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.083+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a607f0 con 0x55d995a512c0 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.084+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94393006945200] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.084+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.084+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94393006949120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a5ee90 con 0x55d995a512c0 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.085+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a61240 con 0x55d995a5a7c0 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.086+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.086+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94393006951760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a61ae0 con 0x55d995a5a7c0 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.086+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a62560 con 0x7f16d0088050 2024-04-26T07:54:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.086+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94393006949120] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.087+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.087+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94393006956624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a62980 con 0x7f16d0088050 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.087+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94393006951760] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.087+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a63380 con 0x55d995a512c0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.088+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.088+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94393006954032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a63340 con 0x55d995a512c0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.088+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a63d90 con 0x55d995a55cb0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.088+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94393006956624] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.089+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94393006954032] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.089+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.089+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94393006962912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a63340 con 0x55d995a55cb0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.089+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a63d40 con 0x55d995a55cb0 2024-04-26T07:54:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.090+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94393006962912] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.090+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.090+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94393006960272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a632b0 con 0x55d995a55cb0 2024-04-26T07:54:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.090+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64cd0 con 0x55d995a55cb0 2024-04-26T07:54:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94393006966688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a65140 con 0x55d995a55cb0 2024-04-26T07:54:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e3b25800 20 add_watcher() i=0 2024-04-26T07:54:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e3b25800 20 add_watcher() i=1 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e3b25800 20 add_watcher() i=2 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e3b25800 20 add_watcher() i=3 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e3b25800 20 add_watcher() i=4 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e3b25800 20 add_watcher() i=5 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94393006960272] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.091+0000 7f16e3b25800 20 add_watcher() i=6 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.092+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94393006966688] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.092+0000 7f16e3b25800 20 add_watcher() i=7 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.092+0000 7f16e3b25800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.092+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64180 con 0x55d995a512c0 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.092+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.092+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94393006967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64180 con 0x55d995a512c0 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.093+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94393006967952] v27'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.093+0000 7f1595fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.093+0000 7f16e3b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.093+0000 7f16e3b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.093+0000 7f16e3b25800 5 note: GC not initialized 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f1594fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 20 Filter name: none 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f150e7fc640 20 reqs_thread_entry: start 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a9b960 con 0x55d995a512c0 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 20 rados_obj.operate() r=0 bl.length=502 2024-04-26T07:54:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.094+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995aa2010 con 0x55d995a512c0 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.095+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.095+0000 7f16e3b25800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.095+0000 7f16e3b25800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.095+0000 7f16e3b25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.095+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94393007217280 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a9d700 con 0x55d995a512c0 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94393006954032 notify 115964116996 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f16d4018040 con 0x55d995a512c0 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f15beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94393006954032 notifier 4347 bl.length()=567 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94393007217280 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f15beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f15beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f15beffd640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f15a4003ea0 con 0x55d995a512c0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94393007217280 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f16d402f880 con 0x55d995a512c0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.096+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995aa1a80 con 0x55d995a55cb0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.097+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v27'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.097+0000 7f16e3b25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.097+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94393007217280 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d995a9d250 con 0x55d995a5a7c0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.098+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== watch-notify(notify (1) cookie 94393006951760 notify 115964116993 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f16d00a3040 con 0x55d995a5a7c0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.098+0000 7f15beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94393006951760 notifier 4347 bl.length()=170 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.098+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 notify.2 [notify cookie 94393007217280 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.098+0000 7f15beffd640 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f15a4003ea0 con 0x55d995a5a7c0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.098+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.098+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== watch-notify(notify_complete (2) cookie 94393007217280 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d995a18ce0 con 0x55d995a5a7c0 2024-04-26T07:54:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.099+0000 7f1595fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.099+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94393006967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a99ee0 con 0x55d995a512c0 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.100+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94393006967952] v27'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.100+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94393006945200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64c90 con 0x7f16d0088050 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.101+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94393006945200] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.101+0000 7f16e3b25800 20 remove_watcher() i=0 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.101+0000 7f16e3b25800 2 removed watcher, disabling cache 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.101+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94393006949120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64c90 con 0x55d995a512c0 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.102+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94393006949120] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.102+0000 7f16e3b25800 20 remove_watcher() i=1 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.102+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94393006951760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64c90 con 0x55d995a5a7c0 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.103+0000 7f16df8b7640 1 -- 172.21.15.62:0/2543859910 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94393006951760] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d0084030 con 0x55d995a5a7c0 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.103+0000 7f16e3b25800 20 remove_watcher() i=2 2024-04-26T07:54:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.103+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94393006956624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64c90 con 0x7f16d0088050 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.104+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94393006956624] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x7f16d0088050 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.104+0000 7f16e3b25800 20 remove_watcher() i=3 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.104+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94393006954032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a62050 con 0x55d995a512c0 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.105+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94393006954032] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d402b040 con 0x55d995a512c0 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.105+0000 7f16e3b25800 20 remove_watcher() i=4 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.105+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94393006962912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64c90 con 0x55d995a55cb0 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.106+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94393006962912] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.106+0000 7f16e3b25800 20 remove_watcher() i=5 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.106+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94393006960272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a638e0 con 0x55d995a55cb0 2024-04-26T07:54:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.107+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94393006960272] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.107+0000 7f16e3b25800 20 remove_watcher() i=6 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.107+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94393006966688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d995a64c90 con 0x55d995a55cb0 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e00b8640 1 -- 172.21.15.62:0/2543859910 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94393006966688] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16d802a070 con 0x55d995a55cb0 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 20 remove_watcher() i=7 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a55cb0 msgr2=0x55d995a580a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a55cb0 0x55d995a580a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995a512c0 msgr2=0x55d995a53780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995a512c0 0x55d995a53780 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f16d0088050 msgr2=0x7f16d0066380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f16d0088050 0x7f16d0066380 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d995a5a7c0 msgr2=0x55d995a5cc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d995a5a7c0 0x55d995a5cc80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15a8036eb0 msgr2=0x7f15a8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15a8036eb0 0x7f15a8039370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f16d0044700 tx=0x7f16d0086000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 msgr2=0x55d995a457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16df0b6640 1 -- 172.21.15.62:0/2543859910 reap_dead start 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a457e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f16d804bf60 tx=0x7f16d804cfd0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 shutdown_connections 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2543859910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a3e1c0 0x55d995a457e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 >> 172.21.15.62:0/2543859910 conn(0x55d995a3a520 msgr2=0x55d995a37b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 shutdown_connections 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.108+0000 7f16e3b25800 1 -- 172.21.15.62:0/2543859910 wait complete. 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/369730925 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15b8036eb0 msgr2=0x7f15b8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/369730925 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15b8036eb0 0x7f15b8039370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f16d004c040 tx=0x7f16d008c620 comp rx=0 tx=0).stop 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/369730925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a30f40 msgr2=0x55d995a31360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/369730925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a30f40 0x55d995a31360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55d995a1d3c0 tx=0x7f16d8018830 comp rx=0 tx=0).stop 2024-04-26T07:54:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/369730925 shutdown_connections 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/369730925 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15b8036eb0 0x7f15b8039370 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/369730925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d995a30f40 0x55d995a31360 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/369730925 >> 172.21.15.62:0/369730925 conn(0x55d995a24fe0 msgr2=0x55d995a253e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/369730925 shutdown_connections 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/369730925 wait complete. 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a1f340 msgr2=0x55d995a21730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a1f340 0x55d995a21730 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995890150 msgr2=0x55d995a1caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995890150 0x55d995a1caa0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15c8036eb0 msgr2=0x7f15c8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15c8036eb0 0x7f15c8039370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16d4000c00 tx=0x7f16d40013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 msgr2=0x55d995a158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a158b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f16d000a470 tx=0x7f16d0002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 shutdown_connections 2024-04-26T07:54:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d995890150 0x55d995a1caa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55d995a1f340 0x55d995a21730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f15c8036eb0 0x7f15c8039370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 --2- 172.21.15.62:0/2079927800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d99588ec40 0x55d995a158b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 >> 172.21.15.62:0/2079927800 conn(0x55d995915d60 msgr2=0x55d995a07f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 shutdown_connections 2024-04-26T07:54:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.109+0000 7f16e3b25800 1 -- 172.21.15.62:0/2079927800 wait complete. 2024-04-26T07:54:35.120 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:35.120 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-26T07:54:35.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-26T07:54:35.120 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-04-26T07:54:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba59a2800 1 Processor -- start 2024-04-26T07:54:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba59a2800 1 -- start start 2024-04-26T07:54:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba59a2800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a4a5bdfc20 0x55a4a5be2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba59a2800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4a5be2550 con 0x55a4a5bdc110 2024-04-26T07:54:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba59a2800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55a4a5a7de20 con 0x55a4a5bdfc20 2024-04-26T07:54:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba2ca0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a4a5bdfc20 0x55a4a5be2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba34a1640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55a4a5bdc110 0x55a4a5bde500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36542/0 (socket says 172.21.15.62:36542) 2024-04-26T07:54:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba34a1640 1 -- 172.21.15.62:0/398693607 learned_addr learned my addr 172.21.15.62:0/398693607 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba2ca0640 1 -- 172.21.15.62:0/398693607 >> v1:172.21.15.1:6789/0 conn(0x55a4a5bdc110 legacy=0x55a4a5bde500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.169+0000 7ffba2ca0640 1 -- 172.21.15.62:0/398693607 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a5be3730 con 0x55a4a5bdfc20 2024-04-26T07:54:35.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.171+0000 7ffba2ca0640 1 --2- 172.21.15.62:0/398693607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdfc20 0x55a4a5be2010 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00a470 tx=0x7ffb8c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77338dff56928cdf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.171+0000 7ffba249f640 1 -- 172.21.15.62:0/398693607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb8c057070 con 0x55a4a5bdfc20 2024-04-26T07:54:35.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.171+0000 7ffba249f640 1 -- 172.21.15.62:0/398693607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb8c052570 con 0x55a4a5bdfc20 2024-04-26T07:54:35.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.171+0000 7ffba249f640 1 -- 172.21.15.62:0/398693607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb8c052870 con 0x55a4a5bdfc20 2024-04-26T07:54:35.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.172+0000 7ffba59a2800 1 -- 172.21.15.62:0/398693607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdfc20 msgr2=0x55a4a5be2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.172+0000 7ffba59a2800 1 --2- 172.21.15.62:0/398693607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdfc20 0x55a4a5be2010 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00a470 tx=0x7ffb8c01ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:35.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.172+0000 7ffba59a2800 1 -- 172.21.15.62:0/398693607 shutdown_connections 2024-04-26T07:54:35.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.172+0000 7ffba59a2800 1 --2- 172.21.15.62:0/398693607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdfc20 0x55a4a5be2010 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.172+0000 7ffba59a2800 1 -- 172.21.15.62:0/398693607 >> 172.21.15.62:0/398693607 conn(0x55a4a5bd5be0 msgr2=0x55a4a5bd8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.172+0000 7ffba59a2800 1 -- 172.21.15.62:0/398693607 shutdown_connections 2024-04-26T07:54:35.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.172+0000 7ffba59a2800 1 -- 172.21.15.62:0/398693607 wait complete. 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.184+0000 7ffba59a2800 1 Processor -- start 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.185+0000 7ffba59a2800 1 -- start start 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.185+0000 7ffba59a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5ccccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.185+0000 7ffba59a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4a5b26d00 con 0x55a4a5bdc110 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.185+0000 7ffba34a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5ccccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.185+0000 7ffba34a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5ccccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32896/0 (socket says 172.21.15.62:32896) 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.185+0000 7ffba34a1640 1 -- 172.21.15.62:0/1805396001 learned_addr learned my addr 172.21.15.62:0/1805396001 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.185+0000 7ffba34a1640 1 -- 172.21.15.62:0/1805396001 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a5ccd280 con 0x55a4a5bdc110 2024-04-26T07:54:35.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.185+0000 7ffba34a1640 1 --2- 172.21.15.62:0/1805396001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5ccccb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0017a0 tx=0x7ffb9c001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99b16b1a374c318 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffa9160a640 1 -- 172.21.15.62:0/1805396001 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb9c004520 con 0x55a4a5bdc110 2024-04-26T07:54:35.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffa9160a640 1 -- 172.21.15.62:0/1805396001 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9c0046c0 con 0x55a4a5bdc110 2024-04-26T07:54:35.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffa9160a640 1 -- 172.21.15.62:0/1805396001 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb9c004a00 con 0x55a4a5bdc110 2024-04-26T07:54:35.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffba59a2800 1 -- 172.21.15.62:0/1805396001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 msgr2=0x55a4a5ccccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1805396001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5ccccb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0017a0 tx=0x7ffb9c001c60 comp rx=0 tx=0).stop 2024-04-26T07:54:35.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffba59a2800 1 -- 172.21.15.62:0/1805396001 shutdown_connections 2024-04-26T07:54:35.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1805396001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5ccccb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffba59a2800 1 -- 172.21.15.62:0/1805396001 >> 172.21.15.62:0/1805396001 conn(0x55a4a5bd5be0 msgr2=0x55a4a5cc85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffba59a2800 1 -- 172.21.15.62:0/1805396001 shutdown_connections 2024-04-26T07:54:35.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.186+0000 7ffba59a2800 1 -- 172.21.15.62:0/1805396001 wait complete. 2024-04-26T07:54:35.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba59a2800 1 Processor -- start 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba59a2800 1 -- start start 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba59a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5cd4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba59a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4a5be2a20 con 0x55a4a5bdc110 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba34a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5cd4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba34a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5cd4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32912/0 (socket says 172.21.15.62:32912) 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba34a1640 1 -- 172.21.15.62:0/3155032108 learned_addr learned my addr 172.21.15.62:0/3155032108 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba34a1640 1 -- 172.21.15.62:0/3155032108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a5cd4d70 con 0x55a4a5bdc110 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.187+0000 7ffba34a1640 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5cd4830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c000f80 tx=0x7ffb9c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.188+0000 7ffa8fe07640 1 -- 172.21.15.62:0/3155032108 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb9c022020 con 0x55a4a5bdc110 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.188+0000 7ffa8fe07640 1 -- 172.21.15.62:0/3155032108 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9c014870 con 0x55a4a5bdc110 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.188+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4a5cd5000 con 0x55a4a5bdc110 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.188+0000 7ffa8fe07640 1 -- 172.21.15.62:0/3155032108 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb9c014bb0 con 0x55a4a5bdc110 2024-04-26T07:54:35.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.188+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a5cd7c60 con 0x55a4a5bdc110 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.188+0000 7ffa8fe07640 1 -- 172.21.15.62:0/3155032108 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb9c025020 con 0x55a4a5bdc110 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.189+0000 7ffa8fe07640 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa88036eb0 0x7ffa88039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.189+0000 7ffa8fe07640 1 -- 172.21.15.62:0/3155032108 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ffb9c018030 con 0x55a4a5bdc110 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.189+0000 7ffba2ca0640 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa88036eb0 0x7ffa88039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.189+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5bdfc20 0x55a4a5cdba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.189+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5cdbff0 con 0x55a4a5bdfc20 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.189+0000 7ffba3ca2640 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5bdfc20 0x55a4a5cdba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.189+0000 7ffba2ca0640 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa88036eb0 0x7ffa88039370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c054000 tx=0x7ffb8c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.189+0000 7ffba3ca2640 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5bdfc20 0x55a4a5cdba20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.190+0000 7ffba3ca2640 1 -- 172.21.15.62:0/3155032108 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb940083e0 con 0x55a4a5bdfc20 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.190+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5cd8fb0 con 0x55a4a5bdfc20 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.190+0000 7ffba3ca2640 1 -- 172.21.15.62:0/3155032108 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb940083e0 con 0x55a4a5bdfc20 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.190+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5cde300 0x55a4a5ce06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.190+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5ce0dc0 con 0x55a4a5cde300 2024-04-26T07:54:35.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.190+0000 7ffba34a1640 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5cde300 0x55a4a5ce06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.190+0000 7ffba34a1640 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5cde300 0x55a4a5ce06f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.191+0000 7ffba34a1640 1 -- 172.21.15.62:0/3155032108 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5cde300 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.191+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5cdd280 con 0x55a4a5bdfc20 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.191+0000 7ffba3ca2640 1 -- 172.21.15.62:0/3155032108 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb940083e0 con 0x55a4a5bdfc20 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.191+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5cdd6f0 con 0x55a4a5bdfc20 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.191+0000 7ffba3ca2640 1 -- 172.21.15.62:0/3155032108 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb940083e0 con 0x55a4a5bdfc20 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba59a2800 1 Processor -- start 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba59a2800 1 -- start start 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba59a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdbc90 0x55a4a5bda100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba59a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4a5ace170 con 0x55a4a5bdbc90 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba3ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdbc90 0x55a4a5bda100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba3ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdbc90 0x55a4a5bda100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32926/0 (socket says 172.21.15.62:32926) 2024-04-26T07:54:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba3ca2640 1 -- 172.21.15.62:0/406639622 learned_addr learned my addr 172.21.15.62:0/406639622 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba3ca2640 1 -- 172.21.15.62:0/406639622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a5bda640 con 0x55a4a5bdbc90 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.192+0000 7ffba3ca2640 1 --2- 172.21.15.62:0/406639622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdbc90 0x55a4a5bda100 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55a4a5cd56b0 tx=0x7ffb9400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.193+0000 7ffa8d602640 1 -- 172.21.15.62:0/406639622 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94007d00 con 0x55a4a5bdbc90 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.193+0000 7ffa8d602640 1 -- 172.21.15.62:0/406639622 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9401e020 con 0x55a4a5bdbc90 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.193+0000 7ffba59a2800 1 -- 172.21.15.62:0/406639622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4a5bda870 con 0x55a4a5bdbc90 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.193+0000 7ffa8d602640 1 -- 172.21.15.62:0/406639622 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94019420 con 0x55a4a5bdbc90 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.193+0000 7ffba59a2800 1 -- 172.21.15.62:0/406639622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a5bdad70 con 0x55a4a5bdbc90 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.193+0000 7ffa8d602640 1 -- 172.21.15.62:0/406639622 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb94016040 con 0x55a4a5bdbc90 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffa8d602640 1 --2- 172.21.15.62:0/406639622 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa7c036eb0 0x7ffa7c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffa8d602640 1 -- 172.21.15.62:0/406639622 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ffb9401f030 con 0x55a4a5bdbc90 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba34a1640 1 --2- 172.21.15.62:0/406639622 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa7c036eb0 0x7ffa7c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba59a2800 1 Processor -- start 2024-04-26T07:54:35.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba59a2800 1 -- start start 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba34a1640 1 --2- 172.21.15.62:0/406639622 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa7c036eb0 0x7ffa7c039370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c006690 tx=0x7ffb9c014fb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba59a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5cff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba59a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4a5ccd600 con 0x55a4a5cff4c0 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba3ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5cff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba3ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5cff8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32930/0 (socket says 172.21.15.62:32930) 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.194+0000 7ffba3ca2640 1 -- 172.21.15.62:0/3861451822 learned_addr learned my addr 172.21.15.62:0/3861451822 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba3ca2640 1 -- 172.21.15.62:0/3861451822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a5cffeb0 con 0x55a4a5cff4c0 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba3ca2640 1 --2- 172.21.15.62:0/3861451822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5cff8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffb9404ce70 tx=0x7ffb94017ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15a47317689abeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffa86ffd640 1 -- 172.21.15.62:0/3861451822 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb9401d070 con 0x55a4a5cff4c0 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffa86ffd640 1 -- 172.21.15.62:0/3861451822 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94041130 con 0x55a4a5cff4c0 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffa86ffd640 1 -- 172.21.15.62:0/3861451822 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94014950 con 0x55a4a5cff4c0 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba59a2800 1 -- 172.21.15.62:0/3861451822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 msgr2=0x55a4a5cff8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3861451822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5cff8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffb9404ce70 tx=0x7ffb94017ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba59a2800 1 -- 172.21.15.62:0/3861451822 shutdown_connections 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3861451822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5cff8e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba59a2800 1 -- 172.21.15.62:0/3861451822 >> 172.21.15.62:0/3861451822 conn(0x55a4a5cfb820 msgr2=0x55a4a5cf9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba59a2800 1 -- 172.21.15.62:0/3861451822 shutdown_connections 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.195+0000 7ffba59a2800 1 -- 172.21.15.62:0/3861451822 wait complete. 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba59a2800 1 Processor -- start 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba59a2800 1 -- start start 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba59a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5d06a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba59a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4a5d00640 con 0x55a4a5cff4c0 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba3ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5d06a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba3ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5d06a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32942/0 (socket says 172.21.15.62:32942) 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 learned_addr learned my addr 172.21.15.62:0/1699195473 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a5d06f40 con 0x55a4a5cff4c0 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.196+0000 7ffba3ca2640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5d06a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffb94018010 tx=0x7ffb9404ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.197+0000 7ffa857fa640 1 -- 172.21.15.62:0/1699195473 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94019900 con 0x55a4a5cff4c0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.197+0000 7ffa857fa640 1 -- 172.21.15.62:0/1699195473 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94019aa0 con 0x55a4a5cff4c0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.197+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4a5d071d0 con 0x55a4a5cff4c0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.197+0000 7ffa857fa640 1 -- 172.21.15.62:0/1699195473 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94015960 con 0x55a4a5cff4c0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.197+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a5d071d0 con 0x55a4a5cff4c0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.197+0000 7ffa857fa640 1 -- 172.21.15.62:0/1699195473 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb9404eb80 con 0x55a4a5cff4c0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.198+0000 7ffa857fa640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa6c036eb0 0x7ffa6c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.198+0000 7ffa857fa640 1 -- 172.21.15.62:0/1699195473 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ffb94038c40 con 0x55a4a5cff4c0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.198+0000 7ffba34a1640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa6c036eb0 0x7ffa6c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.198+0000 7ffba34a1640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa6c036eb0 0x7ffa6c039370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0021b0 tx=0x7ffb9c042000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.198+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.198+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5d123c0 0x55a4a5d14880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.198+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d14fd0 con 0x55a4a5d123c0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.198+0000 7ffba2ca0640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5d123c0 0x55a4a5d14880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba2ca0640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5d123c0 0x55a4a5d14880 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 20 realm 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d153a0 con 0x55a4a5d123c0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d15c70 con 0x55a4a5d123c0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.199+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d16010 con 0x55a4a5d123c0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.200+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.200+0000 7ffba59a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.200+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.200+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5d16d70 0x55a4a5d19160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.200+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d19720 con 0x55a4a5d16d70 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.200+0000 7ffba3ca2640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5d16d70 0x55a4a5d19160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.200+0000 7ffba3ca2640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5d16d70 0x55a4a5d19160 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.201+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.201+0000 7ffba59a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.201+0000 7ffba59a2800 20 searching for the correct realm 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.201+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a4a5d1b500 0x55a4a5d1d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.201+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1ded0 con 0x55a4a5d1b500 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.201+0000 7ffba34a1640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a4a5d1b500 0x55a4a5d1d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.201+0000 7ffba34a1640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a4a5d1b500 0x55a4a5d1d8f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.202+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.202+0000 7ffba34a1640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb9c027020 0x7ffb9c026830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.202+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1ded0 con 0x7ffb9c027020 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.202+0000 7ffba2ca0640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb9c027020 0x7ffb9c026830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.202+0000 7ffba2ca0640 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb9c027020 0x7ffb9c026830 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.202+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.202+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1ded0 con 0x55a4a5d16d70 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.203+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.203+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d123c0 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.203+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.203+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d123c0 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.203+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.203+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d16d70 2024-04-26T07:54:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.203+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.203+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d16d70 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.204+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.204+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x7ffb9c027020 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.204+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.204+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d1b500 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.204+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.204+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d123c0 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.204+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.204+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d16d70 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.205+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.205+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d123c0 2024-04-26T07:54:35.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.205+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.205+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x7ffb9c027020 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.205+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.205+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d1b500 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.205+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.205+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d1b500 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.206+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.206+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d16d70 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.206+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.206+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d1b500 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.206+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.206+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d1b500 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.206+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.206+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d123c0 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.207+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.207+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d123c0 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.207+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.207+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d16d70 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.207+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.207+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d1b500 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.207+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.207+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x7ffb9c027020 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.208+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.208+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d123c0 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.208+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.208+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d16d70 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.208+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.208+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d1b500 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.208+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.208+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d16d70 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.209+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.209+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x7ffb9c027020 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.209+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.209+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d1b500 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.209+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.209+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d16d70 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x55a4a5d123c0 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ffb94042020 con 0x7ffb9c027020 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d19fe0 con 0x55a4a5d123c0 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.210+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1a3d0 con 0x55a4a5d123c0 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1a7f0 con 0x55a4a5d123c0 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 zone default found 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 4 Realm: () 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 zonegroup default 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1e350 con 0x55a4a5d16d70 2024-04-26T07:54:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d200d0 con 0x55a4a5d1b500 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.211+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d20500 con 0x55a4a5d1b500 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.212+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.212+0000 7ffba59a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.212+0000 7ffba59a2800 20 started sync module instance, tier type = 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.212+0000 7ffba59a2800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.212+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1f570 con 0x7ffb9c027020 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.213+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.213+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94165644999328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1f570 con 0x7ffb9c027020 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.213+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d21030 con 0x55a4a5d123c0 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.214+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94165644999328] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.214+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.214+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94165645003520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1f570 con 0x55a4a5d123c0 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.214+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d21af0 con 0x55a4a5d1b500 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.215+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.215+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94165645006272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d22390 con 0x55a4a5d1b500 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.215+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d22e40 con 0x7ffb9c027020 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.215+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94165645003520] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.216+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94165645006272] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.216+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.216+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94165645008608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d22920 con 0x7ffb9c027020 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.216+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d236e0 con 0x55a4a5d123c0 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.217+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.217+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94165645013472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d23af0 con 0x55a4a5d123c0 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.217+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d245d0 con 0x55a4a5d16d70 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.217+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94165645008608] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.218+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94165645013472] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.218+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.218+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94165644996800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d240e0 con 0x55a4a5d16d70 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.218+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d24ea0 con 0x55a4a5d16d70 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.219+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.219+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94165644996800] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.219+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94165645019296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d25170 con 0x55a4a5d16d70 2024-04-26T07:54:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.219+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d23600 con 0x55a4a5d16d70 2024-04-26T07:54:35.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94165645014528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d25b30 con 0x55a4a5d16d70 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba59a2800 20 add_watcher() i=0 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba59a2800 20 add_watcher() i=1 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba59a2800 20 add_watcher() i=2 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba59a2800 20 add_watcher() i=3 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba59a2800 20 add_watcher() i=4 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba59a2800 20 add_watcher() i=5 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94165645019296] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.220+0000 7ffba59a2800 20 add_watcher() i=6 2024-04-26T07:54:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.221+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94165645014528] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.221+0000 7ffba59a2800 20 add_watcher() i=7 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.221+0000 7ffba59a2800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.221+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d28b60 con 0x55a4a5d123c0 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.222+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.222+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94165645022848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d26000 con 0x55a4a5d123c0 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94165645022848] v27'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffa59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba59a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba59a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba59a2800 5 note: GC not initialized 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffa58fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba59a2800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba59a2800 20 Filter name: none 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ff9d27fc640 20 reqs_thread_entry: start 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba59a2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.223+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d5c0c0 con 0x55a4a5d123c0 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d5cb30 con 0x55a4a5d123c0 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.224+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d62520 con 0x55a4a5d123c0 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.225+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v27'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.225+0000 7ffba59a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.225+0000 7ffba59a2800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.225+0000 7ffba59a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.225+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94165645270928 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d5db40 con 0x55a4a5d123c0 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== watch-notify(notify (1) cookie 94165645013472 notify 115964116997 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55a4a5be3730 con 0x55a4a5d123c0 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffa86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94165645013472 notifier 4354 bl.length()=732 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffa86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffa86ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffa86ffd640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ffa68003ea0 con 0x55a4a5d123c0 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify cookie 94165645270928 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== watch-notify(notify_complete (2) cookie 94165645270928 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffb8c05da60 con 0x55a4a5d123c0 2024-04-26T07:54:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.226+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d61f90 con 0x55a4a5d123c0 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.227+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.227+0000 7ffba59a2800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.227+0000 7ffba59a2800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.227+0000 7ffba59a2800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.227+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94165645270928 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d5d690 con 0x7ffb9c027020 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.228+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== watch-notify(notify (1) cookie 94165644999328 notify 115964116994 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7ffb8c05da60 con 0x7ffb9c027020 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.228+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.0 [notify cookie 94165645270928 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.228+0000 7ffa867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94165644999328 notifier 4354 bl.length()=166 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.228+0000 7ffa867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.228+0000 7ffa867fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.228+0000 7ffa867fc640 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff9d8003400 con 0x7ffb9c027020 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.228+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.228+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== watch-notify(notify_complete (2) cookie 94165645270928 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffb8c090440 con 0x7ffb9c027020 2024-04-26T07:54:35.244 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"dlqAtamnzz0eBC0IpGRJVtLs32uzdG6kUEV0LvFc","active":true,"create_date":"2024-04-26T07:54:35.225778Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.229+0000 7ffa59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.229+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94165645022848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d61420 con 0x55a4a5d123c0 2024-04-26T07:54:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.230+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94165645022848] v27'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.230+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94165644999328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d61420 con 0x7ffb9c027020 2024-04-26T07:54:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.231+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94165644999328] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.231+0000 7ffba59a2800 20 remove_watcher() i=0 2024-04-26T07:54:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.231+0000 7ffba59a2800 2 removed watcher, disabling cache 2024-04-26T07:54:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.231+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94165645003520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1faa0 con 0x55a4a5d123c0 2024-04-26T07:54:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.232+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94165645003520] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.232+0000 7ffba59a2800 20 remove_watcher() i=1 2024-04-26T07:54:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.232+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94165645006272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d1faa0 con 0x55a4a5d1b500 2024-04-26T07:54:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.233+0000 7ffba34a1640 1 -- 172.21.15.62:0/1699195473 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94165645006272] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb9c01b070 con 0x55a4a5d1b500 2024-04-26T07:54:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.233+0000 7ffba59a2800 20 remove_watcher() i=2 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.233+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94165645008608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d20b00 con 0x7ffb9c027020 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.234+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94165645008608] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x7ffb9c027020 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.234+0000 7ffba59a2800 20 remove_watcher() i=3 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.234+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94165645013472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d20b00 con 0x55a4a5d123c0 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.235+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94165645013472] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8c05a040 con 0x55a4a5d123c0 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.235+0000 7ffba59a2800 20 remove_watcher() i=4 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.235+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94165644996800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d231e0 con 0x55a4a5d16d70 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.236+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94165644996800] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.236+0000 7ffba59a2800 20 remove_watcher() i=5 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.236+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94165645019296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d20b00 con 0x55a4a5d16d70 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.237+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94165645019296] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.237+0000 7ffba59a2800 20 remove_watcher() i=6 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.237+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94165645014528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a5d231e0 con 0x55a4a5d16d70 2024-04-26T07:54:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba3ca2640 1 -- 172.21.15.62:0/1699195473 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94165645014528] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb94034020 con 0x55a4a5d16d70 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 20 remove_watcher() i=7 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5d16d70 msgr2=0x55a4a5d19160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5d16d70 0x55a4a5d19160 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5d123c0 msgr2=0x55a4a5d14880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5d123c0 0x55a4a5d14880 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb9c027020 msgr2=0x7ffb9c026830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb9c027020 0x7ffb9c026830 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a4a5d1b500 msgr2=0x55a4a5d1d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a4a5d1b500 0x55a4a5d1d8f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa6c036eb0 msgr2=0x7ffa6c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa6c036eb0 0x7ffa6c039370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0021b0 tx=0x7ffb9c042000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 msgr2=0x55a4a5d06a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/1699195473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5cff4c0 0x55a4a5d06a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffb94018010 tx=0x7ffb9404ce00 comp rx=0 tx=0).stop 2024-04-26T07:54:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 reap_dead start 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba2ca0640 1 -- 172.21.15.62:0/1699195473 reap_dead start 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 shutdown_connections 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 >> 172.21.15.62:0/1699195473 conn(0x55a4a5cfb820 msgr2=0x55a4a5cf8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 shutdown_connections 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/1699195473 wait complete. 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/406639622 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa7c036eb0 msgr2=0x7ffa7c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/406639622 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa7c036eb0 0x7ffa7c039370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c006690 tx=0x7ffb9c014fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/406639622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdbc90 msgr2=0x55a4a5bda100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/406639622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdbc90 0x55a4a5bda100 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55a4a5cd56b0 tx=0x7ffb9400aec0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/406639622 shutdown_connections 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/406639622 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa7c036eb0 0x7ffa7c039370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 --2- 172.21.15.62:0/406639622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdbc90 0x55a4a5bda100 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.238+0000 7ffba59a2800 1 -- 172.21.15.62:0/406639622 >> 172.21.15.62:0/406639622 conn(0x55a4a5ce3fd0 msgr2=0x55a4a5ce43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/406639622 shutdown_connections 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/406639622 wait complete. 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5cde300 msgr2=0x55a4a5ce06f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5cde300 0x55a4a5ce06f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5bdfc20 msgr2=0x55a4a5cdba20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5bdfc20 0x55a4a5cdba20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa88036eb0 msgr2=0x7ffa88039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa88036eb0 0x7ffa88039370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c054000 tx=0x7ffb8c04e000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 msgr2=0x55a4a5cd4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5cd4830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c000f80 tx=0x7ffb9c001250 comp rx=0 tx=0).stop 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 shutdown_connections 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a4a5bdfc20 0x55a4a5cdba20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a4a5cde300 0x55a4a5ce06f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa88036eb0 0x7ffa88039370 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 --2- 172.21.15.62:0/3155032108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a5bdc110 0x55a4a5cd4830 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 >> 172.21.15.62:0/3155032108 conn(0x55a4a5bd5be0 msgr2=0x55a4a5cc6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 shutdown_connections 2024-04-26T07:54:35.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.239+0000 7ffba59a2800 1 -- 172.21.15.62:0/3155032108 wait complete. 2024-04-26T07:54:35.255 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'dlqAtamnzz0eBC0IpGRJVtLs32uzdG6kUEV0LvFc', 'active': True, 'create_date': '2024-04-26T07:54:35.225778Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:35.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-26T07:54:35.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-26T07:54:35.255 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-04-26T07:54:35.304 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:35.304 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.306+0000 7f63f580e800 1 Processor -- start 2024-04-26T07:54:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.306+0000 7f63f580e800 1 -- start start 2024-04-26T07:54:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.306+0000 7f63f580e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x563ac043ba30 0x563ac043de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.306+0000 7f63f580e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ac043e3f0 con 0x563ac04375a0 2024-04-26T07:54:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.306+0000 7f63f580e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x563ac02dae20 con 0x563ac043ba30 2024-04-26T07:54:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.307+0000 7f63f2b0c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x563ac043ba30 0x563ac043de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.307+0000 7f63f330d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x563ac04375a0 0x563ac04379c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36548/0 (socket says 172.21.15.62:36548) 2024-04-26T07:54:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.307+0000 7f63f330d640 1 -- 172.21.15.62:0/958634521 learned_addr learned my addr 172.21.15.62:0/958634521 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.307+0000 7f63f2b0c640 1 -- 172.21.15.62:0/958634521 >> v1:172.21.15.1:6789/0 conn(0x563ac04375a0 legacy=0x563ac04379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.307+0000 7f63f230b640 1 -- 172.21.15.62:0/958634521 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117456750 0 0) 0x563ac043e3f0 con 0x563ac04375a0 2024-04-26T07:54:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.307+0000 7f63f2b0c640 1 -- 172.21.15.62:0/958634521 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac043f620 con 0x563ac043ba30 2024-04-26T07:54:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.309+0000 7f63f2b0c640 1 --2- 172.21.15.62:0/958634521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac043ba30 0x563ac043de20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f63e800a470 tx=0x7f63e801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64c6e62ce986065 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.309+0000 7f63f230b640 1 -- 172.21.15.62:0/958634521 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e8057070 con 0x563ac043ba30 2024-04-26T07:54:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.309+0000 7f63f230b640 1 -- 172.21.15.62:0/958634521 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e8052570 con 0x563ac043ba30 2024-04-26T07:54:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.309+0000 7f63f230b640 1 -- 172.21.15.62:0/958634521 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e8052870 con 0x563ac043ba30 2024-04-26T07:54:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.310+0000 7f63f580e800 1 -- 172.21.15.62:0/958634521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac043ba30 msgr2=0x563ac043de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.310+0000 7f63f580e800 1 --2- 172.21.15.62:0/958634521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac043ba30 0x563ac043de20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f63e800a470 tx=0x7f63e801ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.310+0000 7f63f580e800 1 -- 172.21.15.62:0/958634521 shutdown_connections 2024-04-26T07:54:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.310+0000 7f63f580e800 1 --2- 172.21.15.62:0/958634521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac043ba30 0x563ac043de20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.310+0000 7f63f580e800 1 -- 172.21.15.62:0/958634521 >> 172.21.15.62:0/958634521 conn(0x563ac0432bc0 msgr2=0x563ac0434fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.310+0000 7f63f580e800 1 -- 172.21.15.62:0/958634521 shutdown_connections 2024-04-26T07:54:35.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.310+0000 7f63f580e800 1 -- 172.21.15.62:0/958634521 wait complete. 2024-04-26T07:54:35.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.322+0000 7f63f580e800 1 Processor -- start 2024-04-26T07:54:35.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.322+0000 7f63f580e800 1 -- start start 2024-04-26T07:54:35.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.322+0000 7f63f580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac0529b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.322+0000 7f63f580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563ac0383cf0 con 0x563ac04375a0 2024-04-26T07:54:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.323+0000 7f63f330d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac0529b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.323+0000 7f63f330d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac0529b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32954/0 (socket says 172.21.15.62:32954) 2024-04-26T07:54:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.323+0000 7f63f330d640 1 -- 172.21.15.62:0/3808361491 learned_addr learned my addr 172.21.15.62:0/3808361491 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.323+0000 7f63f330d640 1 -- 172.21.15.62:0/3808361491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac052a150 con 0x563ac04375a0 2024-04-26T07:54:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.323+0000 7f63f330d640 1 --2- 172.21.15.62:0/3808361491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac0529b80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b240 tx=0x7f63e400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e08584913989936 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.323+0000 7f62e160a640 1 -- 172.21.15.62:0/3808361491 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e4008070 con 0x563ac04375a0 2024-04-26T07:54:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.323+0000 7f62e160a640 1 -- 172.21.15.62:0/3808361491 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e400d500 con 0x563ac04375a0 2024-04-26T07:54:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.323+0000 7f62e160a640 1 -- 172.21.15.62:0/3808361491 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e400d860 con 0x563ac04375a0 2024-04-26T07:54:35.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 -- 172.21.15.62:0/3808361491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 msgr2=0x563ac0529b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 --2- 172.21.15.62:0/3808361491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac0529b80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b240 tx=0x7f63e400b700 comp rx=0 tx=0).stop 2024-04-26T07:54:35.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 -- 172.21.15.62:0/3808361491 shutdown_connections 2024-04-26T07:54:35.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 --2- 172.21.15.62:0/3808361491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac0529b80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 -- 172.21.15.62:0/3808361491 >> 172.21.15.62:0/3808361491 conn(0x563ac0432bc0 msgr2=0x563ac05254a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 -- 172.21.15.62:0/3808361491 shutdown_connections 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 -- 172.21.15.62:0/3808361491 wait complete. 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 Processor -- start 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 -- start start 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac04433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.324+0000 7f63f580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563ac043e8c0 con 0x563ac04375a0 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f63f330d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac04433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f63f330d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac04433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32962/0 (socket says 172.21.15.62:32962) 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f63f330d640 1 -- 172.21.15.62:0/3212401056 learned_addr learned my addr 172.21.15.62:0/3212401056 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f63f330d640 1 -- 172.21.15.62:0/3212401056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac0441ae0 con 0x563ac04375a0 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f63f330d640 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac04433f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f63e4000f60 tx=0x7f63e4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f62dfe07640 1 -- 172.21.15.62:0/3212401056 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e4019870 con 0x563ac04375a0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f62dfe07640 1 -- 172.21.15.62:0/3212401056 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e4019a10 con 0x563ac04375a0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f62dfe07640 1 -- 172.21.15.62:0/3212401056 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e4019d10 con 0x563ac04375a0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ac0441d70 con 0x563ac04375a0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.325+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ac0442290 con 0x563ac04375a0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.326+0000 7f62dfe07640 1 -- 172.21.15.62:0/3212401056 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f63e4017040 con 0x563ac04375a0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.326+0000 7f62dfe07640 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62d8036e60 0x7f62d8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.326+0000 7f62dfe07640 1 -- 172.21.15.62:0/3212401056 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f63e4015020 con 0x563ac04375a0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.326+0000 7f63f2b0c640 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62d8036e60 0x7f62d8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.326+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac043ba30 0x563ac053ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.326+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac053b070 con 0x563ac043ba30 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.326+0000 7f63f3b0e640 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac043ba30 0x563ac053ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.327+0000 7f63f2b0c640 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62d8036e60 0x7f62d8039320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f63e8054000 tx=0x7f63e804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.327+0000 7f63f3b0e640 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac043ba30 0x563ac053ab30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.327+0000 7f63f3b0e640 1 -- 172.21.15.62:0/3212401056 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63ec00a4a0 con 0x563ac043ba30 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.327+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac0442620 con 0x563ac043ba30 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.327+0000 7f63f3b0e640 1 -- 172.21.15.62:0/3212401056 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63ec00a4a0 con 0x563ac043ba30 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.327+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac053d3a0 0x563ac053f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.327+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac053fe30 con 0x563ac053d3a0 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.328+0000 7f63f330d640 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac053d3a0 0x563ac053f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.328+0000 7f63f330d640 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac053d3a0 0x563ac053f790 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.328+0000 7f63f330d640 1 -- 172.21.15.62:0/3212401056 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f63e402d070 con 0x563ac053d3a0 2024-04-26T07:54:35.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.328+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac053c320 con 0x563ac043ba30 2024-04-26T07:54:35.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.328+0000 7f63f3b0e640 1 -- 172.21.15.62:0/3212401056 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f63ec00a4a0 con 0x563ac043ba30 2024-04-26T07:54:35.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac053c800 con 0x563ac043ba30 2024-04-26T07:54:35.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f3b0e640 1 -- 172.21.15.62:0/3212401056 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f63ec00a4a0 con 0x563ac043ba30 2024-04-26T07:54:35.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f580e800 1 Processor -- start 2024-04-26T07:54:35.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f580e800 1 -- start start 2024-04-26T07:54:35.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac054efe0 0x563ac054f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563ac032b170 con 0x563ac054efe0 2024-04-26T07:54:35.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f3b0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac054efe0 0x563ac054f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f3b0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac054efe0 0x563ac054f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32978/0 (socket says 172.21.15.62:32978) 2024-04-26T07:54:35.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.329+0000 7f63f3b0e640 1 -- 172.21.15.62:0/3445562666 learned_addr learned my addr 172.21.15.62:0/3445562666 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.330+0000 7f63f3b0e640 1 -- 172.21.15.62:0/3445562666 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac054f940 con 0x563ac054efe0 2024-04-26T07:54:35.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.330+0000 7f63f3b0e640 1 --2- 172.21.15.62:0/3445562666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac054efe0 0x563ac054f400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x563ac0442c00 tx=0x7f63ec0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.330+0000 7f62dd602640 1 -- 172.21.15.62:0/3445562666 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63ec014450 con 0x563ac054efe0 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.330+0000 7f62dd602640 1 -- 172.21.15.62:0/3445562666 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec0145f0 con 0x563ac054efe0 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.330+0000 7f63f580e800 1 -- 172.21.15.62:0/3445562666 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ac05503b0 con 0x563ac054efe0 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.330+0000 7f62dd602640 1 -- 172.21.15.62:0/3445562666 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63ec0148d0 con 0x563ac054efe0 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.330+0000 7f63f580e800 1 -- 172.21.15.62:0/3445562666 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ac05508b0 con 0x563ac054efe0 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.331+0000 7f62dd602640 1 -- 172.21.15.62:0/3445562666 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f63ec011040 con 0x563ac054efe0 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.331+0000 7f62dd602640 1 --2- 172.21.15.62:0/3445562666 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62cc036eb0 0x7f62cc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.331+0000 7f62dd602640 1 -- 172.21.15.62:0/3445562666 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f63ec01e070 con 0x563ac054efe0 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.331+0000 7f63f330d640 1 --2- 172.21.15.62:0/3445562666 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62cc036eb0 0x7f62cc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.331+0000 7f63f580e800 1 Processor -- start 2024-04-26T07:54:35.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.331+0000 7f63f580e800 1 -- start start 2024-04-26T07:54:35.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.331+0000 7f63f330d640 1 --2- 172.21.15.62:0/3445562666 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62cc036eb0 0x7f62cc039370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63e404bb70 tx=0x7f63e404ba40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f63f580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac055c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f63f580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563ac052a4d0 con 0x563ac055c250 2024-04-26T07:54:35.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f63f3b0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac055c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f63f3b0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac055c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32980/0 (socket says 172.21.15.62:32980) 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f63f3b0e640 1 -- 172.21.15.62:0/356392226 learned_addr learned my addr 172.21.15.62:0/356392226 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f63f3b0e640 1 -- 172.21.15.62:0/356392226 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac055cc40 con 0x563ac055c250 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f63f3b0e640 1 --2- 172.21.15.62:0/356392226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac055c670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f63ec04ce90 tx=0x7f63ec011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26c022fb859a406 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f62d6ffd640 1 -- 172.21.15.62:0/356392226 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63ec0167c0 con 0x563ac055c250 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f62d6ffd640 1 -- 172.21.15.62:0/356392226 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec013ca0 con 0x563ac055c250 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.332+0000 7f62d6ffd640 1 -- 172.21.15.62:0/356392226 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63ec016960 con 0x563ac055c250 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 -- 172.21.15.62:0/356392226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 msgr2=0x563ac055c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 --2- 172.21.15.62:0/356392226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac055c670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f63ec04ce90 tx=0x7f63ec011700 comp rx=0 tx=0).stop 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 -- 172.21.15.62:0/356392226 shutdown_connections 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 --2- 172.21.15.62:0/356392226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac055c670 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 -- 172.21.15.62:0/356392226 >> 172.21.15.62:0/356392226 conn(0x563ac05585b0 msgr2=0x563ac0556610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 -- 172.21.15.62:0/356392226 shutdown_connections 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 -- 172.21.15.62:0/356392226 wait complete. 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 Processor -- start 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 -- start start 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac0563850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563ac055d3b0 con 0x563ac055c250 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f3b0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac0563850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f3b0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac0563850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32982/0 (socket says 172.21.15.62:32982) 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.333+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 learned_addr learned my addr 172.21.15.62:0/2048886663 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.334+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac0563d90 con 0x563ac055c250 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.334+0000 7f63f3b0e640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac0563850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f63ec048010 tx=0x7f63ec04ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.334+0000 7f62d57fa640 1 -- 172.21.15.62:0/2048886663 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63ec022a80 con 0x563ac055c250 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.334+0000 7f62d57fa640 1 -- 172.21.15.62:0/2048886663 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec022c20 con 0x563ac055c250 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.334+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ac0564020 con 0x563ac055c250 2024-04-26T07:54:35.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.334+0000 7f62d57fa640 1 -- 172.21.15.62:0/2048886663 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63ec02b350 con 0x563ac055c250 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.334+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ac0566cd0 con 0x563ac055c250 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.335+0000 7f62d57fa640 1 -- 172.21.15.62:0/2048886663 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f63ec04ebe0 con 0x563ac055c250 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.335+0000 7f62d57fa640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62bc036eb0 0x7f62bc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.335+0000 7f62d57fa640 1 -- 172.21.15.62:0/2048886663 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f63ec033070 con 0x563ac055c250 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.335+0000 7f63f330d640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62bc036eb0 0x7f62bc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.335+0000 7f63f330d640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62bc036eb0 0x7f62bc039370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63e4001020 tx=0x7f63e4027000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac056f340 0x563ac0571800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac0571f50 con 0x563ac056f340 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f2b0c640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac056f340 0x563ac0571800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f2b0c640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac056f340 0x563ac0571800 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f580e800 20 realm 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.336+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac0572320 con 0x563ac056f340 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac0572bf0 con 0x563ac056f340 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac0572f90 con 0x563ac056f340 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac0573cf0 0x563ac05760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.337+0000 7f63f3b0e640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac0573cf0 0x563ac05760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.338+0000 7f63f3b0e640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac0573cf0 0x563ac05760e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.338+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.338+0000 7f63f580e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.338+0000 7f63f580e800 20 searching for the correct realm 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.338+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563ac0578680 0x563ac057ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.338+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac057b210 con 0x563ac0578680 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.338+0000 7f63f330d640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563ac0578680 0x563ac057ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.338+0000 7f63f330d640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563ac0578680 0x563ac057ab40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.339+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.339+0000 7f63f330d640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63e404d880 0x7f63e401c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.339+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac057b210 con 0x7f63e404d880 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.339+0000 7f63f2b0c640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63e404d880 0x7f63e401c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.339+0000 7f63f2b0c640 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63e404d880 0x7f63e401c5e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.340+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.340+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac057b210 con 0x563ac0573cf0 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.340+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.340+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac056f340 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.340+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.340+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac056f340 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.341+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.341+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.341+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.341+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.341+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.341+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x7f63e404d880 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.341+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.341+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0578680 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.342+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.342+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac056f340 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.342+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.342+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.342+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.342+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac056f340 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.343+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.343+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x7f63e404d880 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.343+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.343+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0578680 2024-04-26T07:54:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.343+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.343+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0578680 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.343+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.343+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0578680 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0578680 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac056f340 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac056f340 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.344+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.345+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.345+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0578680 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.345+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.345+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x7f63e404d880 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.346+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.346+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac056f340 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.346+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.346+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.346+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.346+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0578680 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.346+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.346+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.347+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.347+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x7f63e404d880 2024-04-26T07:54:35.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.347+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.347+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0578680 2024-04-26T07:54:35.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.347+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.347+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac0573cf0 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x563ac056f340 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563ac05766f0 con 0x7f63e404d880 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f580e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f580e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f580e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f580e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f580e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f580e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.348+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac0576a90 con 0x563ac056f340 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac0576e80 con 0x563ac056f340 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac05772a0 con 0x563ac056f340 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 zone default found 2024-04-26T07:54:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 4 Realm: () 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 zonegroup default 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac057b690 con 0x563ac0573cf0 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.349+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac057d470 con 0x563ac0578680 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac057d900 con 0x563ac0578680 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f580e800 20 started sync module instance, tier type = 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f580e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.350+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057c8b0 con 0x7f63e404d880 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.351+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.351+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94810335071664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057c8b0 con 0x7f63e404d880 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.351+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057e3c0 con 0x563ac056f340 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.352+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94810335071664] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.352+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.352+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94810335076016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057c8b0 con 0x563ac056f340 2024-04-26T07:54:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.352+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057ee50 con 0x563ac0578680 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.353+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94810335076016] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.353+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.353+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94810335069184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057f1f0 con 0x563ac0578680 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.353+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057fc20 con 0x7f63e404d880 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.354+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94810335069184] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.354+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.354+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94810335078736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0580040 con 0x7f63e404d880 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.354+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0580a40 con 0x563ac056f340 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.355+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.355+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94810335085904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0580970 con 0x563ac056f340 2024-04-26T07:54:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.355+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0581990 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.356+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94810335078736] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.356+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94810335085904] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.357+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.357+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94810335088176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0581950 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.357+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0582230 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.358+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94810335088176] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.358+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.358+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94810335089792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0581950 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.358+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0582880 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94810335089792] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94810335093584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac0582840 con 0x563ac0573cf0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f580e800 20 add_watcher() i=0 2024-04-26T07:54:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f580e800 20 add_watcher() i=1 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f580e800 20 add_watcher() i=2 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f580e800 20 add_watcher() i=3 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f580e800 20 add_watcher() i=4 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f580e800 20 add_watcher() i=5 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.359+0000 7f63f580e800 20 add_watcher() i=6 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.360+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94810335093584] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.360+0000 7f63f580e800 20 add_watcher() i=7 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.360+0000 7f63f580e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.360+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac0585d30 con 0x563ac056f340 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.360+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.360+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94810335092016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac05831f0 con 0x563ac056f340 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.361+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94810335092016] v27'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f62a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f63f580e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f63f580e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f63f580e800 5 note: GC not initialized 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f62a8fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f63f580e800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f63f580e800 20 Filter name: none 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f62227fc640 20 reqs_thread_entry: start 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f63f580e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f63f580e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.362+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac05b9500 con 0x563ac056f340 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.363+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.363+0000 7f63f580e800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.363+0000 7f63f580e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.363+0000 7f63f580e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.363+0000 7f63f580e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.363+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac05bfc30 con 0x563ac056f340 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v27'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f63f580e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f63f580e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f63f580e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94810335344288 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563ac05bb380 con 0x563ac056f340 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94810335085904 notify 115964116998 ret 0) ==== 774+0+0 (crc 0 0 0) 0x563ac043f620 con 0x563ac056f340 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f62d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94810335085904 notifier 4361 bl.length()=732 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94810335344288 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f62d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:35.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f62d6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.364+0000 7f62d6ffd640 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f62b8003ea0 con 0x563ac056f340 2024-04-26T07:54:35.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.365+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.365+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94810335344288 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f63e805da20 con 0x563ac056f340 2024-04-26T07:54:35.378 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:35.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.366+0000 7f62a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.366+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94810335092016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac05baed0 con 0x563ac056f340 2024-04-26T07:54:35.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.366+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94810335092016] v27'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.366+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94810335071664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac05bb380 con 0x7f63e404d880 2024-04-26T07:54:35.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.367+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94810335071664] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.367+0000 7f63f580e800 20 remove_watcher() i=0 2024-04-26T07:54:35.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.367+0000 7f63f580e800 2 removed watcher, disabling cache 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.367+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94810335076016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac05bb380 con 0x563ac056f340 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.368+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94810335076016] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.368+0000 7f63f580e800 20 remove_watcher() i=1 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.368+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94810335069184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac05bb380 con 0x563ac0578680 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.369+0000 7f63f330d640 1 -- 172.21.15.62:0/2048886663 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94810335069184] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e402d070 con 0x563ac0578680 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.369+0000 7f63f580e800 20 remove_watcher() i=2 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.369+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94810335078736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057cdb0 con 0x7f63e404d880 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.370+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94810335078736] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x7f63e404d880 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.370+0000 7f63f580e800 20 remove_watcher() i=3 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.370+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94810335085904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057deb0 con 0x563ac056f340 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.371+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94810335085904] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e805a040 con 0x563ac056f340 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.371+0000 7f63f580e800 20 remove_watcher() i=4 2024-04-26T07:54:35.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.371+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94810335088176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057c400 con 0x563ac0573cf0 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.372+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94810335088176] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.372+0000 7f63f580e800 20 remove_watcher() i=5 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.372+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94810335089792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057e950 con 0x563ac0573cf0 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.373+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94810335089792] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.373+0000 7f63f580e800 20 remove_watcher() i=6 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.373+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94810335093584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563ac057cdb0 con 0x563ac0573cf0 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f3b0e640 1 -- 172.21.15.62:0/2048886663 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94810335093584] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63ec02a070 con 0x563ac0573cf0 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 20 remove_watcher() i=7 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac0573cf0 msgr2=0x563ac05760e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac0573cf0 0x563ac05760e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac056f340 msgr2=0x563ac0571800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac056f340 0x563ac0571800 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63e404d880 msgr2=0x7f63e401c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63e404d880 0x7f63e401c5e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563ac0578680 msgr2=0x563ac057ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.374+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563ac0578680 0x563ac057ab40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62bc036eb0 msgr2=0x7f62bc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62bc036eb0 0x7f62bc039370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63e4001020 tx=0x7f63e4027000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 msgr2=0x563ac0563850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac0563850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f63ec048010 tx=0x7f63ec04ce20 comp rx=0 tx=0).stop 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f2b0c640 1 -- 172.21.15.62:0/2048886663 reap_dead start 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 shutdown_connections 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/2048886663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac055c250 0x563ac0563850 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 >> 172.21.15.62:0/2048886663 conn(0x563ac05585b0 msgr2=0x563ac0555c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 shutdown_connections 2024-04-26T07:54:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/2048886663 wait complete. 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/3445562666 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62cc036eb0 msgr2=0x7f62cc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/3445562666 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62cc036eb0 0x7f62cc039370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63e404bb70 tx=0x7f63e404ba40 comp rx=0 tx=0).stop 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/3445562666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac054efe0 msgr2=0x563ac054f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/3445562666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac054efe0 0x563ac054f400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x563ac0442c00 tx=0x7f63ec0188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/3445562666 shutdown_connections 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/3445562666 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62cc036eb0 0x7f62cc039370 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/3445562666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac054efe0 0x563ac054f400 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/3445562666 >> 172.21.15.62:0/3445562666 conn(0x563ac0543080 msgr2=0x563ac0543480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/3445562666 shutdown_connections 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/3445562666 wait complete. 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac053d3a0 msgr2=0x563ac053f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac053d3a0 0x563ac053f790 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac043ba30 msgr2=0x563ac053ab30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.375+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac043ba30 0x563ac053ab30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62d8036e60 msgr2=0x7f62d8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62d8036e60 0x7f62d8039320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f63e8054000 tx=0x7f63e804e000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 msgr2=0x563ac04433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac04433f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f63e4000f60 tx=0x7f63e4000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 shutdown_connections 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563ac043ba30 0x563ac053ab30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563ac053d3a0 0x563ac053f790 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f62d8036e60 0x7f62d8039320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 --2- 172.21.15.62:0/3212401056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ac04375a0 0x563ac04433f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 >> 172.21.15.62:0/3212401056 conn(0x563ac0432bc0 msgr2=0x563ac0523cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 shutdown_connections 2024-04-26T07:54:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.376+0000 7f63f580e800 1 -- 172.21.15.62:0/3212401056 wait complete. 2024-04-26T07:54:35.390 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:35.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:54:35.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:54:35.390 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:54:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.436+0000 7f5d8300a800 1 Processor -- start 2024-04-26T07:54:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.436+0000 7f5d8300a800 1 -- start start 2024-04-26T07:54:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.436+0000 7f5d8300a800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5598ad16fb90 0x5598ad171f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.436+0000 7f5d8300a800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598ad172550 con 0x5598ad169970 2024-04-26T07:54:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.436+0000 7f5d8300a800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5598ad00de20 con 0x5598ad16fb90 2024-04-26T07:54:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.437+0000 7f5d80308640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5598ad16fb90 0x5598ad171f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.437+0000 7f5d80b09640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5598ad169970 0x5598ad169d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36558/0 (socket says 172.21.15.62:36558) 2024-04-26T07:54:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.437+0000 7f5d80b09640 1 -- 172.21.15.62:0/2001134936 learned_addr learned my addr 172.21.15.62:0/2001134936 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.437+0000 7f5d80308640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5598ad16fb90 0x5598ad171f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:32996/0 (socket says 172.21.15.62:32996) 2024-04-26T07:54:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.437+0000 7f5d7fb07640 1 -- 172.21.15.62:0/2001134936 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511850072 0 0) 0x5598ad172550 con 0x5598ad169970 2024-04-26T07:54:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.437+0000 7f5d7fb07640 1 -- 172.21.15.62:0/2001134936 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d68001e10 con 0x5598ad169970 2024-04-26T07:54:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.437+0000 7f5d80308640 1 -- 172.21.15.62:0/2001134936 >> v1:172.21.15.1:6789/0 conn(0x5598ad169970 legacy=0x5598ad169d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.437+0000 7f5d80308640 1 -- 172.21.15.62:0/2001134936 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ad173730 con 0x5598ad16fb90 2024-04-26T07:54:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.439+0000 7f5d80308640 1 --2- 172.21.15.62:0/2001134936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad16fb90 0x5598ad171f80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400a470 tx=0x7f5d7401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1300d1b0e98a854f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.439+0000 7f5d7fb07640 1 -- 172.21.15.62:0/2001134936 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d74057070 con 0x5598ad16fb90 2024-04-26T07:54:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.439+0000 7f5d7fb07640 1 -- 172.21.15.62:0/2001134936 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d74052570 con 0x5598ad16fb90 2024-04-26T07:54:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.439+0000 7f5d7fb07640 1 -- 172.21.15.62:0/2001134936 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d74052870 con 0x5598ad16fb90 2024-04-26T07:54:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.440+0000 7f5d8300a800 1 -- 172.21.15.62:0/2001134936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad16fb90 msgr2=0x5598ad171f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.440+0000 7f5d8300a800 1 --2- 172.21.15.62:0/2001134936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad16fb90 0x5598ad171f80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400a470 tx=0x7f5d7401cdb0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.440+0000 7f5d8300a800 1 -- 172.21.15.62:0/2001134936 shutdown_connections 2024-04-26T07:54:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.440+0000 7f5d8300a800 1 --2- 172.21.15.62:0/2001134936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad16fb90 0x5598ad171f80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.440+0000 7f5d8300a800 1 -- 172.21.15.62:0/2001134936 >> 172.21.15.62:0/2001134936 conn(0x5598ad165320 msgr2=0x5598ad167740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.440+0000 7f5d8300a800 1 -- 172.21.15.62:0/2001134936 shutdown_connections 2024-04-26T07:54:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.440+0000 7f5d8300a800 1 -- 172.21.15.62:0/2001134936 wait complete. 2024-04-26T07:54:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.452+0000 7f5d8300a800 1 Processor -- start 2024-04-26T07:54:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.452+0000 7f5d8300a800 1 -- start start 2024-04-26T07:54:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.453+0000 7f5d8300a800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad25ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.453+0000 7f5d8300a800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598ad0b6cd0 con 0x5598ad169970 2024-04-26T07:54:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.453+0000 7f5d80b09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad25ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.453+0000 7f5d80b09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad25ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33012/0 (socket says 172.21.15.62:33012) 2024-04-26T07:54:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.453+0000 7f5d80b09640 1 -- 172.21.15.62:0/3303657207 learned_addr learned my addr 172.21.15.62:0/3303657207 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.453+0000 7f5d80b09640 1 -- 172.21.15.62:0/3303657207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ad25d040 con 0x5598ad169970 2024-04-26T07:54:35.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.453+0000 7f5d80b09640 1 --2- 172.21.15.62:0/3303657207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad25ca70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5d70001de0 tx=0x7f5d7000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108919e06fdfaf02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.453+0000 7f5c6ee0d640 1 -- 172.21.15.62:0/3303657207 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d70012020 con 0x5598ad169970 2024-04-26T07:54:35.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5c6ee0d640 1 -- 172.21.15.62:0/3303657207 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7000e5a0 con 0x5598ad169970 2024-04-26T07:54:35.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5c6ee0d640 1 -- 172.21.15.62:0/3303657207 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7000e900 con 0x5598ad169970 2024-04-26T07:54:35.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5d8300a800 1 -- 172.21.15.62:0/3303657207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 msgr2=0x5598ad25ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5d8300a800 1 --2- 172.21.15.62:0/3303657207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad25ca70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5d70001de0 tx=0x7f5d7000b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5d8300a800 1 -- 172.21.15.62:0/3303657207 shutdown_connections 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5d8300a800 1 --2- 172.21.15.62:0/3303657207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad25ca70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5d8300a800 1 -- 172.21.15.62:0/3303657207 >> 172.21.15.62:0/3303657207 conn(0x5598ad165320 msgr2=0x5598ad258390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5d8300a800 1 -- 172.21.15.62:0/3303657207 shutdown_connections 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.454+0000 7f5d8300a800 1 -- 172.21.15.62:0/3303657207 wait complete. 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d8300a800 1 Processor -- start 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d8300a800 1 -- start start 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d8300a800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad16c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d8300a800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598ad1729f0 con 0x5598ad169970 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d80b09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad16c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d80b09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad16c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33026/0 (socket says 172.21.15.62:33026) 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d80b09640 1 -- 172.21.15.62:0/11854190 learned_addr learned my addr 172.21.15.62:0/11854190 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d80b09640 1 -- 172.21.15.62:0/11854190 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ad16c790 con 0x5598ad169970 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5d80b09640 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad16c250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c010 tx=0x7f5d70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.455+0000 7f5c6d60a640 1 -- 172.21.15.62:0/11854190 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d70012030 con 0x5598ad169970 2024-04-26T07:54:35.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.456+0000 7f5c6d60a640 1 -- 172.21.15.62:0/11854190 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7001a7a0 con 0x5598ad169970 2024-04-26T07:54:35.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.456+0000 7f5c6d60a640 1 -- 172.21.15.62:0/11854190 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7001a950 con 0x5598ad169970 2024-04-26T07:54:35.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.456+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ad16a990 con 0x5598ad169970 2024-04-26T07:54:35.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.456+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ad16aeb0 con 0x5598ad169970 2024-04-26T07:54:35.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.456+0000 7f5c6d60a640 1 -- 172.21.15.62:0/11854190 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5d70015020 con 0x5598ad169970 2024-04-26T07:54:35.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.456+0000 7f5c6d60a640 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c68036eb0 0x7f5c68039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5c6d60a640 1 -- 172.21.15.62:0/11854190 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5d70020030 con 0x5598ad169970 2024-04-26T07:54:35.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5d80308640 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c68036eb0 0x7f5c68039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad16fb90 0x5598ad26d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad26df10 con 0x5598ad16fb90 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5d8130a640 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad16fb90 0x5598ad26d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5d80308640 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c68036eb0 0x7f5c68039370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d74054000 tx=0x7f5d7404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5d8130a640 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad16fb90 0x5598ad26d9d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5d8130a640 1 -- 172.21.15.62:0/11854190 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d7800a4a0 con 0x5598ad16fb90 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.457+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad16b3b0 con 0x5598ad16fb90 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.458+0000 7f5d8130a640 1 -- 172.21.15.62:0/11854190 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d7800a4a0 con 0x5598ad16fb90 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.458+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad270260 0x5598ad272650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.458+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad272cf0 con 0x5598ad270260 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.458+0000 7f5d80b09640 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad270260 0x5598ad272650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.458+0000 7f5d80b09640 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad270260 0x5598ad272650 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.459+0000 7f5d80b09640 1 -- 172.21.15.62:0/11854190 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad270260 2024-04-26T07:54:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.459+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad26f210 con 0x5598ad16fb90 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.459+0000 7f5d8130a640 1 -- 172.21.15.62:0/11854190 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d7800a4a0 con 0x5598ad16fb90 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.459+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad26f6f0 con 0x5598ad16fb90 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.459+0000 7f5d8130a640 1 -- 172.21.15.62:0/11854190 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d7800a4a0 con 0x5598ad16fb90 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8300a800 1 Processor -- start 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8300a800 1 -- start start 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8300a800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad281ee0 0x5598ad282300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8300a800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598ad05e170 con 0x5598ad281ee0 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8130a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad281ee0 0x5598ad282300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8130a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad281ee0 0x5598ad282300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33034/0 (socket says 172.21.15.62:33034) 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8130a640 1 -- 172.21.15.62:0/3313783094 learned_addr learned my addr 172.21.15.62:0/3313783094 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8130a640 1 -- 172.21.15.62:0/3313783094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ad282840 con 0x5598ad281ee0 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.460+0000 7f5d8130a640 1 --2- 172.21.15.62:0/3313783094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad281ee0 0x5598ad282300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5598ad16bc40 tx=0x7f5d780188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.461+0000 7f5c667fc640 1 -- 172.21.15.62:0/3313783094 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d78014450 con 0x5598ad281ee0 2024-04-26T07:54:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.461+0000 7f5c667fc640 1 -- 172.21.15.62:0/3313783094 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d780145f0 con 0x5598ad281ee0 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.461+0000 7f5d8300a800 1 -- 172.21.15.62:0/3313783094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ad2832b0 con 0x5598ad281ee0 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.461+0000 7f5c667fc640 1 -- 172.21.15.62:0/3313783094 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d780148d0 con 0x5598ad281ee0 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.461+0000 7f5d8300a800 1 -- 172.21.15.62:0/3313783094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ad2837b0 con 0x5598ad281ee0 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.461+0000 7f5c667fc640 1 -- 172.21.15.62:0/3313783094 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5d78011040 con 0x5598ad281ee0 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5c667fc640 1 --2- 172.21.15.62:0/3313783094 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c58036e60 0x7f5c58039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5c667fc640 1 -- 172.21.15.62:0/3313783094 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5d7801e070 con 0x5598ad281ee0 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d80b09640 1 --2- 172.21.15.62:0/3313783094 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c58036e60 0x7f5c58039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d8300a800 1 Processor -- start 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d8300a800 1 -- start start 2024-04-26T07:54:35.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d80b09640 1 --2- 172.21.15.62:0/3313783094 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c58036e60 0x7f5c58039320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5598ad26e380 tx=0x7f5d7004b2d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d8300a800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad28f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d8300a800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598ad25d3c0 con 0x5598ad28f1a0 2024-04-26T07:54:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d8130a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad28f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d8130a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad28f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33048/0 (socket says 172.21.15.62:33048) 2024-04-26T07:54:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.462+0000 7f5d8130a640 1 -- 172.21.15.62:0/771075946 learned_addr learned my addr 172.21.15.62:0/771075946 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5d8130a640 1 -- 172.21.15.62:0/771075946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ad28fb90 con 0x5598ad28f1a0 2024-04-26T07:54:35.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5d8130a640 1 --2- 172.21.15.62:0/771075946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad28f5c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5d7804cf10 tx=0x7f5d78011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d03e4954119a7aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5c57fff640 1 -- 172.21.15.62:0/771075946 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d780168f0 con 0x5598ad28f1a0 2024-04-26T07:54:35.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5c57fff640 1 -- 172.21.15.62:0/771075946 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d78013ca0 con 0x5598ad28f1a0 2024-04-26T07:54:35.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5c57fff640 1 -- 172.21.15.62:0/771075946 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d780133b0 con 0x5598ad28f1a0 2024-04-26T07:54:35.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5d8300a800 1 -- 172.21.15.62:0/771075946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 msgr2=0x5598ad28f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5d8300a800 1 --2- 172.21.15.62:0/771075946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad28f5c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5d7804cf10 tx=0x7f5d78011700 comp rx=0 tx=0).stop 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5d8300a800 1 -- 172.21.15.62:0/771075946 shutdown_connections 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5d8300a800 1 --2- 172.21.15.62:0/771075946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad28f5c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.463+0000 7f5d8300a800 1 -- 172.21.15.62:0/771075946 >> 172.21.15.62:0/771075946 conn(0x5598ad28b500 msgr2=0x5598ad289560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8300a800 1 -- 172.21.15.62:0/771075946 shutdown_connections 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8300a800 1 -- 172.21.15.62:0/771075946 wait complete. 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8300a800 1 Processor -- start 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8300a800 1 -- start start 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8300a800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad296730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8300a800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598ad290300 con 0x5598ad28f1a0 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8130a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad296730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8130a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad296730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33052/0 (socket says 172.21.15.62:33052) 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 learned_addr learned my addr 172.21.15.62:0/1556829788 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.464+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ad296c70 con 0x5598ad28f1a0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.465+0000 7f5d8130a640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad296730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d78013bf0 tx=0x7f5d7804ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.465+0000 7f5c567fc640 1 -- 172.21.15.62:0/1556829788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d78022a80 con 0x5598ad28f1a0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.465+0000 7f5c567fc640 1 -- 172.21.15.62:0/1556829788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d78022c20 con 0x5598ad28f1a0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.465+0000 7f5c567fc640 1 -- 172.21.15.62:0/1556829788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7802b350 con 0x5598ad28f1a0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.465+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ad296f00 con 0x5598ad28f1a0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.465+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ad299bb0 con 0x5598ad28f1a0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5c567fc640 1 -- 172.21.15.62:0/1556829788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5d78041020 con 0x5598ad28f1a0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5c567fc640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c4c036e60 0x7f5c4c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5c567fc640 1 -- 172.21.15.62:0/1556829788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5d78033070 con 0x5598ad28f1a0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5d80b09640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c4c036e60 0x7f5c4c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad2a23e0 0x5598ad2a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2a4ff0 con 0x5598ad2a23e0 2024-04-26T07:54:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5d80308640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad2a23e0 0x5598ad2a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5d80b09640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c4c036e60 0x7f5c4c039320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5d7001a6f0 tx=0x7f5d70042000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.466+0000 7f5d80308640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad2a23e0 0x5598ad2a48a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 realm 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2a53c0 con 0x5598ad2a23e0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2a5c90 con 0x5598ad2a23e0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2a6030 con 0x5598ad2a23e0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.467+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad2a6ae0 0x5598ad2a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2a9630 con 0x5598ad2a6ae0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d8130a640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad2a6ae0 0x5598ad2a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d8130a640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad2a6ae0 0x5598ad2a8ed0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d8300a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d8300a800 20 searching for the correct realm 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5598ad2ab6e0 0x5598ad2adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.468+0000 7f5d80b09640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5598ad2ab6e0 0x5598ad2adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.469+0000 7f5d80b09640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5598ad2ab6e0 0x5598ad2adba0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.469+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.469+0000 7f5d80b09640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d70017050 0x7f5d7002d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.469+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x7f5d70017050 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.469+0000 7f5d80308640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d70017050 0x7f5d7002d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.470+0000 7f5d80308640 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d70017050 0x7f5d7002d3f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.470+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.470+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.471+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.471+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a23e0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.471+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.471+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a23e0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.471+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.471+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.471+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.471+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.472+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.472+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x7f5d70017050 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.472+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.472+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.472+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.472+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a23e0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.472+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.472+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.473+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.473+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a23e0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.473+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.473+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x7f5d70017050 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.473+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.473+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.473+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.473+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.474+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.474+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.474+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.474+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.474+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.474+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.474+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.474+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a23e0 2024-04-26T07:54:35.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.475+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.475+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a23e0 2024-04-26T07:54:35.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.475+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.475+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.475+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.475+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.476+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.476+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x7f5d70017050 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.476+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.476+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a23e0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.476+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.476+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.476+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.476+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.477+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.477+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.477+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.477+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x7f5d70017050 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.477+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.477+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2ab6e0 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.477+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.477+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a6ae0 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x5598ad2a23e0 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae270 con 0x7f5d70017050 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8300a800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8300a800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:35.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8300a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8300a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8300a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8300a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.478+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2aa0e0 con 0x5598ad2a23e0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2aa530 con 0x5598ad2a23e0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2aaa10 con 0x5598ad2a23e0 2024-04-26T07:54:35.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 zone default found 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 4 Realm: () 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 zonegroup default 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ae6f0 con 0x5598ad2a6ae0 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.479+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b0920 con 0x5598ad2ab6e0 2024-04-26T07:54:35.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d8300a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b0cc0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d8300a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d8300a800 20 started sync module instance, tier type = 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d8300a800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.480+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2afd60 con 0x7f5d70017050 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.481+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.481+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114228666704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2afd60 con 0x7f5d70017050 2024-04-26T07:54:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.481+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b1680 con 0x5598ad2a23e0 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.482+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114228666704] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.482+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.482+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114228664976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b1680 con 0x5598ad2a23e0 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.482+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b2040 con 0x5598ad2ab6e0 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.485+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114228664976] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.485+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.485+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114228673424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b23e0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.485+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b2e90 con 0x7f5d70017050 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.486+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114228673424] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.486+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.486+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114228670928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b3280 con 0x7f5d70017050 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.486+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b3c80 con 0x5598ad2a23e0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.487+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.487+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114228680592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b3bb0 con 0x5598ad2a23e0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.487+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b4bd0 con 0x5598ad2a6ae0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.487+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114228670928] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.488+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114228680592] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.488+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.488+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114228682864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b4b90 con 0x5598ad2a6ae0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.488+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b5470 con 0x5598ad2a6ae0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.489+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114228682864] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.489+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.489+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114228684480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b4b90 con 0x5598ad2a6ae0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.489+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b5ad0 con 0x5598ad2a6ae0 2024-04-26T07:54:35.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114228684480] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114228688320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b5a90 con 0x5598ad2a6ae0 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8300a800 20 add_watcher() i=0 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8300a800 20 add_watcher() i=1 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8300a800 20 add_watcher() i=2 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8300a800 20 add_watcher() i=3 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8300a800 20 add_watcher() i=4 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8300a800 20 add_watcher() i=5 2024-04-26T07:54:35.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.490+0000 7f5d8300a800 20 add_watcher() i=6 2024-04-26T07:54:35.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.491+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114228688320] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.491+0000 7f5d8300a800 20 add_watcher() i=7 2024-04-26T07:54:35.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.491+0000 7f5d8300a800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:35.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.491+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b8f50 con 0x5598ad2a23e0 2024-04-26T07:54:35.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.492+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.492+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114228686704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b6410 con 0x5598ad2a23e0 2024-04-26T07:54:35.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114228686704] v27'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5c36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5d8300a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5d8300a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5d8300a800 5 note: GC not initialized 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5c35fe3640 20 reqs_thread_entry: start 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5d8300a800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5d8300a800 20 Filter name: none 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5ba77fe640 20 reqs_thread_entry: start 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5d8300a800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.493+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2ec1b0 con 0x5598ad2a23e0 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.494+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.494+0000 7f5d8300a800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T07:54:35.500 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:35.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.495+0000 7f5c36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.495+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114228686704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2eac20 con 0x5598ad2a23e0 2024-04-26T07:54:35.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.496+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94114228686704] v27'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.496+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114228666704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b4f70 con 0x7f5d70017050 2024-04-26T07:54:35.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.497+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94114228666704] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.497+0000 7f5d8300a800 20 remove_watcher() i=0 2024-04-26T07:54:35.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.497+0000 7f5d8300a800 2 removed watcher, disabling cache 2024-04-26T07:54:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.497+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114228664976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b4f70 con 0x5598ad2a23e0 2024-04-26T07:54:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.498+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94114228664976] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.498+0000 7f5d8300a800 20 remove_watcher() i=1 2024-04-26T07:54:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.498+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114228673424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2afa90 con 0x5598ad2ab6e0 2024-04-26T07:54:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.499+0000 7f5d80b09640 1 -- 172.21.15.62:0/1556829788 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94114228673424] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7000dcd0 con 0x5598ad2ab6e0 2024-04-26T07:54:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.499+0000 7f5d8300a800 20 remove_watcher() i=2 2024-04-26T07:54:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.499+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114228670928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b4f70 con 0x7f5d70017050 2024-04-26T07:54:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.500+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94114228670928] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x7f5d70017050 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.500+0000 7f5d8300a800 20 remove_watcher() i=3 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.500+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114228680592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b1b90 con 0x5598ad2a23e0 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.501+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94114228680592] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7405a040 con 0x5598ad2a23e0 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.501+0000 7f5d8300a800 20 remove_watcher() i=4 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.501+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114228682864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b11d0 con 0x5598ad2a6ae0 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.502+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94114228682864] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.502+0000 7f5d8300a800 20 remove_watcher() i=5 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.502+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114228684480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b4f70 con 0x5598ad2a6ae0 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.503+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94114228684480] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.503+0000 7f5d8300a800 20 remove_watcher() i=6 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.503+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114228688320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5598ad2b3790 con 0x5598ad2a6ae0 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8130a640 1 -- 172.21.15.62:0/1556829788 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94114228688320] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7802a070 con 0x5598ad2a6ae0 2024-04-26T07:54:35.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 20 remove_watcher() i=7 2024-04-26T07:54:35.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad2a6ae0 msgr2=0x5598ad2a8ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad2a6ae0 0x5598ad2a8ed0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad2a23e0 msgr2=0x5598ad2a48a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad2a23e0 0x5598ad2a48a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d70017050 msgr2=0x7f5d7002d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d70017050 0x7f5d7002d3f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5598ad2ab6e0 msgr2=0x5598ad2adba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5598ad2ab6e0 0x5598ad2adba0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c4c036e60 msgr2=0x7f5c4c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c4c036e60 0x7f5c4c039320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5d7001a6f0 tx=0x7f5d70042000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 msgr2=0x5598ad296730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d80308640 1 -- 172.21.15.62:0/1556829788 reap_dead start 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad296730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d78013bf0 tx=0x7f5d7804ce70 comp rx=0 tx=0).stop 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 shutdown_connections 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 --2- 172.21.15.62:0/1556829788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad28f1a0 0x5598ad296730 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.504+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 >> 172.21.15.62:0/1556829788 conn(0x5598ad28b500 msgr2=0x5598ad288b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 shutdown_connections 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/1556829788 wait complete. 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/3313783094 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c58036e60 msgr2=0x7f5c58039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/3313783094 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c58036e60 0x7f5c58039320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5598ad26e380 tx=0x7f5d7004b2d0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/3313783094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad281ee0 msgr2=0x5598ad282300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/3313783094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad281ee0 0x5598ad282300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5598ad16bc40 tx=0x7f5d780188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/3313783094 shutdown_connections 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/3313783094 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c58036e60 0x7f5c58039320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/3313783094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad281ee0 0x5598ad282300 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/3313783094 >> 172.21.15.62:0/3313783094 conn(0x5598ad275f80 msgr2=0x5598ad276380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/3313783094 shutdown_connections 2024-04-26T07:54:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/3313783094 wait complete. 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad270260 msgr2=0x5598ad272650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad270260 0x5598ad272650 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad16fb90 msgr2=0x5598ad26d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad16fb90 0x5598ad26d9d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c68036eb0 msgr2=0x7f5c68039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c68036eb0 0x7f5c68039370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d74054000 tx=0x7f5d7404e000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 msgr2=0x5598ad16c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad16c250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c010 tx=0x7f5d70000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 shutdown_connections 2024-04-26T07:54:35.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5598ad16fb90 0x5598ad26d9d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5598ad270260 0x5598ad272650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c68036eb0 0x7f5c68039370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 --2- 172.21.15.62:0/11854190 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598ad169970 0x5598ad16c250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 >> 172.21.15.62:0/11854190 conn(0x5598ad165320 msgr2=0x5598ad256bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 shutdown_connections 2024-04-26T07:54:35.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.505+0000 7f5d8300a800 1 -- 172.21.15.62:0/11854190 wait complete. 2024-04-26T07:54:35.513 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:35.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:54:35.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:54:35.514 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:54:35.557 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.560+0000 7fdd24e62800 1 Processor -- start 2024-04-26T07:54:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.560+0000 7fdd24e62800 1 -- start start 2024-04-26T07:54:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.560+0000 7fdd24e62800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x556b6185bfa0 0x556b6185c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.560+0000 7fdd24e62800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b617d1280 con 0x556b6185c900 2024-04-26T07:54:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.560+0000 7fdd24e62800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x556b616ffe20 con 0x556b6185bfa0 2024-04-26T07:54:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.560+0000 7fdd22961640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x556b6185bfa0 0x556b6185c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.560+0000 7fdd22160640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x556b6185c900 0x556b6185cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36568/0 (socket says 172.21.15.62:36568) 2024-04-26T07:54:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.560+0000 7fdd22160640 1 -- 172.21.15.62:0/3307672748 learned_addr learned my addr 172.21.15.62:0/3307672748 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.561+0000 7fdd2195f640 1 -- 172.21.15.62:0/3307672748 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989603128 0 0) 0x556b617d1280 con 0x556b6185c900 2024-04-26T07:54:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.561+0000 7fdd2195f640 1 -- 172.21.15.62:0/3307672748 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd0c001e10 con 0x556b6185c900 2024-04-26T07:54:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.561+0000 7fdd22961640 1 -- 172.21.15.62:0/3307672748 >> v1:172.21.15.1:6789/0 conn(0x556b6185c900 legacy=0x556b6185cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.561+0000 7fdd22961640 1 -- 172.21.15.62:0/3307672748 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6185d4c0 con 0x556b6185bfa0 2024-04-26T07:54:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd22961640 1 --2- 172.21.15.62:0/3307672748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b6185c3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400a470 tx=0x7fdd1401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd82dacd3de65a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd2195f640 1 -- 172.21.15.62:0/3307672748 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd14057070 con 0x556b6185bfa0 2024-04-26T07:54:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd2195f640 1 -- 172.21.15.62:0/3307672748 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd14052570 con 0x556b6185bfa0 2024-04-26T07:54:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd2195f640 1 -- 172.21.15.62:0/3307672748 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd14052870 con 0x556b6185bfa0 2024-04-26T07:54:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd24e62800 1 -- 172.21.15.62:0/3307672748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 msgr2=0x556b6185c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd24e62800 1 --2- 172.21.15.62:0/3307672748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b6185c3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400a470 tx=0x7fdd1401cdb0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd24e62800 1 -- 172.21.15.62:0/3307672748 shutdown_connections 2024-04-26T07:54:35.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd24e62800 1 --2- 172.21.15.62:0/3307672748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b6185c3c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd24e62800 1 -- 172.21.15.62:0/3307672748 >> 172.21.15.62:0/3307672748 conn(0x556b61857b80 msgr2=0x556b61859fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd24e62800 1 -- 172.21.15.62:0/3307672748 shutdown_connections 2024-04-26T07:54:35.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.563+0000 7fdd24e62800 1 -- 172.21.15.62:0/3307672748 wait complete. 2024-04-26T07:54:35.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.576+0000 7fdd24e62800 1 Processor -- start 2024-04-26T07:54:35.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.576+0000 7fdd24e62800 1 -- start start 2024-04-26T07:54:35.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.576+0000 7fdd24e62800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61950eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.576+0000 7fdd24e62800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556b617a8cd0 con 0x556b6185bfa0 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.576+0000 7fdd22961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61950eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.576+0000 7fdd22961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61950eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33078/0 (socket says 172.21.15.62:33078) 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.576+0000 7fdd22961640 1 -- 172.21.15.62:0/2483806227 learned_addr learned my addr 172.21.15.62:0/2483806227 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.577+0000 7fdd22961640 1 -- 172.21.15.62:0/2483806227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b61951480 con 0x556b6185bfa0 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.577+0000 7fdd22961640 1 --2- 172.21.15.62:0/2483806227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61950eb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdd14000c00 tx=0x7fdd1404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2740461f3ca2e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.577+0000 7fdc10e09640 1 -- 172.21.15.62:0/2483806227 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd14057040 con 0x556b6185bfa0 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.577+0000 7fdc10e09640 1 -- 172.21.15.62:0/2483806227 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd140528d0 con 0x556b6185bfa0 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.577+0000 7fdc10e09640 1 -- 172.21.15.62:0/2483806227 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd14052bf0 con 0x556b6185bfa0 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 -- 172.21.15.62:0/2483806227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 msgr2=0x556b61950eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 --2- 172.21.15.62:0/2483806227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61950eb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdd14000c00 tx=0x7fdd1404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 -- 172.21.15.62:0/2483806227 shutdown_connections 2024-04-26T07:54:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 --2- 172.21.15.62:0/2483806227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61950eb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 -- 172.21.15.62:0/2483806227 >> 172.21.15.62:0/2483806227 conn(0x556b61857b80 msgr2=0x556b6194c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 -- 172.21.15.62:0/2483806227 shutdown_connections 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 -- 172.21.15.62:0/2483806227 wait complete. 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 Processor -- start 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 -- start start 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61958940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd24e62800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556b6185d9f0 con 0x556b6185bfa0 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd22961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61958940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd22961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61958940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33086/0 (socket says 172.21.15.62:33086) 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.578+0000 7fdd22961640 1 -- 172.21.15.62:0/285889313 learned_addr learned my addr 172.21.15.62:0/285889313 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.579+0000 7fdd22961640 1 -- 172.21.15.62:0/285889313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b61958e80 con 0x556b6185bfa0 2024-04-26T07:54:35.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.579+0000 7fdd22961640 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61958940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd1401baa0 tx=0x7fdd14003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.579+0000 7fdc0f606640 1 -- 172.21.15.62:0/285889313 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd14073070 con 0x556b6185bfa0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.579+0000 7fdc0f606640 1 -- 172.21.15.62:0/285889313 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1405d650 con 0x556b6185bfa0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.579+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b61959110 con 0x556b6185bfa0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.579+0000 7fdc0f606640 1 -- 172.21.15.62:0/285889313 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd14057050 con 0x556b6185bfa0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.579+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6195bd70 con 0x556b6185bfa0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.580+0000 7fdc0f606640 1 -- 172.21.15.62:0/285889313 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fdd14076070 con 0x556b6185bfa0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.580+0000 7fdc0f606640 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc08036e60 0x7fdc08039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.580+0000 7fdc0f606640 1 -- 172.21.15.62:0/285889313 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fdd1408e670 con 0x556b6185bfa0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.580+0000 7fdd22160640 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc08036e60 0x7fdc08039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.580+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b6185c900 0x556b6195fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.580+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b61960070 con 0x556b6185c900 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.580+0000 7fdd23162640 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b6185c900 0x556b6195fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.580+0000 7fdd22160640 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc08036e60 0x7fdc08039320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd18000f60 tx=0x7fdd180010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.581+0000 7fdd23162640 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b6185c900 0x556b6195fb30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.581+0000 7fdd23162640 1 -- 172.21.15.62:0/285889313 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd1c00a4a0 con 0x556b6185c900 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.581+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b6195d0e0 con 0x556b6185c900 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.581+0000 7fdd23162640 1 -- 172.21.15.62:0/285889313 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd1c00a4a0 con 0x556b6185c900 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.581+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b619623b0 0x556b619647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.581+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b61964e40 con 0x556b619623b0 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.581+0000 7fdd22961640 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b619623b0 0x556b619647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.582+0000 7fdd22961640 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b619623b0 0x556b619647a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.582+0000 7fdd22961640 1 -- 172.21.15.62:0/285889313 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd14075030 con 0x556b619623b0 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.582+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b61961330 con 0x556b6185c900 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.582+0000 7fdd23162640 1 -- 172.21.15.62:0/285889313 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd1c00a4a0 con 0x556b6185c900 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.582+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b61961810 con 0x556b6185c900 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.583+0000 7fdd23162640 1 -- 172.21.15.62:0/285889313 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd1c00a4a0 con 0x556b6185c900 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.583+0000 7fdd24e62800 1 Processor -- start 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.583+0000 7fdd24e62800 1 -- start start 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.583+0000 7fdd24e62800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61973fb0 0x556b619743d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.583+0000 7fdd24e62800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556b61750170 con 0x556b61973fb0 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.583+0000 7fdd23162640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61973fb0 0x556b619743d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.583+0000 7fdd23162640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61973fb0 0x556b619743d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33096/0 (socket says 172.21.15.62:33096) 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.583+0000 7fdd23162640 1 -- 172.21.15.62:0/4140025859 learned_addr learned my addr 172.21.15.62:0/4140025859 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.584+0000 7fdd23162640 1 -- 172.21.15.62:0/4140025859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b61974910 con 0x556b61973fb0 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.584+0000 7fdd23162640 1 --2- 172.21.15.62:0/4140025859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61973fb0 0x556b619743d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x556b61960430 tx=0x7fdd1c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.584+0000 7fdc0ce01640 1 -- 172.21.15.62:0/4140025859 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd1c014450 con 0x556b61973fb0 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.584+0000 7fdc0ce01640 1 -- 172.21.15.62:0/4140025859 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c0145f0 con 0x556b61973fb0 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.584+0000 7fdd24e62800 1 -- 172.21.15.62:0/4140025859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b61975380 con 0x556b61973fb0 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.584+0000 7fdc0ce01640 1 -- 172.21.15.62:0/4140025859 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd1c0148d0 con 0x556b61973fb0 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.584+0000 7fdd24e62800 1 -- 172.21.15.62:0/4140025859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b61975880 con 0x556b61973fb0 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.585+0000 7fdc0ce01640 1 -- 172.21.15.62:0/4140025859 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fdd1c011040 con 0x556b61973fb0 2024-04-26T07:54:35.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.585+0000 7fdc0ce01640 1 --2- 172.21.15.62:0/4140025859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbfc036eb0 0x7fdbfc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.585+0000 7fdc0ce01640 1 -- 172.21.15.62:0/4140025859 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fdd1c01e070 con 0x556b61973fb0 2024-04-26T07:54:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.585+0000 7fdd22961640 1 --2- 172.21.15.62:0/4140025859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbfc036eb0 0x7fdbfc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.585+0000 7fdd24e62800 1 Processor -- start 2024-04-26T07:54:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.585+0000 7fdd24e62800 1 -- start start 2024-04-26T07:54:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.585+0000 7fdd22961640 1 --2- 172.21.15.62:0/4140025859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbfc036eb0 0x7fdbfc039370 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd1408cae0 tx=0x7fdd1408c9b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdd24e62800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b619816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdd24e62800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556b61951740 con 0x556b61981290 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdd23162640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b619816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdd23162640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b619816b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33104/0 (socket says 172.21.15.62:33104) 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdd23162640 1 -- 172.21.15.62:0/87234283 learned_addr learned my addr 172.21.15.62:0/87234283 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdd23162640 1 -- 172.21.15.62:0/87234283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b61981c80 con 0x556b61981290 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdd23162640 1 --2- 172.21.15.62:0/87234283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b619816b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c04d040 tx=0x7fdd1c041420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29c7d4b555cf0ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdc067fc640 1 -- 172.21.15.62:0/87234283 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd1c0168f0 con 0x556b61981290 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdc067fc640 1 -- 172.21.15.62:0/87234283 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c013c90 con 0x556b61981290 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.586+0000 7fdc067fc640 1 -- 172.21.15.62:0/87234283 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd1c014a70 con 0x556b61981290 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 -- 172.21.15.62:0/87234283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 msgr2=0x556b619816b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 --2- 172.21.15.62:0/87234283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b619816b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c04d040 tx=0x7fdd1c041420 comp rx=0 tx=0).stop 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 -- 172.21.15.62:0/87234283 shutdown_connections 2024-04-26T07:54:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 --2- 172.21.15.62:0/87234283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b619816b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 -- 172.21.15.62:0/87234283 >> 172.21.15.62:0/87234283 conn(0x556b6197d5a0 msgr2=0x556b6197b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 -- 172.21.15.62:0/87234283 shutdown_connections 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 -- 172.21.15.62:0/87234283 wait complete. 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 Processor -- start 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 -- start start 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b61988750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd24e62800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556b61982400 con 0x556b61981290 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.587+0000 7fdd23162640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b61988750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdd23162640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b61988750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33108/0 (socket says 172.21.15.62:33108) 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 learned_addr learned my addr 172.21.15.62:0/1529480405 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b61988c90 con 0x556b61981290 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdd23162640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b61988750 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c011be0 tx=0x7fdd1c04cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdc04ff9640 1 -- 172.21.15.62:0/1529480405 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd1c03a070 con 0x556b61981290 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdc04ff9640 1 -- 172.21.15.62:0/1529480405 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c022a80 con 0x556b61981290 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b61988f20 con 0x556b61981290 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdc04ff9640 1 -- 172.21.15.62:0/1529480405 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd1c022d60 con 0x556b61981290 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.588+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6198bbd0 con 0x556b61981290 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.589+0000 7fdc04ff9640 1 -- 172.21.15.62:0/1529480405 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fdd1c0133b0 con 0x556b61981290 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.589+0000 7fdc04ff9640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbec036eb0 0x7fdbec039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.589+0000 7fdc04ff9640 1 -- 172.21.15.62:0/1529480405 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fdd1c00e040 con 0x556b61981290 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.589+0000 7fdd22961640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbec036eb0 0x7fdbec039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.589+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.589+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b61994260 0x556b61996720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.589+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b61996e20 con 0x556b61994260 2024-04-26T07:54:35.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.589+0000 7fdd22160640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b61994260 0x556b61996720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd22961640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbec036eb0 0x7fdbec039370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd14070000 tx=0x7fdd14092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd22160640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b61994260 0x556b61996720 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd18009050 con 0x556b61994260 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 20 realm 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b61993700 con 0x556b61994260 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd18009050 con 0x556b61994260 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b61997900 con 0x556b61994260 2024-04-26T07:54:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd18009050 con 0x556b61994260 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.590+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b619981d0 con 0x556b61994260 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.591+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd18009050 con 0x556b61994260 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.591+0000 7fdd24e62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.591+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.591+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b61998ad0 0x556b6199aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.591+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b6199b620 con 0x556b61998ad0 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.591+0000 7fdd23162640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b61998ad0 0x556b6199aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.591+0000 7fdd23162640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b61998ad0 0x556b6199aec0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.592+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.592+0000 7fdd24e62800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.592+0000 7fdd24e62800 20 searching for the correct realm 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.592+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556b6199d6f0 0x556b6199fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.592+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.592+0000 7fdd22961640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556b6199d6f0 0x556b6199fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.592+0000 7fdd22961640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556b6199d6f0 0x556b6199fbb0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd22961640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdd1409b030 0x7fdd1408e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x7fdd1409b030 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd22160640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdd1409b030 0x7fdd1408e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd22160640 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdd1409b030 0x7fdd1408e990 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18009050 con 0x7fdd1409b030 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.593+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61994260 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.594+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18009050 con 0x556b61994260 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.594+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61994260 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.594+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.594+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.594+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.594+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.595+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.595+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x7fdd1409b030 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.595+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18029040 con 0x7fdd1409b030 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.595+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.595+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.595+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61994260 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.595+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.595+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.596+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.596+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61994260 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.596+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.596+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x7fdd1409b030 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.596+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd18029040 con 0x7fdd1409b030 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.596+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.596+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.596+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.597+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.597+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.597+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.597+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.598+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.598+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.598+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.598+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61994260 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.598+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.598+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61994260 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.598+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.598+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.599+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.599+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.599+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.599+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x7fdd1409b030 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.599+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18029040 con 0x7fdd1409b030 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.599+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61994260 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.600+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.600+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.600+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.600+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.600+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.600+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.600+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.600+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x7fdd1409b030 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.601+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18029040 con 0x7fdd1409b030 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.601+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b6199d6f0 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.601+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.601+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61998ad0 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.601+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.601+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x556b61994260 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.601+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0280 con 0x7fdd1409b030 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd18029040 con 0x7fdd1409b030 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:35.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b6199c120 con 0x556b61994260 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b6199c5a0 con 0x556b61994260 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b6199ca40 con 0x556b61994260 2024-04-26T07:54:35.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.602+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd18029040 con 0x556b61994260 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 20 zone default found 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 4 Realm: () 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 20 zonegroup default 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b619a0700 con 0x556b61998ad0 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b619a2930 con 0x556b6199d6f0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.603+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.604+0000 7fdd24e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.604+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.604+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b619a2cd0 con 0x556b6199d6f0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.604+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.604+0000 7fdd24e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.604+0000 7fdd24e62800 20 started sync module instance, tier type = 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.604+0000 7fdd24e62800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:35.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.604+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a1d70 con 0x7fdd1409b030 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.605+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x7fdd1409b030 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.605+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93919687352672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a1d70 con 0x7fdd1409b030 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.605+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a3690 con 0x556b61994260 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.606+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93919687352672] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x7fdd1409b030 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.606+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.606+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93919687350944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a3690 con 0x556b61994260 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.606+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a4050 con 0x556b6199d6f0 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.607+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.607+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93919687359392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a48a0 con 0x556b6199d6f0 2024-04-26T07:54:35.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.607+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a5320 con 0x7fdd1409b030 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.607+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93919687350944] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.608+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93919687359392] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.608+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x7fdd1409b030 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.608+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93919687361520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a31e0 con 0x7fdd1409b030 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.608+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a5bc0 con 0x556b61994260 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.609+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.609+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93919687366336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a5ae0 con 0x556b61994260 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.609+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a6b00 con 0x556b61998ad0 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.610+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93919687361520] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x7fdd1409b030 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.610+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93919687366336] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.610+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.610+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93919687368624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a4e10 con 0x556b61998ad0 2024-04-26T07:54:35.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.610+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a73a0 con 0x556b61998ad0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.611+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93919687368624] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.611+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.611+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93919687370192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a7350 con 0x556b61998ad0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.611+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a7d90 con 0x556b61998ad0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93919687370192] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93919687374944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a7d50 con 0x556b61998ad0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd24e62800 20 add_watcher() i=0 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd24e62800 20 add_watcher() i=1 2024-04-26T07:54:35.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd24e62800 20 add_watcher() i=2 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd24e62800 20 add_watcher() i=3 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd24e62800 20 add_watcher() i=4 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd24e62800 20 add_watcher() i=5 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.612+0000 7fdd24e62800 20 add_watcher() i=6 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.613+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93919687374944] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.613+0000 7fdd24e62800 20 add_watcher() i=7 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.613+0000 7fdd24e62800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.613+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b619ab210 con 0x556b61994260 2024-04-26T07:54:35.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.614+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.614+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93919687372448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a86d0 con 0x556b61994260 2024-04-26T07:54:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93919687372448] v27'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdbd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdd24e62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdd24e62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdd24e62800 5 note: GC not initialized 2024-04-26T07:54:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdb53fff640 20 reqs_thread_entry: start 2024-04-26T07:54:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdd24e62800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:35.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdd24e62800 20 Filter name: none 2024-04-26T07:54:35.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdb51ffb640 20 reqs_thread_entry: start 2024-04-26T07:54:35.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdd24e62800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.615+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b619de510 con 0x556b61994260 2024-04-26T07:54:35.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.616+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.616+0000 7fdd24e62800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T07:54:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:35.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.617+0000 7fdbd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.617+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93919687372448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619dcf60 con 0x556b61994260 2024-04-26T07:54:35.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.618+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93919687372448] v27'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.618+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93919687352672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a6ea0 con 0x7fdd1409b030 2024-04-26T07:54:35.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.619+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93919687352672] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x7fdd1409b030 2024-04-26T07:54:35.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.619+0000 7fdd24e62800 20 remove_watcher() i=0 2024-04-26T07:54:35.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.619+0000 7fdd24e62800 2 removed watcher, disabling cache 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.619+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93919687350944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a6ea0 con 0x556b61994260 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.620+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93919687350944] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.620+0000 7fdd24e62800 20 remove_watcher() i=1 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.620+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93919687359392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a6ea0 con 0x556b6199d6f0 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.621+0000 7fdd22961640 1 -- 172.21.15.62:0/1529480405 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93919687359392] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd14075030 con 0x556b6199d6f0 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.621+0000 7fdd24e62800 20 remove_watcher() i=2 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.621+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93919687361520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a3ba0 con 0x7fdd1409b030 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.622+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93919687361520] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x7fdd1409b030 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.622+0000 7fdd24e62800 20 remove_watcher() i=3 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.622+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93919687366336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a3ba0 con 0x556b61994260 2024-04-26T07:54:35.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.623+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93919687366336] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd18039040 con 0x556b61994260 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.623+0000 7fdd24e62800 20 remove_watcher() i=4 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.623+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93919687368624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a56c0 con 0x556b61998ad0 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.624+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93919687368624] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.624+0000 7fdd24e62800 20 remove_watcher() i=5 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.624+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93919687370192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a3ba0 con 0x556b61998ad0 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.625+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93919687370192] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.625+0000 7fdd24e62800 20 remove_watcher() i=6 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.625+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93919687374944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b619a56c0 con 0x556b61998ad0 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd23162640 1 -- 172.21.15.62:0/1529480405 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93919687374944] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1c055070 con 0x556b61998ad0 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 20 remove_watcher() i=7 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b61998ad0 msgr2=0x556b6199aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b61998ad0 0x556b6199aec0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b61994260 msgr2=0x556b61996720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b61994260 0x556b61996720 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdd1409b030 msgr2=0x7fdd1408e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdd1409b030 0x7fdd1408e990 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556b6199d6f0 msgr2=0x556b6199fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.626+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556b6199d6f0 0x556b6199fbb0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbec036eb0 msgr2=0x7fdbec039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbec036eb0 0x7fdbec039370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd14070000 tx=0x7fdd14092000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd22160640 1 -- 172.21.15.62:0/1529480405 reap_dead start 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 msgr2=0x556b61988750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b61988750 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c011be0 tx=0x7fdd1c04cfd0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 shutdown_connections 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/1529480405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61981290 0x556b61988750 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 >> 172.21.15.62:0/1529480405 conn(0x556b6197d5a0 msgr2=0x556b6197ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 shutdown_connections 2024-04-26T07:54:35.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/1529480405 wait complete. 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/4140025859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbfc036eb0 msgr2=0x7fdbfc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/4140025859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbfc036eb0 0x7fdbfc039370 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd1408cae0 tx=0x7fdd1408c9b0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/4140025859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61973fb0 msgr2=0x556b619743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/4140025859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61973fb0 0x556b619743d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x556b61960430 tx=0x7fdd1c018830 comp rx=0 tx=0).stop 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/4140025859 shutdown_connections 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/4140025859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdbfc036eb0 0x7fdbfc039370 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/4140025859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b61973fb0 0x556b619743d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/4140025859 >> 172.21.15.62:0/4140025859 conn(0x556b61968050 msgr2=0x556b61968450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/4140025859 shutdown_connections 2024-04-26T07:54:35.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/4140025859 wait complete. 2024-04-26T07:54:35.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b619623b0 msgr2=0x556b619647a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b619623b0 0x556b619647a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b6185c900 msgr2=0x556b6195fb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b6185c900 0x556b6195fb30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc08036e60 msgr2=0x7fdc08039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc08036e60 0x7fdc08039320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd18000f60 tx=0x7fdd180010a0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 msgr2=0x556b61958940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.627+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61958940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd1401baa0 tx=0x7fdd14003020 comp rx=0 tx=0).stop 2024-04-26T07:54:35.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.628+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 shutdown_connections 2024-04-26T07:54:35.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.628+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556b6185c900 0x556b6195fb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.628+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556b619623b0 0x556b619647a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.628+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdc08036e60 0x7fdc08039320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.628+0000 7fdd24e62800 1 --2- 172.21.15.62:0/285889313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b6185bfa0 0x556b61958940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.628+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 >> 172.21.15.62:0/285889313 conn(0x556b61857b80 msgr2=0x556b6194aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.628+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 shutdown_connections 2024-04-26T07:54:35.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.628+0000 7fdd24e62800 1 -- 172.21.15.62:0/285889313 wait complete. 2024-04-26T07:54:35.660 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:35.660 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-26T07:54:35.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-26T07:54:35.661 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-04-26T07:54:35.742 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:35.742 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.744+0000 7f9388f29800 1 Processor -- start 2024-04-26T07:54:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.744+0000 7f9388f29800 1 -- start start 2024-04-26T07:54:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.744+0000 7f9388f29800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5634943bccc0 0x5634943bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.744+0000 7f9388f29800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634943bf5f0 con 0x5634943b91b0 2024-04-26T07:54:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.745+0000 7f9388f29800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x56349425ae20 con 0x5634943bccc0 2024-04-26T07:54:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.745+0000 7f93844ea640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5634943bccc0 0x5634943bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.745+0000 7f93844ea640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5634943bccc0 0x5634943bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33116/0 (socket says 172.21.15.62:33116) 2024-04-26T07:54:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.745+0000 7f93844ea640 1 -- 172.21.15.62:0/201546204 learned_addr learned my addr 172.21.15.62:0/201546204 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.745+0000 7f9384ceb640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5634943b91b0 0x5634943bb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36584/0 (socket says 172.21.15.62:36584) 2024-04-26T07:54:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.745+0000 7f93844ea640 1 -- 172.21.15.62:0/201546204 >> v1:172.21.15.1:6789/0 conn(0x5634943b91b0 legacy=0x5634943bb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.745+0000 7f93844ea640 1 -- 172.21.15.62:0/201546204 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634943c07d0 con 0x5634943bccc0 2024-04-26T07:54:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.747+0000 7f93844ea640 1 --2- 172.21.15.62:0/201546204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943bccc0 0x5634943bf0b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f936c00a520 tx=0x7f936c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86eef67cc9374b70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.747+0000 7f9383ce9640 1 -- 172.21.15.62:0/201546204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c057070 con 0x5634943bccc0 2024-04-26T07:54:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.747+0000 7f9383ce9640 1 -- 172.21.15.62:0/201546204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c052570 con 0x5634943bccc0 2024-04-26T07:54:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.747+0000 7f9383ce9640 1 -- 172.21.15.62:0/201546204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c04ae60 con 0x5634943bccc0 2024-04-26T07:54:35.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.748+0000 7f9388f29800 1 -- 172.21.15.62:0/201546204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943bccc0 msgr2=0x5634943bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.748+0000 7f9388f29800 1 --2- 172.21.15.62:0/201546204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943bccc0 0x5634943bf0b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f936c00a520 tx=0x7f936c01d010 comp rx=0 tx=0).stop 2024-04-26T07:54:35.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.748+0000 7f9388f29800 1 -- 172.21.15.62:0/201546204 shutdown_connections 2024-04-26T07:54:35.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.748+0000 7f9388f29800 1 --2- 172.21.15.62:0/201546204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943bccc0 0x5634943bf0b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.748+0000 7f9388f29800 1 -- 172.21.15.62:0/201546204 >> 172.21.15.62:0/201546204 conn(0x5634943b2ba0 msgr2=0x5634943b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.748+0000 7f9388f29800 1 -- 172.21.15.62:0/201546204 shutdown_connections 2024-04-26T07:54:35.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.748+0000 7f9388f29800 1 -- 172.21.15.62:0/201546204 wait complete. 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.760+0000 7f9388f29800 1 Processor -- start 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.761+0000 7f9388f29800 1 -- start start 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.761+0000 7f9388f29800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634943b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.761+0000 7f9388f29800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563494303cf0 con 0x5634943b91b0 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.761+0000 7f9384ceb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634943b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.761+0000 7f9384ceb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634943b8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33124/0 (socket says 172.21.15.62:33124) 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.761+0000 7f9384ceb640 1 -- 172.21.15.62:0/3934472194 learned_addr learned my addr 172.21.15.62:0/3934472194 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.761+0000 7f9384ceb640 1 -- 172.21.15.62:0/3934472194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634943b70b0 con 0x5634943b91b0 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9384ceb640 1 --2- 172.21.15.62:0/3934472194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634943b8af0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9374001e90 tx=0x7f937400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485c8236c160d813 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9272e0d640 1 -- 172.21.15.62:0/3934472194 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937400e5c0 con 0x5634943b91b0 2024-04-26T07:54:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9272e0d640 1 -- 172.21.15.62:0/3934472194 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9374006070 con 0x5634943b91b0 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9272e0d640 1 -- 172.21.15.62:0/3934472194 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937400e890 con 0x5634943b91b0 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9388f29800 1 -- 172.21.15.62:0/3934472194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 msgr2=0x5634943b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9388f29800 1 --2- 172.21.15.62:0/3934472194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634943b8af0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9374001e90 tx=0x7f937400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9388f29800 1 -- 172.21.15.62:0/3934472194 shutdown_connections 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9388f29800 1 --2- 172.21.15.62:0/3934472194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634943b8af0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9388f29800 1 -- 172.21.15.62:0/3934472194 >> 172.21.15.62:0/3934472194 conn(0x5634943b2ba0 msgr2=0x5634944a5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9388f29800 1 -- 172.21.15.62:0/3934472194 shutdown_connections 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.762+0000 7f9388f29800 1 -- 172.21.15.62:0/3934472194 wait complete. 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.763+0000 7f9388f29800 1 Processor -- start 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.763+0000 7f9388f29800 1 -- start start 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.763+0000 7f9388f29800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634944b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.763+0000 7f9388f29800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5634943bfac0 con 0x5634943b91b0 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.763+0000 7f9384ceb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634944b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.763+0000 7f9384ceb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634944b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33136/0 (socket says 172.21.15.62:33136) 2024-04-26T07:54:35.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.763+0000 7f9384ceb640 1 -- 172.21.15.62:0/2598967215 learned_addr learned my addr 172.21.15.62:0/2598967215 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.763+0000 7f9384ceb640 1 -- 172.21.15.62:0/2598967215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634944b4000 con 0x5634943b91b0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.764+0000 7f9384ceb640 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634944b3ac0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9374001ed0 tx=0x7f9374000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.764+0000 7f927160a640 1 -- 172.21.15.62:0/2598967215 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937401a880 con 0x5634943b91b0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.764+0000 7f927160a640 1 -- 172.21.15.62:0/2598967215 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937401aa20 con 0x5634943b91b0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.764+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634944b4290 con 0x5634943b91b0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.764+0000 7f927160a640 1 -- 172.21.15.62:0/2598967215 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937401ad40 con 0x5634943b91b0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.764+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634944b6f40 con 0x5634943b91b0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f927160a640 1 -- 172.21.15.62:0/2598967215 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9374017070 con 0x5634943b91b0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f927160a640 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f926c036eb0 0x7f926c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f927160a640 1 -- 172.21.15.62:0/2598967215 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9374015020 con 0x5634943b91b0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f93844ea640 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f926c036eb0 0x7f926c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634943bccc0 0x5634944bad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944bb2d0 con 0x5634943bccc0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f93854ec640 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634943bccc0 0x5634944bad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f93844ea640 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f926c036eb0 0x7f926c039370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f936c054000 tx=0x7f936c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.765+0000 7f93854ec640 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634943bccc0 0x5634944bad00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.766+0000 7f93854ec640 1 -- 172.21.15.62:0/2598967215 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f937c00a4a0 con 0x5634943bccc0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.766+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944b82d0 con 0x5634943bccc0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.766+0000 7f93854ec640 1 -- 172.21.15.62:0/2598967215 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f937c00a4a0 con 0x5634943bccc0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.766+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944bd5e0 0x5634944bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.766+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944c0070 con 0x5634944bd5e0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.766+0000 7f9384ceb640 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944bd5e0 0x5634944bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.767+0000 7f9384ceb640 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944bd5e0 0x5634944bf9d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.767+0000 7f9384ceb640 1 -- 172.21.15.62:0/2598967215 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f937402e070 con 0x5634944bd5e0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.767+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944bc590 con 0x5634943bccc0 2024-04-26T07:54:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.767+0000 7f93854ec640 1 -- 172.21.15.62:0/2598967215 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f937c00a4a0 con 0x5634943bccc0 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.767+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944bca70 con 0x5634943bccc0 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.767+0000 7f93854ec640 1 -- 172.21.15.62:0/2598967215 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f937c00a4a0 con 0x5634943bccc0 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.768+0000 7f9388f29800 1 Processor -- start 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.768+0000 7f9388f29800 1 -- start start 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.768+0000 7f9388f29800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944cf220 0x5634944cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.768+0000 7f9388f29800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5634942ab170 con 0x5634944cf220 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.768+0000 7f93854ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944cf220 0x5634944cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.768+0000 7f93854ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944cf220 0x5634944cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33148/0 (socket says 172.21.15.62:33148) 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.768+0000 7f93854ec640 1 -- 172.21.15.62:0/1140267838 learned_addr learned my addr 172.21.15.62:0/1140267838 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.768+0000 7f93854ec640 1 -- 172.21.15.62:0/1140267838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634944cfb80 con 0x5634944cf220 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.769+0000 7f93854ec640 1 --2- 172.21.15.62:0/1140267838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944cf220 0x5634944cf640 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5634944b4990 tx=0x7f937c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.769+0000 7f926a7fc640 1 -- 172.21.15.62:0/1140267838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937c014450 con 0x5634944cf220 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.769+0000 7f926a7fc640 1 -- 172.21.15.62:0/1140267838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c0145f0 con 0x5634944cf220 2024-04-26T07:54:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.769+0000 7f9388f29800 1 -- 172.21.15.62:0/1140267838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634944d05f0 con 0x5634944cf220 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.769+0000 7f926a7fc640 1 -- 172.21.15.62:0/1140267838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937c0148d0 con 0x5634944cf220 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.769+0000 7f9388f29800 1 -- 172.21.15.62:0/1140267838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634944d0af0 con 0x5634944cf220 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f926a7fc640 1 -- 172.21.15.62:0/1140267838 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f937c011040 con 0x5634944cf220 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f926a7fc640 1 --2- 172.21.15.62:0/1140267838 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f925c036eb0 0x7f925c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f926a7fc640 1 -- 172.21.15.62:0/1140267838 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f937c01e070 con 0x5634944cf220 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f9384ceb640 1 --2- 172.21.15.62:0/1140267838 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f925c036eb0 0x7f925c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f9388f29800 1 Processor -- start 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f9388f29800 1 -- start start 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f9384ceb640 1 --2- 172.21.15.62:0/1140267838 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f925c036eb0 0x7f925c039370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5634944bb700 tx=0x7f937400b6c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f9388f29800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944dc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.770+0000 7f9388f29800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5634943b7430 con 0x5634944dc550 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f93854ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944dc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f93854ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944dc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33152/0 (socket says 172.21.15.62:33152) 2024-04-26T07:54:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f93854ec640 1 -- 172.21.15.62:0/3884723636 learned_addr learned my addr 172.21.15.62:0/3884723636 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f93854ec640 1 -- 172.21.15.62:0/3884723636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634944dcf40 con 0x5634944dc550 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f93854ec640 1 --2- 172.21.15.62:0/3884723636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944dc970 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f937c04ceb0 tx=0x7f937c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e66dc3b2ca228c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f925bfff640 1 -- 172.21.15.62:0/3884723636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937c0167c0 con 0x5634944dc550 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f925bfff640 1 -- 172.21.15.62:0/3884723636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c013cb0 con 0x5634944dc550 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f925bfff640 1 -- 172.21.15.62:0/3884723636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937c016960 con 0x5634944dc550 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f9388f29800 1 -- 172.21.15.62:0/3884723636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 msgr2=0x5634944dc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.771+0000 7f9388f29800 1 --2- 172.21.15.62:0/3884723636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944dc970 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f937c04ceb0 tx=0x7f937c011700 comp rx=0 tx=0).stop 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 -- 172.21.15.62:0/3884723636 shutdown_connections 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 --2- 172.21.15.62:0/3884723636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944dc970 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 -- 172.21.15.62:0/3884723636 >> 172.21.15.62:0/3884723636 conn(0x5634944d8860 msgr2=0x5634944d68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 -- 172.21.15.62:0/3884723636 shutdown_connections 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 -- 172.21.15.62:0/3884723636 wait complete. 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 Processor -- start 2024-04-26T07:54:35.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 -- start start 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f9388f29800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5634944dd690 con 0x5634944dc550 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f93854ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f93854ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944e3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33156/0 (socket says 172.21.15.62:33156) 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.772+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 learned_addr learned my addr 172.21.15.62:0/3427426198 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.773+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634944e4040 con 0x5634944dc550 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.773+0000 7f93854ec640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944e3b00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f937c011be0 tx=0x7f937c04ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.773+0000 7f925a7fc640 1 -- 172.21.15.62:0/3427426198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937c03b070 con 0x5634944dc550 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.773+0000 7f925a7fc640 1 -- 172.21.15.62:0/3427426198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c0133b0 con 0x5634944dc550 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.773+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634944e42d0 con 0x5634944dc550 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.773+0000 7f925a7fc640 1 -- 172.21.15.62:0/3427426198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937c013e60 con 0x5634944dc550 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.773+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634944e6f80 con 0x5634944dc550 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.774+0000 7f925a7fc640 1 -- 172.21.15.62:0/3427426198 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f937c0136b0 con 0x5634944dc550 2024-04-26T07:54:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.774+0000 7f925a7fc640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9250036eb0 0x7f9250039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.774+0000 7f925a7fc640 1 -- 172.21.15.62:0/3427426198 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f937c033070 con 0x5634944dc550 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.774+0000 7f9384ceb640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9250036eb0 0x7f9250039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.774+0000 7f9384ceb640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9250036eb0 0x7f9250039370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f937400bc10 tx=0x7f9374034040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.774+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.774+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634944ef740 0x5634944f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.774+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944f2350 con 0x5634944ef740 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f93844ea640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634944ef740 0x5634944f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f93844ea640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634944ef740 0x5634944f1c00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f9388f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f9388f29800 20 realm 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944f2720 con 0x5634944ef740 2024-04-26T07:54:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f9388f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f9388f29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.775+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944f2ff0 con 0x5634944ef740 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f9388f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944f3390 con 0x5634944ef740 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f9388f29800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944f40f0 0x5634944f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944f6aa0 con 0x5634944f40f0 2024-04-26T07:54:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f93854ec640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944f40f0 0x5634944f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.776+0000 7f93854ec640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944f40f0 0x5634944f64e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.777+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.777+0000 7f9388f29800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.777+0000 7f9388f29800 20 searching for the correct realm 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.777+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5634944f8a70 0x5634944faf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.777+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.777+0000 7f9384ceb640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5634944f8a70 0x5634944faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.777+0000 7f9384ceb640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5634944f8a70 0x5634944faf30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.778+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.778+0000 7f9384ceb640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f937400f070 0x7f9374019840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.778+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x7f937400f070 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.778+0000 7f93844ea640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f937400f070 0x7f9374019840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.778+0000 7f93844ea640 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f937400f070 0x7f9374019840 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.778+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.778+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.779+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.779+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944ef740 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.779+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.779+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944ef740 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.779+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.779+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.779+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.779+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.780+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.780+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x7f937400f070 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.780+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.780+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.780+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.780+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944ef740 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.780+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.780+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.781+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.781+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944ef740 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.781+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.781+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x7f937400f070 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.781+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.781+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.781+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.781+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944ef740 2024-04-26T07:54:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.782+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.783+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944ef740 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.783+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.783+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.783+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.783+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.783+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.783+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x7f937400f070 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.784+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.784+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944ef740 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.784+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.784+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.785+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.785+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.785+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.785+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.785+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.785+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x7f937400f070 2024-04-26T07:54:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.785+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.785+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f8a70 2024-04-26T07:54:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.786+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.786+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944f40f0 2024-04-26T07:54:35.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.786+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.786+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x5634944ef740 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.786+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.786+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5634944fb600 con 0x7f937400f070 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944f7460 con 0x5634944ef740 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944f7070 con 0x5634944ef740 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944f7dd0 con 0x5634944ef740 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 zone default found 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 4 Realm: () 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 zonegroup default 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.787+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944fbaa0 con 0x5634944f40f0 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9388f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944fdd70 con 0x5634944f8a70 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9388f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5634944fe110 con 0x5634944f8a70 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.788+0000 7f9388f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.789+0000 7f9388f29800 20 started sync module instance, tier type = 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.789+0000 7f9388f29800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.789+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944fd1b0 con 0x7f937400f070 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.789+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.790+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94783826548400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944fd1b0 con 0x7f937400f070 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.790+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944feb10 con 0x5634944ef740 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.790+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94783826548400] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.791+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.791+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94783826552352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944fd1b0 con 0x5634944ef740 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.791+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944ff560 con 0x5634944f8a70 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.792+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94783826552352] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.792+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.792+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94783826545920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944ff900 con 0x5634944f8a70 2024-04-26T07:54:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.792+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494500340 con 0x7f937400f070 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.793+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.793+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94783826558480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494500be0 con 0x7f937400f070 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.793+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634945016a0 con 0x5634944ef740 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.793+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94783826545920] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.794+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94783826558480] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.794+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.794+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94783826563536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494500660 con 0x5634944ef740 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.794+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494501f70 con 0x5634944f40f0 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.795+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94783826563536] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.795+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.795+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94783826554992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494500660 con 0x5634944f40f0 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.795+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494502590 con 0x5634944f40f0 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.796+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94783826554992] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.796+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.796+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94783826565824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494502590 con 0x5634944f40f0 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.796+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494502fd0 con 0x5634944f40f0 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.797+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94783826565824] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.797+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.797+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94783826569888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634945031b0 con 0x5634944f40f0 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 20 add_watcher() i=0 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 20 add_watcher() i=1 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 20 add_watcher() i=2 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 20 add_watcher() i=3 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 20 add_watcher() i=4 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 20 add_watcher() i=5 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 20 add_watcher() i=6 2024-04-26T07:54:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94783826569888] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 20 add_watcher() i=7 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.798+0000 7f9388f29800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.799+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563494506580 con 0x5634944ef740 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.799+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.799+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94783826571424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634945039a0 con 0x5634944ef740 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.800+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94783826571424] v27'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.800+0000 7f923b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.800+0000 7f9388f29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.800+0000 7f9388f29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.800+0000 7f9388f29800 5 note: GC not initialized 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.800+0000 7f923a7e4640 20 reqs_thread_entry: start 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.800+0000 7f9388f29800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 20 Filter name: none 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f92337fe640 20 reqs_thread_entry: start 2024-04-26T07:54:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563494539c40 con 0x5634944ef740 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56349453a980 con 0x7f937400f070 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-04-26T07:54:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.801+0000 7f9388f29800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.802+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494540640 con 0x5634944ef740 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v27'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f9388f29800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f9388f29800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f9388f29800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94783826821408 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56349453d220 con 0x5634944ef740 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94783826563536 notify 115964116999 ret 0) ==== 891+0+0 (crc 0 0 0) 0x5634943c07d0 con 0x5634944ef740 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f925bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94783826563536 notifier 4382 bl.length()=849 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f925bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f925bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 notify.4 [notify cookie 94783826821408 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f925bfff640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9248003ea0 con 0x5634944ef740 2024-04-26T07:54:35.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94783826821408 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f936c05db40 con 0x5634944ef740 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.803+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494540120 con 0x7f937400f070 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f9388f29800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f9388f29800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f9388f29800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94783826821408 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56349453ad50 con 0x7f937400f070 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== watch-notify(notify (1) cookie 94783826548400 notify 115964116995 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f936c05db40 con 0x7f937400f070 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f925b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94783826548400 notifier 4382 bl.length()=166 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f925b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f925b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f925b7fe640 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f91ac003400 con 0x7f937400f070 2024-04-26T07:54:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(68 notify.0 [notify cookie 94783826821408 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.805+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.806+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== watch-notify(notify_complete (2) cookie 94783826821408 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f936c086450 con 0x7f937400f070 2024-04-26T07:54:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T07:54:35.802982Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.806+0000 7f923b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.806+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94783826571424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494538e00 con 0x5634944ef740 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.807+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94783826571424] v27'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.807+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94783826548400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563494538e00 con 0x7f937400f070 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.808+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94783826548400] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.808+0000 7f9388f29800 20 remove_watcher() i=0 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.808+0000 7f9388f29800 2 removed watcher, disabling cache 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.809+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94783826552352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944fd6b0 con 0x5634944ef740 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.809+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94783826552352] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.809+0000 7f9388f29800 20 remove_watcher() i=1 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.809+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94783826545920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944fd6b0 con 0x5634944f8a70 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.810+0000 7f9384ceb640 1 -- 172.21.15.62:0/3427426198 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94783826545920] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374056040 con 0x5634944f8a70 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.810+0000 7f9388f29800 20 remove_watcher() i=2 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.810+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94783826558480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944fcd00 con 0x7f937400f070 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.811+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94783826558480] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x7f937400f070 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.811+0000 7f9388f29800 20 remove_watcher() i=3 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.811+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94783826563536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944ffe10 con 0x5634944ef740 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.812+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94783826563536] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c05a040 con 0x5634944ef740 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.812+0000 7f9388f29800 20 remove_watcher() i=4 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.812+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94783826554992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944fcd00 con 0x5634944f40f0 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.814+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94783826554992] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.814+0000 7f9388f29800 20 remove_watcher() i=5 2024-04-26T07:54:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.814+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94783826565824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944ffe10 con 0x5634944f40f0 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.815+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94783826565824] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.815+0000 7f9388f29800 20 remove_watcher() i=6 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.815+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94783826569888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5634944ff070 con 0x5634944f40f0 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f93854ec640 1 -- 172.21.15.62:0/3427426198 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94783826569888] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f937c02a070 con 0x5634944f40f0 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 20 remove_watcher() i=7 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944f40f0 msgr2=0x5634944f64e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944f40f0 0x5634944f64e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634944ef740 msgr2=0x5634944f1c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634944ef740 0x5634944f1c00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f937400f070 msgr2=0x7f9374019840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f937400f070 0x7f9374019840 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5634944f8a70 msgr2=0x5634944faf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5634944f8a70 0x5634944faf30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9250036eb0 msgr2=0x7f9250039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9250036eb0 0x7f9250039370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f937400bc10 tx=0x7f9374034040 comp rx=0 tx=0).stop 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 msgr2=0x5634944e3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 --2- 172.21.15.62:0/3427426198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944dc550 0x5634944e3b00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f937c011be0 tx=0x7f937c04ce40 comp rx=0 tx=0).stop 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f93844ea640 1 -- 172.21.15.62:0/3427426198 reap_dead start 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 shutdown_connections 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 >> 172.21.15.62:0/3427426198 conn(0x5634944d8860 msgr2=0x5634944d5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 shutdown_connections 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.816+0000 7f9388f29800 1 -- 172.21.15.62:0/3427426198 wait complete. 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/1140267838 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f925c036eb0 msgr2=0x7f925c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/1140267838 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f925c036eb0 0x7f925c039370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5634944bb700 tx=0x7f937400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/1140267838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944cf220 msgr2=0x5634944cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/1140267838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944cf220 0x5634944cf640 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5634944b4990 tx=0x7f937c0188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/1140267838 shutdown_connections 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/1140267838 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f925c036eb0 0x7f925c039370 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/1140267838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634944cf220 0x5634944cf640 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/1140267838 >> 172.21.15.62:0/1140267838 conn(0x5634944c32c0 msgr2=0x5634944c36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/1140267838 shutdown_connections 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/1140267838 wait complete. 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944bd5e0 msgr2=0x5634944bf9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944bd5e0 0x5634944bf9d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634943bccc0 msgr2=0x5634944bad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634943bccc0 0x5634944bad00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f926c036eb0 msgr2=0x7f926c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f926c036eb0 0x7f926c039370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f936c054000 tx=0x7f936c04e000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 msgr2=0x5634944b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634944b3ac0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9374001ed0 tx=0x7f9374000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 shutdown_connections 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5634943bccc0 0x5634944bad00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5634944bd5e0 0x5634944bf9d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f926c036eb0 0x7f926c039370 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 --2- 172.21.15.62:0/2598967215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634943b91b0 0x5634944b3ac0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 >> 172.21.15.62:0/2598967215 conn(0x5634943b2ba0 msgr2=0x5634943b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 shutdown_connections 2024-04-26T07:54:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.817+0000 7f9388f29800 1 -- 172.21.15.62:0/2598967215 wait complete. 2024-04-26T07:54:35.830 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T07:54:35.802982Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:35.830 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:54:35.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:54:35.831 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:54:35.874 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:35.874 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:35.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.877+0000 7f05f1b26800 1 Processor -- start 2024-04-26T07:54:35.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.877+0000 7f05f1b26800 1 -- start start 2024-04-26T07:54:35.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.877+0000 7f05f1b26800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559287fe1fa0 0x559287fe23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.877+0000 7f05f1b26800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559287f57280 con 0x559287fe2900 2024-04-26T07:54:35.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.877+0000 7f05f1b26800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x559287e85e20 con 0x559287fe1fa0 2024-04-26T07:54:35.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.877+0000 7f05ed828640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559287fe1fa0 0x559287fe23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.878+0000 7f05ed027640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x559287fe2900 0x559287fe2db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36600/0 (socket says 172.21.15.62:36600) 2024-04-26T07:54:35.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.878+0000 7f05ed027640 1 -- 172.21.15.62:0/1496220007 learned_addr learned my addr 172.21.15.62:0/1496220007 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:35.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.878+0000 7f05ed828640 1 -- 172.21.15.62:0/1496220007 >> v1:172.21.15.1:6789/0 conn(0x559287fe2900 legacy=0x559287fe2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.878+0000 7f05ed828640 1 -- 172.21.15.62:0/1496220007 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559287fe34c0 con 0x559287fe1fa0 2024-04-26T07:54:35.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.878+0000 7f05ec826640 1 -- 172.21.15.62:0/1496220007 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592291862 0 0) 0x559287f57280 con 0x559287fe2900 2024-04-26T07:54:35.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05ed828640 1 --2- 172.21.15.62:0/1496220007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x559287fe23c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f05e000a470 tx=0x7f05e001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f716d4641b4c607e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05ec826640 1 -- 172.21.15.62:0/1496220007 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e0057070 con 0x559287fe1fa0 2024-04-26T07:54:35.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05ec826640 1 -- 172.21.15.62:0/1496220007 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e0052570 con 0x559287fe1fa0 2024-04-26T07:54:35.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05ec826640 1 -- 172.21.15.62:0/1496220007 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e0052870 con 0x559287fe1fa0 2024-04-26T07:54:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05f1b26800 1 -- 172.21.15.62:0/1496220007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 msgr2=0x559287fe23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05f1b26800 1 --2- 172.21.15.62:0/1496220007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x559287fe23c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f05e000a470 tx=0x7f05e001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05f1b26800 1 -- 172.21.15.62:0/1496220007 shutdown_connections 2024-04-26T07:54:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05f1b26800 1 --2- 172.21.15.62:0/1496220007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x559287fe23c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05f1b26800 1 -- 172.21.15.62:0/1496220007 >> 172.21.15.62:0/1496220007 conn(0x559287fddb80 msgr2=0x559287fdffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05f1b26800 1 -- 172.21.15.62:0/1496220007 shutdown_connections 2024-04-26T07:54:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.880+0000 7f05f1b26800 1 -- 172.21.15.62:0/1496220007 wait complete. 2024-04-26T07:54:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.893+0000 7f05f1b26800 1 Processor -- start 2024-04-26T07:54:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.893+0000 7f05f1b26800 1 -- start start 2024-04-26T07:54:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.893+0000 7f05f1b26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880d6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.893+0000 7f05f1b26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559287f2ecd0 con 0x559287fe1fa0 2024-04-26T07:54:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.893+0000 7f05ed828640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880d6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.893+0000 7f05ed828640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880d6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33178/0 (socket says 172.21.15.62:33178) 2024-04-26T07:54:35.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.893+0000 7f05ed828640 1 -- 172.21.15.62:0/2426248595 learned_addr learned my addr 172.21.15.62:0/2426248595 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.894+0000 7f05ed828640 1 -- 172.21.15.62:0/2426248595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592880d7500 con 0x559287fe1fa0 2024-04-26T07:54:35.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.894+0000 7f05ed828640 1 --2- 172.21.15.62:0/2426248595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880d6f30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f05e0055040 tx=0x7f05e004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513b6f0464febeb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.894+0000 7f04dbe07640 1 -- 172.21.15.62:0/2426248595 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e0057070 con 0x559287fe1fa0 2024-04-26T07:54:35.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.894+0000 7f04dbe07640 1 -- 172.21.15.62:0/2426248595 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e0063070 con 0x559287fe1fa0 2024-04-26T07:54:35.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.894+0000 7f04dbe07640 1 -- 172.21.15.62:0/2426248595 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e0052720 con 0x559287fe1fa0 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 -- 172.21.15.62:0/2426248595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 msgr2=0x5592880d6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2426248595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880d6f30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f05e0055040 tx=0x7f05e004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 -- 172.21.15.62:0/2426248595 shutdown_connections 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2426248595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880d6f30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 -- 172.21.15.62:0/2426248595 >> 172.21.15.62:0/2426248595 conn(0x559287fddb80 msgr2=0x5592880d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 -- 172.21.15.62:0/2426248595 shutdown_connections 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 -- 172.21.15.62:0/2426248595 wait complete. 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 Processor -- start 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 -- start start 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880de960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05f1b26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559287fe3a50 con 0x559287fe1fa0 2024-04-26T07:54:35.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.895+0000 7f05ed828640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f05ed828640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880de960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33180/0 (socket says 172.21.15.62:33180) 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f05ed828640 1 -- 172.21.15.62:0/2182148009 learned_addr learned my addr 172.21.15.62:0/2182148009 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f05ed828640 1 -- 172.21.15.62:0/2182148009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592880deea0 con 0x559287fe1fa0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f05ed828640 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880de960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f05e0060040 tx=0x7f05e0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f04da604640 1 -- 172.21.15.62:0/2182148009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e0052e30 con 0x559287fe1fa0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f04da604640 1 -- 172.21.15.62:0/2182148009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e006c070 con 0x559287fe1fa0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592880df130 con 0x559287fe1fa0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f04da604640 1 -- 172.21.15.62:0/2182148009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e005e5f0 con 0x559287fe1fa0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.896+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592880e1de0 con 0x559287fe1fa0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.897+0000 7f04da604640 1 -- 172.21.15.62:0/2182148009 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f05e005e790 con 0x559287fe1fa0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.897+0000 7f04da604640 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04d4036eb0 0x7f04d4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.897+0000 7f04da604640 1 -- 172.21.15.62:0/2182148009 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f05e008eec0 con 0x559287fe1fa0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.897+0000 7f05ed027640 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04d4036eb0 0x7f04d4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.897+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559287fe2900 0x5592880e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.897+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5592880e60e0 con 0x559287fe2900 2024-04-26T07:54:35.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.898+0000 7f05ee029640 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559287fe2900 0x5592880e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.898+0000 7f05ed027640 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04d4036eb0 0x7f04d4039370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05e4000c00 tx=0x7f05e40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.898+0000 7f05ee029640 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559287fe2900 0x5592880e5ba0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.898+0000 7f05ee029640 1 -- 172.21.15.62:0/2182148009 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05e800a4a0 con 0x559287fe2900 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.898+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5592880e3130 con 0x559287fe2900 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.898+0000 7f05ee029640 1 -- 172.21.15.62:0/2182148009 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05e800a4a0 con 0x559287fe2900 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.898+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5592880e8410 0x5592880ea800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.898+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5592880eaed0 con 0x5592880e8410 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.899+0000 7f05ed828640 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5592880e8410 0x5592880ea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.899+0000 7f05ed828640 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5592880e8410 0x5592880ea800 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.899+0000 7f05ed828640 1 -- 172.21.15.62:0/2182148009 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05e0071990 con 0x5592880e8410 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.899+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5592880e73c0 con 0x559287fe2900 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.900+0000 7f05ee029640 1 -- 172.21.15.62:0/2182148009 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05e800a4a0 con 0x559287fe2900 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.900+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5592880e7840 con 0x559287fe2900 2024-04-26T07:54:35.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.900+0000 7f05ee029640 1 -- 172.21.15.62:0/2182148009 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05e800a4a0 con 0x559287fe2900 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.900+0000 7f05f1b26800 1 Processor -- start 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.900+0000 7f05f1b26800 1 -- start start 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.900+0000 7f05f1b26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592880fa030 0x5592880fa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.900+0000 7f05f1b26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559287ed6170 con 0x5592880fa030 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f05ee029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592880fa030 0x5592880fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f05ee029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592880fa030 0x5592880fa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33192/0 (socket says 172.21.15.62:33192) 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f05ee029640 1 -- 172.21.15.62:0/1946660909 learned_addr learned my addr 172.21.15.62:0/1946660909 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f05ee029640 1 -- 172.21.15.62:0/1946660909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592880fa990 con 0x5592880fa030 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f05ee029640 1 --2- 172.21.15.62:0/1946660909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592880fa030 0x5592880fa450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5592880dfd60 tx=0x7f05e8012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f04d37fe640 1 -- 172.21.15.62:0/1946660909 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8014450 con 0x5592880fa030 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f04d37fe640 1 -- 172.21.15.62:0/1946660909 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e8014610 con 0x5592880fa030 2024-04-26T07:54:35.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f05f1b26800 1 -- 172.21.15.62:0/1946660909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592880fb400 con 0x5592880fa030 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f04d37fe640 1 -- 172.21.15.62:0/1946660909 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8014930 con 0x5592880fa030 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.901+0000 7f05f1b26800 1 -- 172.21.15.62:0/1946660909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592880fb900 con 0x5592880fa030 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.902+0000 7f04d37fe640 1 -- 172.21.15.62:0/1946660909 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f05e8011040 con 0x5592880fa030 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.902+0000 7f04d37fe640 1 --2- 172.21.15.62:0/1946660909 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04c8036eb0 0x7f04c8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.902+0000 7f04d37fe640 1 -- 172.21.15.62:0/1946660909 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f05e801e070 con 0x5592880fa030 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.902+0000 7f05ed828640 1 --2- 172.21.15.62:0/1946660909 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04c8036eb0 0x7f04c8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.902+0000 7f05f1b26800 1 Processor -- start 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.902+0000 7f05f1b26800 1 -- start start 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f05ed828640 1 --2- 172.21.15.62:0/1946660909 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04c8036eb0 0x7f04c8039370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5592880e6540 tx=0x7f05e007ae90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f05f1b26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x559288107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f05f1b26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5592880d77c0 con 0x559288107330 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f05ee029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x559288107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f05ee029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x559288107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33200/0 (socket says 172.21.15.62:33200) 2024-04-26T07:54:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f05ee029640 1 -- 172.21.15.62:0/129244174 learned_addr learned my addr 172.21.15.62:0/129244174 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f05ee029640 1 -- 172.21.15.62:0/129244174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559288107d20 con 0x559288107330 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f05ee029640 1 --2- 172.21.15.62:0/129244174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x559288107750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f05e804d090 tx=0x7f05e802bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88bccef624b9cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f04d17fa640 1 -- 172.21.15.62:0/129244174 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8047e60 con 0x559288107330 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f04d17fa640 1 -- 172.21.15.62:0/129244174 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e8041200 con 0x559288107330 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.903+0000 7f04d17fa640 1 -- 172.21.15.62:0/129244174 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e802b350 con 0x559288107330 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 -- 172.21.15.62:0/129244174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 msgr2=0x559288107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 --2- 172.21.15.62:0/129244174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x559288107750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f05e804d090 tx=0x7f05e802bef0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 -- 172.21.15.62:0/129244174 shutdown_connections 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 --2- 172.21.15.62:0/129244174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x559288107750 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 -- 172.21.15.62:0/129244174 >> 172.21.15.62:0/129244174 conn(0x559288103650 msgr2=0x5592881016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 -- 172.21.15.62:0/129244174 shutdown_connections 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 -- 172.21.15.62:0/129244174 wait complete. 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 Processor -- start 2024-04-26T07:54:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 -- start start 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x55928810e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.904+0000 7f05f1b26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5592881084a0 con 0x559288107330 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f05ee029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x55928810e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f05ee029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x55928810e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33208/0 (socket says 172.21.15.62:33208) 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 learned_addr learned my addr 172.21.15.62:0/2308236523 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55928810ee40 con 0x559288107330 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f05ee029640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x55928810e900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f05e802bf30 tx=0x7f05e804cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f04bf7fe640 1 -- 172.21.15.62:0/2308236523 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8047070 con 0x559288107330 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f04bf7fe640 1 -- 172.21.15.62:0/2308236523 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e8048040 con 0x559288107330 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f04bf7fe640 1 -- 172.21.15.62:0/2308236523 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e803c0c0 con 0x559288107330 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55928810f0d0 con 0x559288107330 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.905+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559288111d80 con 0x559288107330 2024-04-26T07:54:35.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.906+0000 7f04bf7fe640 1 -- 172.21.15.62:0/2308236523 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f05e8022a80 con 0x559288107330 2024-04-26T07:54:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.906+0000 7f04bf7fe640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04b8037000 0x7f04b80394c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.906+0000 7f04bf7fe640 1 -- 172.21.15.62:0/2308236523 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f05e8035030 con 0x559288107330 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.906+0000 7f05ed828640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04b8037000 0x7f04b80394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.906+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.906+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55928811a540 0x55928811ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.906+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55928811d150 con 0x55928811a540 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.906+0000 7f05ed027640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55928811a540 0x55928811ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05ed828640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04b8037000 0x7f04b80394c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f05e0071ca0 tx=0x7f05e0087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05ed027640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55928811a540 0x55928811ca00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05e400f5f0 con 0x55928811a540 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 20 realm 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288119990 con 0x55928811a540 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05e400f5f0 con 0x55928811a540 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55928811dc30 con 0x55928811a540 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05e400f5f0 con 0x55928811a540 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.907+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55928811e500 con 0x55928811a540 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.908+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05e400f5f0 con 0x55928811a540 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.908+0000 7f05f1b26800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.908+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.908+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55928811ee00 0x559288121210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.908+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288121970 con 0x55928811ee00 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.908+0000 7f05ee029640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55928811ee00 0x559288121210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.908+0000 7f05ee029640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55928811ee00 0x559288121210 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.909+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.909+0000 7f05f1b26800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.909+0000 7f05f1b26800 20 searching for the correct realm 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.909+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559288123a20 0x559288125ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.909+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x559288123a20 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.909+0000 7f05ed828640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559288123a20 0x559288125ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.909+0000 7f05ed828640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559288123a20 0x559288125ee0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.910+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.910+0000 7f05ed828640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f05e00735d0 0x7f05e0066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.910+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x7f05e00735d0 2024-04-26T07:54:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.910+0000 7f05ed027640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f05e00735d0 0x7f05e0066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.910+0000 7f05ed027640 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f05e00735d0 0x7f05e0066380 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.910+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e400f5f0 con 0x7f05e00735d0 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.910+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x55928811ee00 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.910+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.911+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x55928811a540 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.911+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e400f5f0 con 0x55928811a540 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.911+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x55928811a540 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.911+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.911+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x55928811ee00 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.911+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.911+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x55928811ee00 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.912+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.912+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x7f05e00735d0 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.912+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.912+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x559288123a20 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.912+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.912+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x55928811a540 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.912+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.912+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x55928811ee00 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.913+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.913+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x55928811a540 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.913+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.913+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x7f05e00735d0 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.913+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.913+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5592881265b0 con 0x559288123a20 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.913+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.913+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x559288123a20 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.914+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.914+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811ee00 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.914+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.914+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x559288123a20 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.914+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.914+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x559288123a20 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.914+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.914+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811a540 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.915+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.915+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811a540 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.915+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.915+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811ee00 2024-04-26T07:54:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.915+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.915+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x559288123a20 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.915+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.915+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x7f05e00735d0 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.916+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.916+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811a540 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.916+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.916+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811ee00 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.916+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.916+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x559288123a20 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.916+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.916+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811ee00 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.917+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.917+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x7f05e00735d0 2024-04-26T07:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.917+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.917+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x559288123a20 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.917+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.917+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811ee00 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x55928811a540 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f05e00ad040 con 0x7f05e00735d0 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:35.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288122420 con 0x55928811a540 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.918+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288122840 con 0x55928811a540 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288122ce0 con 0x55928811a540 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 20 zone default found 2024-04-26T07:54:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 4 Realm: () 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 20 zonegroup default 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288126a30 con 0x55928811ee00 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288122030 con 0x559288123a20 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.919+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.920+0000 7f05f1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.920+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.920+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288128d00 con 0x559288123a20 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.920+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.920+0000 7f05f1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.920+0000 7f05f1b26800 20 started sync module instance, tier type = 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.920+0000 7f05f1b26800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.920+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5592881280f0 con 0x7f05e00735d0 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.921+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.921+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94087836501488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5592881280f0 con 0x7f05e00735d0 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.921+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559288129830 con 0x55928811a540 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.922+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94087836501488] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.922+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.922+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94087836504832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5592881280f0 con 0x55928811a540 2024-04-26T07:54:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.922+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812a2c0 con 0x559288123a20 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.923+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94087836504832] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.923+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.923+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94087836499008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559288128060 con 0x559288123a20 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.923+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812b180 con 0x7f05e00735d0 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.924+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94087836499008] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.924+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.924+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94087836509872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812b180 con 0x7f05e00735d0 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.924+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812bbd0 con 0x55928811a540 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.925+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.925+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94087836514016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812bb00 con 0x55928811a540 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.925+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812cb20 con 0x55928811ee00 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.925+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94087836509872] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.926+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94087836514016] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.926+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.926+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94087836516288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812acd0 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.926+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812d3c0 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.927+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94087836516288] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.927+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.927+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94087836517904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812d3c0 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.927+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812dde0 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94087836517904] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94087836522704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812dfc0 con 0x55928811ee00 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05f1b26800 20 add_watcher() i=0 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05f1b26800 20 add_watcher() i=1 2024-04-26T07:54:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05f1b26800 20 add_watcher() i=2 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05f1b26800 20 add_watcher() i=3 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05f1b26800 20 add_watcher() i=4 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05f1b26800 20 add_watcher() i=5 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.928+0000 7f05f1b26800 20 add_watcher() i=6 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.929+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94087836522704] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.929+0000 7f05f1b26800 20 add_watcher() i=7 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.929+0000 7f05f1b26800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.929+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288131390 con 0x55928811a540 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.930+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.930+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94087836524208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812e850 con 0x55928811a540 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.931+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94087836524208] v27'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.931+0000 7f049f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.931+0000 7f05f1b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.931+0000 7f05f1b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.931+0000 7f05f1b26800 5 note: GC not initialized 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.931+0000 7f049e7fc640 20 reqs_thread_entry: start 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.931+0000 7f05f1b26800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.931+0000 7f05f1b26800 20 Filter name: none 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.932+0000 7f040ffff640 20 reqs_thread_entry: start 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.932+0000 7f05f1b26800 20 rados->read ofs=0 len=0 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.932+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559288164520 con 0x55928811a540 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.932+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.932+0000 7f05f1b26800 20 rados_obj.operate() r=0 bl.length=673 2024-04-26T07:54:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T07:54:35.802982Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.933+0000 7f049f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.933+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94087836524208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559288164a60 con 0x55928811a540 2024-04-26T07:54:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.934+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94087836524208] v27'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.934+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94087836501488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812deb0 con 0x7f05e00735d0 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.935+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94087836501488] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.935+0000 7f05f1b26800 20 remove_watcher() i=0 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.935+0000 7f05f1b26800 2 removed watcher, disabling cache 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.935+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94087836504832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812deb0 con 0x55928811a540 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.936+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94087836504832] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.936+0000 7f05f1b26800 20 remove_watcher() i=1 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.936+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94087836499008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812deb0 con 0x559288123a20 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.937+0000 7f05ed828640 1 -- 172.21.15.62:0/2308236523 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94087836499008] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e0071990 con 0x559288123a20 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.937+0000 7f05f1b26800 20 remove_watcher() i=2 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.937+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94087836509872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812deb0 con 0x7f05e00735d0 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.938+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94087836509872] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x7f05e00735d0 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.938+0000 7f05f1b26800 20 remove_watcher() i=3 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.938+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94087836514016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812a6b0 con 0x55928811a540 2024-04-26T07:54:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.939+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94087836514016] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e402b040 con 0x55928811a540 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.939+0000 7f05f1b26800 20 remove_watcher() i=4 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.939+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94087836516288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812deb0 con 0x55928811ee00 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.940+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94087836516288] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.940+0000 7f05f1b26800 20 remove_watcher() i=5 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.940+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94087836517904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812b6e0 con 0x55928811ee00 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.941+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94087836517904] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.941+0000 7f05f1b26800 20 remove_watcher() i=6 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.941+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94087836522704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55928812bfc0 con 0x55928811ee00 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05ee029640 1 -- 172.21.15.62:0/2308236523 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94087836522704] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8055070 con 0x55928811ee00 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 20 remove_watcher() i=7 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55928811ee00 msgr2=0x559288121210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55928811ee00 0x559288121210 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55928811a540 msgr2=0x55928811ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55928811a540 0x55928811ca00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f05e00735d0 msgr2=0x7f05e0066380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f05e00735d0 0x7f05e0066380 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559288123a20 msgr2=0x559288125ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.942+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559288123a20 0x559288125ee0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04b8037000 msgr2=0x7f04b80394c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04b8037000 0x7f04b80394c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f05e0071ca0 tx=0x7f05e0087000 comp rx=0 tx=0).stop 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 msgr2=0x55928810e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05ed027640 1 -- 172.21.15.62:0/2308236523 reap_dead start 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x55928810e900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f05e802bf30 tx=0x7f05e804cff0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 shutdown_connections 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2308236523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559288107330 0x55928810e900 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 >> 172.21.15.62:0/2308236523 conn(0x559288103650 msgr2=0x559288100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 shutdown_connections 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/2308236523 wait complete. 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/1946660909 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04c8036eb0 msgr2=0x7f04c8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 --2- 172.21.15.62:0/1946660909 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04c8036eb0 0x7f04c8039370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5592880e6540 tx=0x7f05e007ae90 comp rx=0 tx=0).stop 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/1946660909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592880fa030 msgr2=0x5592880fa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 --2- 172.21.15.62:0/1946660909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592880fa030 0x5592880fa450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5592880dfd60 tx=0x7f05e8012fd0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/1946660909 shutdown_connections 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 --2- 172.21.15.62:0/1946660909 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04c8036eb0 0x7f04c8039370 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 --2- 172.21.15.62:0/1946660909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5592880fa030 0x5592880fa450 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/1946660909 >> 172.21.15.62:0/1946660909 conn(0x5592880ee0d0 msgr2=0x5592880ee4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/1946660909 shutdown_connections 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/1946660909 wait complete. 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5592880e8410 msgr2=0x5592880ea800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5592880e8410 0x5592880ea800 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.943+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559287fe2900 msgr2=0x5592880e5ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559287fe2900 0x5592880e5ba0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04d4036eb0 msgr2=0x7f04d4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04d4036eb0 0x7f04d4039370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05e4000c00 tx=0x7f05e40013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 msgr2=0x5592880de960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880de960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f05e0060040 tx=0x7f05e0002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 shutdown_connections 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559287fe2900 0x5592880e5ba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5592880e8410 0x5592880ea800 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f04d4036eb0 0x7f04d4039370 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 --2- 172.21.15.62:0/2182148009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559287fe1fa0 0x5592880de960 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 >> 172.21.15.62:0/2182148009 conn(0x559287fddb80 msgr2=0x5592880d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 shutdown_connections 2024-04-26T07:54:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:35.944+0000 7f05f1b26800 1 -- 172.21.15.62:0/2182148009 wait complete. 2024-04-26T07:54:35.950 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T07:54:35.802982Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:35.950 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-26T07:54:35.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-26T07:54:35.951 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-04-26T07:54:35.999 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:35.999 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:36.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.001+0000 7f2508413800 1 Processor -- start 2024-04-26T07:54:36.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.001+0000 7f2508413800 1 -- start start 2024-04-26T07:54:36.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.001+0000 7f2508413800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55753fbf5a00 0x55753fbf7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.001+0000 7f2508413800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55753fbf83c0 con 0x55753fbf1570 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.001+0000 7f2508413800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55753fa94e20 con 0x55753fbf5a00 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.002+0000 7f250326d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55753fbf5a00 0x55753fbf7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.002+0000 7f2503a6e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55753fbf1570 0x55753fbf1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36604/0 (socket says 172.21.15.62:36604) 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.002+0000 7f250326d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55753fbf5a00 0x55753fbf7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33214/0 (socket says 172.21.15.62:33214) 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.002+0000 7f2503a6e640 1 -- 172.21.15.62:0/2643098232 learned_addr learned my addr 172.21.15.62:0/2643098232 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.002+0000 7f2502a6c640 1 -- 172.21.15.62:0/2643098232 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286543750 0 0) 0x55753fbf83c0 con 0x55753fbf1570 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.002+0000 7f2502a6c640 1 -- 172.21.15.62:0/2643098232 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24ec001e10 con 0x55753fbf1570 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.002+0000 7f250326d640 1 -- 172.21.15.62:0/2643098232 >> v1:172.21.15.1:6789/0 conn(0x55753fbf1570 legacy=0x55753fbf1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.002+0000 7f250326d640 1 -- 172.21.15.62:0/2643098232 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753fbf95f0 con 0x55753fbf5a00 2024-04-26T07:54:36.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.004+0000 7f250326d640 1 --2- 172.21.15.62:0/2643098232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf5a00 0x55753fbf7df0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f24f800a470 tx=0x7f24f801cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fac1dbf9b159ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.004+0000 7f2502a6c640 1 -- 172.21.15.62:0/2643098232 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f8057070 con 0x55753fbf5a00 2024-04-26T07:54:36.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.004+0000 7f2502a6c640 1 -- 172.21.15.62:0/2643098232 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f8052570 con 0x55753fbf5a00 2024-04-26T07:54:36.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.004+0000 7f2502a6c640 1 -- 172.21.15.62:0/2643098232 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f8052870 con 0x55753fbf5a00 2024-04-26T07:54:36.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.005+0000 7f2508413800 1 -- 172.21.15.62:0/2643098232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf5a00 msgr2=0x55753fbf7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.005+0000 7f2508413800 1 --2- 172.21.15.62:0/2643098232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf5a00 0x55753fbf7df0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f24f800a470 tx=0x7f24f801cdb0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.005+0000 7f2508413800 1 -- 172.21.15.62:0/2643098232 shutdown_connections 2024-04-26T07:54:36.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.005+0000 7f2508413800 1 --2- 172.21.15.62:0/2643098232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf5a00 0x55753fbf7df0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.005+0000 7f2508413800 1 -- 172.21.15.62:0/2643098232 >> 172.21.15.62:0/2643098232 conn(0x55753fbecbb0 msgr2=0x55753fbeefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.005+0000 7f2508413800 1 -- 172.21.15.62:0/2643098232 shutdown_connections 2024-04-26T07:54:36.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.005+0000 7f2508413800 1 -- 172.21.15.62:0/2643098232 wait complete. 2024-04-26T07:54:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.018+0000 7f2508413800 1 Processor -- start 2024-04-26T07:54:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.018+0000 7f2508413800 1 -- start start 2024-04-26T07:54:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.018+0000 7f2508413800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fce2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.018+0000 7f2508413800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55753fb3dd00 con 0x55753fbf1570 2024-04-26T07:54:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.018+0000 7f2503a6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fce2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.018+0000 7f2503a6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fce2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33226/0 (socket says 172.21.15.62:33226) 2024-04-26T07:54:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.018+0000 7f2503a6e640 1 -- 172.21.15.62:0/1443693221 learned_addr learned my addr 172.21.15.62:0/1443693221 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.018+0000 7f2503a6e640 1 -- 172.21.15.62:0/1443693221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753fce2f20 con 0x55753fbf1570 2024-04-26T07:54:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f2503a6e640 1 --2- 172.21.15.62:0/1443693221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fce2950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f24f4001e30 tx=0x7f24f400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc92c3599c6654a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f23f1e0b640 1 -- 172.21.15.62:0/1443693221 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f4012020 con 0x55753fbf1570 2024-04-26T07:54:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f23f1e0b640 1 -- 172.21.15.62:0/1443693221 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f400e5a0 con 0x55753fbf1570 2024-04-26T07:54:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f23f1e0b640 1 -- 172.21.15.62:0/1443693221 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f400e8e0 con 0x55753fbf1570 2024-04-26T07:54:36.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f2508413800 1 -- 172.21.15.62:0/1443693221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 msgr2=0x55753fce2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f2508413800 1 --2- 172.21.15.62:0/1443693221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fce2950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f24f4001e30 tx=0x7f24f400b780 comp rx=0 tx=0).stop 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f2508413800 1 -- 172.21.15.62:0/1443693221 shutdown_connections 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f2508413800 1 --2- 172.21.15.62:0/1443693221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fce2950 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.019+0000 7f2508413800 1 -- 172.21.15.62:0/1443693221 >> 172.21.15.62:0/1443693221 conn(0x55753fbecbb0 msgr2=0x55753fcde270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2508413800 1 -- 172.21.15.62:0/1443693221 shutdown_connections 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2508413800 1 -- 172.21.15.62:0/1443693221 wait complete. 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2508413800 1 Processor -- start 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2508413800 1 -- start start 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2508413800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fb65f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2508413800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55753fbf8890 con 0x55753fbf1570 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2503a6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fb65f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2503a6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fb65f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33230/0 (socket says 172.21.15.62:33230) 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2503a6e640 1 -- 172.21.15.62:0/1773855423 learned_addr learned my addr 172.21.15.62:0/1773855423 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.020+0000 7f2503a6e640 1 -- 172.21.15.62:0/1773855423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753fcee2a0 con 0x55753fbf1570 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.021+0000 7f2503a6e640 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fb65f50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f24f4001e30 tx=0x7f24f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.021+0000 7f23ebfff640 1 -- 172.21.15.62:0/1773855423 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f4012030 con 0x55753fbf1570 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.021+0000 7f23ebfff640 1 -- 172.21.15.62:0/1773855423 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f401a7a0 con 0x55753fbf1570 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.021+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55753fcee470 con 0x55753fbf1570 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.021+0000 7f23ebfff640 1 -- 172.21.15.62:0/1773855423 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f401aaa0 con 0x55753fbf1570 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.021+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753fcee990 con 0x55753fbf1570 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f23ebfff640 1 -- 172.21.15.62:0/1773855423 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f24f4015020 con 0x55753fbf1570 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f23ebfff640 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23ec036e60 0x7f23ec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f23ebfff640 1 -- 172.21.15.62:0/1773855423 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f24f4020030 con 0x55753fbf1570 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f250326d640 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23ec036e60 0x7f23ec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fbf5a00 0x55753fcf27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fcf2dd0 con 0x55753fbf5a00 2024-04-26T07:54:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f250426f640 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fbf5a00 0x55753fcf27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f250326d640 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23ec036e60 0x7f23ec039320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f24f8054000 tx=0x7f24f804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.022+0000 7f250426f640 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fbf5a00 0x55753fcf27b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.023+0000 7f250426f640 1 -- 172.21.15.62:0/1773855423 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc00a4a0 con 0x55753fbf5a00 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.023+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fcefd80 con 0x55753fbf5a00 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.023+0000 7f250426f640 1 -- 172.21.15.62:0/1773855423 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24fc00a4a0 con 0x55753fbf5a00 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.023+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fcf5120 0x55753fcf7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.023+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fcf7bb0 con 0x55753fcf5120 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.023+0000 7f2503a6e640 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fcf5120 0x55753fcf7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.024+0000 7f2503a6e640 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fcf5120 0x55753fcf7510 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.024+0000 7f2503a6e640 1 -- 172.21.15.62:0/1773855423 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fcf5120 2024-04-26T07:54:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.024+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fcf40d0 con 0x55753fbf5a00 2024-04-26T07:54:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.024+0000 7f250426f640 1 -- 172.21.15.62:0/1773855423 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24fc00a4a0 con 0x55753fbf5a00 2024-04-26T07:54:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.024+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fcf45b0 con 0x55753fbf5a00 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.024+0000 7f250426f640 1 -- 172.21.15.62:0/1773855423 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24fc00a4a0 con 0x55753fbf5a00 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.025+0000 7f2508413800 1 Processor -- start 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.025+0000 7f2508413800 1 -- start start 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.025+0000 7f2508413800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd06cf0 0x55753fd07110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.025+0000 7f2508413800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55753fae5170 con 0x55753fd06cf0 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.025+0000 7f250426f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd06cf0 0x55753fd07110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.025+0000 7f250426f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd06cf0 0x55753fd07110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33242/0 (socket says 172.21.15.62:33242) 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.025+0000 7f250426f640 1 -- 172.21.15.62:0/4106227780 learned_addr learned my addr 172.21.15.62:0/4106227780 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.025+0000 7f250426f640 1 -- 172.21.15.62:0/4106227780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753fd07650 con 0x55753fd06cf0 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.026+0000 7f250426f640 1 --2- 172.21.15.62:0/4106227780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd06cf0 0x55753fd07110 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55753fb65940 tx=0x7f24fc0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.027+0000 7f23e97fa640 1 -- 172.21.15.62:0/4106227780 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc014450 con 0x55753fd06cf0 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.027+0000 7f23e97fa640 1 -- 172.21.15.62:0/4106227780 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc0145f0 con 0x55753fd06cf0 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.027+0000 7f2508413800 1 -- 172.21.15.62:0/4106227780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55753fd080c0 con 0x55753fd06cf0 2024-04-26T07:54:36.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.027+0000 7f23e97fa640 1 -- 172.21.15.62:0/4106227780 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc0148d0 con 0x55753fd06cf0 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.028+0000 7f2508413800 1 -- 172.21.15.62:0/4106227780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753fd085c0 con 0x55753fd06cf0 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.028+0000 7f23e97fa640 1 -- 172.21.15.62:0/4106227780 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f24fc011040 con 0x55753fd06cf0 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.028+0000 7f23e97fa640 1 --2- 172.21.15.62:0/4106227780 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23dc036eb0 0x7f23dc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.028+0000 7f23e97fa640 1 -- 172.21.15.62:0/4106227780 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f24fc01e070 con 0x55753fd06cf0 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f2503a6e640 1 --2- 172.21.15.62:0/4106227780 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23dc036eb0 0x7f23dc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f2508413800 1 Processor -- start 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f2508413800 1 -- start start 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f2503a6e640 1 --2- 172.21.15.62:0/4106227780 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23dc036eb0 0x7f23dc039370 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55753fcf3240 tx=0x7f24f4041040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f2508413800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd144b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f2508413800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55753fce32a0 con 0x55753fd14090 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f250426f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f250426f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd144b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33258/0 (socket says 172.21.15.62:33258) 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f250426f640 1 -- 172.21.15.62:0/3534397641 learned_addr learned my addr 172.21.15.62:0/3534397641 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.029+0000 7f250426f640 1 -- 172.21.15.62:0/3534397641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753fd14a80 con 0x55753fd14090 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f250426f640 1 --2- 172.21.15.62:0/3534397641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd144b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24fc04cf00 tx=0x7f24fc011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eaa32a0b51bc91e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f23e2ffd640 1 -- 172.21.15.62:0/3534397641 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc0411b0 con 0x55753fd14090 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f23e2ffd640 1 -- 172.21.15.62:0/3534397641 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc013c90 con 0x55753fd14090 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f23e2ffd640 1 -- 172.21.15.62:0/3534397641 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc02ba60 con 0x55753fd14090 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f2508413800 1 -- 172.21.15.62:0/3534397641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 msgr2=0x55753fd144b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f2508413800 1 --2- 172.21.15.62:0/3534397641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd144b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24fc04cf00 tx=0x7f24fc011700 comp rx=0 tx=0).stop 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f2508413800 1 -- 172.21.15.62:0/3534397641 shutdown_connections 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f2508413800 1 --2- 172.21.15.62:0/3534397641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd144b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f2508413800 1 -- 172.21.15.62:0/3534397641 >> 172.21.15.62:0/3534397641 conn(0x55753fd10310 msgr2=0x55753fd0e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f2508413800 1 -- 172.21.15.62:0/3534397641 shutdown_connections 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.030+0000 7f2508413800 1 -- 172.21.15.62:0/3534397641 wait complete. 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f2508413800 1 Processor -- start 2024-04-26T07:54:36.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f2508413800 1 -- start start 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f2508413800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd1b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f2508413800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55753fd151b0 con 0x55753fd14090 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f250426f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd1b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f250426f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd1b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33270/0 (socket says 172.21.15.62:33270) 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 learned_addr learned my addr 172.21.15.62:0/4207114924 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753fd1bb50 con 0x55753fd14090 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f250426f640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd1b610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f24fc048010 tx=0x7f24fc04ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f23e17fa640 1 -- 172.21.15.62:0/4207114924 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc02b560 con 0x55753fd14090 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f23e17fa640 1 -- 172.21.15.62:0/4207114924 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc02b700 con 0x55753fd14090 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.031+0000 7f23e17fa640 1 -- 172.21.15.62:0/4207114924 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc04e380 con 0x55753fd14090 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.032+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55753fd1bde0 con 0x55753fd14090 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.032+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753fd1ea90 con 0x55753fd14090 2024-04-26T07:54:36.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.032+0000 7f23e17fa640 1 -- 172.21.15.62:0/4207114924 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f24fc04e520 con 0x55753fd14090 2024-04-26T07:54:36.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.033+0000 7f23e17fa640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23cc036eb0 0x7f23cc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.033+0000 7f23e17fa640 1 -- 172.21.15.62:0/4207114924 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f24fc00e040 con 0x55753fd14090 2024-04-26T07:54:36.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.033+0000 7f2503a6e640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23cc036eb0 0x7f23cc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.033+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.033+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fd27300 0x55753fd297c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.033+0000 7f2503a6e640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23cc036eb0 0x7f23cc039370 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24f401a6a0 tx=0x7f24f4033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.033+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd29f10 con 0x55753fd27300 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.033+0000 7f250326d640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fd27300 0x55753fd297c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f250326d640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fd27300 0x55753fd297c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 20 realm 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd2a2e0 con 0x55753fd27300 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd2abb0 con 0x55753fd27300 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.034+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd2af50 con 0x55753fd27300 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f2508413800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fd2bcb0 0x55753fd2e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd2e6b0 con 0x55753fd2bcb0 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f250426f640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fd2bcb0 0x55753fd2e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f250426f640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fd2bcb0 0x55753fd2e0a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f2508413800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.035+0000 7f2508413800 20 searching for the correct realm 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.036+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55753fd30640 0x55753fd32b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.036+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.036+0000 7f2503a6e640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55753fd30640 0x55753fd32b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.036+0000 7f2503a6e640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55753fd30640 0x55753fd32b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.036+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.036+0000 7f2503a6e640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f24f4017050 0x7f24f40440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.037+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x7f24f4017050 2024-04-26T07:54:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.037+0000 7f250326d640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f24f4017050 0x7f24f40440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.037+0000 7f250326d640 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f24f4017050 0x7f24f40440d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.037+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.037+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.037+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.038+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd27300 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.038+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.038+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd27300 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.038+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.038+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.038+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.038+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.039+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.039+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x7f24f4017050 2024-04-26T07:54:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.039+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.039+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.039+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.039+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd27300 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.039+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.039+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.040+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.040+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd27300 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.040+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.040+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x7f24f4017050 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.040+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.040+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.040+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.040+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.041+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.041+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.041+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.041+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.042+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.042+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.042+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.042+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd27300 2024-04-26T07:54:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.042+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.042+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd27300 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.042+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.042+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.043+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.043+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.043+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.043+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x7f24f4017050 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.043+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.043+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd27300 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.043+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.043+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.044+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.044+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.044+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.044+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.044+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.044+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x7f24f4017050 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.044+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.044+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd30640 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.045+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.045+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd2bcb0 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.045+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.045+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x55753fd27300 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.045+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.045+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55753fd331d0 con 0x7f24f4017050 2024-04-26T07:54:36.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd2fb90 con 0x55753fd27300 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd2eb40 con 0x55753fd27300 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd2f500 con 0x55753fd27300 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 zone default found 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 4 Realm: () 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 zonegroup default 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.046+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd33b00 con 0x55753fd2bcb0 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd35d30 con 0x55753fd30640 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd360d0 con 0x55753fd30640 2024-04-26T07:54:36.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 20 started sync module instance, tier type = 2024-04-26T07:54:36.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:36.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.047+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd35170 con 0x7f24f4017050 2024-04-26T07:54:36.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.048+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.048+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93962070349424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd35170 con 0x7f24f4017050 2024-04-26T07:54:36.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.048+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd36a90 con 0x55753fd27300 2024-04-26T07:54:36.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.049+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93962070349424] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.050+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.050+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93962070353856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd35170 con 0x55753fd27300 2024-04-26T07:54:36.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.050+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd37520 con 0x55753fd30640 2024-04-26T07:54:36.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.051+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93962070353856] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.051+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.051+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93962070346944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd350e0 con 0x55753fd30640 2024-04-26T07:54:36.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.051+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd383e0 con 0x7f24f4017050 2024-04-26T07:54:36.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.052+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93962070346944] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.052+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.052+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93962070359856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd38800 con 0x7f24f4017050 2024-04-26T07:54:36.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.052+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd391c0 con 0x55753fd27300 2024-04-26T07:54:36.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.053+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.053+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93962070363408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd395e0 con 0x55753fd27300 2024-04-26T07:54:36.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.053+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3a0a0 con 0x55753fd2bcb0 2024-04-26T07:54:36.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.053+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93962070359856] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.054+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93962070363408] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.054+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.054+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93962070360912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd395e0 con 0x55753fd2bcb0 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.054+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3a940 con 0x55753fd2bcb0 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.055+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.055+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93962070369424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3ada0 con 0x55753fd2bcb0 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.055+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3b8c0 con 0x55753fd2bcb0 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.055+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93962070360912] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93962070369424] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93962070373264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3b880 con 0x55753fd2bcb0 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f2508413800 20 add_watcher() i=0 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f2508413800 20 add_watcher() i=1 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f2508413800 20 add_watcher() i=2 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f2508413800 20 add_watcher() i=3 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f2508413800 20 add_watcher() i=4 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f2508413800 20 add_watcher() i=5 2024-04-26T07:54:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.057+0000 7f2508413800 20 add_watcher() i=6 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.058+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93962070373264] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.058+0000 7f2508413800 20 add_watcher() i=7 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.058+0000 7f2508413800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.058+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd39130 con 0x55753fd27300 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.058+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.058+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93962070370480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd39130 con 0x55753fd27300 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.059+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93962070370480] v27'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.059+0000 7f23b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.059+0000 7f2508413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.059+0000 7f2508413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.059+0000 7f2508413800 5 note: GC not initialized 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.059+0000 7f23b8fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 20 Filter name: none 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f23327fc640 20 reqs_thread_entry: start 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd72010 con 0x55753fd27300 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 20 rados_obj.operate() r=0 bl.length=673 2024-04-26T07:54:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.060+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd78b30 con 0x55753fd27300 2024-04-26T07:54:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.061+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v27'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.061+0000 7f2508413800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.061+0000 7f2508413800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.061+0000 7f2508413800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.061+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93962070623712 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd742a0 con 0x55753fd27300 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 93962070363408 notify 115964117000 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55753fbf95f0 con 0x55753fd27300 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f23e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 93962070363408 notifier 4396 bl.length()=758 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f23e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f23e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 93962070623712 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f23e2ffd640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f23c8003ea0 con 0x55753fd27300 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 93962070623712 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f24f805ddd0 con 0x55753fd27300 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.062+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd785e0 con 0x55753fd27300 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.063+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 foo:foo1 [delete] v27'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.063+0000 7f2508413800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.063+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93962070623712 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55753fd73df0 con 0x7f24f4017050 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.063+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== watch-notify(notify (1) cookie 93962070349424 notify 115964116996 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f24f805ddd0 con 0x7f24f4017050 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.063+0000 7f23e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 93962070349424 notifier 4396 bl.length()=159 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.063+0000 7f23e2ffd640 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f23c8003ea0 con 0x7f24f4017050 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.063+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.0 [notify cookie 93962070623712 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.064+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.064+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== watch-notify(notify_complete (2) cookie 93962070623712 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f24f80775a0 con 0x7f24f4017050 2024-04-26T07:54:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T07:54:35.802982Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:36.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.064+0000 7f23b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.065+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93962070370480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd23fb0 con 0x55753fd27300 2024-04-26T07:54:36.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.065+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93962070370480] v27'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.065+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93962070349424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3a8b0 con 0x7f24f4017050 2024-04-26T07:54:36.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.066+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93962070349424] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.066+0000 7f2508413800 20 remove_watcher() i=0 2024-04-26T07:54:36.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.066+0000 7f2508413800 2 removed watcher, disabling cache 2024-04-26T07:54:36.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.066+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93962070353856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3a8b0 con 0x55753fd27300 2024-04-26T07:54:36.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.068+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93962070353856] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.068+0000 7f2508413800 20 remove_watcher() i=1 2024-04-26T07:54:36.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.068+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93962070346944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd367c0 con 0x55753fd30640 2024-04-26T07:54:36.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.069+0000 7f2503a6e640 1 -- 172.21.15.62:0/4207114924 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93962070346944] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f400dcd0 con 0x55753fd30640 2024-04-26T07:54:36.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.069+0000 7f2508413800 20 remove_watcher() i=2 2024-04-26T07:54:36.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.069+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93962070359856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3a8b0 con 0x7f24f4017050 2024-04-26T07:54:36.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.070+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93962070359856] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x7f24f4017050 2024-04-26T07:54:36.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.070+0000 7f2508413800 20 remove_watcher() i=3 2024-04-26T07:54:36.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.070+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93962070363408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd34cc0 con 0x55753fd27300 2024-04-26T07:54:36.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.071+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93962070363408] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f805a040 con 0x55753fd27300 2024-04-26T07:54:36.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.071+0000 7f2508413800 20 remove_watcher() i=4 2024-04-26T07:54:36.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.071+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93962070360912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd37f30 con 0x55753fd2bcb0 2024-04-26T07:54:36.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.072+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93962070360912] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.072+0000 7f2508413800 20 remove_watcher() i=5 2024-04-26T07:54:36.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.072+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93962070369424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd3a8b0 con 0x55753fd2bcb0 2024-04-26T07:54:36.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.073+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93962070369424] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.073+0000 7f2508413800 20 remove_watcher() i=6 2024-04-26T07:54:36.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.073+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93962070373264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55753fd38d10 con 0x55753fd2bcb0 2024-04-26T07:54:36.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.074+0000 7f250426f640 1 -- 172.21.15.62:0/4207114924 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93962070373264] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc02a070 con 0x55753fd2bcb0 2024-04-26T07:54:36.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 20 remove_watcher() i=7 2024-04-26T07:54:36.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fd2bcb0 msgr2=0x55753fd2e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fd2bcb0 0x55753fd2e0a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fd27300 msgr2=0x55753fd297c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fd27300 0x55753fd297c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f24f4017050 msgr2=0x7f24f40440d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f24f4017050 0x7f24f40440d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55753fd30640 msgr2=0x55753fd32b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55753fd30640 0x55753fd32b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23cc036eb0 msgr2=0x7f23cc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23cc036eb0 0x7f23cc039370 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24f401a6a0 tx=0x7f24f4033000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 msgr2=0x55753fd1b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd1b610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f24fc048010 tx=0x7f24fc04ce60 comp rx=0 tx=0).stop 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f250326d640 1 -- 172.21.15.62:0/4207114924 reap_dead start 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 shutdown_connections 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4207114924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd14090 0x55753fd1b610 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 >> 172.21.15.62:0/4207114924 conn(0x55753fd10310 msgr2=0x55753fd0d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 shutdown_connections 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4207114924 wait complete. 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4106227780 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23dc036eb0 msgr2=0x7f23dc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4106227780 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23dc036eb0 0x7f23dc039370 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55753fcf3240 tx=0x7f24f4041040 comp rx=0 tx=0).stop 2024-04-26T07:54:36.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4106227780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd06cf0 msgr2=0x55753fd07110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4106227780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd06cf0 0x55753fd07110 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55753fb65940 tx=0x7f24fc0188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4106227780 shutdown_connections 2024-04-26T07:54:36.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4106227780 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23dc036eb0 0x7f23dc039370 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 --2- 172.21.15.62:0/4106227780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fd06cf0 0x55753fd07110 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4106227780 >> 172.21.15.62:0/4106227780 conn(0x55753fcfad90 msgr2=0x55753fcfb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4106227780 shutdown_connections 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.075+0000 7f2508413800 1 -- 172.21.15.62:0/4106227780 wait complete. 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fcf5120 msgr2=0x55753fcf7510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fcf5120 0x55753fcf7510 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fbf5a00 msgr2=0x55753fcf27b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fbf5a00 0x55753fcf27b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23ec036e60 msgr2=0x7f23ec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23ec036e60 0x7f23ec039320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f24f8054000 tx=0x7f24f804e000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 msgr2=0x55753fb65f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fb65f50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f24f4001e30 tx=0x7f24f4000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 shutdown_connections 2024-04-26T07:54:36.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55753fbf5a00 0x55753fcf27b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55753fcf5120 0x55753fcf7510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f23ec036e60 0x7f23ec039320 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 --2- 172.21.15.62:0/1773855423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55753fbf1570 0x55753fb65f50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 >> 172.21.15.62:0/1773855423 conn(0x55753fbecbb0 msgr2=0x55753fcdcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 shutdown_connections 2024-04-26T07:54:36.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.076+0000 7f2508413800 1 -- 172.21.15.62:0/1773855423 wait complete. 2024-04-26T07:54:36.105 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T07:54:35.802982Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:36.106 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-26T07:54:36.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-26T07:54:36.106 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-04-26T07:54:36.150 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:36.151 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:36.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.153+0000 7f7c0d32d800 1 Processor -- start 2024-04-26T07:54:36.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.153+0000 7f7c0d32d800 1 -- start start 2024-04-26T07:54:36.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.153+0000 7f7c0d32d800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x556872675190 0x556872677580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.153+0000 7f7c0d32d800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55687267b5d0 con 0x556872677ac0 2024-04-26T07:54:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.153+0000 7f7c0d32d800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x556872516e20 con 0x556872675190 2024-04-26T07:54:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.153+0000 7f7c08f78640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x556872675190 0x556872677580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.153+0000 7f7c03fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x556872677ac0 0x556872679eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36608/0 (socket says 172.21.15.62:36608) 2024-04-26T07:54:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.153+0000 7f7c03fff640 1 -- 172.21.15.62:0/3247855673 learned_addr learned my addr 172.21.15.62:0/3247855673 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.154+0000 7f7c08f78640 1 -- 172.21.15.62:0/3247855673 >> v1:172.21.15.1:6789/0 conn(0x556872677ac0 legacy=0x556872679eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.154+0000 7f7c08f78640 1 -- 172.21.15.62:0/3247855673 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687267c7b0 con 0x556872675190 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c08f78640 1 --2- 172.21.15.62:0/3247855673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872677580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00a470 tx=0x7f7bfc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28edace17466413 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c037fe640 1 -- 172.21.15.62:0/3247855673 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc057070 con 0x556872675190 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c037fe640 1 -- 172.21.15.62:0/3247855673 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc052570 con 0x556872675190 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c037fe640 1 -- 172.21.15.62:0/3247855673 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc052870 con 0x556872675190 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3247855673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 msgr2=0x556872677580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3247855673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872677580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00a470 tx=0x7f7bfc01ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3247855673 shutdown_connections 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3247855673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872677580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3247855673 >> 172.21.15.62:0/3247855673 conn(0x55687266eb80 msgr2=0x556872670fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3247855673 shutdown_connections 2024-04-26T07:54:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.156+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3247855673 wait complete. 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.169+0000 7f7c0d32d800 1 Processor -- start 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.169+0000 7f7c0d32d800 1 -- start start 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.169+0000 7f7c0d32d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872765c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.169+0000 7f7c0d32d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5568725bfcd0 con 0x556872675190 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.170+0000 7f7c08f78640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872765c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.170+0000 7f7c08f78640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872765c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33284/0 (socket says 172.21.15.62:33284) 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.170+0000 7f7c08f78640 1 -- 172.21.15.62:0/3062618947 learned_addr learned my addr 172.21.15.62:0/3062618947 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.170+0000 7f7c08f78640 1 -- 172.21.15.62:0/3062618947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556872766210 con 0x556872675190 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.170+0000 7f7c08f78640 1 --2- 172.21.15.62:0/3062618947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872765c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc055040 tx=0x7f7bfc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56d6d9bf0bc50fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.170+0000 7f7af6e05640 1 -- 172.21.15.62:0/3062618947 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc057040 con 0x556872675190 2024-04-26T07:54:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.170+0000 7f7af6e05640 1 -- 172.21.15.62:0/3062618947 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc052990 con 0x556872675190 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.170+0000 7f7af6e05640 1 -- 172.21.15.62:0/3062618947 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc052c70 con 0x556872675190 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.171+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3062618947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 msgr2=0x556872765c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.171+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3062618947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872765c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc055040 tx=0x7f7bfc04c000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.171+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3062618947 shutdown_connections 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.171+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3062618947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872765c40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.171+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3062618947 >> 172.21.15.62:0/3062618947 conn(0x55687266eb80 msgr2=0x556872761560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.171+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3062618947 shutdown_connections 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.171+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3062618947 wait complete. 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.171+0000 7f7c0d32d800 1 Processor -- start 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.172+0000 7f7c0d32d800 1 -- start start 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.172+0000 7f7c0d32d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872674a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.172+0000 7f7c0d32d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55687267ba40 con 0x556872675190 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.172+0000 7f7c08f78640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872674a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.172+0000 7f7c08f78640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872674a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33298/0 (socket says 172.21.15.62:33298) 2024-04-26T07:54:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.172+0000 7f7c08f78640 1 -- 172.21.15.62:0/3379757506 learned_addr learned my addr 172.21.15.62:0/3379757506 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.172+0000 7f7c08f78640 1 -- 172.21.15.62:0/3379757506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556872674fc0 con 0x556872675190 2024-04-26T07:54:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.172+0000 7f7c08f78640 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872674a80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00a470 tx=0x7f7bfc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.173+0000 7f7af5602640 1 -- 172.21.15.62:0/3379757506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc073070 con 0x556872675190 2024-04-26T07:54:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.173+0000 7f7af5602640 1 -- 172.21.15.62:0/3379757506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc05d650 con 0x556872675190 2024-04-26T07:54:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.173+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568726731c0 con 0x556872675190 2024-04-26T07:54:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.173+0000 7f7af5602640 1 -- 172.21.15.62:0/3379757506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc057070 con 0x556872675190 2024-04-26T07:54:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.173+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568726736e0 con 0x556872675190 2024-04-26T07:54:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.173+0000 7f7af5602640 1 -- 172.21.15.62:0/3379757506 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7bfc076070 con 0x556872675190 2024-04-26T07:54:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7af5602640 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7af0036e60 0x7f7af0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7af5602640 1 -- 172.21.15.62:0/3379757506 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f7bfc08e5f0 con 0x556872675190 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7c03fff640 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7af0036e60 0x7f7af0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556872677ac0 0x556872776ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556872777090 con 0x556872677ac0 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7c09779640 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556872677ac0 0x556872776ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7c03fff640 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7af0036e60 0x7f7af0039320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4001d90 tx=0x7f7bf40012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7c09779640 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556872677ac0 0x556872776ac0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.174+0000 7f7c09779640 1 -- 172.21.15.62:0/3379757506 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c0400a4a0 con 0x556872677ac0 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.175+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556872777910 con 0x556872677ac0 2024-04-26T07:54:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.175+0000 7f7c09779640 1 -- 172.21.15.62:0/3379757506 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c0400a4a0 con 0x556872677ac0 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.175+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556872779220 0x55687277b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.175+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55687277be40 con 0x556872779220 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.175+0000 7f7c08f78640 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556872779220 0x55687277b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.175+0000 7f7c08f78640 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556872779220 0x55687277b6b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.176+0000 7f7c08f78640 1 -- 172.21.15.62:0/3379757506 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7bfc075030 con 0x556872779220 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.176+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556872778190 con 0x556872677ac0 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.176+0000 7f7c09779640 1 -- 172.21.15.62:0/3379757506 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c0400a4a0 con 0x556872677ac0 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.176+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556872778670 con 0x556872677ac0 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.176+0000 7f7c09779640 1 -- 172.21.15.62:0/3379757506 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c0400a4a0 con 0x556872677ac0 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.177+0000 7f7c0d32d800 1 Processor -- start 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.177+0000 7f7c0d32d800 1 -- start start 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.177+0000 7f7c0d32d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687278aff0 0x55687278b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.177+0000 7f7c0d32d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556872567170 con 0x55687278aff0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.177+0000 7f7c09779640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687278aff0 0x55687278b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.177+0000 7f7c09779640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687278aff0 0x55687278b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33308/0 (socket says 172.21.15.62:33308) 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.177+0000 7f7c09779640 1 -- 172.21.15.62:0/1858201026 learned_addr learned my addr 172.21.15.62:0/1858201026 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.177+0000 7f7c09779640 1 -- 172.21.15.62:0/1858201026 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687278b950 con 0x55687278aff0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.178+0000 7f7c09779640 1 --2- 172.21.15.62:0/1858201026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687278aff0 0x55687278b410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x556872674470 tx=0x7f7c040188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.178+0000 7f7aee7fc640 1 -- 172.21.15.62:0/1858201026 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c04014450 con 0x55687278aff0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.178+0000 7f7aee7fc640 1 -- 172.21.15.62:0/1858201026 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c040145f0 con 0x55687278aff0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.178+0000 7f7c0d32d800 1 -- 172.21.15.62:0/1858201026 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55687278c3c0 con 0x55687278aff0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.178+0000 7f7aee7fc640 1 -- 172.21.15.62:0/1858201026 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c040148d0 con 0x55687278aff0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.178+0000 7f7c0d32d800 1 -- 172.21.15.62:0/1858201026 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55687278c8c0 con 0x55687278aff0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.178+0000 7f7aee7fc640 1 -- 172.21.15.62:0/1858201026 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7c04011040 con 0x55687278aff0 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7aee7fc640 1 --2- 172.21.15.62:0/1858201026 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ae0036eb0 0x7f7ae0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7aee7fc640 1 -- 172.21.15.62:0/1858201026 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f7c0401e070 con 0x55687278aff0 2024-04-26T07:54:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c08f78640 1 --2- 172.21.15.62:0/1858201026 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ae0036eb0 0x7f7ae0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c0d32d800 1 Processor -- start 2024-04-26T07:54:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c0d32d800 1 -- start start 2024-04-26T07:54:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c08f78640 1 --2- 172.21.15.62:0/1858201026 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ae0036eb0 0x7f7ae0039370 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x556872673ce0 tx=0x7f7bfc05ee80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c0d32d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x5568727986d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c0d32d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5568727664d0 con 0x5568727982b0 2024-04-26T07:54:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c09779640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x5568727986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c09779640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x5568727986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33324/0 (socket says 172.21.15.62:33324) 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.179+0000 7f7c09779640 1 -- 172.21.15.62:0/3526625081 learned_addr learned my addr 172.21.15.62:0/3526625081 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c09779640 1 -- 172.21.15.62:0/3526625081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556872798ca0 con 0x5568727982b0 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c09779640 1 --2- 172.21.15.62:0/3526625081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x5568727986d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7c0404cf00 tx=0x7f7c04011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9cdae7095de7f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7adffff640 1 -- 172.21.15.62:0/3526625081 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c040411b0 con 0x5568727982b0 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7adffff640 1 -- 172.21.15.62:0/3526625081 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c04013c90 con 0x5568727982b0 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7adffff640 1 -- 172.21.15.62:0/3526625081 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0402ba60 con 0x5568727982b0 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3526625081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 msgr2=0x5568727986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3526625081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x5568727986d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7c0404cf00 tx=0x7f7c04011700 comp rx=0 tx=0).stop 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3526625081 shutdown_connections 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3526625081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x5568727986d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3526625081 >> 172.21.15.62:0/3526625081 conn(0x556872794610 msgr2=0x556872792670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3526625081 shutdown_connections 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.180+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3526625081 wait complete. 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.181+0000 7f7c0d32d800 1 Processor -- start 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.181+0000 7f7c0d32d800 1 -- start start 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.181+0000 7f7c0d32d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x55687279f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.181+0000 7f7c0d32d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556872799410 con 0x5568727982b0 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.181+0000 7f7c09779640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x55687279f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.181+0000 7f7c09779640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x55687279f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33338/0 (socket says 172.21.15.62:33338) 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.181+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 learned_addr learned my addr 172.21.15.62:0/2745410980 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.181+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687279fdc0 con 0x5568727982b0 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.182+0000 7f7c09779640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x55687279f880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7c04048010 tx=0x7f7c0404ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.182+0000 7f7ade7fc640 1 -- 172.21.15.62:0/2745410980 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c04013e40 con 0x5568727982b0 2024-04-26T07:54:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.182+0000 7f7ade7fc640 1 -- 172.21.15.62:0/2745410980 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0402b560 con 0x5568727982b0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.182+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568727a0050 con 0x5568727982b0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.182+0000 7f7ade7fc640 1 -- 172.21.15.62:0/2745410980 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0404e340 con 0x5568727982b0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.182+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568727a2d00 con 0x5568727982b0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.182+0000 7f7ade7fc640 1 -- 172.21.15.62:0/2745410980 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7c0404ebe0 con 0x5568727982b0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.183+0000 7f7ade7fc640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ad4036eb0 0x7f7ad4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.183+0000 7f7ade7fc640 1 -- 172.21.15.62:0/2745410980 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f7c0400e040 con 0x5568727982b0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.183+0000 7f7c08f78640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ad4036eb0 0x7f7ad4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.183+0000 7f7c08f78640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ad4036eb0 0x7f7ad4039370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc05cfd0 tx=0x7f7bfc06f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.183+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.183+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5568727ab5a0 0x5568727ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.183+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727ae1b0 con 0x5568727ab5a0 2024-04-26T07:54:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c03fff640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5568727ab5a0 0x5568727ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c03fff640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5568727ab5a0 0x5568727ada60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf4009050 con 0x5568727ab5a0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 20 realm 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727aa9f0 con 0x5568727ab5a0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf4009050 con 0x5568727ab5a0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727aeca0 con 0x5568727ab5a0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf4009050 con 0x5568727ab5a0 2024-04-26T07:54:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.184+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.185+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727af570 con 0x5568727ab5a0 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.185+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7bf4009050 con 0x5568727ab5a0 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.185+0000 7f7c0d32d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.185+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.185+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5568727afe60 0x5568727b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.185+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727b2a40 con 0x5568727afe60 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.185+0000 7f7c09779640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5568727afe60 0x5568727b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.186+0000 7f7c09779640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5568727afe60 0x5568727b22b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.186+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.186+0000 7f7c0d32d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.186+0000 7f7c0d32d800 20 searching for the correct realm 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.186+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5568727b4a10 0x5568727b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.186+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.186+0000 7f7c08f78640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5568727b4a10 0x5568727b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.186+0000 7f7c08f78640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5568727b4a10 0x5568727b6ed0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.187+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.187+0000 7f7c08f78640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7bfc09a040 0x7f7bfc08e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.187+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x7f7bfc09a040 2024-04-26T07:54:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.187+0000 7f7c03fff640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7bfc09a040 0x7f7bfc08e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.187+0000 7f7c03fff640 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7bfc09a040 0x7f7bfc08e9d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.187+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4009050 con 0x7f7bfc09a040 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.188+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.188+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.188+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727ab5a0 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.188+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4009050 con 0x5568727ab5a0 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.188+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727ab5a0 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.188+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.188+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.189+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.189+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.189+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.189+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x7f7bfc09a040 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.189+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4029040 con 0x7f7bfc09a040 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.189+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.190+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.190+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727ab5a0 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.190+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.190+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.190+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.190+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727ab5a0 2024-04-26T07:54:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.190+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.190+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x7f7bfc09a040 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.191+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7bf4029040 con 0x7f7bfc09a040 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.191+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.191+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.191+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.191+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.191+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727ab5a0 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727ab5a0 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.192+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.193+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.193+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.193+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.193+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x7f7bfc09a040 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.193+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4029040 con 0x7f7bfc09a040 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.193+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727ab5a0 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.194+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.194+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.194+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.194+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.194+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.194+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.195+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.195+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x7f7bfc09a040 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.195+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4029040 con 0x7f7bfc09a040 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.195+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727b4a10 2024-04-26T07:54:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.195+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.195+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727afe60 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x5568727ab5a0 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568727b75a0 con 0x7f7bfc09a040 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf4029040 con 0x7f7bfc09a040 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727b3400 con 0x5568727ab5a0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.196+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727b3ca0 con 0x5568727ab5a0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727b3040 con 0x5568727ab5a0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7bf4029040 con 0x5568727ab5a0 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 20 zone default found 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 4 Realm: () 2024-04-26T07:54:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 20 zonegroup default 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727b7a40 con 0x5568727afe60 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.197+0000 7f7c0d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727b9d10 con 0x5568727b4a10 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727ba0b0 con 0x5568727b4a10 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 20 started sync module instance, tier type = 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.198+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727b91a0 con 0x7f7bfc09a040 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.199+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x7f7bfc09a040 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.199+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93907085661936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727b91a0 con 0x7f7bfc09a040 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.199+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bab20 con 0x5568727ab5a0 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.200+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.200+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93907085661936] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x7f7bfc09a040 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.200+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93907085665840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727baad0 con 0x5568727ab5a0 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.200+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727b8d10 con 0x5568727b4a10 2024-04-26T07:54:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.201+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93907085665840] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.201+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.201+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93907085668112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bba90 con 0x5568727b4a10 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.201+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bc380 con 0x7f7bfc09a040 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.202+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93907085668112] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.202+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x7f7bfc09a040 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.202+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93907085671984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bc770 con 0x7f7bfc09a040 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.202+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bd1d0 con 0x5568727ab5a0 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.203+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93907085671984] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x7f7bfc09a040 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.205+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.205+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93907085669856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bd1d0 con 0x5568727ab5a0 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.205+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bdbe0 con 0x5568727afe60 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.206+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93907085669856] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.206+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.206+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93907085678384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bdfd0 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.206+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727be990 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.207+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.207+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93907085681888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bee10 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.207+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bf930 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.207+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93907085678384] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93907085681888] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93907085682944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bccb0 con 0x5568727afe60 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c0d32d800 20 add_watcher() i=0 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c0d32d800 20 add_watcher() i=1 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c0d32d800 20 add_watcher() i=2 2024-04-26T07:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c0d32d800 20 add_watcher() i=3 2024-04-26T07:54:36.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c0d32d800 20 add_watcher() i=4 2024-04-26T07:54:36.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c0d32d800 20 add_watcher() i=5 2024-04-26T07:54:36.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.208+0000 7f7c0d32d800 20 add_watcher() i=6 2024-04-26T07:54:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.209+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93907085682944] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.209+0000 7f7c0d32d800 20 add_watcher() i=7 2024-04-26T07:54:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.209+0000 7f7c0d32d800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.209+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727c2920 con 0x5568727ab5a0 2024-04-26T07:54:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.210+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.210+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93907085685760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bfda0 con 0x5568727ab5a0 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93907085685760] v27'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7abefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c0d32d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c0d32d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c0d32d800 5 note: GC not initialized 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7abdfe3640 20 reqs_thread_entry: start 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c0d32d800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c0d32d800 20 Filter name: none 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7a2f7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c0d32d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c0d32d800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.211+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727f5fe0 con 0x5568727ab5a0 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.212+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.212+0000 7f7c0d32d800 20 rados_obj.operate() r=0 bl.length=582 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.212+0000 7f7c0d32d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.212+0000 7f7c0d32d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.212+0000 7f7c0d32d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.212+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727fc620 con 0x5568727ab5a0 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v27'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7c0d32d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7c0d32d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7c0d32d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93907085934736 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568727f7fa0 con 0x5568727ab5a0 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 93907085669856 notify 115964117001 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55687267b5d0 con 0x5568727ab5a0 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7adffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 93907085669856 notifier 4403 bl.length()=732 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7adffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:36.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7adffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 93907085934736 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.213+0000 7f7adffff640 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f7acc003ea0 con 0x5568727ab5a0 2024-04-26T07:54:36.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.214+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.214+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 93907085934736 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7bf402d740 con 0x5568727ab5a0 2024-04-26T07:54:36.225 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T07:54:35.802982Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.215+0000 7f7abefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.215+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93907085685760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727c1f40 con 0x5568727ab5a0 2024-04-26T07:54:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.216+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93907085685760] v27'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.216+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93907085661936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bf400 con 0x7f7bfc09a040 2024-04-26T07:54:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.217+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93907085661936] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x7f7bfc09a040 2024-04-26T07:54:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.217+0000 7f7c0d32d800 20 remove_watcher() i=0 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.217+0000 7f7c0d32d800 2 removed watcher, disabling cache 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.217+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93907085665840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bf400 con 0x5568727ab5a0 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.218+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93907085665840] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.218+0000 7f7c0d32d800 20 remove_watcher() i=1 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.218+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93907085668112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bf400 con 0x5568727b4a10 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.219+0000 7f7c08f78640 1 -- 172.21.15.62:0/2745410980 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93907085668112] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bfc097070 con 0x5568727b4a10 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.219+0000 7f7c0d32d800 20 remove_watcher() i=2 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.219+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93907085671984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727ba630 con 0x7f7bfc09a040 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.220+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93907085671984] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x7f7bfc09a040 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.220+0000 7f7c0d32d800 20 remove_watcher() i=3 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.220+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93907085669856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727ba630 con 0x5568727ab5a0 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.221+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93907085669856] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf4039040 con 0x5568727ab5a0 2024-04-26T07:54:36.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.221+0000 7f7c0d32d800 20 remove_watcher() i=4 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.221+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93907085678384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727bb5e0 con 0x5568727afe60 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.222+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93907085678384] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.222+0000 7f7c0d32d800 20 remove_watcher() i=5 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.222+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93907085681888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727ba630 con 0x5568727afe60 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.223+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93907085681888] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.223+0000 7f7c0d32d800 20 remove_watcher() i=6 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.223+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93907085682944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568727be4e0 con 0x5568727afe60 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c09779640 1 -- 172.21.15.62:0/2745410980 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93907085682944] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c04056040 con 0x5568727afe60 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 20 remove_watcher() i=7 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5568727afe60 msgr2=0x5568727b22b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5568727afe60 0x5568727b22b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5568727ab5a0 msgr2=0x5568727ada60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5568727ab5a0 0x5568727ada60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7bfc09a040 msgr2=0x7f7bfc08e9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7bfc09a040 0x7f7bfc08e9d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5568727b4a10 msgr2=0x5568727b6ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5568727b4a10 0x5568727b6ed0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ad4036eb0 msgr2=0x7f7ad4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ad4036eb0 0x7f7ad4039370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc05cfd0 tx=0x7f7bfc06f000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 msgr2=0x55687279f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c03fff640 1 -- 172.21.15.62:0/2745410980 reap_dead start 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x55687279f880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7c04048010 tx=0x7f7c0404ce60 comp rx=0 tx=0).stop 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 shutdown_connections 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/2745410980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5568727982b0 0x55687279f880 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 >> 172.21.15.62:0/2745410980 conn(0x556872794610 msgr2=0x556872791c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 shutdown_connections 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.224+0000 7f7c0d32d800 1 -- 172.21.15.62:0/2745410980 wait complete. 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/1858201026 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ae0036eb0 msgr2=0x7f7ae0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/1858201026 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ae0036eb0 0x7f7ae0039370 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x556872673ce0 tx=0x7f7bfc05ee80 comp rx=0 tx=0).stop 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/1858201026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687278aff0 msgr2=0x55687278b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/1858201026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687278aff0 0x55687278b410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x556872674470 tx=0x7f7c040188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/1858201026 shutdown_connections 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/1858201026 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7ae0036eb0 0x7f7ae0039370 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/1858201026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55687278aff0 0x55687278b410 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/1858201026 >> 172.21.15.62:0/1858201026 conn(0x55687277f090 msgr2=0x55687277f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/1858201026 shutdown_connections 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/1858201026 wait complete. 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556872779220 msgr2=0x55687277b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556872779220 0x55687277b6b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556872677ac0 msgr2=0x556872776ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556872677ac0 0x556872776ac0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7af0036e60 msgr2=0x7f7af0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7af0036e60 0x7f7af0039320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4001d90 tx=0x7f7bf40012f0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 msgr2=0x556872674a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872674a80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00a470 tx=0x7f7bfc003020 comp rx=0 tx=0).stop 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 shutdown_connections 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556872677ac0 0x556872776ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x556872779220 0x55687277b6b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7af0036e60 0x7f7af0039320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 --2- 172.21.15.62:0/3379757506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556872675190 0x556872674a80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 >> 172.21.15.62:0/3379757506 conn(0x55687266eb80 msgr2=0x55687275fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 shutdown_connections 2024-04-26T07:54:36.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.225+0000 7f7c0d32d800 1 -- 172.21.15.62:0/3379757506 wait complete. 2024-04-26T07:54:36.236 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T07:54:35.802982Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:36.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-26T07:54:36.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-26T07:54:36.237 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-04-26T07:54:36.284 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:36.284 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:36.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31ca40e800 1 Processor -- start 2024-04-26T07:54:36.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31ca40e800 1 -- start start 2024-04-26T07:54:36.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31ca40e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ab8dc85bb0 0x55ab8dc87fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31ca40e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab8dc88570 con 0x55ab8dc7f990 2024-04-26T07:54:36.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31ca40e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55ab8db23e20 con 0x55ab8dc85bb0 2024-04-26T07:54:36.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31c770c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ab8dc85bb0 0x55ab8dc87fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31c7f0d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55ab8dc7f990 0x55ab8dc7fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36618/0 (socket says 172.21.15.62:36618) 2024-04-26T07:54:36.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31c770c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ab8dc85bb0 0x55ab8dc87fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33340/0 (socket says 172.21.15.62:33340) 2024-04-26T07:54:36.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.287+0000 7f31c7f0d640 1 -- 172.21.15.62:0/2244191207 learned_addr learned my addr 172.21.15.62:0/2244191207 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:36.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.288+0000 7f31c770c640 1 -- 172.21.15.62:0/2244191207 >> v1:172.21.15.1:6789/0 conn(0x55ab8dc7f990 legacy=0x55ab8dc7fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.288+0000 7f31c770c640 1 -- 172.21.15.62:0/2244191207 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8dc89750 con 0x55ab8dc85bb0 2024-04-26T07:54:36.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.288+0000 7f31c6f0b640 1 -- 172.21.15.62:0/2244191207 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662658477 0 0) 0x55ab8dc88570 con 0x55ab8dc7f990 2024-04-26T07:54:36.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31c770c640 1 --2- 172.21.15.62:0/2244191207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc85bb0 0x55ab8dc87fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31b000a470 tx=0x7f31b001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330fed7869200602 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31c6f0b640 1 -- 172.21.15.62:0/2244191207 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b0057070 con 0x55ab8dc85bb0 2024-04-26T07:54:36.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31c6f0b640 1 -- 172.21.15.62:0/2244191207 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b0052570 con 0x55ab8dc85bb0 2024-04-26T07:54:36.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31c6f0b640 1 -- 172.21.15.62:0/2244191207 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b0052870 con 0x55ab8dc85bb0 2024-04-26T07:54:36.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31ca40e800 1 -- 172.21.15.62:0/2244191207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc85bb0 msgr2=0x55ab8dc87fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2244191207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc85bb0 0x55ab8dc87fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31b000a470 tx=0x7f31b001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:36.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31ca40e800 1 -- 172.21.15.62:0/2244191207 shutdown_connections 2024-04-26T07:54:36.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2244191207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc85bb0 0x55ab8dc87fa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31ca40e800 1 -- 172.21.15.62:0/2244191207 >> 172.21.15.62:0/2244191207 conn(0x55ab8dc7b340 msgr2=0x55ab8dc7d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31ca40e800 1 -- 172.21.15.62:0/2244191207 shutdown_connections 2024-04-26T07:54:36.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.290+0000 7f31ca40e800 1 -- 172.21.15.62:0/2244191207 wait complete. 2024-04-26T07:54:36.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.303+0000 7f31ca40e800 1 Processor -- start 2024-04-26T07:54:36.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.303+0000 7f31ca40e800 1 -- start start 2024-04-26T07:54:36.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.303+0000 7f31ca40e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dc822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.303+0000 7f31ca40e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab8dbcccf0 con 0x55ab8dc7f990 2024-04-26T07:54:36.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.304+0000 7f31c7f0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dc822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.304+0000 7f31c7f0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dc822c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33342/0 (socket says 172.21.15.62:33342) 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.304+0000 7f31c7f0d640 1 -- 172.21.15.62:0/1644284303 learned_addr learned my addr 172.21.15.62:0/1644284303 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.304+0000 7f31c7f0d640 1 -- 172.21.15.62:0/1644284303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8dc80880 con 0x55ab8dc7f990 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.304+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/1644284303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dc822c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f31b800b210 tx=0x7f31b800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f2fe14c64549ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.304+0000 7f30b5e0b640 1 -- 172.21.15.62:0/1644284303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8008070 con 0x55ab8dc7f990 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.304+0000 7f30b5e0b640 1 -- 172.21.15.62:0/1644284303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b800d500 con 0x55ab8dc7f990 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.304+0000 7f30b5e0b640 1 -- 172.21.15.62:0/1644284303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b800d840 con 0x55ab8dc7f990 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 -- 172.21.15.62:0/1644284303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 msgr2=0x55ab8dc822c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 --2- 172.21.15.62:0/1644284303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dc822c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f31b800b210 tx=0x7f31b800b6d0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 -- 172.21.15.62:0/1644284303 shutdown_connections 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 --2- 172.21.15.62:0/1644284303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dc822c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 -- 172.21.15.62:0/1644284303 >> 172.21.15.62:0/1644284303 conn(0x55ab8dc7b340 msgr2=0x55ab8dd6e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 -- 172.21.15.62:0/1644284303 shutdown_connections 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 -- 172.21.15.62:0/1644284303 wait complete. 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 Processor -- start 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.305+0000 7f31ca40e800 1 -- start start 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f31ca40e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dd7c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f31ca40e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab8dc88a10 con 0x55ab8dc7f990 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f31c7f0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dd7c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f31c7f0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dd7c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33352/0 (socket says 172.21.15.62:33352) 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f31c7f0d640 1 -- 172.21.15.62:0/2131371977 learned_addr learned my addr 172.21.15.62:0/2131371977 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f31c7f0d640 1 -- 172.21.15.62:0/2131371977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8dd7cdb0 con 0x55ab8dc7f990 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dd7c870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f31b8001e60 tx=0x7f31b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f30affff640 1 -- 172.21.15.62:0/2131371977 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8019870 con 0x55ab8dc7f990 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f30affff640 1 -- 172.21.15.62:0/2131371977 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8019a10 con 0x55ab8dc7f990 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f30affff640 1 -- 172.21.15.62:0/2131371977 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8019cf0 con 0x55ab8dc7f990 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.306+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab8dd7d040 con 0x55ab8dc7f990 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.307+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab8dd7fcf0 con 0x55ab8dc7f990 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.307+0000 7f30affff640 1 -- 172.21.15.62:0/2131371977 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f31b8017040 con 0x55ab8dc7f990 2024-04-26T07:54:36.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.307+0000 7f30affff640 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30b0036eb0 0x7f30b0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.307+0000 7f30affff640 1 -- 172.21.15.62:0/2131371977 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f31b8015020 con 0x55ab8dc7f990 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.308+0000 7f31c770c640 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30b0036eb0 0x7f30b0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.308+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8dc85bb0 0x55ab8dd83ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.308+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8dd84040 con 0x55ab8dc85bb0 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.308+0000 7f31c870e640 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8dc85bb0 0x55ab8dd83ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.308+0000 7f31c770c640 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30b0036eb0 0x7f30b0039370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31b0054000 tx=0x7f31b004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.308+0000 7f31c870e640 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8dc85bb0 0x55ab8dd83ab0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.308+0000 7f31c870e640 1 -- 172.21.15.62:0/2131371977 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c000a4a0 con 0x55ab8dc85bb0 2024-04-26T07:54:36.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.308+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8dd81060 con 0x55ab8dc85bb0 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.309+0000 7f31c870e640 1 -- 172.21.15.62:0/2131371977 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31c000a4a0 con 0x55ab8dc85bb0 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.309+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8dd86370 0x55ab8dd88760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.309+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8dd88e00 con 0x55ab8dd86370 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.309+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8dd86370 0x55ab8dd88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.309+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8dd86370 0x55ab8dd88760 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.310+0000 7f31c7f0d640 1 -- 172.21.15.62:0/2131371977 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8dd86370 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.310+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8dd85320 con 0x55ab8dc85bb0 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.310+0000 7f31c870e640 1 -- 172.21.15.62:0/2131371977 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31c000a4a0 con 0x55ab8dc85bb0 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.310+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8dd85800 con 0x55ab8dc85bb0 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.310+0000 7f31c870e640 1 -- 172.21.15.62:0/2131371977 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31c000a4a0 con 0x55ab8dc85bb0 2024-04-26T07:54:36.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31ca40e800 1 Processor -- start 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31ca40e800 1 -- start start 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31ca40e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dd97f40 0x55ab8dd98360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31ca40e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab8db74170 con 0x55ab8dd97f40 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31c870e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dd97f40 0x55ab8dd98360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31c870e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dd97f40 0x55ab8dd98360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33368/0 (socket says 172.21.15.62:33368) 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31c870e640 1 -- 172.21.15.62:0/1905546648 learned_addr learned my addr 172.21.15.62:0/1905546648 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31c870e640 1 -- 172.21.15.62:0/1905546648 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8dd988a0 con 0x55ab8dd97f40 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.311+0000 7f31c870e640 1 --2- 172.21.15.62:0/1905546648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dd97f40 0x55ab8dd98360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55ab8dd7d740 tx=0x7f31c00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.312+0000 7f30ad7fa640 1 -- 172.21.15.62:0/1905546648 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c0014450 con 0x55ab8dd97f40 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.312+0000 7f30ad7fa640 1 -- 172.21.15.62:0/1905546648 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c00145f0 con 0x55ab8dd97f40 2024-04-26T07:54:36.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.312+0000 7f30ad7fa640 1 -- 172.21.15.62:0/1905546648 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c00148d0 con 0x55ab8dd97f40 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.312+0000 7f31ca40e800 1 -- 172.21.15.62:0/1905546648 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab8dd99310 con 0x55ab8dd97f40 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.312+0000 7f31ca40e800 1 -- 172.21.15.62:0/1905546648 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab8dd99810 con 0x55ab8dd97f40 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.312+0000 7f30ad7fa640 1 -- 172.21.15.62:0/1905546648 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f31c0011040 con 0x55ab8dd97f40 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.312+0000 7f30ad7fa640 1 --2- 172.21.15.62:0/1905546648 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30a0036eb0 0x7f30a0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f30ad7fa640 1 -- 172.21.15.62:0/1905546648 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f31c001e070 con 0x55ab8dd97f40 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/1905546648 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30a0036eb0 0x7f30a0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31ca40e800 1 Processor -- start 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31ca40e800 1 -- start start 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/1905546648 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30a0036eb0 0x7f30a0039370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55ab8dd844b0 tx=0x7f31b8000fe0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31ca40e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8dda5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31ca40e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab8dc80c00 con 0x55ab8dda5270 2024-04-26T07:54:36.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31c870e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8dda5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31c870e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8dda5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33382/0 (socket says 172.21.15.62:33382) 2024-04-26T07:54:36.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.313+0000 7f31c870e640 1 -- 172.21.15.62:0/877236170 learned_addr learned my addr 172.21.15.62:0/877236170 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31c870e640 1 -- 172.21.15.62:0/877236170 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8dda5c60 con 0x55ab8dda5270 2024-04-26T07:54:36.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31c870e640 1 --2- 172.21.15.62:0/877236170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8dda5690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f31c004cf00 tx=0x7f31c0016a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e5f0143e54ab33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f30a6ffd640 1 -- 172.21.15.62:0/877236170 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c0013c90 con 0x55ab8dda5270 2024-04-26T07:54:36.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f30a6ffd640 1 -- 172.21.15.62:0/877236170 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c0013e30 con 0x55ab8dda5270 2024-04-26T07:54:36.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f30a6ffd640 1 -- 172.21.15.62:0/877236170 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c002bb90 con 0x55ab8dda5270 2024-04-26T07:54:36.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31ca40e800 1 -- 172.21.15.62:0/877236170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 msgr2=0x55ab8dda5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31ca40e800 1 --2- 172.21.15.62:0/877236170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8dda5690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f31c004cf00 tx=0x7f31c0016a90 comp rx=0 tx=0).stop 2024-04-26T07:54:36.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31ca40e800 1 -- 172.21.15.62:0/877236170 shutdown_connections 2024-04-26T07:54:36.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31ca40e800 1 --2- 172.21.15.62:0/877236170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8dda5690 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31ca40e800 1 -- 172.21.15.62:0/877236170 >> 172.21.15.62:0/877236170 conn(0x55ab8dda1580 msgr2=0x55ab8dd9f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31ca40e800 1 -- 172.21.15.62:0/877236170 shutdown_connections 2024-04-26T07:54:36.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.314+0000 7f31ca40e800 1 -- 172.21.15.62:0/877236170 wait complete. 2024-04-26T07:54:36.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31ca40e800 1 Processor -- start 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31ca40e800 1 -- start start 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31ca40e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8ddac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31ca40e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab8dda63b0 con 0x55ab8dda5270 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31c870e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8ddac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31c870e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8ddac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33384/0 (socket says 172.21.15.62:33384) 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 learned_addr learned my addr 172.21.15.62:0/254222600 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8ddacd40 con 0x55ab8dda5270 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.315+0000 7f31c870e640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8ddac800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f31c004bdf0 tx=0x7f31c004ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.316+0000 7f30a57fa640 1 -- 172.21.15.62:0/254222600 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c002b560 con 0x55ab8dda5270 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.316+0000 7f30a57fa640 1 -- 172.21.15.62:0/254222600 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c002b700 con 0x55ab8dda5270 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.316+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab8ddacfd0 con 0x55ab8dda5270 2024-04-26T07:54:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.316+0000 7f30a57fa640 1 -- 172.21.15.62:0/254222600 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c00133b0 con 0x55ab8dda5270 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.316+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab8ddafc80 con 0x55ab8dda5270 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.316+0000 7f30a57fa640 1 -- 172.21.15.62:0/254222600 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f31c004ebe0 con 0x55ab8dda5270 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.316+0000 7f30a57fa640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3090036eb0 0x7f3090039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.317+0000 7f30a57fa640 1 -- 172.21.15.62:0/254222600 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f31c000e040 con 0x55ab8dda5270 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.317+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3090036eb0 0x7f3090039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.317+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3090036eb0 0x7f3090039370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31b801a530 tx=0x7f31b8033040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.317+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.317+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8ddb8440 0x55ab8ddba900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.317+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddbb050 con 0x55ab8ddb8440 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.317+0000 7f31c770c640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8ddb8440 0x55ab8ddba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31c770c640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8ddb8440 0x55ab8ddba900 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 20 realm 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddbb420 con 0x55ab8ddb8440 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddbbcf0 con 0x55ab8ddb8440 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.318+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddbc090 con 0x55ab8ddb8440 2024-04-26T07:54:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.319+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.319+0000 7f31ca40e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.319+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.319+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8ddbcdf0 0x55ab8ddbf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.319+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddbf7a0 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.319+0000 7f31c870e640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8ddbcdf0 0x55ab8ddbf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.319+0000 7f31c870e640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8ddbcdf0 0x55ab8ddbf1e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.320+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.320+0000 7f31ca40e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.320+0000 7f31ca40e800 20 searching for the correct realm 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.320+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab8ddc1770 0x55ab8ddc3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.320+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.320+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab8ddc1770 0x55ab8ddc3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.320+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab8ddc1770 0x55ab8ddc3c30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.321+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.321+0000 7f31c7f0d640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f31b804d800 0x7f31b8018800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.321+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x7f31b804d800 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.321+0000 7f31c770c640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f31b804d800 0x7f31b8018800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.321+0000 7f31c770c640 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f31b804d800 0x7f31b8018800 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.321+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.321+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.322+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.322+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddb8440 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.322+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.322+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddb8440 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.322+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.322+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.322+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.322+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.323+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.323+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x7f31b804d800 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.323+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.323+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.323+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.323+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddb8440 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.323+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.323+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddb8440 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x7f31b804d800 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.324+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.325+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.325+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.325+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.325+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.325+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.326+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.326+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddb8440 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.326+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.326+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddb8440 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.326+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.326+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.326+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.326+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.327+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.327+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x7f31b804d800 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.327+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.327+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddb8440 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.327+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.327+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.328+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.328+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.328+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.328+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.328+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.328+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x7f31b804d800 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.328+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.328+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddc1770 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.329+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.329+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.329+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.329+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x55ab8ddb8440 2024-04-26T07:54:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.329+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.329+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4300 con 0x7f31b804d800 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.329+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc0160 con 0x55ab8ddb8440 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddbfda0 con 0x55ab8ddb8440 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc0b40 con 0x55ab8ddb8440 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 zone default found 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 4 Realm: () 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 zonegroup default 2024-04-26T07:54:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.330+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc4830 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc6b00 con 0x55ab8ddc1770 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc6ea0 con 0x55ab8ddc1770 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 20 started sync module instance, tier type = 2024-04-26T07:54:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.331+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc5f90 con 0x7f31b804d800 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.333+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.333+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94195307799696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc5f90 con 0x7f31b804d800 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.333+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc7910 con 0x55ab8ddb8440 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.334+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94195307799696] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.334+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.334+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94195307803648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc5f90 con 0x55ab8ddb8440 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.334+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc83a0 con 0x55ab8ddc1770 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.335+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94195307803648] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.335+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.335+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94195307806320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc8740 con 0x55ab8ddc1770 2024-04-26T07:54:36.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.335+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc9170 con 0x7f31b804d800 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.336+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94195307806320] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.336+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.336+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94195307797216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc9590 con 0x7f31b804d800 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.336+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc9fe0 con 0x55ab8ddb8440 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.337+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.337+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94195307813584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc9fa0 con 0x55ab8ddb8440 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.337+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcafc0 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.337+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94195307797216] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.338+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94195307813584] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.338+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.339+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94195307815888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcafc0 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.339+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcb860 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.339+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94195307815888] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.340+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.340+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94195307817680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcafc0 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.340+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcbf00 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94195307817680] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94195307821520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcbec0 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31ca40e800 20 add_watcher() i=0 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31ca40e800 20 add_watcher() i=1 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31ca40e800 20 add_watcher() i=2 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31ca40e800 20 add_watcher() i=3 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31ca40e800 20 add_watcher() i=4 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31ca40e800 20 add_watcher() i=5 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.341+0000 7f31ca40e800 20 add_watcher() i=6 2024-04-26T07:54:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.342+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94195307821520] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.342+0000 7f31ca40e800 20 add_watcher() i=7 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.342+0000 7f31ca40e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.342+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcf350 con 0x55ab8ddb8440 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.342+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.342+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94195307819552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcc7d0 con 0x55ab8ddb8440 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94195307819552] v27'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f307dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31ca40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31ca40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31ca40e800 5 note: GC not initialized 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f307cfe1640 20 reqs_thread_entry: start 2024-04-26T07:54:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31ca40e800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31ca40e800 20 Filter name: none 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f2ff67fc640 20 reqs_thread_entry: start 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31ca40e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31ca40e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.345+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8de02a50 con 0x55ab8ddb8440 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.346+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.346+0000 7f31ca40e800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.346+0000 7f31ca40e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.346+0000 7f31ca40e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.346+0000 7f31ca40e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.346+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8de09190 con 0x55ab8ddb8440 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f31ca40e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f31ca40e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f31ca40e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94195308071968 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8de04920 con 0x55ab8ddb8440 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94195307813584 notify 115964117002 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ab8dc89750 con 0x55ab8ddb8440 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f30a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94195307813584 notifier 4410 bl.length()=567 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f30a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f30a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f30a6ffd640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f308c003ea0 con 0x55ab8ddb8440 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94195308071968 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.347+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.348+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94195308071968 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f31b005e8e0 con 0x55ab8ddb8440 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.348+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8de08c20 con 0x7f31b804d800 2024-04-26T07:54:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.349+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 foo:foo2 [delete] v27'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.349+0000 7f31ca40e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.349+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94195308071968 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab8de04470 con 0x7f31b804d800 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.349+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== watch-notify(notify (1) cookie 94195307799696 notify 115964116997 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f31b005e8e0 con 0x7f31b804d800 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.349+0000 7f30a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94195307799696 notifier 4410 bl.length()=159 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.349+0000 7f30a67fc640 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f2ffc0032c0 con 0x7f31b804d800 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.349+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(67 notify.0 [notify cookie 94195308071968 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.350+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.350+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== watch-notify(notify_complete (2) cookie 94195308071968 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f31b005ec50 con 0x7f31b804d800 2024-04-26T07:54:36.361 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.351+0000 7f307dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.351+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94195307819552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddce970 con 0x55ab8ddb8440 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.352+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94195307819552] v27'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.352+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94195307799696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcb1e0 con 0x7f31b804d800 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.353+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94195307799696] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.353+0000 7f31ca40e800 20 remove_watcher() i=0 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.353+0000 7f31ca40e800 2 removed watcher, disabling cache 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.353+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94195307803648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc6490 con 0x55ab8ddb8440 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.354+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94195307803648] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.354+0000 7f31ca40e800 20 remove_watcher() i=1 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.354+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94195307806320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc7400 con 0x55ab8ddc1770 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.355+0000 7f31c7f0d640 1 -- 172.21.15.62:0/254222600 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94195307806320] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b802d070 con 0x55ab8ddc1770 2024-04-26T07:54:36.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.355+0000 7f31ca40e800 20 remove_watcher() i=2 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.355+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94195307797216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc7e70 con 0x7f31b804d800 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.356+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94195307797216] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x7f31b804d800 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.356+0000 7f31ca40e800 20 remove_watcher() i=3 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.356+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94195307813584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc5ae0 con 0x55ab8ddb8440 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.357+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94195307813584] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b005a040 con 0x55ab8ddb8440 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.357+0000 7f31ca40e800 20 remove_watcher() i=4 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.357+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94195307815888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc5ae0 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.358+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94195307815888] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.358+0000 7f31ca40e800 20 remove_watcher() i=5 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.358+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94195307817680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddc5ae0 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.358+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94195307817680] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.358+0000 7f31ca40e800 20 remove_watcher() i=6 2024-04-26T07:54:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.358+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94195307821520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab8ddcaad0 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.359+0000 7f31c870e640 1 -- 172.21.15.62:0/254222600 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94195307821520] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c002a070 con 0x55ab8ddbcdf0 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.359+0000 7f31ca40e800 20 remove_watcher() i=7 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.359+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8ddbcdf0 msgr2=0x55ab8ddbf1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8ddbcdf0 0x55ab8ddbf1e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8ddb8440 msgr2=0x55ab8ddba900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8ddb8440 0x55ab8ddba900 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f31b804d800 msgr2=0x7f31b8018800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f31b804d800 0x7f31b8018800 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab8ddc1770 msgr2=0x55ab8ddc3c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab8ddc1770 0x55ab8ddc3c30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3090036eb0 msgr2=0x7f3090039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3090036eb0 0x7f3090039370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31b801a530 tx=0x7f31b8033040 comp rx=0 tx=0).stop 2024-04-26T07:54:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 msgr2=0x55ab8ddac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31c770c640 1 -- 172.21.15.62:0/254222600 reap_dead start 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8ddac800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f31c004bdf0 tx=0x7f31c004ce60 comp rx=0 tx=0).stop 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 shutdown_connections 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/254222600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dda5270 0x55ab8ddac800 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 >> 172.21.15.62:0/254222600 conn(0x55ab8dda1580 msgr2=0x55ab8dd9ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 shutdown_connections 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/254222600 wait complete. 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/1905546648 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30a0036eb0 msgr2=0x7f30a0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/1905546648 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30a0036eb0 0x7f30a0039370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55ab8dd844b0 tx=0x7f31b8000fe0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/1905546648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dd97f40 msgr2=0x55ab8dd98360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/1905546648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dd97f40 0x55ab8dd98360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55ab8dd7d740 tx=0x7f31c00188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/1905546648 shutdown_connections 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/1905546648 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30a0036eb0 0x7f30a0039370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 --2- 172.21.15.62:0/1905546648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dd97f40 0x55ab8dd98360 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/1905546648 >> 172.21.15.62:0/1905546648 conn(0x55ab8dd8bfe0 msgr2=0x55ab8dd8c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/1905546648 shutdown_connections 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.360+0000 7f31ca40e800 1 -- 172.21.15.62:0/1905546648 wait complete. 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8dd86370 msgr2=0x55ab8dd88760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8dd86370 0x55ab8dd88760 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8dc85bb0 msgr2=0x55ab8dd83ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8dc85bb0 0x55ab8dd83ab0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30b0036eb0 msgr2=0x7f30b0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30b0036eb0 0x7f30b0039370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31b0054000 tx=0x7f31b004e000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 msgr2=0x55ab8dd7c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dd7c870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f31b8001e60 tx=0x7f31b8000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 shutdown_connections 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab8dc85bb0 0x55ab8dd83ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab8dd86370 0x55ab8dd88760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f30b0036eb0 0x7f30b0039370 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 --2- 172.21.15.62:0/2131371977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab8dc7f990 0x55ab8dd7c870 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 >> 172.21.15.62:0/2131371977 conn(0x55ab8dc7b340 msgr2=0x55ab8dc81160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 shutdown_connections 2024-04-26T07:54:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.361+0000 7f31ca40e800 1 -- 172.21.15.62:0/2131371977 wait complete. 2024-04-26T07:54:36.373 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:36.374 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-26T07:54:36.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-26T07:54:36.374 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-26T07:54:36.418 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:36.418 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:36.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.420+0000 7f98c820f800 1 Processor -- start 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.420+0000 7f98c820f800 1 -- start start 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.420+0000 7f98c820f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5589ea715190 0x5589ea717580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.420+0000 7f98c820f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589ea71b5d0 con 0x5589ea717ac0 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.420+0000 7f98c820f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5589ea5b6e20 con 0x5589ea715190 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.421+0000 7f98c3814640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5589ea715190 0x5589ea717580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.421+0000 7f98c3013640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5589ea717ac0 0x5589ea719eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36622/0 (socket says 172.21.15.62:36622) 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.421+0000 7f98c3013640 1 -- 172.21.15.62:0/585641854 learned_addr learned my addr 172.21.15.62:0/585641854 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.421+0000 7f98c3814640 1 -- 172.21.15.62:0/585641854 >> v1:172.21.15.1:6789/0 conn(0x5589ea717ac0 legacy=0x5589ea719eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.421+0000 7f98c3814640 1 -- 172.21.15.62:0/585641854 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ea71c7b0 con 0x5589ea715190 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.423+0000 7f98c3814640 1 --2- 172.21.15.62:0/585641854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea717580 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f98b400a470 tx=0x7f98b401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e5058ca40e9333 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.423+0000 7f98c2812640 1 -- 172.21.15.62:0/585641854 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4057070 con 0x5589ea715190 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.423+0000 7f98c2812640 1 -- 172.21.15.62:0/585641854 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4052570 con 0x5589ea715190 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.423+0000 7f98c2812640 1 -- 172.21.15.62:0/585641854 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4052870 con 0x5589ea715190 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.424+0000 7f98c820f800 1 -- 172.21.15.62:0/585641854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 msgr2=0x5589ea717580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.424+0000 7f98c820f800 1 --2- 172.21.15.62:0/585641854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea717580 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f98b400a470 tx=0x7f98b401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.424+0000 7f98c820f800 1 -- 172.21.15.62:0/585641854 shutdown_connections 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.424+0000 7f98c820f800 1 --2- 172.21.15.62:0/585641854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea717580 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.424+0000 7f98c820f800 1 -- 172.21.15.62:0/585641854 >> 172.21.15.62:0/585641854 conn(0x5589ea70eb80 msgr2=0x5589ea710fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.424+0000 7f98c820f800 1 -- 172.21.15.62:0/585641854 shutdown_connections 2024-04-26T07:54:36.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.424+0000 7f98c820f800 1 -- 172.21.15.62:0/585641854 wait complete. 2024-04-26T07:54:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.436+0000 7f98c820f800 1 Processor -- start 2024-04-26T07:54:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.436+0000 7f98c820f800 1 -- start start 2024-04-26T07:54:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.437+0000 7f98c820f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea714ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.437+0000 7f98c820f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5589ea65fcd0 con 0x5589ea715190 2024-04-26T07:54:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.437+0000 7f98c3814640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea714ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.437+0000 7f98c3814640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea714ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33400/0 (socket says 172.21.15.62:33400) 2024-04-26T07:54:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.437+0000 7f98c3814640 1 -- 172.21.15.62:0/4023559324 learned_addr learned my addr 172.21.15.62:0/4023559324 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.437+0000 7f98c3814640 1 -- 172.21.15.62:0/4023559324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ea713090 con 0x5589ea715190 2024-04-26T07:54:36.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.437+0000 7f98c3814640 1 --2- 172.21.15.62:0/4023559324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea714ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98b401ced0 tx=0x7f98b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979988cee365dfe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f97b1e0b640 1 -- 172.21.15.62:0/4023559324 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4057040 con 0x5589ea715190 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f97b1e0b640 1 -- 172.21.15.62:0/4023559324 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b40529a0 con 0x5589ea715190 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f97b1e0b640 1 -- 172.21.15.62:0/4023559324 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4052cc0 con 0x5589ea715190 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f98c820f800 1 -- 172.21.15.62:0/4023559324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 msgr2=0x5589ea714ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f98c820f800 1 --2- 172.21.15.62:0/4023559324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea714ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98b401ced0 tx=0x7f98b404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f98c820f800 1 -- 172.21.15.62:0/4023559324 shutdown_connections 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f98c820f800 1 --2- 172.21.15.62:0/4023559324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea714ad0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f98c820f800 1 -- 172.21.15.62:0/4023559324 >> 172.21.15.62:0/4023559324 conn(0x5589ea70eb80 msgr2=0x5589ea8014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f98c820f800 1 -- 172.21.15.62:0/4023559324 shutdown_connections 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.438+0000 7f98c820f800 1 -- 172.21.15.62:0/4023559324 wait complete. 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c820f800 1 Processor -- start 2024-04-26T07:54:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c820f800 1 -- start start 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c820f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea80f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c820f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5589ea71ba40 con 0x5589ea715190 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c3814640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea80f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c3814640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea80f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33404/0 (socket says 172.21.15.62:33404) 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c3814640 1 -- 172.21.15.62:0/627419418 learned_addr learned my addr 172.21.15.62:0/627419418 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c3814640 1 -- 172.21.15.62:0/627419418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ea80fd70 con 0x5589ea715190 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.439+0000 7f98c3814640 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea80f830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f98b4000c00 tx=0x7f98b4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.440+0000 7f97abfff640 1 -- 172.21.15.62:0/627419418 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4073070 con 0x5589ea715190 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.440+0000 7f97abfff640 1 -- 172.21.15.62:0/627419418 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b405d780 con 0x5589ea715190 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.440+0000 7f97abfff640 1 -- 172.21.15.62:0/627419418 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4057070 con 0x5589ea715190 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.440+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589ea810000 con 0x5589ea715190 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.440+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ea812cb0 con 0x5589ea715190 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.440+0000 7f97abfff640 1 -- 172.21.15.62:0/627419418 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f98b4076070 con 0x5589ea715190 2024-04-26T07:54:36.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f97abfff640 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f97ac036eb0 0x7f97ac039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f97abfff640 1 -- 172.21.15.62:0/627419418 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f98b408e7a0 con 0x5589ea715190 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f98c3013640 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f97ac036eb0 0x7f97ac039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea717ac0 0x5589ea816ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea817050 con 0x5589ea717ac0 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f98c4015640 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea717ac0 0x5589ea816ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f98c3013640 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f97ac036eb0 0x7f97ac039370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98ac000f60 tx=0x7f98ac0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f98c4015640 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea717ac0 0x5589ea816ad0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.441+0000 7f98c4015640 1 -- 172.21.15.62:0/627419418 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98bc00a4a0 con 0x5589ea717ac0 2024-04-26T07:54:36.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.442+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8140a0 con 0x5589ea717ac0 2024-04-26T07:54:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.442+0000 7f98c4015640 1 -- 172.21.15.62:0/627419418 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98bc00a4a0 con 0x5589ea717ac0 2024-04-26T07:54:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.442+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea8193a0 0x5589ea81b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.442+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea81be80 con 0x5589ea8193a0 2024-04-26T07:54:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.442+0000 7f98c3814640 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea8193a0 0x5589ea81b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.443+0000 7f98c3814640 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea8193a0 0x5589ea81b790 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.443+0000 7f98c3814640 1 -- 172.21.15.62:0/627419418 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea8193a0 2024-04-26T07:54:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.443+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea818350 con 0x5589ea717ac0 2024-04-26T07:54:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.443+0000 7f98c4015640 1 -- 172.21.15.62:0/627419418 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98bc00a4a0 con 0x5589ea717ac0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.443+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea818830 con 0x5589ea717ac0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.443+0000 7f98c4015640 1 -- 172.21.15.62:0/627419418 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98bc00a4a0 con 0x5589ea717ac0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.444+0000 7f98c820f800 1 Processor -- start 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.444+0000 7f98c820f800 1 -- start start 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.444+0000 7f98c820f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea82aff0 0x5589ea82b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.444+0000 7f98c820f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5589ea607170 con 0x5589ea82aff0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.444+0000 7f98c4015640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea82aff0 0x5589ea82b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.444+0000 7f98c4015640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea82aff0 0x5589ea82b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33420/0 (socket says 172.21.15.62:33420) 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.444+0000 7f98c4015640 1 -- 172.21.15.62:0/3353531517 learned_addr learned my addr 172.21.15.62:0/3353531517 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.444+0000 7f98c4015640 1 -- 172.21.15.62:0/3353531517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ea82b950 con 0x5589ea82aff0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.445+0000 7f98c4015640 1 --2- 172.21.15.62:0/3353531517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea82aff0 0x5589ea82b410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5589ea817450 tx=0x7f98bc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.445+0000 7f97a97fa640 1 -- 172.21.15.62:0/3353531517 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc014450 con 0x5589ea82aff0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.445+0000 7f97a97fa640 1 -- 172.21.15.62:0/3353531517 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc014610 con 0x5589ea82aff0 2024-04-26T07:54:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.445+0000 7f97a97fa640 1 -- 172.21.15.62:0/3353531517 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc014930 con 0x5589ea82aff0 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.445+0000 7f98c820f800 1 -- 172.21.15.62:0/3353531517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589ea82c3c0 con 0x5589ea82aff0 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.445+0000 7f98c820f800 1 -- 172.21.15.62:0/3353531517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ea82c8c0 con 0x5589ea82aff0 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.445+0000 7f97a97fa640 1 -- 172.21.15.62:0/3353531517 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f98bc011040 con 0x5589ea82aff0 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f97a97fa640 1 --2- 172.21.15.62:0/3353531517 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f979c036eb0 0x7f979c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f97a97fa640 1 -- 172.21.15.62:0/3353531517 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f98bc01e070 con 0x5589ea82aff0 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c3814640 1 --2- 172.21.15.62:0/3353531517 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f979c036eb0 0x7f979c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c820f800 1 Processor -- start 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c820f800 1 -- start start 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c3814640 1 --2- 172.21.15.62:0/3353531517 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f979c036eb0 0x7f979c039370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5589ea8174f0 tx=0x7f98b4052f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c820f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea838690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c820f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5589ea713350 con 0x5589ea838270 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c4015640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea838690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c4015640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea838690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33426/0 (socket says 172.21.15.62:33426) 2024-04-26T07:54:36.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.446+0000 7f98c4015640 1 -- 172.21.15.62:0/3066036711 learned_addr learned my addr 172.21.15.62:0/3066036711 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c4015640 1 -- 172.21.15.62:0/3066036711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ea838c60 con 0x5589ea838270 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c4015640 1 --2- 172.21.15.62:0/3066036711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea838690 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98bc04cf00 tx=0x7f98bc011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f399ca319cef92d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f97a2ffd640 1 -- 172.21.15.62:0/3066036711 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc0168f0 con 0x5589ea838270 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f97a2ffd640 1 -- 172.21.15.62:0/3066036711 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc014ad0 con 0x5589ea838270 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f97a2ffd640 1 -- 172.21.15.62:0/3066036711 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc046590 con 0x5589ea838270 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c820f800 1 -- 172.21.15.62:0/3066036711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 msgr2=0x5589ea838690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c820f800 1 --2- 172.21.15.62:0/3066036711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea838690 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98bc04cf00 tx=0x7f98bc011f20 comp rx=0 tx=0).stop 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c820f800 1 -- 172.21.15.62:0/3066036711 shutdown_connections 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c820f800 1 --2- 172.21.15.62:0/3066036711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea838690 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c820f800 1 -- 172.21.15.62:0/3066036711 >> 172.21.15.62:0/3066036711 conn(0x5589ea8345d0 msgr2=0x5589ea832630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c820f800 1 -- 172.21.15.62:0/3066036711 shutdown_connections 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.447+0000 7f98c820f800 1 -- 172.21.15.62:0/3066036711 wait complete. 2024-04-26T07:54:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.448+0000 7f98c820f800 1 Processor -- start 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.448+0000 7f98c820f800 1 -- start start 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.448+0000 7f98c820f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea83f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.448+0000 7f98c820f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5589ea8393d0 con 0x5589ea838270 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.448+0000 7f98c4015640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea83f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.448+0000 7f98c4015640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea83f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33430/0 (socket says 172.21.15.62:33430) 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.448+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 learned_addr learned my addr 172.21.15.62:0/1857620913 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.448+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ea83fda0 con 0x5589ea838270 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.449+0000 7f98c4015640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea83f860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f98bc043040 tx=0x7f98bc04ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.449+0000 7f97a17fa640 1 -- 172.21.15.62:0/1857620913 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc014c80 con 0x5589ea838270 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.449+0000 7f97a17fa640 1 -- 172.21.15.62:0/1857620913 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc04e2f0 con 0x5589ea838270 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.449+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589ea840030 con 0x5589ea838270 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.449+0000 7f97a17fa640 1 -- 172.21.15.62:0/1857620913 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc04e610 con 0x5589ea838270 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.449+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ea842ce0 con 0x5589ea838270 2024-04-26T07:54:36.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f97a17fa640 1 -- 172.21.15.62:0/1857620913 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f98bc0472b0 con 0x5589ea838270 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f97a17fa640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f978c036eb0 0x7f978c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f97a17fa640 1 -- 172.21.15.62:0/1857620913 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f98bc033070 con 0x5589ea838270 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f98c3814640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f978c036eb0 0x7f978c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea84b300 0x5589ea84d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea84df10 con 0x5589ea84b300 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f98c3013640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea84b300 0x5589ea84d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.450+0000 7f98c3814640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f978c036eb0 0x7f978c039370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f98b4077fd0 tx=0x7f98b408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c3013640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea84b300 0x5589ea84d7c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98ac009050 con 0x5589ea84b300 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 20 realm 2024-04-26T07:54:36.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea84a7a0 con 0x5589ea84b300 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98ac009050 con 0x5589ea84b300 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea84e9f0 con 0x5589ea84b300 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98ac009050 con 0x5589ea84b300 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea84f2c0 con 0x5589ea84b300 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.451+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98ac009050 con 0x5589ea84b300 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c820f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea84fb70 0x5589ea851f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8526a0 con 0x5589ea84fb70 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c4015640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea84fb70 0x5589ea851f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c4015640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea84fb70 0x5589ea851f60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c820f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c820f800 20 searching for the correct realm 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5589ea854750 0x5589ea856c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.452+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.453+0000 7f98c3814640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5589ea854750 0x5589ea856c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.453+0000 7f98c3814640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5589ea854750 0x5589ea856c10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.453+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.453+0000 7f98c3814640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f98b409d040 0x7f98b408e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.453+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x7f98b409d040 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.454+0000 7f98c3013640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f98b409d040 0x7f98b408e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.454+0000 7f98c3013640 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f98b409d040 0x7f98b408e050 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.454+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac009050 con 0x7f98b409d040 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.454+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.454+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.454+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84b300 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.455+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac009050 con 0x5589ea84b300 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.455+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84b300 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.455+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.455+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.455+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.455+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.455+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.455+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x7f98b409d040 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.456+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac029040 con 0x7f98b409d040 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.456+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.456+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.456+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84b300 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.456+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.456+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.456+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.456+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84b300 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.457+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.457+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x7f98b409d040 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.457+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98ac029040 con 0x7f98b409d040 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.457+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.457+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.457+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.457+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.457+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.458+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.458+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.458+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.458+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.458+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.458+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84b300 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.458+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.458+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84b300 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.459+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.459+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.459+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.459+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.459+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.459+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x7f98b409d040 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.459+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac029040 con 0x7f98b409d040 2024-04-26T07:54:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.459+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84b300 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.460+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.460+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.460+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.460+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.460+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.460+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.460+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.460+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x7f98b409d040 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.461+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac029040 con 0x7f98b409d040 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.461+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea854750 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.461+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.461+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84fb70 2024-04-26T07:54:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.461+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.461+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x5589ea84b300 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8572e0 con 0x7f98b409d040 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac029040 con 0x7f98b409d040 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea853150 con 0x5589ea84b300 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea8535a0 con 0x5589ea84b300 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.462+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea853a80 con 0x5589ea84b300 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98ac029040 con 0x5589ea84b300 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 20 zone default found 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 4 Realm: () 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 20 zonegroup default 2024-04-26T07:54:36.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea857760 con 0x5589ea84fb70 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea859990 con 0x5589ea854750 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.463+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea859d30 con 0x5589ea854750 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.464+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.464+0000 7f98c820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.464+0000 7f98c820f800 20 started sync module instance, tier type = 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.464+0000 7f98c820f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.464+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea858dd0 con 0x7f98b409d040 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.465+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x7f98b409d040 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.465+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94050833503008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea858dd0 con 0x7f98b409d040 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.465+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85a6f0 con 0x5589ea84b300 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.466+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94050833503008] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x7f98b409d040 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.466+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.466+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94050833507360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea858dd0 con 0x5589ea84b300 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.466+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85b140 con 0x5589ea854750 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.467+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.467+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94050833509456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85b9e0 con 0x5589ea854750 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.467+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85c4d0 con 0x7f98b409d040 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.467+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94050833507360] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.468+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94050833509456] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.468+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x7f98b409d040 2024-04-26T07:54:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.468+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94050833511728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea858920 con 0x7f98b409d040 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.468+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85cdb0 con 0x5589ea84b300 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.469+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94050833511728] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x7f98b409d040 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.469+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.469+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94050833514400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85ccf0 con 0x5589ea84b300 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.469+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85d7c0 con 0x5589ea84fb70 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.470+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.470+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94050833519376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85dbe0 con 0x5589ea84fb70 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.470+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85e6e0 con 0x5589ea84fb70 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.470+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94050833514400] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.471+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94050833519376] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.471+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.471+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94050833523152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85d730 con 0x5589ea84fb70 2024-04-26T07:54:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.471+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85efb0 con 0x5589ea84fb70 2024-04-26T07:54:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94050833523152] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94050833516608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85d730 con 0x5589ea84fb70 2024-04-26T07:54:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c820f800 20 add_watcher() i=0 2024-04-26T07:54:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c820f800 20 add_watcher() i=1 2024-04-26T07:54:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c820f800 20 add_watcher() i=2 2024-04-26T07:54:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c820f800 20 add_watcher() i=3 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c820f800 20 add_watcher() i=4 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c820f800 20 add_watcher() i=5 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.472+0000 7f98c820f800 20 add_watcher() i=6 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.473+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94050833516608] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.473+0000 7f98c820f800 20 add_watcher() i=7 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.473+0000 7f98c820f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.473+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea862010 con 0x5589ea84b300 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.474+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.474+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94050833525504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85f4c0 con 0x5589ea84b300 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94050833525504] v27'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f9779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f98c820f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f98c820f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f98c820f800 5 note: GC not initialized 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f9778fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f98c820f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f98c820f800 20 Filter name: none 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f96f27fc640 20 reqs_thread_entry: start 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.475+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea895350 con 0x5589ea84b300 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.476+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.476+0000 7f98c820f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.476+0000 7f98c820f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.476+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea895d40 con 0x5589ea84b300 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.476+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.476+0000 7f98c820f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.476+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5589ea896d50 con 0x7f98b409d040 2024-04-26T07:54:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.476+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x7f98b409d040 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.477+0000 7f9779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.477+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94050833525504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85f490 con 0x5589ea84b300 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.478+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94050833525504] v27'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.478+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94050833503008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85eb00 con 0x7f98b409d040 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.479+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94050833503008] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x7f98b409d040 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.479+0000 7f98c820f800 20 remove_watcher() i=0 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.479+0000 7f98c820f800 2 removed watcher, disabling cache 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.480+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94050833507360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea859320 con 0x5589ea84b300 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.480+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94050833507360] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.481+0000 7f98c820f800 20 remove_watcher() i=1 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.481+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94050833509456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea859320 con 0x5589ea854750 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.481+0000 7f98c3814640 1 -- 172.21.15.62:0/1857620913 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94050833509456] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b4075030 con 0x5589ea854750 2024-04-26T07:54:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.482+0000 7f98c820f800 20 remove_watcher() i=2 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.482+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94050833511728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85a420 con 0x7f98b409d040 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.483+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94050833511728] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x7f98b409d040 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.483+0000 7f98c820f800 20 remove_watcher() i=3 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.483+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94050833514400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85b530 con 0x5589ea84b300 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.483+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94050833514400] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac039040 con 0x5589ea84b300 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.483+0000 7f98c820f800 20 remove_watcher() i=4 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.483+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94050833519376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85b530 con 0x5589ea84fb70 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.485+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94050833519376] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.485+0000 7f98c820f800 20 remove_watcher() i=5 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.485+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94050833523152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85d310 con 0x5589ea84fb70 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.485+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94050833523152] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.485+0000 7f98c820f800 20 remove_watcher() i=6 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.485+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94050833516608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5589ea85d310 con 0x5589ea84fb70 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c4015640 1 -- 172.21.15.62:0/1857620913 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94050833516608] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc02a070 con 0x5589ea84fb70 2024-04-26T07:54:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 20 remove_watcher() i=7 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea84fb70 msgr2=0x5589ea851f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea84fb70 0x5589ea851f60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea84b300 msgr2=0x5589ea84d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea84b300 0x5589ea84d7c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f98b409d040 msgr2=0x7f98b408e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f98b409d040 0x7f98b408e050 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5589ea854750 msgr2=0x5589ea856c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5589ea854750 0x5589ea856c10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f978c036eb0 msgr2=0x7f978c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f978c036eb0 0x7f978c039370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f98b4077fd0 tx=0x7f98b408a000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 msgr2=0x5589ea83f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c3013640 1 -- 172.21.15.62:0/1857620913 reap_dead start 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea83f860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f98bc043040 tx=0x7f98bc04ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 shutdown_connections 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/1857620913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea838270 0x5589ea83f860 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 >> 172.21.15.62:0/1857620913 conn(0x5589ea8345d0 msgr2=0x5589ea831c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 shutdown_connections 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/1857620913 wait complete. 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/3353531517 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f979c036eb0 msgr2=0x7f979c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/3353531517 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f979c036eb0 0x7f979c039370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5589ea8174f0 tx=0x7f98b4052f90 comp rx=0 tx=0).stop 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/3353531517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea82aff0 msgr2=0x5589ea82b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/3353531517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea82aff0 0x5589ea82b410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5589ea817450 tx=0x7f98bc018830 comp rx=0 tx=0).stop 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/3353531517 shutdown_connections 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/3353531517 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f979c036eb0 0x7f979c039370 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 --2- 172.21.15.62:0/3353531517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea82aff0 0x5589ea82b410 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/3353531517 >> 172.21.15.62:0/3353531517 conn(0x5589ea81f090 msgr2=0x5589ea81f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/3353531517 shutdown_connections 2024-04-26T07:54:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.487+0000 7f98c820f800 1 -- 172.21.15.62:0/3353531517 wait complete. 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea8193a0 msgr2=0x5589ea81b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea8193a0 0x5589ea81b790 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea717ac0 msgr2=0x5589ea816ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea717ac0 0x5589ea816ad0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f97ac036eb0 msgr2=0x7f97ac039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f97ac036eb0 0x7f97ac039370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98ac000f60 tx=0x7f98ac0012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 msgr2=0x5589ea80f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea80f830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f98b4000c00 tx=0x7f98b4003020 comp rx=0 tx=0).stop 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 shutdown_connections 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5589ea717ac0 0x5589ea816ad0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5589ea8193a0 0x5589ea81b790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f97ac036eb0 0x7f97ac039370 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 --2- 172.21.15.62:0/627419418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5589ea715190 0x5589ea80f830 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 >> 172.21.15.62:0/627419418 conn(0x5589ea70eb80 msgr2=0x5589ea8010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 shutdown_connections 2024-04-26T07:54:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.488+0000 7f98c820f800 1 -- 172.21.15.62:0/627419418 wait complete. 2024-04-26T07:54:36.496 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-04-26T07:54:36.496 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T07:54:36.496 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-26T07:54:36.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-26T07:54:36.496 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-26T07:54:36.582 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:36.582 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:36.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50ddb34800 1 Processor -- start 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50ddb34800 1 -- start start 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50ddb34800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5610cc7d7ca0 0x5610cc7da090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50ddb34800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5610cc7da5d0 con 0x5610cc7d4190 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50ddb34800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5610cc675e20 con 0x5610cc7d7ca0 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50d90cb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5610cc7d7ca0 0x5610cc7da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50d98cc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5610cc7d4190 0x5610cc7d6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36638/0 (socket says 172.21.15.62:36638) 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50d98cc640 1 -- 172.21.15.62:0/380628152 learned_addr learned my addr 172.21.15.62:0/380628152 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50d90cb640 1 -- 172.21.15.62:0/380628152 >> v1:172.21.15.1:6789/0 conn(0x5610cc7d4190 legacy=0x5610cc7d6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.583+0000 7f50d90cb640 1 -- 172.21.15.62:0/380628152 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cc7db7b0 con 0x5610cc7d7ca0 2024-04-26T07:54:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.585+0000 7f50d90cb640 1 --2- 172.21.15.62:0/380628152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d7ca0 0x5610cc7da090 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f50c400a470 tx=0x7f50c401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae299d39a37fe74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.585+0000 7f50d88ca640 1 -- 172.21.15.62:0/380628152 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c4057070 con 0x5610cc7d7ca0 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.585+0000 7f50d88ca640 1 -- 172.21.15.62:0/380628152 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c4052570 con 0x5610cc7d7ca0 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.585+0000 7f50d88ca640 1 -- 172.21.15.62:0/380628152 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c4052870 con 0x5610cc7d7ca0 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.586+0000 7f50ddb34800 1 -- 172.21.15.62:0/380628152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d7ca0 msgr2=0x5610cc7da090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.586+0000 7f50ddb34800 1 --2- 172.21.15.62:0/380628152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d7ca0 0x5610cc7da090 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f50c400a470 tx=0x7f50c401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.586+0000 7f50ddb34800 1 -- 172.21.15.62:0/380628152 shutdown_connections 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.586+0000 7f50ddb34800 1 --2- 172.21.15.62:0/380628152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d7ca0 0x5610cc7da090 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.586+0000 7f50ddb34800 1 -- 172.21.15.62:0/380628152 >> 172.21.15.62:0/380628152 conn(0x5610cc7cdb80 msgr2=0x5610cc7cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.586+0000 7f50ddb34800 1 -- 172.21.15.62:0/380628152 shutdown_connections 2024-04-26T07:54:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.586+0000 7f50ddb34800 1 -- 172.21.15.62:0/380628152 wait complete. 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.598+0000 7f50ddb34800 1 Processor -- start 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.599+0000 7f50ddb34800 1 -- start start 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.599+0000 7f50ddb34800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc7d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.599+0000 7f50ddb34800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610cc71ecd0 con 0x5610cc7d4190 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.599+0000 7f50d98cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc7d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.599+0000 7f50d98cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc7d3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33458/0 (socket says 172.21.15.62:33458) 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.599+0000 7f50d98cc640 1 -- 172.21.15.62:0/769879434 learned_addr learned my addr 172.21.15.62:0/769879434 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.599+0000 7f50d98cc640 1 -- 172.21.15.62:0/769879434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cc7d2090 con 0x5610cc7d4190 2024-04-26T07:54:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.599+0000 7f50d98cc640 1 --2- 172.21.15.62:0/769879434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc7d3ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0017a0 tx=0x7f50cc001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7808c52caf70c961 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f4fc7e07640 1 -- 172.21.15.62:0/769879434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50cc004520 con 0x5610cc7d4190 2024-04-26T07:54:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f4fc7e07640 1 -- 172.21.15.62:0/769879434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50cc0046c0 con 0x5610cc7d4190 2024-04-26T07:54:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f4fc7e07640 1 -- 172.21.15.62:0/769879434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50cc004a00 con 0x5610cc7d4190 2024-04-26T07:54:36.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f50ddb34800 1 -- 172.21.15.62:0/769879434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 msgr2=0x5610cc7d3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f50ddb34800 1 --2- 172.21.15.62:0/769879434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc7d3ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0017a0 tx=0x7f50cc001c60 comp rx=0 tx=0).stop 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f50ddb34800 1 -- 172.21.15.62:0/769879434 shutdown_connections 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f50ddb34800 1 --2- 172.21.15.62:0/769879434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc7d3ad0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f50ddb34800 1 -- 172.21.15.62:0/769879434 >> 172.21.15.62:0/769879434 conn(0x5610cc7cdb80 msgr2=0x5610cc8c05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f50ddb34800 1 -- 172.21.15.62:0/769879434 shutdown_connections 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.600+0000 7f50ddb34800 1 -- 172.21.15.62:0/769879434 wait complete. 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50ddb34800 1 Processor -- start 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50ddb34800 1 -- start start 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50ddb34800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc8cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50ddb34800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610cc7daaa0 con 0x5610cc7d4190 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50d98cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc8cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50d98cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc8cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33466/0 (socket says 172.21.15.62:33466) 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50d98cc640 1 -- 172.21.15.62:0/2674192427 learned_addr learned my addr 172.21.15.62:0/2674192427 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50d98cc640 1 -- 172.21.15.62:0/2674192427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cc8cef40 con 0x5610cc7d4190 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.601+0000 7f50d98cc640 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc8cea00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f50cc000f80 tx=0x7f50cc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.602+0000 7f4fc6604640 1 -- 172.21.15.62:0/2674192427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50cc022020 con 0x5610cc7d4190 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.602+0000 7f4fc6604640 1 -- 172.21.15.62:0/2674192427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50cc014870 con 0x5610cc7d4190 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.602+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610cc8cf1d0 con 0x5610cc7d4190 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.602+0000 7f4fc6604640 1 -- 172.21.15.62:0/2674192427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50cc014bb0 con 0x5610cc7d4190 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.602+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610cc8d1e80 con 0x5610cc7d4190 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.602+0000 7f4fc6604640 1 -- 172.21.15.62:0/2674192427 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f50cc025020 con 0x5610cc7d4190 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f4fc6604640 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fc0036e60 0x7f4fc0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f4fc6604640 1 -- 172.21.15.62:0/2674192427 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f50cc018030 con 0x5610cc7d4190 2024-04-26T07:54:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f50d90cb640 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fc0036e60 0x7f4fc0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc7d7ca0 0x5610cc8d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc8d6210 con 0x5610cc7d7ca0 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f50da0cd640 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc7d7ca0 0x5610cc8d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f50d90cb640 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fc0036e60 0x7f4fc0039320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50c4054000 tx=0x7f50c404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f50da0cd640 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc7d7ca0 0x5610cc8d5c40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.603+0000 7f50da0cd640 1 -- 172.21.15.62:0/2674192427 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50d40083e0 con 0x5610cc7d7ca0 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.604+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc8d31f0 con 0x5610cc7d7ca0 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.604+0000 7f50da0cd640 1 -- 172.21.15.62:0/2674192427 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50d40083e0 con 0x5610cc7d7ca0 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.604+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc8d8500 0x5610cc8da8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.604+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc8dafe0 con 0x5610cc8d8500 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.604+0000 7f50d98cc640 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc8d8500 0x5610cc8da8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.605+0000 7f50d98cc640 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc8d8500 0x5610cc8da8f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.605+0000 7f50d98cc640 1 -- 172.21.15.62:0/2674192427 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f50cc047040 con 0x5610cc8d8500 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.605+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc8d74b0 con 0x5610cc7d7ca0 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.605+0000 7f50da0cd640 1 -- 172.21.15.62:0/2674192427 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50d40083e0 con 0x5610cc7d7ca0 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.605+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc8d7950 con 0x5610cc7d7ca0 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50da0cd640 1 -- 172.21.15.62:0/2674192427 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f50d40083e0 con 0x5610cc7d7ca0 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50ddb34800 1 Processor -- start 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50ddb34800 1 -- start start 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50ddb34800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8ea180 0x5610cc8ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50ddb34800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610cc6c6170 con 0x5610cc8ea180 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50da0cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8ea180 0x5610cc8ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50da0cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8ea180 0x5610cc8ea5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33470/0 (socket says 172.21.15.62:33470) 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50da0cd640 1 -- 172.21.15.62:0/2417241147 learned_addr learned my addr 172.21.15.62:0/2417241147 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.606+0000 7f50da0cd640 1 -- 172.21.15.62:0/2417241147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cc8eaae0 con 0x5610cc8ea180 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.607+0000 7f50da0cd640 1 --2- 172.21.15.62:0/2417241147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8ea180 0x5610cc8ea5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5610cc8cf8d0 tx=0x7f50d400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.607+0000 7f4fbf7fe640 1 -- 172.21.15.62:0/2417241147 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d4007d00 con 0x5610cc8ea180 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.607+0000 7f4fbf7fe640 1 -- 172.21.15.62:0/2417241147 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d401e020 con 0x5610cc8ea180 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.607+0000 7f50ddb34800 1 -- 172.21.15.62:0/2417241147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610cc8eb550 con 0x5610cc8ea180 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.607+0000 7f4fbf7fe640 1 -- 172.21.15.62:0/2417241147 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d4019420 con 0x5610cc8ea180 2024-04-26T07:54:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.607+0000 7f50ddb34800 1 -- 172.21.15.62:0/2417241147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610cc8eba50 con 0x5610cc8ea180 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f4fbf7fe640 1 -- 172.21.15.62:0/2417241147 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f50d4016040 con 0x5610cc8ea180 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f4fbf7fe640 1 --2- 172.21.15.62:0/2417241147 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fb4036eb0 0x7f4fb4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f4fbf7fe640 1 -- 172.21.15.62:0/2417241147 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f50d401f030 con 0x5610cc8ea180 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f50d98cc640 1 --2- 172.21.15.62:0/2417241147 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fb4036eb0 0x7f4fb4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f50ddb34800 1 Processor -- start 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f50d98cc640 1 --2- 172.21.15.62:0/2417241147 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fb4036eb0 0x7f4fb4039370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5610cc8d6670 tx=0x7f50cc0263f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f50ddb34800 1 -- start start 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f50ddb34800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.608+0000 7f50ddb34800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610cc7d2410 con 0x5610cc8f73d0 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.609+0000 7f50da0cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.609+0000 7f50da0cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8f77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33478/0 (socket says 172.21.15.62:33478) 2024-04-26T07:54:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.609+0000 7f50da0cd640 1 -- 172.21.15.62:0/790159838 learned_addr learned my addr 172.21.15.62:0/790159838 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.609+0000 7f50da0cd640 1 -- 172.21.15.62:0/790159838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cc8f7dc0 con 0x5610cc8f73d0 2024-04-26T07:54:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.609+0000 7f50da0cd640 1 --2- 172.21.15.62:0/790159838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8f77f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f50d4022470 tx=0x7f50d4017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d30f8b0bf6b383b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.609+0000 7f4fbd7fa640 1 -- 172.21.15.62:0/790159838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d401d030 con 0x5610cc8f73d0 2024-04-26T07:54:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.609+0000 7f4fbd7fa640 1 -- 172.21.15.62:0/790159838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d4015e30 con 0x5610cc8f73d0 2024-04-26T07:54:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.609+0000 7f4fbd7fa640 1 -- 172.21.15.62:0/790159838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d40198d0 con 0x5610cc8f73d0 2024-04-26T07:54:36.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 -- 172.21.15.62:0/790159838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 msgr2=0x5610cc8f77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 --2- 172.21.15.62:0/790159838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8f77f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f50d4022470 tx=0x7f50d4017fa0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 -- 172.21.15.62:0/790159838 shutdown_connections 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 --2- 172.21.15.62:0/790159838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8f77f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 -- 172.21.15.62:0/790159838 >> 172.21.15.62:0/790159838 conn(0x5610cc8f3780 msgr2=0x5610cc8f17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 -- 172.21.15.62:0/790159838 shutdown_connections 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 -- 172.21.15.62:0/790159838 wait complete. 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 Processor -- start 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 -- start start 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8fe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50ddb34800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610cc8f8470 con 0x5610cc8f73d0 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50da0cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8fe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50da0cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8fe8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33486/0 (socket says 172.21.15.62:33486) 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.610+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 learned_addr learned my addr 172.21.15.62:0/3052673856 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.611+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cc8fee20 con 0x5610cc8f73d0 2024-04-26T07:54:36.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.611+0000 7f50da0cd640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8fe8e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f50d4022a30 tx=0x7f50d404d190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.611+0000 7f4fab7fe640 1 -- 172.21.15.62:0/3052673856 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d403d020 con 0x5610cc8f73d0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.611+0000 7f4fab7fe640 1 -- 172.21.15.62:0/3052673856 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d40153e0 con 0x5610cc8f73d0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.611+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610cc8ff0b0 con 0x5610cc8f73d0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.611+0000 7f4fab7fe640 1 -- 172.21.15.62:0/3052673856 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d402b350 con 0x5610cc8f73d0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.611+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610cc901d60 con 0x5610cc8f73d0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f4fab7fe640 1 -- 172.21.15.62:0/3052673856 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f50d4040020 con 0x5610cc8f73d0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f4fab7fe640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fa4036e60 0x7f4fa4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f4fab7fe640 1 -- 172.21.15.62:0/3052673856 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f50d401a070 con 0x5610cc8f73d0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f50d98cc640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fa4036e60 0x7f4fa4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc90a370 0x5610cc90c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc90cf80 con 0x5610cc90a370 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f50d90cb640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc90a370 0x5610cc90c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.612+0000 7f50d98cc640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fa4036e60 0x7f4fa4039320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5610cc8db3e0 tx=0x7f50cc034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50d90cb640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc90a370 0x5610cc90c830 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 20 realm 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc90d350 con 0x5610cc90a370 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc90dc20 con 0x5610cc90a370 2024-04-26T07:54:36.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.613+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc90dfc0 con 0x5610cc90a370 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.614+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.614+0000 7f50ddb34800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.614+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.614+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc90ea70 0x5610cc910e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.614+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9115c0 con 0x5610cc90ea70 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.614+0000 7f50da0cd640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc90ea70 0x5610cc910e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.614+0000 7f50da0cd640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc90ea70 0x5610cc910e60 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.614+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50ddb34800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50ddb34800 20 searching for the correct realm 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5610cc913660 0x5610cc915b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50d98cc640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5610cc913660 0x5610cc915b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50d98cc640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5610cc913660 0x5610cc915b20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc047040 con 0x5610cc913660 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50d98cc640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f50cc032040 0x7f50cc01d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.615+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x7f50cc032040 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.616+0000 7f50d90cb640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f50cc032040 0x7f50cc01d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.616+0000 7f50d90cb640 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f50cc032040 0x7f50cc01d580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.616+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.616+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.616+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.616+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90a370 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.617+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.617+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90a370 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.617+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.617+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.617+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.617+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.618+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.618+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x7f50cc032040 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.618+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.618+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.618+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc047040 con 0x5610cc913660 2024-04-26T07:54:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.618+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90a370 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.618+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.618+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.619+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.619+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90a370 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.619+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.619+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x7f50cc032040 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.619+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.619+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.619+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.619+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.620+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.620+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.620+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.620+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.620+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.620+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.620+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.620+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90a370 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.621+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.621+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90a370 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.621+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.621+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.621+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.621+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.621+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.621+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x7f50cc032040 2024-04-26T07:54:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.622+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.622+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90a370 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.622+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.622+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.622+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.622+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.622+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.622+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.623+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.623+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x7f50cc032040 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.623+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.623+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc913660 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90ea70 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x5610cc90a370 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9161f0 con 0x7f50cc032040 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50ddb34800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50ddb34800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50ddb34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50ddb34800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50ddb34800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50ddb34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.624+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc912060 con 0x5610cc90a370 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc911c70 con 0x5610cc90a370 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc912950 con 0x5610cc90a370 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 20 zone default found 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 4 Realm: () 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:36.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 20 zonegroup default 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc916670 con 0x5610cc90ea70 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.625+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc912510 con 0x5610cc913660 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc918990 con 0x5610cc913660 2024-04-26T07:54:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 20 started sync module instance, tier type = 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.626+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc917d30 con 0x7f50cc032040 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.627+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.627+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94630151553616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc917d30 con 0x7f50cc032040 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.627+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc919500 con 0x5610cc90a370 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.628+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94630151553616] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.628+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.629+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94630151557136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc917d30 con 0x5610cc90a370 2024-04-26T07:54:36.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.629+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc919fd0 con 0x5610cc913660 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.630+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.630+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94630151559872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91a870 con 0x5610cc913660 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.630+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91b310 con 0x7f50cc032040 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.630+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94630151557136] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.631+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94630151559872] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.631+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.631+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94630151562176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc917880 con 0x7f50cc032040 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.631+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91bbb0 con 0x5610cc90a370 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.632+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.632+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94630151567024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91bad0 con 0x5610cc90a370 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.632+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91caf0 con 0x5610cc90ea70 2024-04-26T07:54:36.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.632+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94630151562176] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.633+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94630151567024] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.633+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.633+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94630151569312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91cab0 con 0x5610cc90ea70 2024-04-26T07:54:36.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.633+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91d390 con 0x5610cc90ea70 2024-04-26T07:54:36.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.634+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.634+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94630151569312] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.634+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94630151573216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91d7b0 con 0x5610cc90ea70 2024-04-26T07:54:36.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.634+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91c5c0 con 0x5610cc90ea70 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94630151573216] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94630151574272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91dbd0 con 0x5610cc90ea70 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50ddb34800 20 add_watcher() i=0 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50ddb34800 20 add_watcher() i=1 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50ddb34800 20 add_watcher() i=2 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50ddb34800 20 add_watcher() i=3 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50ddb34800 20 add_watcher() i=4 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50ddb34800 20 add_watcher() i=5 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.635+0000 7f50ddb34800 20 add_watcher() i=6 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.636+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94630151574272] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.636+0000 7f50ddb34800 20 add_watcher() i=7 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.636+0000 7f50ddb34800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:36.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.636+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc920db0 con 0x5610cc90a370 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.636+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.636+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94630151575328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91dff0 con 0x5610cc90a370 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.637+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94630151575328] v27'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.637+0000 7f4f8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.637+0000 7f50ddb34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.637+0000 7f50ddb34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.637+0000 7f50ddb34800 5 note: GC not initialized 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f4f8a7fc640 20 reqs_thread_entry: start 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50ddb34800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50ddb34800 20 Filter name: none 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f4efbfff640 20 reqs_thread_entry: start 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc9540e0 con 0x5610cc90a370 2024-04-26T07:54:36.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50ddb34800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50ddb34800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc954ad0 con 0x5610cc90a370 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.638+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.639+0000 7f50ddb34800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.639+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610cc955ae0 con 0x7f50cc032040 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.639+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.640+0000 7f4f8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.640+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94630151575328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91fcf0 con 0x5610cc90a370 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.641+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94630151575328] v27'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.641+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94630151553616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91d720 con 0x7f50cc032040 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.642+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94630151553616] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.642+0000 7f50ddb34800 20 remove_watcher() i=0 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.642+0000 7f50ddb34800 2 removed watcher, disabling cache 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.642+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94630151557136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91d720 con 0x5610cc90a370 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.643+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94630151557136] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.643+0000 7f50ddb34800 20 remove_watcher() i=1 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.643+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94630151559872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91d720 con 0x5610cc913660 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.644+0000 7f50d98cc640 1 -- 172.21.15.62:0/3052673856 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94630151559872] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc05f040 con 0x5610cc913660 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.644+0000 7f50ddb34800 20 remove_watcher() i=2 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.644+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94630151562176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc919ac0 con 0x7f50cc032040 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.645+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94630151562176] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x7f50cc032040 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.645+0000 7f50ddb34800 20 remove_watcher() i=3 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.645+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94630151567024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91a3c0 con 0x5610cc90a370 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.646+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94630151567024] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c405a040 con 0x5610cc90a370 2024-04-26T07:54:36.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.646+0000 7f50ddb34800 20 remove_watcher() i=4 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.646+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94630151569312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc919ac0 con 0x5610cc90ea70 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.646+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94630151569312] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.646+0000 7f50ddb34800 20 remove_watcher() i=5 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.647+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94630151573216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91b6b0 con 0x5610cc90ea70 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.648+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94630151573216] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.648+0000 7f50ddb34800 20 remove_watcher() i=6 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.648+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94630151574272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610cc91a3c0 con 0x5610cc90ea70 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.648+0000 7f50da0cd640 1 -- 172.21.15.62:0/3052673856 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94630151574272] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d402a070 con 0x5610cc90ea70 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.648+0000 7f50ddb34800 20 remove_watcher() i=7 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc90ea70 msgr2=0x5610cc910e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc90ea70 0x5610cc910e60 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc90a370 msgr2=0x5610cc90c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc90a370 0x5610cc90c830 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f50cc032040 msgr2=0x7f50cc01d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f50cc032040 0x7f50cc01d580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5610cc913660 msgr2=0x5610cc915b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5610cc913660 0x5610cc915b20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fa4036e60 msgr2=0x7f4fa4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fa4036e60 0x7f4fa4039320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5610cc8db3e0 tx=0x7f50cc034000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 msgr2=0x5610cc8fe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/3052673856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8f73d0 0x5610cc8fe8e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f50d4022a30 tx=0x7f50d404d190 comp rx=0 tx=0).stop 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 reap_dead start 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50d90cb640 1 -- 172.21.15.62:0/3052673856 reap_dead start 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 shutdown_connections 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 >> 172.21.15.62:0/3052673856 conn(0x5610cc8f3780 msgr2=0x5610cc8f0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 shutdown_connections 2024-04-26T07:54:36.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/3052673856 wait complete. 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/2417241147 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fb4036eb0 msgr2=0x7f4fb4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2417241147 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fb4036eb0 0x7f4fb4039370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5610cc8d6670 tx=0x7f50cc0263f0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/2417241147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8ea180 msgr2=0x5610cc8ea5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2417241147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8ea180 0x5610cc8ea5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5610cc8cf8d0 tx=0x7f50d400aec0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/2417241147 shutdown_connections 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2417241147 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fb4036eb0 0x7f4fb4039370 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2417241147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc8ea180 0x5610cc8ea5a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/2417241147 >> 172.21.15.62:0/2417241147 conn(0x5610cc8de220 msgr2=0x5610cc8de620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/2417241147 shutdown_connections 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.649+0000 7f50ddb34800 1 -- 172.21.15.62:0/2417241147 wait complete. 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc8d8500 msgr2=0x5610cc8da8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc8d8500 0x5610cc8da8f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc7d7ca0 msgr2=0x5610cc8d5c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc7d7ca0 0x5610cc8d5c40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fc0036e60 msgr2=0x7f4fc0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fc0036e60 0x7f4fc0039320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50c4054000 tx=0x7f50c404e000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 msgr2=0x5610cc8cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc8cea00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f50cc000f80 tx=0x7f50cc001250 comp rx=0 tx=0).stop 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 shutdown_connections 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5610cc7d7ca0 0x5610cc8d5c40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5610cc8d8500 0x5610cc8da8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4fc0036e60 0x7f4fc0039320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 --2- 172.21.15.62:0/2674192427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cc7d4190 0x5610cc8cea00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 >> 172.21.15.62:0/2674192427 conn(0x5610cc7cdb80 msgr2=0x5610cc7d2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 shutdown_connections 2024-04-26T07:54:36.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.650+0000 7f50ddb34800 1 -- 172.21.15.62:0/2674192427 wait complete. 2024-04-26T07:54:36.664 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-04-26T07:54:36.664 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T07:54:36.679 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:36.679 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-26T07:54:36.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-26T07:54:36.681 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-26T07:54:36.725 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:36.726 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:36.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.728+0000 7f5cd8535800 1 Processor -- start 2024-04-26T07:54:36.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.728+0000 7f5cd8535800 1 -- start start 2024-04-26T07:54:36.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.728+0000 7f5cd8535800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55da3405cb90 0x55da3405ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.728+0000 7f5cd8535800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da3405f550 con 0x55da34056970 2024-04-26T07:54:36.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.728+0000 7f5cd8535800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55da33efae20 con 0x55da3405cb90 2024-04-26T07:54:36.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.728+0000 7f5cd39b4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55da3405cb90 0x55da3405ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.728+0000 7f5cd41b5640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55da34056970 0x55da34056d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36640/0 (socket says 172.21.15.62:36640) 2024-04-26T07:54:36.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.728+0000 7f5cd41b5640 1 -- 172.21.15.62:0/1595551393 learned_addr learned my addr 172.21.15.62:0/1595551393 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:36.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.729+0000 7f5cd39b4640 1 -- 172.21.15.62:0/1595551393 >> v1:172.21.15.1:6789/0 conn(0x55da34056970 legacy=0x55da34056d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.729+0000 7f5cd39b4640 1 -- 172.21.15.62:0/1595551393 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da34060730 con 0x55da3405cb90 2024-04-26T07:54:36.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd39b4640 1 --2- 172.21.15.62:0/1595551393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3405cb90 0x55da3405ef80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800a470 tx=0x7f5cc801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254ca2327f2763a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd31b3640 1 -- 172.21.15.62:0/1595551393 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc8057070 con 0x55da3405cb90 2024-04-26T07:54:36.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd31b3640 1 -- 172.21.15.62:0/1595551393 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc8052570 con 0x55da3405cb90 2024-04-26T07:54:36.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd31b3640 1 -- 172.21.15.62:0/1595551393 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc8052870 con 0x55da3405cb90 2024-04-26T07:54:36.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd8535800 1 -- 172.21.15.62:0/1595551393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3405cb90 msgr2=0x55da3405ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd8535800 1 --2- 172.21.15.62:0/1595551393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3405cb90 0x55da3405ef80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800a470 tx=0x7f5cc801ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:36.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd8535800 1 -- 172.21.15.62:0/1595551393 shutdown_connections 2024-04-26T07:54:36.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd8535800 1 --2- 172.21.15.62:0/1595551393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3405cb90 0x55da3405ef80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd8535800 1 -- 172.21.15.62:0/1595551393 >> 172.21.15.62:0/1595551393 conn(0x55da34052320 msgr2=0x55da34054740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd8535800 1 -- 172.21.15.62:0/1595551393 shutdown_connections 2024-04-26T07:54:36.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.731+0000 7f5cd8535800 1 -- 172.21.15.62:0/1595551393 wait complete. 2024-04-26T07:54:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.744+0000 7f5cd8535800 1 Processor -- start 2024-04-26T07:54:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.744+0000 7f5cd8535800 1 -- start start 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.744+0000 7f5cd8535800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da34149c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.744+0000 7f5cd8535800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55da33fa3cd0 con 0x55da34056970 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.744+0000 7f5cd41b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da34149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.744+0000 7f5cd41b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da34149c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33514/0 (socket says 172.21.15.62:33514) 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.744+0000 7f5cd41b5640 1 -- 172.21.15.62:0/2356351834 learned_addr learned my addr 172.21.15.62:0/2356351834 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.745+0000 7f5cd41b5640 1 -- 172.21.15.62:0/2356351834 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3414a200 con 0x55da34056970 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.745+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/2356351834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da34149c30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4001d50 tx=0x7f5cc400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17ad52d2899e60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.745+0000 7f5bc260c640 1 -- 172.21.15.62:0/2356351834 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc4013030 con 0x55da34056970 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.745+0000 7f5bc260c640 1 -- 172.21.15.62:0/2356351834 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc400e470 con 0x55da34056970 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.745+0000 7f5bc260c640 1 -- 172.21.15.62:0/2356351834 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc400e810 con 0x55da34056970 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 -- 172.21.15.62:0/2356351834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 msgr2=0x55da34149c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2356351834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da34149c30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4001d50 tx=0x7f5cc400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 -- 172.21.15.62:0/2356351834 shutdown_connections 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2356351834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da34149c30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 -- 172.21.15.62:0/2356351834 >> 172.21.15.62:0/2356351834 conn(0x55da34052320 msgr2=0x55da34145550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 -- 172.21.15.62:0/2356351834 shutdown_connections 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 -- 172.21.15.62:0/2356351834 wait complete. 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 Processor -- start 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 -- start start 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da340592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.746+0000 7f5cd8535800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55da3405f9f0 con 0x55da34056970 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5cd41b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da340592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5cd41b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da340592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33516/0 (socket says 172.21.15.62:33516) 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5cd41b5640 1 -- 172.21.15.62:0/2626838090 learned_addr learned my addr 172.21.15.62:0/2626838090 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5cd41b5640 1 -- 172.21.15.62:0/2626838090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da34057990 con 0x55da34056970 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da340592a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55da3414a9c0 tx=0x7f5cc4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5bc0e09640 1 -- 172.21.15.62:0/2626838090 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc4027070 con 0x55da34056970 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5bc0e09640 1 -- 172.21.15.62:0/2626838090 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc4019900 con 0x55da34056970 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5bc0e09640 1 -- 172.21.15.62:0/2626838090 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc4019c40 con 0x55da34056970 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da34057c20 con 0x55da34056970 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.747+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da34058140 con 0x55da34056970 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.748+0000 7f5bc0e09640 1 -- 172.21.15.62:0/2626838090 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5cc402a070 con 0x55da34056970 2024-04-26T07:54:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.748+0000 7f5bc0e09640 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bbc036e60 0x7f5bbc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.748+0000 7f5bc0e09640 1 -- 172.21.15.62:0/2626838090 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5cc401f070 con 0x55da34056970 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.748+0000 7f5cd39b4640 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bbc036e60 0x7f5bbc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.748+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3405cb90 0x55da3415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.748+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da3415b1d0 con 0x55da3405cb90 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.749+0000 7f5cd49b6640 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3405cb90 0x55da3415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.749+0000 7f5cd39b4640 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bbc036e60 0x7f5bbc039320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8054000 tx=0x7f5cc804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.749+0000 7f5cd49b6640 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3405cb90 0x55da3415abf0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.749+0000 7f5cd49b6640 1 -- 172.21.15.62:0/2626838090 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ccc00a4a0 con 0x55da3405cb90 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.749+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da3415bab0 con 0x55da3405cb90 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.749+0000 7f5cd49b6640 1 -- 172.21.15.62:0/2626838090 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ccc00a4a0 con 0x55da3405cb90 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.750+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da3415d4e0 0x55da3415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.750+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da34160130 con 0x55da3415d4e0 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.750+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da3415d4e0 0x55da3415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.750+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da3415d4e0 0x55da3415f9a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.750+0000 7f5cd41b5640 1 -- 172.21.15.62:0/2626838090 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5cc4029030 con 0x55da3415d4e0 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.750+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da3415c330 con 0x55da3405cb90 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.751+0000 7f5cd49b6640 1 -- 172.21.15.62:0/2626838090 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ccc00a4a0 con 0x55da3405cb90 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.751+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da3415c810 con 0x55da3405cb90 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.751+0000 7f5cd49b6640 1 -- 172.21.15.62:0/2626838090 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5ccc00a4a0 con 0x55da3405cb90 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.751+0000 7f5cd8535800 1 Processor -- start 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.751+0000 7f5cd8535800 1 -- start start 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd8535800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3416f2c0 0x55da3416f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd8535800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55da340597e0 con 0x55da3416f2c0 2024-04-26T07:54:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd49b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3416f2c0 0x55da3416f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd49b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3416f2c0 0x55da3416f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33530/0 (socket says 172.21.15.62:33530) 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd49b6640 1 -- 172.21.15.62:0/1798356597 learned_addr learned my addr 172.21.15.62:0/1798356597 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd49b6640 1 -- 172.21.15.62:0/1798356597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3416fc20 con 0x55da3416f2c0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd49b6640 1 --2- 172.21.15.62:0/1798356597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3416f2c0 0x55da3416f6e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55da3415b5d0 tx=0x7f5ccc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5bb9ffb640 1 -- 172.21.15.62:0/1798356597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc014450 con 0x55da3416f2c0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5bb9ffb640 1 -- 172.21.15.62:0/1798356597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc014610 con 0x55da3416f2c0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd8535800 1 -- 172.21.15.62:0/1798356597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da34170690 con 0x55da3416f2c0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5bb9ffb640 1 -- 172.21.15.62:0/1798356597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc014930 con 0x55da3416f2c0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.752+0000 7f5cd8535800 1 -- 172.21.15.62:0/1798356597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da34170b90 con 0x55da3416f2c0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.753+0000 7f5bb9ffb640 1 -- 172.21.15.62:0/1798356597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5ccc011040 con 0x55da3416f2c0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.753+0000 7f5bb9ffb640 1 --2- 172.21.15.62:0/1798356597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bac036eb0 0x7f5bac039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.753+0000 7f5bb9ffb640 1 -- 172.21.15.62:0/1798356597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5ccc01e070 con 0x55da3416f2c0 2024-04-26T07:54:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.753+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/1798356597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bac036eb0 0x7f5bac039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd8535800 1 Processor -- start 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd8535800 1 -- start start 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/1798356597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bac036eb0 0x7f5bac039370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55da34058720 tx=0x7f5cc400ef30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd8535800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da3417c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd8535800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55da33f4b170 con 0x55da3417c5d0 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd49b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da3417c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd49b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da3417c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33540/0 (socket says 172.21.15.62:33540) 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd49b6640 1 -- 172.21.15.62:0/781934436 learned_addr learned my addr 172.21.15.62:0/781934436 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd49b6640 1 -- 172.21.15.62:0/781934436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3417cfc0 con 0x55da3417c5d0 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5cd49b6640 1 --2- 172.21.15.62:0/781934436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da3417c9f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc04cff0 tx=0x7f5ccc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a54609369fdfaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.754+0000 7f5bb37fe640 1 -- 172.21.15.62:0/781934436 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc0412b0 con 0x55da3417c5d0 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5bb37fe640 1 -- 172.21.15.62:0/781934436 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc014ad0 con 0x55da3417c5d0 2024-04-26T07:54:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5bb37fe640 1 -- 172.21.15.62:0/781934436 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc011bb0 con 0x55da3417c5d0 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 -- 172.21.15.62:0/781934436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 msgr2=0x55da3417c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 --2- 172.21.15.62:0/781934436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da3417c9f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc04cff0 tx=0x7f5ccc02bf30 comp rx=0 tx=0).stop 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 -- 172.21.15.62:0/781934436 shutdown_connections 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 --2- 172.21.15.62:0/781934436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da3417c9f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 -- 172.21.15.62:0/781934436 >> 172.21.15.62:0/781934436 conn(0x55da341788a0 msgr2=0x55da34176900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 -- 172.21.15.62:0/781934436 shutdown_connections 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 -- 172.21.15.62:0/781934436 wait complete. 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 Processor -- start 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.755+0000 7f5cd8535800 1 -- start start 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd8535800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da34183980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd8535800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55da3417d5d0 con 0x55da3417c5d0 2024-04-26T07:54:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd49b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da34183980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd49b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da34183980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33548/0 (socket says 172.21.15.62:33548) 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 learned_addr learned my addr 172.21.15.62:0/4065440737 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da34183ec0 con 0x55da3417c5d0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd49b6640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da34183980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc04bf10 tx=0x7f5ccc04cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5bb1ffb640 1 -- 172.21.15.62:0/4065440737 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc0135c0 con 0x55da3417c5d0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5bb1ffb640 1 -- 172.21.15.62:0/4065440737 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc042040 con 0x55da3417c5d0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5bb1ffb640 1 -- 172.21.15.62:0/4065440737 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc0138b0 con 0x55da3417c5d0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da341841b0 con 0x55da3417c5d0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.756+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da34186e00 con 0x55da3417c5d0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.757+0000 7f5bb1ffb640 1 -- 172.21.15.62:0/4065440737 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5ccc04e1d0 con 0x55da3417c5d0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.757+0000 7f5bb1ffb640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5ba4036eb0 0x7f5ba4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.757+0000 7f5bb1ffb640 1 -- 172.21.15.62:0/4065440737 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5ccc00e040 con 0x55da3417c5d0 2024-04-26T07:54:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.757+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5ba4036eb0 0x7f5ba4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.757+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.757+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3418f430 0x55da341918f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.757+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da34192040 con 0x55da3418f430 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd39b4640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3418f430 0x55da341918f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5ba4036eb0 0x7f5ba4039370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4016b30 tx=0x7f5cc4042000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd39b4640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3418f430 0x55da341918f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd8535800 20 realm 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da34192410 con 0x55da3418f430 2024-04-26T07:54:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.758+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da34192ce0 con 0x55da3418f430 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da34193080 con 0x55da3418f430 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da34193b30 0x55da34195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da341966a0 con 0x55da34193b30 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.759+0000 7f5cd49b6640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da34193b30 0x55da34195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.760+0000 7f5cd49b6640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da34193b30 0x55da34195f40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.760+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.760+0000 7f5cd8535800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.760+0000 7f5cd8535800 20 searching for the correct realm 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.760+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55da34198750 0x55da3419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.760+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.760+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55da34198750 0x55da3419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.760+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55da34198750 0x55da3419ac10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.761+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.761+0000 7f5cd41b5640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5cc402c060 0x7f5cc402a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.761+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x7f5cc402c060 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.761+0000 7f5cd39b4640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5cc402c060 0x7f5cc402a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.761+0000 7f5cd39b4640 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5cc402c060 0x7f5cc402a580 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.762+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.762+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.762+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.762+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da3418f430 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.762+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.762+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da3418f430 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.762+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.762+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.763+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.763+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.763+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.763+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x7f5cc402c060 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.763+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.763+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.763+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.763+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da3418f430 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.764+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.764+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.764+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.764+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da3418f430 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.764+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.764+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x7f5cc402c060 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.765+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.765+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.765+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.765+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.765+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.765+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.765+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.765+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.766+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.766+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.766+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.766+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da3418f430 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.766+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.766+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da3418f430 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.766+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.766+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.767+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.767+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.767+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.767+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x7f5cc402c060 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.767+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.767+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da3418f430 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.767+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.767+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.768+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.768+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.768+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.768+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.768+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.768+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x7f5cc402c060 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.768+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.768+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34198750 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.769+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.769+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da34193b30 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.769+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.769+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x55da3418f430 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.769+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.769+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b2e0 con 0x7f5cc402c060 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da34197150 con 0x55da3418f430 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da341975d0 con 0x55da3418f430 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da34197ab0 con 0x55da3418f430 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 zone default found 2024-04-26T07:54:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 4 Realm: () 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 zonegroup default 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.770+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da3419b760 con 0x55da34193b30 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da3419d990 con 0x55da34198750 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da3419dd30 con 0x55da34198750 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 20 started sync module instance, tier type = 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.771+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419cdd0 con 0x7f5cc402c060 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.772+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.772+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94395665338864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419cdd0 con 0x7f5cc402c060 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.773+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419e6f0 con 0x55da3418f430 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.774+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94395665338864] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.774+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.774+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94395665337088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419e6f0 con 0x55da3418f430 2024-04-26T07:54:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.774+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419f0b0 con 0x55da34198750 2024-04-26T07:54:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.775+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94395665337088] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.775+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.775+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94395665345536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419f450 con 0x55da34198750 2024-04-26T07:54:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.775+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419fe90 con 0x7f5cc402c060 2024-04-26T07:54:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.776+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94395665345536] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.776+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.776+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94395665348960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a0280 con 0x7f5cc402c060 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.776+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a0cc0 con 0x55da3418f430 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.777+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.777+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94395665352592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a1130 con 0x55da3418f430 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.777+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a1c00 con 0x55da34193b30 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.777+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94395665348960] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.778+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.778+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94395665352592] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.778+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94395665356528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419e240 con 0x55da34193b30 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.778+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a24a0 con 0x55da34193b30 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.779+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94395665356528] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.779+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.779+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94395665353856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a24a0 con 0x55da34193b30 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.779+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a2ee0 con 0x55da34193b30 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94395665361328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a2ea0 con 0x55da34193b30 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd8535800 20 add_watcher() i=0 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd8535800 20 add_watcher() i=1 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd8535800 20 add_watcher() i=2 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd8535800 20 add_watcher() i=3 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd8535800 20 add_watcher() i=4 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd8535800 20 add_watcher() i=5 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94395665353856] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.780+0000 7f5cd8535800 20 add_watcher() i=6 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.781+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94395665361328] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.781+0000 7f5cd8535800 20 add_watcher() i=7 2024-04-26T07:54:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.781+0000 7f5cd8535800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.781+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da341a1ff0 con 0x55da3418f430 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.782+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.782+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94395665363664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a1ff0 con 0x55da3418f430 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94395665363664] v27'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5b8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5cd8535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5cd8535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5cd8535800 5 note: GC not initialized 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5b897e2640 20 reqs_thread_entry: start 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5cd8535800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5cd8535800 20 Filter name: none 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5afaffd640 20 reqs_thread_entry: start 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.783+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da341d9720 con 0x55da3418f430 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.784+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.784+0000 7f5cd8535800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.784+0000 7f5cd8535800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.784+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da341da110 con 0x55da3418f430 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.784+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.784+0000 7f5cd8535800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.784+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da341db120 con 0x7f5cc402c060 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.785+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.786+0000 7f5b8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.786+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94395665363664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341888a0 con 0x55da3418f430 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.787+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94395665363664] v27'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.787+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94395665338864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a32d0 con 0x7f5cc402c060 2024-04-26T07:54:36.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.788+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94395665338864] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.788+0000 7f5cd8535800 20 remove_watcher() i=0 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.788+0000 7f5cd8535800 2 removed watcher, disabling cache 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.788+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94395665337088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a32d0 con 0x55da3418f430 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.789+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94395665337088] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.789+0000 7f5cd8535800 20 remove_watcher() i=1 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.789+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94395665345536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a32d0 con 0x55da34198750 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.790+0000 7f5cd41b5640 1 -- 172.21.15.62:0/4065440737 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94395665345536] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc403e070 con 0x55da34198750 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.790+0000 7f5cd8535800 20 remove_watcher() i=2 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.790+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94395665348960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419ec00 con 0x7f5cc402c060 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.791+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94395665348960] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x7f5cc402c060 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.791+0000 7f5cd8535800 20 remove_watcher() i=3 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.791+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94395665352592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419f960 con 0x55da3418f430 2024-04-26T07:54:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.792+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94395665352592] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc805a040 con 0x55da3418f430 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.792+0000 7f5cd8535800 20 remove_watcher() i=4 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.792+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94395665356528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419f960 con 0x55da34193b30 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.793+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94395665356528] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.793+0000 7f5cd8535800 20 remove_watcher() i=5 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.793+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94395665353856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da341a16f0 con 0x55da34193b30 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.793+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94395665353856] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.793+0000 7f5cd8535800 20 remove_watcher() i=6 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.794+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94395665361328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da3419f960 con 0x55da34193b30 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.794+0000 7f5cd49b6640 1 -- 172.21.15.62:0/4065440737 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94395665361328] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc02a070 con 0x55da34193b30 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.794+0000 7f5cd8535800 20 remove_watcher() i=7 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da34193b30 msgr2=0x55da34195f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da34193b30 0x55da34195f40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3418f430 msgr2=0x55da341918f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3418f430 0x55da341918f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5cc402c060 msgr2=0x7f5cc402a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5cc402c060 0x7f5cc402a580 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55da34198750 msgr2=0x55da3419ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55da34198750 0x55da3419ac10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5ba4036eb0 msgr2=0x7f5ba4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5ba4036eb0 0x7f5ba4039370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4016b30 tx=0x7f5cc4042000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd39b4640 1 -- 172.21.15.62:0/4065440737 reap_dead start 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 msgr2=0x55da34183980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da34183980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc04bf10 tx=0x7f5ccc04cf80 comp rx=0 tx=0).stop 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 shutdown_connections 2024-04-26T07:54:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/4065440737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3417c5d0 0x55da34183980 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 >> 172.21.15.62:0/4065440737 conn(0x55da341788a0 msgr2=0x55da34175f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 shutdown_connections 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/4065440737 wait complete. 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/1798356597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bac036eb0 msgr2=0x7f5bac039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/1798356597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bac036eb0 0x7f5bac039370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55da34058720 tx=0x7f5cc400ef30 comp rx=0 tx=0).stop 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/1798356597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3416f2c0 msgr2=0x55da3416f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/1798356597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3416f2c0 0x55da3416f6e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55da3415b5d0 tx=0x7f5ccc018830 comp rx=0 tx=0).stop 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/1798356597 shutdown_connections 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/1798356597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bac036eb0 0x7f5bac039370 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 --2- 172.21.15.62:0/1798356597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da3416f2c0 0x55da3416f6e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/1798356597 >> 172.21.15.62:0/1798356597 conn(0x55da34163360 msgr2=0x55da34163760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/1798356597 shutdown_connections 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.795+0000 7f5cd8535800 1 -- 172.21.15.62:0/1798356597 wait complete. 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da3415d4e0 msgr2=0x55da3415f9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da3415d4e0 0x55da3415f9a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3405cb90 msgr2=0x55da3415abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3405cb90 0x55da3415abf0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bbc036e60 msgr2=0x7f5bbc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bbc036e60 0x7f5bbc039320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8054000 tx=0x7f5cc804e000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 msgr2=0x55da340592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da340592a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55da3414a9c0 tx=0x7f5cc4000bc0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 shutdown_connections 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55da3405cb90 0x55da3415abf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55da3415d4e0 0x55da3415f9a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5bbc036e60 0x7f5bbc039320 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 --2- 172.21.15.62:0/2626838090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da34056970 0x55da340592a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 >> 172.21.15.62:0/2626838090 conn(0x55da34052320 msgr2=0x55da34143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 shutdown_connections 2024-04-26T07:54:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.796+0000 7f5cd8535800 1 -- 172.21.15.62:0/2626838090 wait complete. 2024-04-26T07:54:36.813 INFO:teuthology.orchestra.run.smithi062.stdout:["myfoo"] 2024-04-26T07:54:36.813 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-26T07:54:36.816 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:36.817 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-26T07:54:36.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-26T07:54:36.817 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-26T07:54:36.863 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.861+0000 7fd5a0d33800 1 Processor -- start 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.861+0000 7fd5a0d33800 1 -- start start 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.861+0000 7fd5a0d33800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f9101aa990 0x55f9101ace30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.861+0000 7fd5a0d33800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9101ad4b0 con 0x55f910119860 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.861+0000 7fd5a0d33800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55f910048e20 con 0x55f9101aa990 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.862+0000 7fd597fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f9101aa990 0x55f9101ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.862+0000 7fd597fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f9101aa990 0x55f9101ace30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33564/0 (socket says 172.21.15.62:33564) 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.862+0000 7fd597fff640 1 -- 172.21.15.62:0/3447691894 learned_addr learned my addr 172.21.15.62:0/3447691894 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.862+0000 7fd59c9f5640 1 --1- 172.21.15.62:0/3447691894 >> v1:172.21.15.1:6789/0 conn(0x55f910119860 0x55f9101a9210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36652/0 (socket says 172.21.15.62:36652) 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.862+0000 7fd597fff640 1 -- 172.21.15.62:0/3447691894 >> v1:172.21.15.1:6789/0 conn(0x55f910119860 legacy=0x55f9101a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.862+0000 7fd597fff640 1 -- 172.21.15.62:0/3447691894 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9101ae6e0 con 0x55f9101aa990 2024-04-26T07:54:36.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.864+0000 7fd597fff640 1 --2- 172.21.15.62:0/3447691894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9101aa990 0x55f9101ace30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd58800a520 tx=0x7fd58801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f0b9bf90a578b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.864+0000 7fd5977fe640 1 -- 172.21.15.62:0/3447691894 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd588057070 con 0x55f9101aa990 2024-04-26T07:54:36.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.864+0000 7fd5977fe640 1 -- 172.21.15.62:0/3447691894 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588052570 con 0x55f9101aa990 2024-04-26T07:54:36.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.864+0000 7fd5977fe640 1 -- 172.21.15.62:0/3447691894 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58804ae60 con 0x55f9101aa990 2024-04-26T07:54:36.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.865+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3447691894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9101aa990 msgr2=0x55f9101ace30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.865+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3447691894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9101aa990 0x55f9101ace30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd58800a520 tx=0x7fd58801d010 comp rx=0 tx=0).stop 2024-04-26T07:54:36.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.865+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3447691894 shutdown_connections 2024-04-26T07:54:36.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.865+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3447691894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9101aa990 0x55f9101ace30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.865+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3447691894 >> 172.21.15.62:0/3447691894 conn(0x55f9101a0b90 msgr2=0x55f9101a2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.865+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3447691894 shutdown_connections 2024-04-26T07:54:36.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.865+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3447691894 wait complete. 2024-04-26T07:54:36.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.877+0000 7fd5a0d33800 1 Processor -- start 2024-04-26T07:54:36.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.877+0000 7fd5a0d33800 1 -- start start 2024-04-26T07:54:36.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.878+0000 7fd5a0d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9101a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.878+0000 7fd5a0d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9100f1cc0 con 0x55f910119860 2024-04-26T07:54:36.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.878+0000 7fd59c9f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9101a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.878+0000 7fd59c9f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9101a6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33576/0 (socket says 172.21.15.62:33576) 2024-04-26T07:54:36.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.878+0000 7fd59c9f5640 1 -- 172.21.15.62:0/2851451296 learned_addr learned my addr 172.21.15.62:0/2851451296 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.878+0000 7fd59c9f5640 1 -- 172.21.15.62:0/2851451296 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9101a5100 con 0x55f910119860 2024-04-26T07:54:36.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.878+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/2851451296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9101a6b40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd590001e90 tx=0x7fd59000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949e0de6d6cf9dc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd48ae05640 1 -- 172.21.15.62:0/2851451296 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59000e5c0 con 0x55f910119860 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd48ae05640 1 -- 172.21.15.62:0/2851451296 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd590006070 con 0x55f910119860 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd48ae05640 1 -- 172.21.15.62:0/2851451296 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59000e890 con 0x55f910119860 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd5a0d33800 1 -- 172.21.15.62:0/2851451296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 msgr2=0x55f9101a6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/2851451296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9101a6b40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd590001e90 tx=0x7fd59000b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd5a0d33800 1 -- 172.21.15.62:0/2851451296 shutdown_connections 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/2851451296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9101a6b40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd5a0d33800 1 -- 172.21.15.62:0/2851451296 >> 172.21.15.62:0/2851451296 conn(0x55f9101a0b90 msgr2=0x55f9102935b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd5a0d33800 1 -- 172.21.15.62:0/2851451296 shutdown_connections 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.879+0000 7fd5a0d33800 1 -- 172.21.15.62:0/2851451296 wait complete. 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.880+0000 7fd5a0d33800 1 Processor -- start 2024-04-26T07:54:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.880+0000 7fd5a0d33800 1 -- start start 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.880+0000 7fd5a0d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9102a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.880+0000 7fd5a0d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9101ad980 con 0x55f910119860 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.880+0000 7fd59c9f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9102a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.880+0000 7fd59c9f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9102a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33586/0 (socket says 172.21.15.62:33586) 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.880+0000 7fd59c9f5640 1 -- 172.21.15.62:0/693920075 learned_addr learned my addr 172.21.15.62:0/693920075 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.880+0000 7fd59c9f5640 1 -- 172.21.15.62:0/693920075 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9102a1f30 con 0x55f910119860 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.881+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9102a19f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd59000c010 tx=0x7fd590000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.881+0000 7fd489602640 1 -- 172.21.15.62:0/693920075 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59000f8d0 con 0x55f910119860 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.881+0000 7fd489602640 1 -- 172.21.15.62:0/693920075 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59000fa90 con 0x55f910119860 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.881+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9102a21c0 con 0x55f910119860 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.881+0000 7fd489602640 1 -- 172.21.15.62:0/693920075 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59000fdb0 con 0x55f910119860 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.881+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9102a4e70 con 0x55f910119860 2024-04-26T07:54:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd489602640 1 -- 172.21.15.62:0/693920075 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd590017070 con 0x55f910119860 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd489602640 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd484036e60 0x7fd484039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd489602640 1 -- 172.21.15.62:0/693920075 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fd590015020 con 0x55f910119860 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd597fff640 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd484036e60 0x7fd484039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9101aa990 0x55f9102a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102a9200 con 0x55f9101aa990 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd59d1f6640 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9101aa990 0x55f9102a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd597fff640 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd484036e60 0x7fd484039320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd588054000 tx=0x7fd58804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.882+0000 7fd59d1f6640 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9101aa990 0x55f9102a8c30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.883+0000 7fd59d1f6640 1 -- 172.21.15.62:0/693920075 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59800a4a0 con 0x55f9101aa990 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.883+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102a6200 con 0x55f9101aa990 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.883+0000 7fd59d1f6640 1 -- 172.21.15.62:0/693920075 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd59800a4a0 con 0x55f9101aa990 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.883+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102ab510 0x55f9102ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.883+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102adfa0 con 0x55f9102ab510 2024-04-26T07:54:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.883+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102ab510 0x55f9102ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.884+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102ab510 0x55f9102ad900 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.884+0000 7fd59c9f5640 1 -- 172.21.15.62:0/693920075 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd59002e070 con 0x55f9102ab510 2024-04-26T07:54:36.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.884+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102aa490 con 0x55f9101aa990 2024-04-26T07:54:36.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.884+0000 7fd59d1f6640 1 -- 172.21.15.62:0/693920075 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd59800a4a0 con 0x55f9101aa990 2024-04-26T07:54:36.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.884+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102aa970 con 0x55f9101aa990 2024-04-26T07:54:36.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd59d1f6640 1 -- 172.21.15.62:0/693920075 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd59800a4a0 con 0x55f9101aa990 2024-04-26T07:54:36.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd5a0d33800 1 Processor -- start 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd5a0d33800 1 -- start start 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd5a0d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102bd110 0x55f9102bd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd5a0d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f910099170 con 0x55f9102bd110 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd59d1f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102bd110 0x55f9102bd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd59d1f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102bd110 0x55f9102bd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33598/0 (socket says 172.21.15.62:33598) 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd59d1f6640 1 -- 172.21.15.62:0/626900737 learned_addr learned my addr 172.21.15.62:0/626900737 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.885+0000 7fd59d1f6640 1 -- 172.21.15.62:0/626900737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9102bda70 con 0x55f9102bd110 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.886+0000 7fd59d1f6640 1 --2- 172.21.15.62:0/626900737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102bd110 0x55f9102bd530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55f9102a28c0 tx=0x7fd5980188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.886+0000 7fd4827fc640 1 -- 172.21.15.62:0/626900737 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd598014450 con 0x55f9102bd110 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.886+0000 7fd4827fc640 1 -- 172.21.15.62:0/626900737 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5980145f0 con 0x55f9102bd110 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.886+0000 7fd5a0d33800 1 -- 172.21.15.62:0/626900737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9102be4e0 con 0x55f9102bd110 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.886+0000 7fd4827fc640 1 -- 172.21.15.62:0/626900737 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5980148d0 con 0x55f9102bd110 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.886+0000 7fd5a0d33800 1 -- 172.21.15.62:0/626900737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9102be9e0 con 0x55f9102bd110 2024-04-26T07:54:36.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd4827fc640 1 -- 172.21.15.62:0/626900737 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd598011040 con 0x55f9102bd110 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd4827fc640 1 --2- 172.21.15.62:0/626900737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd474036eb0 0x7fd474039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd4827fc640 1 -- 172.21.15.62:0/626900737 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fd59801e070 con 0x55f9102bd110 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/626900737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd474036eb0 0x7fd474039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd5a0d33800 1 Processor -- start 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd5a0d33800 1 -- start start 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/626900737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd474036eb0 0x7fd474039370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd5900178f0 tx=0x7fd59004bab0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd5a0d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd5a0d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9101a5480 con 0x55f9102ca3d0 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd59d1f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd59d1f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33604/0 (socket says 172.21.15.62:33604) 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.887+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3885089058 learned_addr learned my addr 172.21.15.62:0/3885089058 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.888+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3885089058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9102cadc0 con 0x55f9102ca3d0 2024-04-26T07:54:36.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.888+0000 7fd59d1f6640 1 --2- 172.21.15.62:0/3885089058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102ca7f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd59804cee0 tx=0x7fd598011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ab737f07aab1e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.888+0000 7fd473fff640 1 -- 172.21.15.62:0/3885089058 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd598041080 con 0x55f9102ca3d0 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.888+0000 7fd473fff640 1 -- 172.21.15.62:0/3885089058 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5980167c0 con 0x55f9102ca3d0 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.888+0000 7fd473fff640 1 -- 172.21.15.62:0/3885089058 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd598013ca0 con 0x55f9102ca3d0 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.888+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3885089058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 msgr2=0x55f9102ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.888+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3885089058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102ca7f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd59804cee0 tx=0x7fd598011700 comp rx=0 tx=0).stop 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3885089058 shutdown_connections 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3885089058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102ca7f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3885089058 >> 172.21.15.62:0/3885089058 conn(0x55f9102c66e0 msgr2=0x55f9102c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3885089058 shutdown_connections 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3885089058 wait complete. 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 Processor -- start 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 -- start start 2024-04-26T07:54:36.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102d1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd5a0d33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9102cb590 con 0x55f9102ca3d0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd59d1f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd59d1f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33606/0 (socket says 172.21.15.62:33606) 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 learned_addr learned my addr 172.21.15.62:0/3305832720 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.889+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9102d1eb0 con 0x55f9102ca3d0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.890+0000 7fd59d1f6640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102d1970 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd598048010 tx=0x7fd59804ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.890+0000 7fd4727fc640 1 -- 172.21.15.62:0/3305832720 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd598022a80 con 0x55f9102ca3d0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.890+0000 7fd4727fc640 1 -- 172.21.15.62:0/3305832720 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd598031070 con 0x55f9102ca3d0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.890+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9102d2140 con 0x55f9102ca3d0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.890+0000 7fd4727fc640 1 -- 172.21.15.62:0/3305832720 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd598022d50 con 0x55f9102ca3d0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.890+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9102d4df0 con 0x55f9102ca3d0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd4727fc640 1 -- 172.21.15.62:0/3305832720 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd59802b350 con 0x55f9102ca3d0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd4727fc640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd468036eb0 0x7fd468039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd4727fc640 1 -- 172.21.15.62:0/3305832720 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fd59800e040 con 0x55f9102ca3d0 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd468036eb0 0x7fd468039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9102dd5f0 0x55f9102dfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e01e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd597fff640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9102dd5f0 0x55f9102dfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.891+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd468036eb0 0x7fd468039370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd590017fd0 tx=0x7fd590035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd597fff640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9102dd5f0 0x55f9102dfa90 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 20 realm 2024-04-26T07:54:36.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e0600 con 0x55f9102dd5f0 2024-04-26T07:54:36.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:36.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e0ea0 con 0x55f9102dd5f0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.892+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e1240 con 0x55f9102dd5f0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd5a0d33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102e1fa0 0x55f9102e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e48d0 con 0x55f9102e1fa0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd59d1f6640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102e1fa0 0x55f9102e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd59d1f6640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102e1fa0 0x55f9102e4390 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd5a0d33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd5a0d33800 20 searching for the correct realm 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f9102e6950 0x55f9102e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.893+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f9102e6950 0x55f9102e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.894+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f9102e6950 0x55f9102e8e10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.894+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.894+0000 7fd59c9f5640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd59000f070 0x7fd59004a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.894+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x7fd59000f070 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.894+0000 7fd597fff640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd59000f070 0x7fd59004a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.895+0000 7fd597fff640 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd59000f070 0x7fd59004a0e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.895+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.895+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.895+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.895+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.895+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.895+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.896+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.896+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.896+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.896+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.896+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.896+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x7fd59000f070 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.896+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.896+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.897+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.897+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.897+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.897+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.897+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.897+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.898+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.898+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x7fd59000f070 2024-04-26T07:54:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.898+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.898+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.898+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.898+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.898+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.898+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.899+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.899+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.899+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.899+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.899+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.899+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.899+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.899+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.900+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.900+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.900+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.900+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.900+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.900+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x7fd59000f070 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.900+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.900+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.901+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.901+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.901+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.901+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.901+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.901+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.902+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.902+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x7fd59000f070 2024-04-26T07:54:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.902+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.902+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e6950 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.902+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.902+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102e1fa0 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.902+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.902+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x55f9102dd5f0 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e94e0 con 0x7fd59000f070 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e5350 con 0x55f9102dd5f0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102dd5f0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.903+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e5cb0 con 0x55f9102dd5f0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 20 zone default found 2024-04-26T07:54:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 4 Realm: () 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 20 zonegroup default 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e1fa0 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e4fb0 con 0x55f9102e6950 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.904+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102ebcc0 con 0x55f9102e6950 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.905+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.905+0000 7fd5a0d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.905+0000 7fd5a0d33800 20 started sync module instance, tier type = 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.905+0000 7fd5a0d33800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.905+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eb020 con 0x7fd59000f070 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.906+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.906+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94528206714176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eb020 con 0x7fd59000f070 2024-04-26T07:54:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.906+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102ec7a0 con 0x55f9102dd5f0 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.907+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94528206714176] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.907+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.907+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94528206717584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eb020 con 0x55f9102dd5f0 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.907+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102ed210 con 0x55f9102e6950 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.908+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94528206717584] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.908+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.908+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94528206711664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eaf90 con 0x55f9102e6950 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.908+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102ee0d0 con 0x7fd59000f070 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.909+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.909+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94528206711664] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.909+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94528206724336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102ee5c0 con 0x7fd59000f070 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.909+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eee50 con 0x55f9102dd5f0 2024-04-26T07:54:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.910+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.910+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94528206726592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eea20 con 0x55f9102dd5f0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.910+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102efe00 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.913+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94528206724336] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.913+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94528206726592] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.913+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.913+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94528206729792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102ef910 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.913+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102f0310 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.914+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94528206729792] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.914+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.914+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94528206725392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102f02d0 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.914+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102f0d30 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94528206725392] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94528206732832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102f0cf0 con 0x55f9102e1fa0 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd5a0d33800 20 add_watcher() i=0 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd5a0d33800 20 add_watcher() i=1 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd5a0d33800 20 add_watcher() i=2 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd5a0d33800 20 add_watcher() i=3 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd5a0d33800 20 add_watcher() i=4 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd5a0d33800 20 add_watcher() i=5 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.915+0000 7fd5a0d33800 20 add_watcher() i=6 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.916+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94528206732832] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.916+0000 7fd5a0d33800 20 add_watcher() i=7 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.916+0000 7fd5a0d33800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.916+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f9102f4180 con 0x55f9102dd5f0 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.916+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.916+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94528206735888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102f1600 con 0x55f9102dd5f0 2024-04-26T07:54:36.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.917+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94528206735888] v27'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.917+0000 7fd452fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.917+0000 7fd5a0d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:36.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.917+0000 7fd5a0d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:36.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.917+0000 7fd5a0d33800 5 note: GC not initialized 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.918+0000 7fd451fe3640 20 reqs_thread_entry: start 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.918+0000 7fd5a0d33800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.918+0000 7fd5a0d33800 20 Filter name: none 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.918+0000 7fd3c37fe640 20 reqs_thread_entry: start 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.918+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f910326e80 con 0x55f9102e6950 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.919+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.919+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f910326e80 con 0x55f9102e6950 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.919+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.919+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f910326e80 con 0x55f9102dd5f0 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.919+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(64 [pgnls start_epoch 27 out=127b] v27'3 uv3 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.919+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102dd5f0 2024-04-26T07:54:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.919+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v27'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.919+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x7fd59000f070 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.920+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.920+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102e6950 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.920+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.920+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102dd5f0 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.920+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.920+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102e6950 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.920+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.920+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x7fd59000f070 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.921+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.921+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102e6950 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.921+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.921+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102dd5f0 2024-04-26T07:54:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.921+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.921+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.921+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.921+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.922+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.922+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e6950 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.922+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.922+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.922+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.922+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.922+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.922+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e1fa0 2024-04-26T07:54:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.923+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.923+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e6950 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.923+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.923+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x7fd59000f070 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.923+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(80 [pgnls start_epoch 27 out=70b] v27'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.923+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102dd5f0 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.923+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.923+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102dd5f0 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.924+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.924+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e6950 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.924+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.924+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x7fd59000f070 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.924+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.924+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e1fa0 2024-04-26T07:54:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.924+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.924+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102dd5f0 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.925+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.925+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e1fa0 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.925+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.925+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e6950 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.925+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.925+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x7fd59000f070 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.925+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.925+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e1fa0 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.926+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.926+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102dd5f0 2024-04-26T07:54:36.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.926+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.926+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x55f9102e6950 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.926+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.926+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e9960 con 0x7fd59000f070 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.926+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(93 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.927+0000 7fd5a0d33800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.927+0000 7fd5a0d33800 20 RGWRados::pool_iterate: got myfoo 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.927+0000 7fd452fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.927+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94528206735888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102dd5f0 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.928+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94528206735888] v27'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.928+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94528206714176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x7fd59000f070 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.929+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94528206714176] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.929+0000 7fd5a0d33800 20 remove_watcher() i=0 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.929+0000 7fd5a0d33800 2 removed watcher, disabling cache 2024-04-26T07:54:36.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.929+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94528206717584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102dd5f0 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.930+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94528206717584] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.930+0000 7fd5a0d33800 20 remove_watcher() i=1 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.930+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94528206711664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102e57d0 con 0x55f9102e6950 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.931+0000 7fd59c9f5640 1 -- 172.21.15.62:0/3305832720 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94528206711664] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59003b040 con 0x55f9102e6950 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.931+0000 7fd5a0d33800 20 remove_watcher() i=2 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.931+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94528206724336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eab70 con 0x7fd59000f070 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.932+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94528206724336] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x7fd59000f070 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.932+0000 7fd5a0d33800 20 remove_watcher() i=3 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.932+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94528206726592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eab70 con 0x55f9102dd5f0 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.933+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94528206726592] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58805a040 con 0x55f9102dd5f0 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.933+0000 7fd5a0d33800 20 remove_watcher() i=4 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.933+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94528206729792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102ee5c0 con 0x55f9102e1fa0 2024-04-26T07:54:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.934+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94528206729792] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.934+0000 7fd5a0d33800 20 remove_watcher() i=5 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.935+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94528206725392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eab70 con 0x55f9102e1fa0 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.935+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94528206725392] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.935+0000 7fd5a0d33800 20 remove_watcher() i=6 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.935+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94528206732832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f9102eab70 con 0x55f9102e1fa0 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd59d1f6640 1 -- 172.21.15.62:0/3305832720 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94528206732832] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59802a070 con 0x55f9102e1fa0 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 20 remove_watcher() i=7 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102e1fa0 msgr2=0x55f9102e4390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102e1fa0 0x55f9102e4390 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9102dd5f0 msgr2=0x55f9102dfa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9102dd5f0 0x55f9102dfa90 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd59000f070 msgr2=0x7fd59004a0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd59000f070 0x7fd59004a0e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f9102e6950 msgr2=0x55f9102e8e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.936+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f9102e6950 0x55f9102e8e10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd468036eb0 msgr2=0x7fd468039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd468036eb0 0x7fd468039370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd590017fd0 tx=0x7fd590035000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 msgr2=0x55f9102d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102d1970 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd598048010 tx=0x7fd59804ce70 comp rx=0 tx=0).stop 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd597fff640 1 -- 172.21.15.62:0/3305832720 reap_dead start 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 shutdown_connections 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/3305832720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102ca3d0 0x55f9102d1970 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 >> 172.21.15.62:0/3305832720 conn(0x55f9102c66e0 msgr2=0x55f9102c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 shutdown_connections 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/3305832720 wait complete. 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/626900737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd474036eb0 msgr2=0x7fd474039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/626900737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd474036eb0 0x7fd474039370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd5900178f0 tx=0x7fd59004bab0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/626900737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102bd110 msgr2=0x55f9102bd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/626900737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102bd110 0x55f9102bd530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55f9102a28c0 tx=0x7fd5980188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/626900737 shutdown_connections 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/626900737 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd474036eb0 0x7fd474039370 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/626900737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9102bd110 0x55f9102bd530 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/626900737 >> 172.21.15.62:0/626900737 conn(0x55f9102b11b0 msgr2=0x55f9102b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/626900737 shutdown_connections 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.937+0000 7fd5a0d33800 1 -- 172.21.15.62:0/626900737 wait complete. 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102ab510 msgr2=0x55f9102ad900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102ab510 0x55f9102ad900 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9101aa990 msgr2=0x55f9102a8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9101aa990 0x55f9102a8c30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd484036e60 msgr2=0x7fd484039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd484036e60 0x7fd484039320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd588054000 tx=0x7fd58804e000 comp rx=0 tx=0).stop 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 msgr2=0x55f9102a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9102a19f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd59000c010 tx=0x7fd590000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 shutdown_connections 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9101aa990 0x55f9102a8c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f9102ab510 0x55f9102ad900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd484036e60 0x7fd484039320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 --2- 172.21.15.62:0/693920075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f910119860 0x55f9102a19f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 >> 172.21.15.62:0/693920075 conn(0x55f9101a0b90 msgr2=0x55f9101a59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 shutdown_connections 2024-04-26T07:54:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:36.938+0000 7fd5a0d33800 1 -- 172.21.15.62:0/693920075 wait complete. 2024-04-26T07:54:36.949 INFO:teuthology.orchestra.run.smithi062.stdout:["myfoo"] 2024-04-26T07:54:36.949 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-26T07:54:36.964 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:36.977 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:36.988 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:37.031 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-04-26T07:54:37.059 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:37.087 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:37.116 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:37.116 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T07:54:37.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T07:54:37.116 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T07:54:37.160 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:37.161 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:37.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77fa0e800 1 Processor -- start 2024-04-26T07:54:37.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77fa0e800 1 -- start start 2024-04-26T07:54:37.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77fa0e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a2b48b0110 0x55a2b48b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77fa0e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2b48b6550 con 0x55a2b48b2a40 2024-04-26T07:54:37.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77fa0e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55a2b4751e20 con 0x55a2b48b0110 2024-04-26T07:54:37.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77d50d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a2b48b0110 0x55a2b48b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77cd0c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55a2b48b2a40 0x55a2b48b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36664/0 (socket says 172.21.15.62:36664) 2024-04-26T07:54:37.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77d50d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a2b48b0110 0x55a2b48b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33614/0 (socket says 172.21.15.62:33614) 2024-04-26T07:54:37.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.163+0000 7fc77cd0c640 1 -- 172.21.15.62:0/914191815 learned_addr learned my addr 172.21.15.62:0/914191815 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:37.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.164+0000 7fc77d50d640 1 -- 172.21.15.62:0/914191815 >> v1:172.21.15.1:6789/0 conn(0x55a2b48b2a40 legacy=0x55a2b48b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.164+0000 7fc77d50d640 1 -- 172.21.15.62:0/914191815 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b48b7730 con 0x55a2b48b0110 2024-04-26T07:54:37.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.165+0000 7fc77d50d640 1 --2- 172.21.15.62:0/914191815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b48b2500 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc77000a470 tx=0x7fc77001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416607069d17a50f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc76ffff640 1 -- 172.21.15.62:0/914191815 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc770057070 con 0x55a2b48b0110 2024-04-26T07:54:37.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc76ffff640 1 -- 172.21.15.62:0/914191815 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc770052570 con 0x55a2b48b0110 2024-04-26T07:54:37.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc76ffff640 1 -- 172.21.15.62:0/914191815 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc770052870 con 0x55a2b48b0110 2024-04-26T07:54:37.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc77fa0e800 1 -- 172.21.15.62:0/914191815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 msgr2=0x55a2b48b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/914191815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b48b2500 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc77000a470 tx=0x7fc77001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:37.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc77fa0e800 1 -- 172.21.15.62:0/914191815 shutdown_connections 2024-04-26T07:54:37.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/914191815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b48b2500 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc77fa0e800 1 -- 172.21.15.62:0/914191815 >> 172.21.15.62:0/914191815 conn(0x55a2b48a9ba0 msgr2=0x55a2b48abfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc77fa0e800 1 -- 172.21.15.62:0/914191815 shutdown_connections 2024-04-26T07:54:37.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.166+0000 7fc77fa0e800 1 -- 172.21.15.62:0/914191815 wait complete. 2024-04-26T07:54:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.179+0000 7fc77fa0e800 1 Processor -- start 2024-04-26T07:54:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.179+0000 7fc77fa0e800 1 -- start start 2024-04-26T07:54:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.179+0000 7fc77fa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.179+0000 7fc77fa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a2b47facd0 con 0x55a2b48b0110 2024-04-26T07:54:37.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.179+0000 7fc77d50d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.179+0000 7fc77d50d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33622/0 (socket says 172.21.15.62:33622) 2024-04-26T07:54:37.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.179+0000 7fc77d50d640 1 -- 172.21.15.62:0/3759939629 learned_addr learned my addr 172.21.15.62:0/3759939629 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.180+0000 7fc77d50d640 1 -- 172.21.15.62:0/3759939629 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b49a1250 con 0x55a2b48b0110 2024-04-26T07:54:37.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.180+0000 7fc77d50d640 1 --2- 172.21.15.62:0/3759939629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a0c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc770055040 tx=0x7fc77004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0378db93d975402 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.180+0000 7fc66b606640 1 -- 172.21.15.62:0/3759939629 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc770057040 con 0x55a2b48b0110 2024-04-26T07:54:37.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.180+0000 7fc66b606640 1 -- 172.21.15.62:0/3759939629 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc770052990 con 0x55a2b48b0110 2024-04-26T07:54:37.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.180+0000 7fc66b606640 1 -- 172.21.15.62:0/3759939629 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc770052c70 con 0x55a2b48b0110 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 -- 172.21.15.62:0/3759939629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 msgr2=0x55a2b49a0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/3759939629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a0c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc770055040 tx=0x7fc77004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 -- 172.21.15.62:0/3759939629 shutdown_connections 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/3759939629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a0c80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 -- 172.21.15.62:0/3759939629 >> 172.21.15.62:0/3759939629 conn(0x55a2b48a9ba0 msgr2=0x55a2b499c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 -- 172.21.15.62:0/3759939629 shutdown_connections 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 -- 172.21.15.62:0/3759939629 wait complete. 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 Processor -- start 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 -- start start 2024-04-26T07:54:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77fa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a2b48b69c0 con 0x55a2b48b0110 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77d50d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77d50d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33632/0 (socket says 172.21.15.62:33632) 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.181+0000 7fc77d50d640 1 -- 172.21.15.62:0/1010045036 learned_addr learned my addr 172.21.15.62:0/1010045036 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.182+0000 7fc77d50d640 1 -- 172.21.15.62:0/1010045036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b49a8bd0 con 0x55a2b48b0110 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.182+0000 7fc77d50d640 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a8690 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc77000a470 tx=0x7fc770003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.182+0000 7fc669e03640 1 -- 172.21.15.62:0/1010045036 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc770073070 con 0x55a2b48b0110 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.182+0000 7fc669e03640 1 -- 172.21.15.62:0/1010045036 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77005d780 con 0x55a2b48b0110 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.182+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b49a8e60 con 0x55a2b48b0110 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.182+0000 7fc669e03640 1 -- 172.21.15.62:0/1010045036 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc770057070 con 0x55a2b48b0110 2024-04-26T07:54:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.182+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b49abb10 con 0x55a2b48b0110 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.183+0000 7fc669e03640 1 -- 172.21.15.62:0/1010045036 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc770076070 con 0x55a2b48b0110 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.183+0000 7fc669e03640 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc664036e60 0x7fc664039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.183+0000 7fc669e03640 1 -- 172.21.15.62:0/1010045036 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fc77008e670 con 0x55a2b48b0110 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.183+0000 7fc77cd0c640 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc664036e60 0x7fc664039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.183+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b48b2a40 0x55a2b49af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.183+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49afea0 con 0x55a2b48b2a40 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.183+0000 7fc77dd0e640 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b48b2a40 0x55a2b49af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.183+0000 7fc77cd0c640 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc664036e60 0x7fc664039320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc774000f60 tx=0x7fc7740012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.184+0000 7fc77dd0e640 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b48b2a40 0x55a2b49af8d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.184+0000 7fc77dd0e640 1 -- 172.21.15.62:0/1010045036 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc77800a4a0 con 0x55a2b48b2a40 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.184+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49ace80 con 0x55a2b48b2a40 2024-04-26T07:54:37.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.184+0000 7fc77dd0e640 1 -- 172.21.15.62:0/1010045036 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc77800a4a0 con 0x55a2b48b2a40 2024-04-26T07:54:37.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.184+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49b21b0 0x55a2b49b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.184+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49b4c40 con 0x55a2b49b21b0 2024-04-26T07:54:37.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.184+0000 7fc77d50d640 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49b21b0 0x55a2b49b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.185+0000 7fc77d50d640 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49b21b0 0x55a2b49b45a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.185+0000 7fc77d50d640 1 -- 172.21.15.62:0/1010045036 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49b21b0 2024-04-26T07:54:37.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.185+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49b1160 con 0x55a2b48b2a40 2024-04-26T07:54:37.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.185+0000 7fc77dd0e640 1 -- 172.21.15.62:0/1010045036 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc77800a4a0 con 0x55a2b48b2a40 2024-04-26T07:54:37.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.185+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49b15f0 con 0x55a2b48b2a40 2024-04-26T07:54:37.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.186+0000 7fc77dd0e640 1 -- 172.21.15.62:0/1010045036 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc77800a4a0 con 0x55a2b48b2a40 2024-04-26T07:54:37.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.186+0000 7fc77fa0e800 1 Processor -- start 2024-04-26T07:54:37.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.186+0000 7fc77fa0e800 1 -- start start 2024-04-26T07:54:37.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.186+0000 7fc77fa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49c3e20 0x55a2b49c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.186+0000 7fc77fa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a2b47a2170 con 0x55a2b49c3e20 2024-04-26T07:54:37.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.186+0000 7fc77dd0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49c3e20 0x55a2b49c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.186+0000 7fc77dd0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49c3e20 0x55a2b49c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33648/0 (socket says 172.21.15.62:33648) 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.186+0000 7fc77dd0e640 1 -- 172.21.15.62:0/1125698276 learned_addr learned my addr 172.21.15.62:0/1125698276 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.187+0000 7fc77dd0e640 1 -- 172.21.15.62:0/1125698276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b49c4780 con 0x55a2b49c3e20 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.187+0000 7fc77dd0e640 1 --2- 172.21.15.62:0/1125698276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49c3e20 0x55a2b49c4240 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55a2b49b0280 tx=0x7fc778018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.187+0000 7fc662ffd640 1 -- 172.21.15.62:0/1125698276 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc778014450 con 0x55a2b49c3e20 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.187+0000 7fc662ffd640 1 -- 172.21.15.62:0/1125698276 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc778014610 con 0x55a2b49c3e20 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.187+0000 7fc662ffd640 1 -- 172.21.15.62:0/1125698276 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc778014930 con 0x55a2b49c3e20 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.187+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1125698276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b49c51f0 con 0x55a2b49c3e20 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.187+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1125698276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b49c56f0 con 0x55a2b49c3e20 2024-04-26T07:54:37.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc662ffd640 1 -- 172.21.15.62:0/1125698276 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc778011040 con 0x55a2b49c3e20 2024-04-26T07:54:37.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc662ffd640 1 --2- 172.21.15.62:0/1125698276 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc654036eb0 0x7fc654039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc662ffd640 1 -- 172.21.15.62:0/1125698276 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fc77801e070 con 0x55a2b49c3e20 2024-04-26T07:54:37.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc77d50d640 1 --2- 172.21.15.62:0/1125698276 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc654036eb0 0x7fc654039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc77fa0e800 1 Processor -- start 2024-04-26T07:54:37.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc77d50d640 1 --2- 172.21.15.62:0/1125698276 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc654036eb0 0x7fc654039370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55a2b49b02f0 tx=0x7fc770077f20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc77fa0e800 1 -- start start 2024-04-26T07:54:37.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc77fa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.188+0000 7fc77fa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a2b49a1510 con 0x55a2b49d10a0 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.189+0000 7fc77dd0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.189+0000 7fc77dd0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33664/0 (socket says 172.21.15.62:33664) 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.189+0000 7fc77dd0e640 1 -- 172.21.15.62:0/2046334870 learned_addr learned my addr 172.21.15.62:0/2046334870 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.189+0000 7fc77dd0e640 1 -- 172.21.15.62:0/2046334870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b49d1a90 con 0x55a2b49d10a0 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.189+0000 7fc77dd0e640 1 --2- 172.21.15.62:0/2046334870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d14c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc77804cf50 tx=0x7fc778011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf909e2f00c32bfc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.189+0000 7fc660ff9640 1 -- 172.21.15.62:0/2046334870 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc778041180 con 0x55a2b49d10a0 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.189+0000 7fc660ff9640 1 -- 172.21.15.62:0/2046334870 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc778013c90 con 0x55a2b49d10a0 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.189+0000 7fc660ff9640 1 -- 172.21.15.62:0/2046334870 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc778014ad0 con 0x55a2b49d10a0 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 -- 172.21.15.62:0/2046334870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 msgr2=0x55a2b49d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/2046334870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d14c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc77804cf50 tx=0x7fc778011700 comp rx=0 tx=0).stop 2024-04-26T07:54:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 -- 172.21.15.62:0/2046334870 shutdown_connections 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/2046334870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d14c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 -- 172.21.15.62:0/2046334870 >> 172.21.15.62:0/2046334870 conn(0x55a2b49cd400 msgr2=0x55a2b49cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 -- 172.21.15.62:0/2046334870 shutdown_connections 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 -- 172.21.15.62:0/2046334870 wait complete. 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 Processor -- start 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 -- start start 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77fa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a2b49d2200 con 0x55a2b49d10a0 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77dd0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77dd0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33666/0 (socket says 172.21.15.62:33666) 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.190+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 learned_addr learned my addr 172.21.15.62:0/4105535033 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.191+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b49d8bc0 con 0x55a2b49d10a0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.191+0000 7fc77dd0e640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d8680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc77804be70 tx=0x7fc77804cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.191+0000 7fc652ffd640 1 -- 172.21.15.62:0/4105535033 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc778016940 con 0x55a2b49d10a0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.191+0000 7fc652ffd640 1 -- 172.21.15.62:0/4105535033 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc778042040 con 0x55a2b49d10a0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.191+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b49d8e50 con 0x55a2b49d10a0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.191+0000 7fc652ffd640 1 -- 172.21.15.62:0/4105535033 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc77804e3c0 con 0x55a2b49d10a0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.191+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b49dbb00 con 0x55a2b49d10a0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.192+0000 7fc652ffd640 1 -- 172.21.15.62:0/4105535033 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc77804e560 con 0x55a2b49d10a0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.192+0000 7fc652ffd640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc648036eb0 0x7fc648039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.192+0000 7fc652ffd640 1 -- 172.21.15.62:0/4105535033 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fc77800e040 con 0x55a2b49d10a0 2024-04-26T07:54:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.192+0000 7fc77d50d640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc648036eb0 0x7fc648039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.192+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.192+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b49e4180 0x55a2b49e6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.192+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49e6d90 con 0x55a2b49e4180 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.192+0000 7fc77cd0c640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b49e4180 0x55a2b49e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77d50d640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc648036eb0 0x7fc648039370 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55a2b49b5040 tx=0x7fc770089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77cd0c640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b49e4180 0x55a2b49e6640 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc774009050 con 0x55a2b49e4180 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 20 realm 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49e35d0 con 0x55a2b49e4180 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc774009050 con 0x55a2b49e4180 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49e7870 con 0x55a2b49e4180 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc774009050 con 0x55a2b49e4180 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.193+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49e8140 con 0x55a2b49e4180 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.194+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc774009050 con 0x55a2b49e4180 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.194+0000 7fc77fa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.194+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.194+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49e89f0 0x55a2b49eade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.194+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49eb520 con 0x55a2b49e89f0 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.194+0000 7fc77dd0e640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49e89f0 0x55a2b49eade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.194+0000 7fc77dd0e640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49e89f0 0x55a2b49eade0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.195+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.195+0000 7fc77fa0e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.195+0000 7fc77fa0e800 20 searching for the correct realm 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.195+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a2b49ed5d0 0x55a2b49efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.195+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.195+0000 7fc77d50d640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a2b49ed5d0 0x55a2b49efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.195+0000 7fc77d50d640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a2b49ed5d0 0x55a2b49efa90 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.195+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.196+0000 7fc77d50d640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc77009c040 0x7fc7700773b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.196+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x7fc77009c040 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.196+0000 7fc77cd0c640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc77009c040 0x7fc7700773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.196+0000 7fc77cd0c640 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc77009c040 0x7fc7700773b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.196+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774009050 con 0x7fc77009c040 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.196+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.197+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.197+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e4180 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.197+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774009050 con 0x55a2b49e4180 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.197+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e4180 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.197+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.197+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.197+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.197+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.198+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.198+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x7fc77009c040 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.198+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774029040 con 0x7fc77009c040 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.198+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.198+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.198+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e4180 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.198+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.198+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.199+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.199+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e4180 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.199+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.199+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x7fc77009c040 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.199+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc774029040 con 0x7fc77009c040 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.199+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.199+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.199+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.200+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.200+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.200+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.200+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.200+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.200+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.200+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.200+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e4180 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.201+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.201+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e4180 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.201+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.201+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.201+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.201+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.202+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.202+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x7fc77009c040 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.202+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774029040 con 0x7fc77009c040 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.202+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e4180 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.202+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.202+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.202+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.202+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.203+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.203+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.203+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.203+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x7fc77009c040 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.203+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774029040 con 0x7fc77009c040 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.203+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49ed5d0 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e89f0 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x55a2b49e4180 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f0160 con 0x7fc77009c040 2024-04-26T07:54:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc774029040 con 0x7fc77009c040 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77fa0e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77fa0e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77fa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77fa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77fa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77fa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.204+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49ebfd0 con 0x55a2b49e4180 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49ec450 con 0x55a2b49e4180 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49ec930 con 0x55a2b49e4180 2024-04-26T07:54:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc774029040 con 0x55a2b49e4180 2024-04-26T07:54:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 20 zone default found 2024-04-26T07:54:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 4 Realm: () 2024-04-26T07:54:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 20 zonegroup default 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.205+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f05e0 con 0x55a2b49e89f0 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f2810 con 0x55a2b49ed5d0 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f2bb0 con 0x55a2b49ed5d0 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 20 started sync module instance, tier type = 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.206+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f1c50 con 0x7fc77009c040 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.207+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774039040 con 0x7fc77009c040 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.207+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94157303390272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f1c50 con 0x7fc77009c040 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.207+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f3440 con 0x55a2b49e4180 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.208+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94157303390272] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774039040 con 0x7fc77009c040 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.208+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774039040 con 0x55a2b49e4180 2024-04-26T07:54:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.208+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94157303394128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f1c50 con 0x55a2b49e4180 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.208+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f3ec0 con 0x55a2b49ed5d0 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.209+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94157303394128] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774039040 con 0x55a2b49e4180 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.210+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.210+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94157303388064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f1bc0 con 0x55a2b49ed5d0 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.210+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f4ca0 con 0x7fc77009c040 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.211+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94157303388064] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.211+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774039040 con 0x7fc77009c040 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.211+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94157303399136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f5090 con 0x7fc77009c040 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.211+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f5ab0 con 0x55a2b49e4180 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.212+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774039040 con 0x55a2b49e4180 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.212+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94157303403936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f5a70 con 0x55a2b49e4180 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.212+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f6a20 con 0x55a2b49e89f0 2024-04-26T07:54:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.212+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94157303399136] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774039040 con 0x7fc77009c040 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.213+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94157303403936] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774039040 con 0x55a2b49e4180 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.213+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.213+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94157303406288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f69e0 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.213+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f69e0 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.214+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94157303406288] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.214+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.214+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94157303407856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f69e0 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.214+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f7910 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94157303407856] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94157303411680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f7d80 con 0x55a2b49e89f0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77fa0e800 20 add_watcher() i=0 2024-04-26T07:54:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77fa0e800 20 add_watcher() i=1 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77fa0e800 20 add_watcher() i=2 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77fa0e800 20 add_watcher() i=3 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77fa0e800 20 add_watcher() i=4 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77fa0e800 20 add_watcher() i=5 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.215+0000 7fc77fa0e800 20 add_watcher() i=6 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.216+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94157303411680] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.216+0000 7fc77fa0e800 20 add_watcher() i=7 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.216+0000 7fc77fa0e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.216+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f7d80 con 0x55a2b49e4180 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.216+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc774039040 con 0x55a2b49e4180 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.216+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94157303412944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b49f7cf0 con 0x55a2b49e4180 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.217+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94157303412944] v27'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc774039040 con 0x55a2b49e4180 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.217+0000 7fc6337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.217+0000 7fc77fa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.217+0000 7fc77fa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.218+0000 7fc77fa0e800 5 note: GC not initialized 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.218+0000 7fc6327e4640 20 reqs_thread_entry: start 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.218+0000 7fc77fa0e800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.218+0000 7fc77fa0e800 20 Filter name: none 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.218+0000 7fc5a3fff640 20 reqs_thread_entry: start 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.218+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.218+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a2e4a0 con 0x7fc77009c040 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc774039040 con 0x7fc77009c040 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a2edd0 con 0x55a2b49e4180 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(63 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc774039040 con 0x55a2b49e4180 2024-04-26T07:54:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a2ee10 con 0x7fc77009c040 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc774039040 con 0x7fc77009c040 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.219+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a30530 con 0x55a2b49e4180 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc774039040 con 0x55a2b49e4180 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 4.1a 4:5a581a9c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a2fb90 con 0x7fc77009c040 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 4.16 4:6ac82eb8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a35070 con 0x55a2b49ed5d0 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 4.e 4:7264ccad:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a378e0 con 0x7fc77009c040 2024-04-26T07:54:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 4.24 4:27ab159e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3a270 con 0x55a2b49e89f0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 4.7 4:e3bd6437:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3d0c0 con 0x55a2b49e89f0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 4.3b 4:de750cfa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3fd70 con 0x55a2b49ed5d0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 4.22 4:476c90f1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a425e0 con 0x55a2b49e4180 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 4.1d 4:ba0b4099:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a452e0 con 0x55a2b49ed5d0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 4.7 4:e33164c7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a47d30 con 0x55a2b49e89f0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(66 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc774044060 con 0x7fc77009c040 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(71 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(68 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc774044060 con 0x7fc77009c040 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 4.2e 4:74fb3df0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f860 con 0x55a2b49ed5d0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.220+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:76 4.34 4:2cf2cafa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a425e0 con 0x7fc77009c040 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.221+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(73 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.221+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(70 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.221+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.221+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.221+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(72 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc774044060 con 0x55a2b49e4180 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.221+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(75 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.221+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(76 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc774044060 con 0x7fc77009c040 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.222+0000 7fc6337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.222+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94157303412944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f860 con 0x55a2b49e4180 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.223+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94157303412944] v27'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc774044060 con 0x55a2b49e4180 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.223+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94157303390272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a378e0 con 0x7fc77009c040 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.224+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94157303390272] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774044060 con 0x7fc77009c040 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.224+0000 7fc77fa0e800 20 remove_watcher() i=0 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.224+0000 7fc77fa0e800 2 removed watcher, disabling cache 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.224+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94157303394128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f820 con 0x55a2b49e4180 2024-04-26T07:54:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.225+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94157303394128] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774044060 con 0x55a2b49e4180 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.225+0000 7fc77fa0e800 20 remove_watcher() i=1 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.225+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94157303388064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f820 con 0x55a2b49ed5d0 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.226+0000 7fc77d50d640 1 -- 172.21.15.62:0/4105535033 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94157303388064] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc770075030 con 0x55a2b49ed5d0 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.226+0000 7fc77fa0e800 20 remove_watcher() i=2 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.226+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94157303399136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f820 con 0x7fc77009c040 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.227+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94157303399136] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774044060 con 0x7fc77009c040 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.227+0000 7fc77fa0e800 20 remove_watcher() i=3 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.227+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94157303403936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f820 con 0x55a2b49e4180 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.228+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94157303403936] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc774044060 con 0x55a2b49e4180 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.228+0000 7fc77fa0e800 20 remove_watcher() i=4 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.228+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94157303406288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f820 con 0x55a2b49e89f0 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.229+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94157303406288] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.229+0000 7fc77fa0e800 20 remove_watcher() i=5 2024-04-26T07:54:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.229+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94157303407856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f820 con 0x55a2b49e89f0 2024-04-26T07:54:37.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.230+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94157303407856] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.230+0000 7fc77fa0e800 20 remove_watcher() i=6 2024-04-26T07:54:37.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.230+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94157303411680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a2b4a3f820 con 0x55a2b49e89f0 2024-04-26T07:54:37.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.231+0000 7fc77dd0e640 1 -- 172.21.15.62:0/4105535033 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94157303411680] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc77802a070 con 0x55a2b49e89f0 2024-04-26T07:54:37.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.231+0000 7fc77fa0e800 20 remove_watcher() i=7 2024-04-26T07:54:37.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.231+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49e89f0 msgr2=0x55a2b49eade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.231+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49e89f0 0x55a2b49eade0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.231+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b49e4180 msgr2=0x55a2b49e6640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.231+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b49e4180 0x55a2b49e6640 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.231+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc77009c040 msgr2=0x7fc7700773b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.231+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc77009c040 0x7fc7700773b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a2b49ed5d0 msgr2=0x55a2b49efa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a2b49ed5d0 0x55a2b49efa90 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc648036eb0 msgr2=0x7fc648039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc648036eb0 0x7fc648039370 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55a2b49b5040 tx=0x7fc770089000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 msgr2=0x55a2b49d8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/4105535033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49d10a0 0x55a2b49d8680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc77804be70 tx=0x7fc77804cee0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 reap_dead start 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77cd0c640 1 -- 172.21.15.62:0/4105535033 reap_dead start 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 shutdown_connections 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 >> 172.21.15.62:0/4105535033 conn(0x55a2b49cd400 msgr2=0x55a2b49caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 shutdown_connections 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/4105535033 wait complete. 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1125698276 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc654036eb0 msgr2=0x7fc654039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1125698276 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc654036eb0 0x7fc654039370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55a2b49b02f0 tx=0x7fc770077f20 comp rx=0 tx=0).stop 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1125698276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49c3e20 msgr2=0x55a2b49c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1125698276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49c3e20 0x55a2b49c4240 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55a2b49b0280 tx=0x7fc778018830 comp rx=0 tx=0).stop 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1125698276 shutdown_connections 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1125698276 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc654036eb0 0x7fc654039370 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1125698276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b49c3e20 0x55a2b49c4240 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1125698276 >> 172.21.15.62:0/1125698276 conn(0x55a2b49b7ec0 msgr2=0x55a2b49b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1125698276 shutdown_connections 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1125698276 wait complete. 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49b21b0 msgr2=0x55a2b49b45a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49b21b0 0x55a2b49b45a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b48b2a40 msgr2=0x55a2b49af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.232+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b48b2a40 0x55a2b49af8d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc664036e60 msgr2=0x7fc664039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc664036e60 0x7fc664039320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc774000f60 tx=0x7fc7740012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 msgr2=0x55a2b49a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a8690 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc77000a470 tx=0x7fc770003020 comp rx=0 tx=0).stop 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 shutdown_connections 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a2b48b2a40 0x55a2b49af8d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a2b49b21b0 0x55a2b49b45a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc664036e60 0x7fc664039320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 --2- 172.21.15.62:0/1010045036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a2b48b0110 0x55a2b49a8690 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 >> 172.21.15.62:0/1010045036 conn(0x55a2b48a9ba0 msgr2=0x55a2b499ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 shutdown_connections 2024-04-26T07:54:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.233+0000 7fc77fa0e800 1 -- 172.21.15.62:0/1010045036 wait complete. 2024-04-26T07:54:37.254 INFO:teuthology.orchestra.run.smithi062.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"76158cff-5435-4eb7-bdd8-fb93108eac49","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","marker":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T07:54:36.677226Z","creation_time":"2024-04-26T07:54:36.674214Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T07:54:37.255 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T07:54:36.677226Z', 'creation_time': '2024-04-26T07:54:36.674214Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T07:54:37.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-26T07:54:37.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-26T07:54:37.255 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-26T07:54:37.307 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:37.307 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:37.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.308+0000 7ffb37b1f800 1 Processor -- start 2024-04-26T07:54:37.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.308+0000 7ffb37b1f800 1 -- start start 2024-04-26T07:54:37.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.308+0000 7ffb37b1f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x561d1bd1eae0 0x561d1bd20ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.308+0000 7ffb37b1f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d1bd214a0 con 0x561d1bd1a740 2024-04-26T07:54:37.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.308+0000 7ffb37b1f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x561d1bbbce20 con 0x561d1bd1eae0 2024-04-26T07:54:37.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.309+0000 7ffb32fc9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x561d1bd1eae0 0x561d1bd20ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.309+0000 7ffb32fc9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x561d1bd1eae0 0x561d1bd20ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33676/0 (socket says 172.21.15.62:33676) 2024-04-26T07:54:37.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.309+0000 7ffb337ca640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x561d1bd1a740 0x561d1bd1ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36666/0 (socket says 172.21.15.62:36666) 2024-04-26T07:54:37.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.309+0000 7ffb32fc9640 1 -- 172.21.15.62:0/474097668 learned_addr learned my addr 172.21.15.62:0/474097668 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.309+0000 7ffb32fc9640 1 -- 172.21.15.62:0/474097668 >> v1:172.21.15.1:6789/0 conn(0x561d1bd1a740 legacy=0x561d1bd1ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.309+0000 7ffb32fc9640 1 -- 172.21.15.62:0/474097668 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d1bd226d0 con 0x561d1bd1eae0 2024-04-26T07:54:37.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.309+0000 7ffb327c8640 1 -- 172.21.15.62:0/474097668 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286929641 0 0) 0x561d1bd214a0 con 0x561d1bd1a740 2024-04-26T07:54:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.311+0000 7ffb32fc9640 1 --2- 172.21.15.62:0/474097668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1eae0 0x561d1bd20ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800a520 tx=0x7ffb2801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a514e1bd67a5bbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.311+0000 7ffb327c8640 1 -- 172.21.15.62:0/474097668 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb28057070 con 0x561d1bd1eae0 2024-04-26T07:54:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.311+0000 7ffb327c8640 1 -- 172.21.15.62:0/474097668 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb28052570 con 0x561d1bd1eae0 2024-04-26T07:54:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.311+0000 7ffb327c8640 1 -- 172.21.15.62:0/474097668 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2804ae60 con 0x561d1bd1eae0 2024-04-26T07:54:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.312+0000 7ffb37b1f800 1 -- 172.21.15.62:0/474097668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1eae0 msgr2=0x561d1bd20ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.312+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/474097668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1eae0 0x561d1bd20ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800a520 tx=0x7ffb2801d010 comp rx=0 tx=0).stop 2024-04-26T07:54:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.312+0000 7ffb37b1f800 1 -- 172.21.15.62:0/474097668 shutdown_connections 2024-04-26T07:54:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.312+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/474097668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1eae0 0x561d1bd20ed0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.312+0000 7ffb37b1f800 1 -- 172.21.15.62:0/474097668 >> 172.21.15.62:0/474097668 conn(0x561d1bd15d20 msgr2=0x561d1bd18140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.312+0000 7ffb37b1f800 1 -- 172.21.15.62:0/474097668 shutdown_connections 2024-04-26T07:54:37.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.312+0000 7ffb37b1f800 1 -- 172.21.15.62:0/474097668 wait complete. 2024-04-26T07:54:37.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.324+0000 7ffb37b1f800 1 Processor -- start 2024-04-26T07:54:37.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.325+0000 7ffb37b1f800 1 -- start start 2024-04-26T07:54:37.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.325+0000 7ffb37b1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1bc90030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.325+0000 7ffb37b1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561d1bc65cd0 con 0x561d1bd1a740 2024-04-26T07:54:37.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.325+0000 7ffb337ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1bc90030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.325+0000 7ffb337ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1bc90030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33678/0 (socket says 172.21.15.62:33678) 2024-04-26T07:54:37.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.325+0000 7ffb337ca640 1 -- 172.21.15.62:0/2674927270 learned_addr learned my addr 172.21.15.62:0/2674927270 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.325+0000 7ffb337ca640 1 -- 172.21.15.62:0/2674927270 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d1bc8e5f0 con 0x561d1bd1a740 2024-04-26T07:54:37.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.326+0000 7ffb337ca640 1 --2- 172.21.15.62:0/2674927270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1bc90030 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400b240 tx=0x7ffb2400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38802291e6ef3e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.326+0000 7ffa2160a640 1 -- 172.21.15.62:0/2674927270 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb24008070 con 0x561d1bd1a740 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.326+0000 7ffa2160a640 1 -- 172.21.15.62:0/2674927270 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2400d500 con 0x561d1bd1a740 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.326+0000 7ffa2160a640 1 -- 172.21.15.62:0/2674927270 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2400d860 con 0x561d1bd1a740 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2674927270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 msgr2=0x561d1bc90030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2674927270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1bc90030 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400b240 tx=0x7ffb2400b700 comp rx=0 tx=0).stop 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2674927270 shutdown_connections 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2674927270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1bc90030 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2674927270 >> 172.21.15.62:0/2674927270 conn(0x561d1bd15d20 msgr2=0x561d1be07320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2674927270 shutdown_connections 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2674927270 wait complete. 2024-04-26T07:54:37.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 Processor -- start 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 -- start start 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1be157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb37b1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561d1bd21970 con 0x561d1bd1a740 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb337ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1be157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb337ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1be157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33684/0 (socket says 172.21.15.62:33684) 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.327+0000 7ffb337ca640 1 -- 172.21.15.62:0/2401222012 learned_addr learned my addr 172.21.15.62:0/2401222012 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.328+0000 7ffb337ca640 1 -- 172.21.15.62:0/2401222012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d1be15d30 con 0x561d1bd1a740 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.328+0000 7ffb337ca640 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1be157f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffb24000f60 tx=0x7ffb24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.328+0000 7ffa1fe07640 1 -- 172.21.15.62:0/2401222012 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb24019870 con 0x561d1bd1a740 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.328+0000 7ffa1fe07640 1 -- 172.21.15.62:0/2401222012 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb24019a10 con 0x561d1bd1a740 2024-04-26T07:54:37.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.328+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d1be15fc0 con 0x561d1bd1a740 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.328+0000 7ffa1fe07640 1 -- 172.21.15.62:0/2401222012 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb24019d10 con 0x561d1bd1a740 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.328+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d1be18c70 con 0x561d1bd1a740 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.329+0000 7ffa1fe07640 1 -- 172.21.15.62:0/2401222012 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb24017040 con 0x561d1bd1a740 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.329+0000 7ffa1fe07640 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa18036eb0 0x7ffa18039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.329+0000 7ffa1fe07640 1 -- 172.21.15.62:0/2401222012 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ffb24015020 con 0x561d1bd1a740 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.329+0000 7ffb32fc9640 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa18036eb0 0x7ffa18039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.329+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1bd1eae0 0x561d1be1ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.329+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be1cf70 con 0x561d1bd1eae0 2024-04-26T07:54:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.330+0000 7ffb33fcb640 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1bd1eae0 0x561d1be1ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.330+0000 7ffb32fc9640 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa18036eb0 0x7ffa18039370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffb28054000 tx=0x7ffb2804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.330+0000 7ffb33fcb640 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1bd1eae0 0x561d1be1ca30 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.330+0000 7ffb33fcb640 1 -- 172.21.15.62:0/2401222012 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb2c00a4a0 con 0x561d1bd1eae0 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.330+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be1a000 con 0x561d1bd1eae0 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.331+0000 7ffb33fcb640 1 -- 172.21.15.62:0/2401222012 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb2c00a4a0 con 0x561d1bd1eae0 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.331+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be1f260 0x561d1be21650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.331+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be21d40 con 0x561d1be1f260 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.331+0000 7ffb337ca640 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be1f260 0x561d1be21650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.331+0000 7ffb337ca640 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be1f260 0x561d1be21650 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.331+0000 7ffb337ca640 1 -- 172.21.15.62:0/2401222012 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be1f260 2024-04-26T07:54:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.331+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be1e1e0 con 0x561d1bd1eae0 2024-04-26T07:54:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.332+0000 7ffb33fcb640 1 -- 172.21.15.62:0/2401222012 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb2c00a4a0 con 0x561d1bd1eae0 2024-04-26T07:54:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.332+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be1e6c0 con 0x561d1bd1eae0 2024-04-26T07:54:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.332+0000 7ffb33fcb640 1 -- 172.21.15.62:0/2401222012 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb2c00a4a0 con 0x561d1bd1eae0 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.332+0000 7ffb37b1f800 1 Processor -- start 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.332+0000 7ffb37b1f800 1 -- start start 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.332+0000 7ffb37b1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be30e70 0x561d1be31290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.332+0000 7ffb37b1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561d1bc0d170 con 0x561d1be30e70 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffb33fcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be30e70 0x561d1be31290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffb33fcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be30e70 0x561d1be31290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33688/0 (socket says 172.21.15.62:33688) 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffb33fcb640 1 -- 172.21.15.62:0/3136596218 learned_addr learned my addr 172.21.15.62:0/3136596218 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffb33fcb640 1 -- 172.21.15.62:0/3136596218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d1be317d0 con 0x561d1be30e70 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffb33fcb640 1 --2- 172.21.15.62:0/3136596218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be30e70 0x561d1be31290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x561d1be1d310 tx=0x7ffb2c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffa1d602640 1 -- 172.21.15.62:0/3136596218 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c014450 con 0x561d1be30e70 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffa1d602640 1 -- 172.21.15.62:0/3136596218 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c014610 con 0x561d1be30e70 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffb37b1f800 1 -- 172.21.15.62:0/3136596218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d1be32240 con 0x561d1be30e70 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffa1d602640 1 -- 172.21.15.62:0/3136596218 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c014930 con 0x561d1be30e70 2024-04-26T07:54:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.333+0000 7ffb37b1f800 1 -- 172.21.15.62:0/3136596218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d1be32740 con 0x561d1be30e70 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.334+0000 7ffa1d602640 1 -- 172.21.15.62:0/3136596218 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb2c011040 con 0x561d1be30e70 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.334+0000 7ffa1d602640 1 --2- 172.21.15.62:0/3136596218 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa0c036e60 0x7ffa0c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.334+0000 7ffa1d602640 1 -- 172.21.15.62:0/3136596218 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ffb2c01e070 con 0x561d1be30e70 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.334+0000 7ffb337ca640 1 --2- 172.21.15.62:0/3136596218 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa0c036e60 0x7ffa0c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb37b1f800 1 Processor -- start 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb37b1f800 1 -- start start 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb337ca640 1 --2- 172.21.15.62:0/3136596218 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa0c036e60 0x7ffa0c039320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb2404bb70 tx=0x7ffb2404ba40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb37b1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be3e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb37b1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561d1bc8e970 con 0x561d1be3e150 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb33fcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be3e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb33fcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be3e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33696/0 (socket says 172.21.15.62:33696) 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb33fcb640 1 -- 172.21.15.62:0/4026942856 learned_addr learned my addr 172.21.15.62:0/4026942856 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb33fcb640 1 -- 172.21.15.62:0/4026942856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d1be3eb40 con 0x561d1be3e150 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.335+0000 7ffb33fcb640 1 --2- 172.21.15.62:0/4026942856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be3e570 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c04cf60 tx=0x7ffb2c02b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7092c4d3a526db5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffa16ffd640 1 -- 172.21.15.62:0/4026942856 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c028040 con 0x561d1be3e150 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffa16ffd640 1 -- 172.21.15.62:0/4026942856 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c046070 con 0x561d1be3e150 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffa16ffd640 1 -- 172.21.15.62:0/4026942856 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c016ad0 con 0x561d1be3e150 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 -- 172.21.15.62:0/4026942856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 msgr2=0x561d1be3e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/4026942856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be3e570 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c04cf60 tx=0x7ffb2c02b410 comp rx=0 tx=0).stop 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 -- 172.21.15.62:0/4026942856 shutdown_connections 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/4026942856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be3e570 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 -- 172.21.15.62:0/4026942856 >> 172.21.15.62:0/4026942856 conn(0x561d1be3a460 msgr2=0x561d1be38510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 -- 172.21.15.62:0/4026942856 shutdown_connections 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 -- 172.21.15.62:0/4026942856 wait complete. 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 Processor -- start 2024-04-26T07:54:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.336+0000 7ffb37b1f800 1 -- start start 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb37b1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb37b1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561d1be3f310 con 0x561d1be3e150 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb33fcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb33fcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33710/0 (socket says 172.21.15.62:33710) 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 learned_addr learned my addr 172.21.15.62:0/1840841776 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d1be45c00 con 0x561d1be3e150 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb33fcb640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be456c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c04cec0 tx=0x7ffb2c04cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffa157fa640 1 -- 172.21.15.62:0/1840841776 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c03d070 con 0x561d1be3e150 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffa157fa640 1 -- 172.21.15.62:0/1840841776 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c016980 con 0x561d1be3e150 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d1be45e90 con 0x561d1be3e150 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffa157fa640 1 -- 172.21.15.62:0/1840841776 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c028040 con 0x561d1be3e150 2024-04-26T07:54:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.337+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d1be48b40 con 0x561d1be3e150 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.338+0000 7ffa157fa640 1 -- 172.21.15.62:0/1840841776 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb2c040070 con 0x561d1be3e150 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.338+0000 7ffa157fa640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9fc036e10 0x7ff9fc0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffa157fa640 1 -- 172.21.15.62:0/1840841776 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ffb2c034030 con 0x561d1be3e150 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb337ca640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9fc036e10 0x7ff9fc0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1be51370 0x561d1be53810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be53f60 con 0x561d1be51370 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb32fc9640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1be51370 0x561d1be53810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb337ca640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9fc036e10 0x7ff9fc0392d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x561d1be22140 tx=0x7ffb24027000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb32fc9640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1be51370 0x561d1be53810 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb37b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb37b1f800 20 realm 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.339+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be54330 con 0x561d1be51370 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be54bd0 con 0x561d1be51370 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be54f70 con 0x561d1be51370 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be55cd0 0x561d1be580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.340+0000 7ffb33fcb640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be55cd0 0x561d1be580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.341+0000 7ffb33fcb640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be55cd0 0x561d1be580c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.341+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.341+0000 7ffb37b1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.341+0000 7ffb37b1f800 20 searching for the correct realm 2024-04-26T07:54:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.341+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561d1be5a670 0x561d1be5cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.341+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be5d200 con 0x561d1be5a670 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.341+0000 7ffb337ca640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561d1be5a670 0x561d1be5cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.341+0000 7ffb337ca640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561d1be5a670 0x561d1be5cb30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.342+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.342+0000 7ffb337ca640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb2404d870 0x7ffb2401c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.342+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be5d200 con 0x7ffb2404d870 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.342+0000 7ffb32fc9640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb2404d870 0x7ffb2401c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.342+0000 7ffb32fc9640 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb2404d870 0x7ffb2401c5e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.343+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.343+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be5d200 con 0x561d1be55cd0 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.343+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.343+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be51370 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.343+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.343+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be51370 2024-04-26T07:54:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.343+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.344+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.344+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.344+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.345+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.345+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x7ffb2404d870 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.345+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.345+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be5a670 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.345+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.345+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be51370 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.345+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.345+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.346+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.346+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be51370 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.346+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.346+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x7ffb2404d870 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.346+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.346+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be5a670 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.346+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.346+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be5a670 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.347+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.347+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.347+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.347+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be5a670 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.347+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.347+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be5a670 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.347+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.347+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be51370 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.348+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.348+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be51370 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.348+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.348+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.348+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.348+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be5a670 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.348+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.348+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x7ffb2404d870 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.349+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.349+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be51370 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.349+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.349+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.349+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.349+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be5a670 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.350+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.350+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.350+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.350+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x7ffb2404d870 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.350+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.350+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be5a670 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.350+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.350+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be55cd0 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x561d1be51370 2024-04-26T07:54:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58600 con 0x7ffb2404d870 2024-04-26T07:54:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be58f70 con 0x561d1be51370 2024-04-26T07:54:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.351+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be59360 con 0x561d1be51370 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be59780 con 0x561d1be51370 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 20 zone default found 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 4 Realm: () 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 20 zonegroup default 2024-04-26T07:54:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.352+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be59bb0 con 0x561d1be55cd0 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be5f510 con 0x561d1be5a670 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be5f8b0 con 0x561d1be5a670 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 20 started sync module instance, tier type = 2024-04-26T07:54:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.353+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be5e950 con 0x7ffb2404d870 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.354+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.354+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94683022093904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be5e950 con 0x7ffb2404d870 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.354+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be60270 con 0x561d1be51370 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.355+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.355+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94683022097856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be606d0 con 0x561d1be51370 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.355+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be611c0 con 0x561d1be5a670 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.355+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94683022093904] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.356+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94683022097856] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.356+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.356+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94683022101648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be601e0 con 0x561d1be5a670 2024-04-26T07:54:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.356+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be61a60 con 0x7ffb2404d870 2024-04-26T07:54:37.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.357+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94683022101648] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.357+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.357+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94683022103984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be619d0 con 0x7ffb2404d870 2024-04-26T07:54:37.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.358+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be62920 con 0x561d1be51370 2024-04-26T07:54:37.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.359+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.359+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94683022107760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be62d40 con 0x561d1be51370 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.359+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be63810 con 0x561d1be55cd0 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.359+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94683022103984] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.359+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94683022107760] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.360+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.360+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94683022111488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be62890 con 0x561d1be55cd0 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.360+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be640b0 con 0x561d1be55cd0 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.361+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.361+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94683022113792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be644d0 con 0x561d1be55cd0 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.361+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be64d20 con 0x561d1be55cd0 2024-04-26T07:54:37.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.361+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94683022111488] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94683022116048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be64da0 con 0x561d1be55cd0 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb37b1f800 20 add_watcher() i=0 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb37b1f800 20 add_watcher() i=1 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb37b1f800 20 add_watcher() i=2 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb37b1f800 20 add_watcher() i=3 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb37b1f800 20 add_watcher() i=4 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb37b1f800 20 add_watcher() i=5 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94683022113792] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.362+0000 7ffb37b1f800 20 add_watcher() i=6 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.363+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94683022116048] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.363+0000 7ffb37b1f800 20 add_watcher() i=7 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.363+0000 7ffb37b1f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.363+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be67dd0 con 0x561d1be51370 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.363+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.363+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94683022117104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be651c0 con 0x561d1be51370 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.364+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94683022117104] v27'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.364+0000 7ff9e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.364+0000 7ffb37b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.364+0000 7ffb37b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.364+0000 7ffb37b1f800 5 note: GC not initialized 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.364+0000 7ff9e8fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.364+0000 7ffb37b1f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb37b1f800 20 Filter name: none 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ff9627fc640 20 reqs_thread_entry: start 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be9ae20 con 0x561d1be51370 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb37b1f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be9b810 con 0x561d1be51370 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb37b1f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.365+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be9c820 con 0x7ffb2404d870 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be99f70 con 0x7ffb2404d870 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb37b1f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb37b1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be9c7e0 con 0x561d1be51370 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(66 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb37b1f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb37b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.366+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 4.1a 4:5a581a9c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be9c250 con 0x7ffb2404d870 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 4.16 4:6ac82eb8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1bea1100 con 0x561d1be5a670 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 4.e 4:7264ccad:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be9c250 con 0x7ffb2404d870 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 4.24 4:27ab159e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1bea61d0 con 0x561d1be55cd0 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 4.7 4:e3bd6437:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1bea8be0 con 0x561d1be55cd0 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(68 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:72 4.3b 4:de750cfa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1beab5f0 con 0x561d1be5a670 2024-04-26T07:54:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(67 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:73 4.22 4:476c90f1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1be9ec30 con 0x561d1be51370 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:74 4.1d 4:ba0b4099:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1bea0830 con 0x561d1be5a670 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(70 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(71 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 4.7 4:e33164c7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1bea0830 con 0x561d1be55cd0 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:76 4.2e 4:74fb3df0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1bea0cc0 con 0x561d1be5a670 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(72 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(69 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2805a040 con 0x7ffb2404d870 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:77 4.34 4:2cf2cafa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d1bea14a0 con 0x7ffb2404d870 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(73 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2805a040 con 0x561d1be51370 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.367+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(75 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.368+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(74 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.368+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(77 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ffb28096060 con 0x7ffb2404d870 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.368+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(76 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.369+0000 7ff9e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.369+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94683022117104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1bea14a0 con 0x561d1be51370 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.370+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94683022117104] v27'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb28096060 con 0x561d1be51370 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.370+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94683022093904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be83710 con 0x7ffb2404d870 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.371+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94683022093904] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb28096060 con 0x7ffb2404d870 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.371+0000 7ffb37b1f800 20 remove_watcher() i=0 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.371+0000 7ffb37b1f800 2 removed watcher, disabling cache 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.371+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94683022097856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be83710 con 0x561d1be51370 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.372+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94683022097856] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb28096060 con 0x561d1be51370 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.372+0000 7ffb37b1f800 20 remove_watcher() i=1 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.372+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94683022101648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be83710 con 0x561d1be5a670 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.373+0000 7ffb337ca640 1 -- 172.21.15.62:0/1840841776 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94683022101648] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2402d070 con 0x561d1be5a670 2024-04-26T07:54:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.373+0000 7ffb37b1f800 20 remove_watcher() i=2 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.373+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94683022103984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be83710 con 0x7ffb2404d870 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.374+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94683022103984] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb28096060 con 0x7ffb2404d870 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.374+0000 7ffb37b1f800 20 remove_watcher() i=3 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.374+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94683022107760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be83710 con 0x561d1be51370 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.375+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94683022107760] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb28096060 con 0x561d1be51370 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.375+0000 7ffb37b1f800 20 remove_watcher() i=4 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.375+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94683022111488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be83710 con 0x561d1be55cd0 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.376+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94683022111488] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.376+0000 7ffb37b1f800 20 remove_watcher() i=5 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.376+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94683022113792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be83710 con 0x561d1be55cd0 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.377+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94683022113792] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.377+0000 7ffb37b1f800 20 remove_watcher() i=6 2024-04-26T07:54:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.377+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94683022116048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d1be83710 con 0x561d1be55cd0 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb33fcb640 1 -- 172.21.15.62:0/1840841776 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94683022116048] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c03f030 con 0x561d1be55cd0 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 20 remove_watcher() i=7 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be55cd0 msgr2=0x561d1be580c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be55cd0 0x561d1be580c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1be51370 msgr2=0x561d1be53810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1be51370 0x561d1be53810 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb2404d870 msgr2=0x7ffb2401c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ffb2404d870 0x7ffb2401c5e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561d1be5a670 msgr2=0x561d1be5cb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561d1be5a670 0x561d1be5cb30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9fc036e10 msgr2=0x7ff9fc0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9fc036e10 0x7ff9fc0392d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x561d1be22140 tx=0x7ffb24027000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 msgr2=0x561d1be456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb32fc9640 1 -- 172.21.15.62:0/1840841776 reap_dead start 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.378+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be456c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c04cec0 tx=0x7ffb2c04cef0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 shutdown_connections 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/1840841776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be3e150 0x561d1be456c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 >> 172.21.15.62:0/1840841776 conn(0x561d1be3a460 msgr2=0x561d1be37b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 shutdown_connections 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/1840841776 wait complete. 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/3136596218 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa0c036e60 msgr2=0x7ffa0c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/3136596218 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa0c036e60 0x7ffa0c039320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb2404bb70 tx=0x7ffb2404ba40 comp rx=0 tx=0).stop 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/3136596218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be30e70 msgr2=0x561d1be31290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/3136596218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be30e70 0x561d1be31290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x561d1be1d310 tx=0x7ffb2c018830 comp rx=0 tx=0).stop 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/3136596218 shutdown_connections 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/3136596218 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa0c036e60 0x7ffa0c039320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/3136596218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1be30e70 0x561d1be31290 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/3136596218 >> 172.21.15.62:0/3136596218 conn(0x561d1be24f10 msgr2=0x561d1be25310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/3136596218 shutdown_connections 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/3136596218 wait complete. 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be1f260 msgr2=0x561d1be21650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be1f260 0x561d1be21650 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1bd1eae0 msgr2=0x561d1be1ca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1bd1eae0 0x561d1be1ca30 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa18036eb0 msgr2=0x7ffa18039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.379+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa18036eb0 0x7ffa18039370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffb28054000 tx=0x7ffb2804e000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 msgr2=0x561d1be157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1be157f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffb24000f60 tx=0x7ffb24000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 shutdown_connections 2024-04-26T07:54:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561d1bd1eae0 0x561d1be1ca30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561d1be1f260 0x561d1be21650 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ffa18036eb0 0x7ffa18039370 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 --2- 172.21.15.62:0/2401222012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d1bd1a740 0x561d1be157f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 >> 172.21.15.62:0/2401222012 conn(0x561d1bd15d20 msgr2=0x561d1bc8eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 shutdown_connections 2024-04-26T07:54:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.380+0000 7ffb37b1f800 1 -- 172.21.15.62:0/2401222012 wait complete. 2024-04-26T07:54:37.402 INFO:teuthology.orchestra.run.smithi062.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"76158cff-5435-4eb7-bdd8-fb93108eac49","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","marker":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T07:54:36.677226Z","creation_time":"2024-04-26T07:54:36.674214Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-04-26T07:54:37.402 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T07:54:36.677226Z', 'creation_time': '2024-04-26T07:54:36.674214Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-26T07:54:37.410 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T07:54:37.410 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T07:54:37.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T07:54:37.411 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T07:54:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.489+0000 7f4281928800 1 Processor -- start 2024-04-26T07:54:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.489+0000 7f4281928800 1 -- start start 2024-04-26T07:54:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.489+0000 7f4281928800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559f65efeca0 0x559f65f01090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.489+0000 7f4281928800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f65f015d0 con 0x559f65efb190 2024-04-26T07:54:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.489+0000 7f4281928800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x559f65d9ce20 con 0x559f65efeca0 2024-04-26T07:54:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.489+0000 7f427ce27640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559f65efeca0 0x559f65f01090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.489+0000 7f427d628640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x559f65efb190 0x559f65efd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36676/0 (socket says 172.21.15.62:36676) 2024-04-26T07:54:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.489+0000 7f427d628640 1 -- 172.21.15.62:0/1681375743 learned_addr learned my addr 172.21.15.62:0/1681375743 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.490+0000 7f427ce27640 1 -- 172.21.15.62:0/1681375743 >> v1:172.21.15.1:6789/0 conn(0x559f65efb190 legacy=0x559f65efd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.490+0000 7f427ce27640 1 -- 172.21.15.62:0/1681375743 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f65f027b0 con 0x559f65efeca0 2024-04-26T07:54:37.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f427ce27640 1 --2- 172.21.15.62:0/1681375743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efeca0 0x559f65f01090 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f427400a470 tx=0x7f427401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911852a863567e95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f426ffff640 1 -- 172.21.15.62:0/1681375743 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4274057070 con 0x559f65efeca0 2024-04-26T07:54:37.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f426ffff640 1 -- 172.21.15.62:0/1681375743 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4274052570 con 0x559f65efeca0 2024-04-26T07:54:37.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f426ffff640 1 -- 172.21.15.62:0/1681375743 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4274052870 con 0x559f65efeca0 2024-04-26T07:54:37.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f4281928800 1 -- 172.21.15.62:0/1681375743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efeca0 msgr2=0x559f65f01090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f4281928800 1 --2- 172.21.15.62:0/1681375743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efeca0 0x559f65f01090 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f427400a470 tx=0x7f427401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f4281928800 1 -- 172.21.15.62:0/1681375743 shutdown_connections 2024-04-26T07:54:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f4281928800 1 --2- 172.21.15.62:0/1681375743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efeca0 0x559f65f01090 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f4281928800 1 -- 172.21.15.62:0/1681375743 >> 172.21.15.62:0/1681375743 conn(0x559f65ef4b80 msgr2=0x559f65ef6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f4281928800 1 -- 172.21.15.62:0/1681375743 shutdown_connections 2024-04-26T07:54:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.492+0000 7f4281928800 1 -- 172.21.15.62:0/1681375743 wait complete. 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.505+0000 7f4281928800 1 Processor -- start 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.505+0000 7f4281928800 1 -- start start 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.505+0000 7f4281928800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65febcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.505+0000 7f4281928800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f65e45cd0 con 0x559f65efb190 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.505+0000 7f427d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65febcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.505+0000 7f427d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65febcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33726/0 (socket says 172.21.15.62:33726) 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.506+0000 7f427d628640 1 -- 172.21.15.62:0/2571738802 learned_addr learned my addr 172.21.15.62:0/2571738802 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.506+0000 7f427d628640 1 -- 172.21.15.62:0/2571738802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f65fec280 con 0x559f65efb190 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.506+0000 7f427d628640 1 --2- 172.21.15.62:0/2571738802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65febcb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4270001de0 tx=0x7f427000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d39622812ddc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.506+0000 7f416b606640 1 -- 172.21.15.62:0/2571738802 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4270012020 con 0x559f65efb190 2024-04-26T07:54:37.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.506+0000 7f416b606640 1 -- 172.21.15.62:0/2571738802 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427000e5a0 con 0x559f65efb190 2024-04-26T07:54:37.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.506+0000 7f416b606640 1 -- 172.21.15.62:0/2571738802 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427000e8c0 con 0x559f65efb190 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 -- 172.21.15.62:0/2571738802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 msgr2=0x559f65febcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 --2- 172.21.15.62:0/2571738802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65febcb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4270001de0 tx=0x7f427000b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 -- 172.21.15.62:0/2571738802 shutdown_connections 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 --2- 172.21.15.62:0/2571738802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65febcb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 -- 172.21.15.62:0/2571738802 >> 172.21.15.62:0/2571738802 conn(0x559f65ef4b80 msgr2=0x559f65fe75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 -- 172.21.15.62:0/2571738802 shutdown_connections 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 -- 172.21.15.62:0/2571738802 wait complete. 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 Processor -- start 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 -- start start 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65ff37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f4281928800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f65f01aa0 con 0x559f65efb190 2024-04-26T07:54:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.507+0000 7f427d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65ff37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f427d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65ff37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33742/0 (socket says 172.21.15.62:33742) 2024-04-26T07:54:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f427d628640 1 -- 172.21.15.62:0/1616193894 learned_addr learned my addr 172.21.15.62:0/1616193894 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f427d628640 1 -- 172.21.15.62:0/1616193894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f65ff3d30 con 0x559f65efb190 2024-04-26T07:54:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f427d628640 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65ff37f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f427000c010 tx=0x7f4270000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f4169e03640 1 -- 172.21.15.62:0/1616193894 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4270012070 con 0x559f65efb190 2024-04-26T07:54:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f4169e03640 1 -- 172.21.15.62:0/1616193894 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427001a7a0 con 0x559f65efb190 2024-04-26T07:54:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f65ff3fc0 con 0x559f65efb190 2024-04-26T07:54:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f4169e03640 1 -- 172.21.15.62:0/1616193894 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427001aa80 con 0x559f65efb190 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.508+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f65ff6c70 con 0x559f65efb190 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.509+0000 7f4169e03640 1 -- 172.21.15.62:0/1616193894 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4270015020 con 0x559f65efb190 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.509+0000 7f4169e03640 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4164036e60 0x7f4164039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.509+0000 7f4169e03640 1 -- 172.21.15.62:0/1616193894 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f4270020070 con 0x559f65efb190 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.509+0000 7f427ce27640 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4164036e60 0x7f4164039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.509+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f65efeca0 0x559f65ffaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.509+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f65ffaf70 con 0x559f65efeca0 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.509+0000 7f427de29640 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f65efeca0 0x559f65ffaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.510+0000 7f427ce27640 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4164036e60 0x7f4164039320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4274054000 tx=0x7f427404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.510+0000 7f427de29640 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f65efeca0 0x559f65ffaa30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.510+0000 7f427de29640 1 -- 172.21.15.62:0/1616193894 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f427800a4a0 con 0x559f65efeca0 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.510+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f65ff7fe0 con 0x559f65efeca0 2024-04-26T07:54:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.510+0000 7f427de29640 1 -- 172.21.15.62:0/1616193894 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f427800a4a0 con 0x559f65efeca0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.510+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f65ffd2b0 0x559f65fff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.510+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f65fffd40 con 0x559f65ffd2b0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.511+0000 7f427d628640 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f65ffd2b0 0x559f65fff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.511+0000 7f427d628640 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f65ffd2b0 0x559f65fff6a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.512+0000 7f427d628640 1 -- 172.21.15.62:0/1616193894 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f427002b070 con 0x559f65ffd2b0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.512+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f65ffc260 con 0x559f65efeca0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.512+0000 7f427de29640 1 -- 172.21.15.62:0/1616193894 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f427800a4a0 con 0x559f65efeca0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.512+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f65ffc740 con 0x559f65efeca0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.512+0000 7f427de29640 1 -- 172.21.15.62:0/1616193894 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f427800a4a0 con 0x559f65efeca0 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.512+0000 7f4281928800 1 Processor -- start 2024-04-26T07:54:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.512+0000 7f4281928800 1 -- start start 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f4281928800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efad10 0x559f65ef9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f4281928800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f65ded170 con 0x559f65efad10 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f427de29640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efad10 0x559f65ef9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f427de29640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efad10 0x559f65ef9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33744/0 (socket says 172.21.15.62:33744) 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f427de29640 1 -- 172.21.15.62:0/2684161421 learned_addr learned my addr 172.21.15.62:0/2684161421 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f427de29640 1 -- 172.21.15.62:0/2684161421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f65ef96c0 con 0x559f65efad10 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f427de29640 1 --2- 172.21.15.62:0/2684161421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efad10 0x559f65ef9180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x559f65ffb330 tx=0x7f4278018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f4162ffd640 1 -- 172.21.15.62:0/2684161421 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4278014450 con 0x559f65efad10 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f4162ffd640 1 -- 172.21.15.62:0/2684161421 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42780145f0 con 0x559f65efad10 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f4281928800 1 -- 172.21.15.62:0/2684161421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f65ef98f0 con 0x559f65efad10 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.513+0000 7f4162ffd640 1 -- 172.21.15.62:0/2684161421 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42780148d0 con 0x559f65efad10 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.514+0000 7f4281928800 1 -- 172.21.15.62:0/2684161421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f65ef9df0 con 0x559f65efad10 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.514+0000 7f4162ffd640 1 -- 172.21.15.62:0/2684161421 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4278011040 con 0x559f65efad10 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.514+0000 7f4162ffd640 1 --2- 172.21.15.62:0/2684161421 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4154036eb0 0x7f4154039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.514+0000 7f4162ffd640 1 -- 172.21.15.62:0/2684161421 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f427801e070 con 0x559f65efad10 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.514+0000 7f427d628640 1 --2- 172.21.15.62:0/2684161421 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4154036eb0 0x7f4154039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f4281928800 1 Processor -- start 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f4281928800 1 -- start start 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f427d628640 1 --2- 172.21.15.62:0/2684161421 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4154036eb0 0x7f4154039370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x559f65ffb3f0 tx=0x7f4270019f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f4281928800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f6601e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f4281928800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f65fec600 con 0x559f6601e3f0 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f427de29640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f6601e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f427de29640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f6601e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33746/0 (socket says 172.21.15.62:33746) 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f427de29640 1 -- 172.21.15.62:0/3778945693 learned_addr learned my addr 172.21.15.62:0/3778945693 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f427de29640 1 -- 172.21.15.62:0/3778945693 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6601ede0 con 0x559f6601e3f0 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.515+0000 7f427de29640 1 --2- 172.21.15.62:0/3778945693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f6601e810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4278013010 tx=0x7f4278013920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ce91e4365f8aa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4160ff9640 1 -- 172.21.15.62:0/3778945693 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4278013e00 con 0x559f6601e3f0 2024-04-26T07:54:37.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4160ff9640 1 -- 172.21.15.62:0/3778945693 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427804e070 con 0x559f6601e3f0 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4160ff9640 1 -- 172.21.15.62:0/3778945693 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42780168f0 con 0x559f6601e3f0 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 -- 172.21.15.62:0/3778945693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 msgr2=0x559f6601e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 --2- 172.21.15.62:0/3778945693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f6601e810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4278013010 tx=0x7f4278013920 comp rx=0 tx=0).stop 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 -- 172.21.15.62:0/3778945693 shutdown_connections 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 --2- 172.21.15.62:0/3778945693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f6601e810 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 -- 172.21.15.62:0/3778945693 >> 172.21.15.62:0/3778945693 conn(0x559f6601a700 msgr2=0x559f66018760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 -- 172.21.15.62:0/3778945693 shutdown_connections 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 -- 172.21.15.62:0/3778945693 wait complete. 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 Processor -- start 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.516+0000 7f4281928800 1 -- start start 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f4281928800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f66025930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f4281928800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f6601f4d0 con 0x559f6601e3f0 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f427de29640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f66025930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f427de29640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f66025930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33760/0 (socket says 172.21.15.62:33760) 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 learned_addr learned my addr 172.21.15.62:0/1395826048 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f66025e70 con 0x559f6601e3f0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f427de29640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f66025930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4278013010 tx=0x7f427804cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f4152ffd640 1 -- 172.21.15.62:0/1395826048 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427803b070 con 0x559f6601e3f0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f4152ffd640 1 -- 172.21.15.62:0/1395826048 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4278022a80 con 0x559f6601e3f0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f66026100 con 0x559f6601e3f0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f4152ffd640 1 -- 172.21.15.62:0/1395826048 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4278016440 con 0x559f6601e3f0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.517+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f66028db0 con 0x559f6601e3f0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.518+0000 7f4152ffd640 1 -- 172.21.15.62:0/1395826048 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f427802b350 con 0x559f6601e3f0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.518+0000 7f4152ffd640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4148036eb0 0x7f4148039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.518+0000 7f4152ffd640 1 -- 172.21.15.62:0/1395826048 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f427800e040 con 0x559f6601e3f0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f427d628640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4148036eb0 0x7f4148039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f66031410 0x559f660338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f66034000 con 0x559f66031410 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f427ce27640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f66031410 0x559f660338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f427d628640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4148036eb0 0x7f4148039370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4270044650 tx=0x7f4270033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f427ce27640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f66031410 0x559f660338b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f4281928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f4281928800 20 realm 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.519+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660343d0 con 0x559f66031410 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f66034c70 con 0x559f66031410 2024-04-26T07:54:37.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f66035010 con 0x559f66031410 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f66035d70 0x559f66038160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660386a0 con 0x559f66035d70 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.520+0000 7f427de29640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f66035d70 0x559f66038160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.521+0000 7f427de29640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f66035d70 0x559f66038160 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.521+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.521+0000 7f4281928800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.521+0000 7f4281928800 20 searching for the correct realm 2024-04-26T07:54:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.521+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f6603a6f0 0x559f6603cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.521+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.521+0000 7f427d628640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f6603a6f0 0x559f6603cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.521+0000 7f427d628640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f6603a6f0 0x559f6603cbb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.522+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.522+0000 7f427d628640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4270017050 0x7f427000d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.522+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x7f4270017050 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.522+0000 7f427ce27640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4270017050 0x7f427000d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.522+0000 7f427ce27640 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4270017050 0x7f427000d8e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.522+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.523+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.523+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.523+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66031410 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.523+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.523+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66031410 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.523+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.523+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.524+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.524+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.524+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.524+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x7f4270017050 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.524+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.524+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.524+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.524+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66031410 2024-04-26T07:54:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.525+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.525+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.525+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.525+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66031410 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.525+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.525+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x7f4270017050 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.525+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.526+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.526+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.526+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.526+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.526+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.526+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.526+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.527+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.527+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.527+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.527+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66031410 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.527+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.527+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66031410 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.527+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.527+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.528+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.528+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.528+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.528+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x7f4270017050 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.528+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.528+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66031410 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.528+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.528+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.529+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.529+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.529+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.529+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.529+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.529+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x7f4270017050 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.529+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.529+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f6603a6f0 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.530+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.530+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66035d70 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.530+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.530+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x559f66031410 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.530+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.530+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d280 con 0x7f4270017050 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.530+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660390f0 con 0x559f66031410 2024-04-26T07:54:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f66038cd0 con 0x559f66031410 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660399d0 con 0x559f66031410 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:37.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 zone default found 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 4 Realm: () 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 zonegroup default 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.531+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6603d700 con 0x559f66035d70 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6603f930 con 0x559f6603a6f0 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6603fcd0 con 0x559f6603a6f0 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 20 started sync module instance, tier type = 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.532+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f6603ed70 con 0x7f4270017050 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.533+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.533+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143099695504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f6603ed70 con 0x7f4270017050 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.533+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f660405a0 con 0x559f66031410 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.534+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.534+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143099699312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f660405a0 con 0x559f66031410 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.534+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f660415b0 con 0x559f6603a6f0 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.534+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94143099695504] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.536+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94143099699312] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.536+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.536+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94143099701648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f6603e8c0 con 0x559f6603a6f0 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.536+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66041e50 con 0x7f4270017050 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.537+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94143099701648] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.537+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.537+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94143099705760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66041dc0 con 0x7f4270017050 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.537+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66042d10 con 0x559f66031410 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.538+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.538+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143099709536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66043130 con 0x559f66031410 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.538+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66043c20 con 0x559f66035d70 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.538+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94143099705760] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.539+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94143099709536] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.541+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.541+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94143099707968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66043130 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.541+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f660444c0 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.541+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.541+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94143099715600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66044920 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.541+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66045420 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.542+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94143099707968] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.542+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94143099719440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f660453e0 con 0x559f66035d70 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 20 add_watcher() i=0 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 20 add_watcher() i=1 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 20 add_watcher() i=2 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 20 add_watcher() i=3 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 20 add_watcher() i=4 2024-04-26T07:54:37.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 20 add_watcher() i=5 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94143099715600] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 20 add_watcher() i=6 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94143099719440] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 20 add_watcher() i=7 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.543+0000 7f4281928800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.544+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f66044430 con 0x559f66031410 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.544+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.544+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94143099710592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66044430 con 0x559f66031410 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94143099710592] v27'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f41337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f4281928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f4281928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f4281928800 5 note: GC not initialized 2024-04-26T07:54:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f41327e4640 20 reqs_thread_entry: start 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f4281928800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f4281928800 20 Filter name: none 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.545+0000 7f40a3fff640 20 reqs_thread_entry: start 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6607ba10 con 0x7f4270017050 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6607c330 con 0x559f66031410 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(63 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.546+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6607c370 con 0x7f4270017050 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6607daa0 con 0x559f66031410 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 4.1a 4:5a581a9c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6607cf70 con 0x7f4270017050 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 4.16 4:6ac82eb8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660822a0 con 0x559f6603a6f0 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 4.e 4:7264ccad:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f66084ec0 con 0x7f4270017050 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 4.24 4:27ab159e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660877b0 con 0x559f66035d70 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 4.7 4:e3bd6437:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6608a5a0 con 0x559f66035d70 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 4.3b 4:de750cfa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660877b0 con 0x559f6603a6f0 2024-04-26T07:54:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 4.22 4:476c90f1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6608f4b0 con 0x559f66031410 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 4.1d 4:ba0b4099:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6608f530 con 0x559f6603a6f0 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 4.7 4:e33164c7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660948e0 con 0x559f66035d70 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 4.2e 4:74fb3df0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f660977a0 con 0x559f6603a6f0 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:76 4.34 4:2cf2cafa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f6609a660 con 0x7f4270017050 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.547+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(71 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(72 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(66 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(68 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(73 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(75 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.548+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(76 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.549+0000 7f41337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.549+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94143099710592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f6609a660 con 0x559f66031410 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.550+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94143099710592] v27'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.550+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94143099695504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66063fd0 con 0x7f4270017050 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.551+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94143099695504] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.551+0000 7f4281928800 20 remove_watcher() i=0 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.551+0000 7f4281928800 2 removed watcher, disabling cache 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.551+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94143099699312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66063fd0 con 0x559f66031410 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.552+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94143099699312] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x559f66031410 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.552+0000 7f4281928800 20 remove_watcher() i=1 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.552+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94143099701648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66063fd0 con 0x559f6603a6f0 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.553+0000 7f427d628640 1 -- 172.21.15.62:0/1395826048 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94143099701648] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427002b070 con 0x559f6603a6f0 2024-04-26T07:54:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.553+0000 7f4281928800 20 remove_watcher() i=2 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.553+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94143099705760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66063fd0 con 0x7f4270017050 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.554+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94143099705760] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427405a040 con 0x7f4270017050 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.554+0000 7f4281928800 20 remove_watcher() i=3 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.554+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94143099709536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66063fd0 con 0x559f66031410 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.555+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94143099709536] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4274095040 con 0x559f66031410 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.555+0000 7f4281928800 20 remove_watcher() i=4 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.555+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94143099707968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66063fd0 con 0x559f66035d70 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.556+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94143099707968] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.556+0000 7f4281928800 20 remove_watcher() i=5 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.556+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94143099715600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66063fd0 con 0x559f66035d70 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.557+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94143099715600] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.557+0000 7f4281928800 20 remove_watcher() i=6 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.557+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94143099719440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f66063fd0 con 0x559f66035d70 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f427de29640 1 -- 172.21.15.62:0/1395826048 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94143099719440] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f427802a070 con 0x559f66035d70 2024-04-26T07:54:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 20 remove_watcher() i=7 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f66035d70 msgr2=0x559f66038160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f66035d70 0x559f66038160 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f66031410 msgr2=0x559f660338b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f66031410 0x559f660338b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4270017050 msgr2=0x7f427000d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4270017050 0x7f427000d8e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f6603a6f0 msgr2=0x559f6603cbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f6603a6f0 0x559f6603cbb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4148036eb0 msgr2=0x7f4148039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4148036eb0 0x7f4148039370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4270044650 tx=0x7f4270033000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 msgr2=0x559f66025930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 --2- 172.21.15.62:0/1395826048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f6601e3f0 0x559f66025930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4278013010 tx=0x7f427804cfd0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f427ce27640 1 -- 172.21.15.62:0/1395826048 reap_dead start 2024-04-26T07:54:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 shutdown_connections 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 >> 172.21.15.62:0/1395826048 conn(0x559f6601a700 msgr2=0x559f6601fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 shutdown_connections 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.558+0000 7f4281928800 1 -- 172.21.15.62:0/1395826048 wait complete. 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/2684161421 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4154036eb0 msgr2=0x7f4154039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/2684161421 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4154036eb0 0x7f4154039370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x559f65ffb3f0 tx=0x7f4270019f90 comp rx=0 tx=0).stop 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/2684161421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efad10 msgr2=0x559f65ef9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/2684161421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efad10 0x559f65ef9180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x559f65ffb330 tx=0x7f4278018830 comp rx=0 tx=0).stop 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/2684161421 shutdown_connections 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/2684161421 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4154036eb0 0x7f4154039370 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/2684161421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efad10 0x559f65ef9180 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/2684161421 >> 172.21.15.62:0/2684161421 conn(0x559f66002f90 msgr2=0x559f66003390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/2684161421 shutdown_connections 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/2684161421 wait complete. 2024-04-26T07:54:37.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f65ffd2b0 msgr2=0x559f65fff6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f65ffd2b0 0x559f65fff6a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f65efeca0 msgr2=0x559f65ffaa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f65efeca0 0x559f65ffaa30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4164036e60 msgr2=0x7f4164039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4164036e60 0x7f4164039320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4274054000 tx=0x7f427404e000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 msgr2=0x559f65ff37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65ff37f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f427000c010 tx=0x7f4270000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 shutdown_connections 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f65efeca0 0x559f65ffaa30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f65ffd2b0 0x559f65fff6a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4164036e60 0x7f4164039320 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 --2- 172.21.15.62:0/1616193894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f65efb190 0x559f65ff37f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 >> 172.21.15.62:0/1616193894 conn(0x559f65ef4b80 msgr2=0x559f65fe5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 shutdown_connections 2024-04-26T07:54:37.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.559+0000 7f4281928800 1 -- 172.21.15.62:0/1616193894 wait complete. 2024-04-26T07:54:37.580 INFO:teuthology.orchestra.run.smithi062.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"76158cff-5435-4eb7-bdd8-fb93108eac49","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","marker":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T07:54:36.677226Z","creation_time":"2024-04-26T07:54:36.674214Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T07:54:37.581 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T07:54:36.677226Z', 'creation_time': '2024-04-26T07:54:36.674214Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T07:54:37.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-26T07:54:37.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-26T07:54:37.581 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-04-26T07:54:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.679+0000 7fbd94b33800 1 Processor -- start 2024-04-26T07:54:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.679+0000 7fbd94b33800 1 -- start start 2024-04-26T07:54:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.679+0000 7fbd94b33800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x563f1482b990 0x563f1482de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.679+0000 7fbd94b33800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563f1482e4b0 con 0x563f1479b100 2024-04-26T07:54:37.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.679+0000 7fbd94b33800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x563f146c9e20 con 0x563f1482b990 2024-04-26T07:54:37.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.680+0000 7fbd8fff4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x563f1482b990 0x563f1482de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.680+0000 7fbd8fff4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x563f1482b990 0x563f1482de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33774/0 (socket says 172.21.15.62:33774) 2024-04-26T07:54:37.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.680+0000 7fbd8fff4640 1 -- 172.21.15.62:0/3152540529 learned_addr learned my addr 172.21.15.62:0/3152540529 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.680+0000 7fbd907f5640 1 --1- 172.21.15.62:0/3152540529 >> v1:172.21.15.1:6789/0 conn(0x563f1479b100 0x563f1482a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36684/0 (socket says 172.21.15.62:36684) 2024-04-26T07:54:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.680+0000 7fbd8fff4640 1 -- 172.21.15.62:0/3152540529 >> v1:172.21.15.1:6789/0 conn(0x563f1479b100 legacy=0x563f1482a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.680+0000 7fbd8fff4640 1 -- 172.21.15.62:0/3152540529 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f1482f6e0 con 0x563f1482b990 2024-04-26T07:54:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.682+0000 7fbd8fff4640 1 --2- 172.21.15.62:0/3152540529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1482b990 0x563f1482de30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800a520 tx=0x7fbd7801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cf21d75631ca50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.682+0000 7fbd8f7f3640 1 -- 172.21.15.62:0/3152540529 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd78057070 con 0x563f1482b990 2024-04-26T07:54:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.682+0000 7fbd8f7f3640 1 -- 172.21.15.62:0/3152540529 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd78052570 con 0x563f1482b990 2024-04-26T07:54:37.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.682+0000 7fbd8f7f3640 1 -- 172.21.15.62:0/3152540529 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd7804ae60 con 0x563f1482b990 2024-04-26T07:54:37.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.683+0000 7fbd94b33800 1 -- 172.21.15.62:0/3152540529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1482b990 msgr2=0x563f1482de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.683+0000 7fbd94b33800 1 --2- 172.21.15.62:0/3152540529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1482b990 0x563f1482de30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800a520 tx=0x7fbd7801d010 comp rx=0 tx=0).stop 2024-04-26T07:54:37.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.683+0000 7fbd94b33800 1 -- 172.21.15.62:0/3152540529 shutdown_connections 2024-04-26T07:54:37.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.683+0000 7fbd94b33800 1 --2- 172.21.15.62:0/3152540529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1482b990 0x563f1482de30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.683+0000 7fbd94b33800 1 -- 172.21.15.62:0/3152540529 >> 172.21.15.62:0/3152540529 conn(0x563f14821bb0 msgr2=0x563f14823fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.683+0000 7fbd94b33800 1 -- 172.21.15.62:0/3152540529 shutdown_connections 2024-04-26T07:54:37.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.683+0000 7fbd94b33800 1 -- 172.21.15.62:0/3152540529 wait complete. 2024-04-26T07:54:37.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.695+0000 7fbd94b33800 1 Processor -- start 2024-04-26T07:54:37.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.695+0000 7fbd94b33800 1 -- start start 2024-04-26T07:54:37.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.696+0000 7fbd94b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14918c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.696+0000 7fbd94b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f14772d00 con 0x563f1479b100 2024-04-26T07:54:37.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.696+0000 7fbd907f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14918c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.696+0000 7fbd907f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14918c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33782/0 (socket says 172.21.15.62:33782) 2024-04-26T07:54:37.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.696+0000 7fbd907f5640 1 -- 172.21.15.62:0/2320746119 learned_addr learned my addr 172.21.15.62:0/2320746119 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.696+0000 7fbd907f5640 1 -- 172.21.15.62:0/2320746119 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f149191d0 con 0x563f1479b100 2024-04-26T07:54:37.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.696+0000 7fbd907f5640 1 --2- 172.21.15.62:0/2320746119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14918c00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001e10 tx=0x7fbd8000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b9583a9dba1d7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.696+0000 7fbc7e60c640 1 -- 172.21.15.62:0/2320746119 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8000e5c0 con 0x563f1479b100 2024-04-26T07:54:37.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbc7e60c640 1 -- 172.21.15.62:0/2320746119 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd80006070 con 0x563f1479b100 2024-04-26T07:54:37.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbc7e60c640 1 -- 172.21.15.62:0/2320746119 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8000e930 con 0x563f1479b100 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbd94b33800 1 -- 172.21.15.62:0/2320746119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 msgr2=0x563f14918c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2320746119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14918c00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001e10 tx=0x7fbd8000b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbd94b33800 1 -- 172.21.15.62:0/2320746119 shutdown_connections 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2320746119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14918c00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbd94b33800 1 -- 172.21.15.62:0/2320746119 >> 172.21.15.62:0/2320746119 conn(0x563f14821bb0 msgr2=0x563f14914520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbd94b33800 1 -- 172.21.15.62:0/2320746119 shutdown_connections 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.697+0000 7fbd94b33800 1 -- 172.21.15.62:0/2320746119 wait complete. 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd94b33800 1 Processor -- start 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd94b33800 1 -- start start 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd94b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14920770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd94b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f1482e980 con 0x563f1479b100 2024-04-26T07:54:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd907f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14920770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd907f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14920770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33794/0 (socket says 172.21.15.62:33794) 2024-04-26T07:54:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd907f5640 1 -- 172.21.15.62:0/1006433848 learned_addr learned my addr 172.21.15.62:0/1006433848 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd907f5640 1 -- 172.21.15.62:0/1006433848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f14920cb0 con 0x563f1479b100 2024-04-26T07:54:37.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.698+0000 7fbd907f5640 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14920770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000b700 tx=0x7fbd80000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.699+0000 7fbc7ce09640 1 -- 172.21.15.62:0/1006433848 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8000f8d0 con 0x563f1479b100 2024-04-26T07:54:37.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.699+0000 7fbc7ce09640 1 -- 172.21.15.62:0/1006433848 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8000fa70 con 0x563f1479b100 2024-04-26T07:54:37.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.699+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f14920f40 con 0x563f1479b100 2024-04-26T07:54:37.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.699+0000 7fbc7ce09640 1 -- 172.21.15.62:0/1006433848 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8000fd50 con 0x563f1479b100 2024-04-26T07:54:37.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.699+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f14923bf0 con 0x563f1479b100 2024-04-26T07:54:37.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.699+0000 7fbc7ce09640 1 -- 172.21.15.62:0/1006433848 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbd80017070 con 0x563f1479b100 2024-04-26T07:54:37.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.700+0000 7fbc7ce09640 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc78036e60 0x7fbc78039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.700+0000 7fbc7ce09640 1 -- 172.21.15.62:0/1006433848 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbd80015020 con 0x563f1479b100 2024-04-26T07:54:37.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.700+0000 7fbd8fff4640 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc78036e60 0x7fbc78039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.700+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1482b990 0x563f149279b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.700+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f14927f80 con 0x563f1482b990 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.700+0000 7fbd90ff6640 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1482b990 0x563f149279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.700+0000 7fbd8fff4640 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc78036e60 0x7fbc78039320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd78054000 tx=0x7fbd7804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.700+0000 7fbd90ff6640 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1482b990 0x563f149279b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.701+0000 7fbd90ff6640 1 -- 172.21.15.62:0/1006433848 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd8800a4a0 con 0x563f1482b990 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.701+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f14924f80 con 0x563f1482b990 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.701+0000 7fbd90ff6640 1 -- 172.21.15.62:0/1006433848 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd8800a4a0 con 0x563f1482b990 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.701+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f1492a290 0x563f1492c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.701+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f1492cd20 con 0x563f1492a290 2024-04-26T07:54:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.701+0000 7fbd907f5640 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f1492a290 0x563f1492c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.702+0000 7fbd907f5640 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f1492a290 0x563f1492c680 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.702+0000 7fbd907f5640 1 -- 172.21.15.62:0/1006433848 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd8002e070 con 0x563f1492a290 2024-04-26T07:54:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.702+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f14929240 con 0x563f1482b990 2024-04-26T07:54:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.702+0000 7fbd90ff6640 1 -- 172.21.15.62:0/1006433848 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd8800a4a0 con 0x563f1482b990 2024-04-26T07:54:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.702+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f14929720 con 0x563f1482b990 2024-04-26T07:54:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd90ff6640 1 -- 172.21.15.62:0/1006433848 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd8800a4a0 con 0x563f1482b990 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd94b33800 1 Processor -- start 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd94b33800 1 -- start start 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd94b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1493bed0 0x563f1493c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd94b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f1471a170 con 0x563f1493bed0 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd90ff6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1493bed0 0x563f1493c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd90ff6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1493bed0 0x563f1493c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33804/0 (socket says 172.21.15.62:33804) 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd90ff6640 1 -- 172.21.15.62:0/1808526491 learned_addr learned my addr 172.21.15.62:0/1808526491 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.703+0000 7fbd90ff6640 1 -- 172.21.15.62:0/1808526491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f1493c830 con 0x563f1493bed0 2024-04-26T07:54:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.704+0000 7fbd90ff6640 1 --2- 172.21.15.62:0/1808526491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1493bed0 0x563f1493c2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x563f14921640 tx=0x7fbd880188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.704+0000 7fbc75ffb640 1 -- 172.21.15.62:0/1808526491 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88014450 con 0x563f1493bed0 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.704+0000 7fbc75ffb640 1 -- 172.21.15.62:0/1808526491 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd880145f0 con 0x563f1493bed0 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.704+0000 7fbd94b33800 1 -- 172.21.15.62:0/1808526491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f1493d2a0 con 0x563f1493bed0 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.704+0000 7fbc75ffb640 1 -- 172.21.15.62:0/1808526491 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd880148d0 con 0x563f1493bed0 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.704+0000 7fbd94b33800 1 -- 172.21.15.62:0/1808526491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f1493d7a0 con 0x563f1493bed0 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.704+0000 7fbc75ffb640 1 -- 172.21.15.62:0/1808526491 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbd88011040 con 0x563f1493bed0 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbc75ffb640 1 --2- 172.21.15.62:0/1808526491 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc68036e60 0x7fbc68039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbc75ffb640 1 -- 172.21.15.62:0/1808526491 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbd8801e070 con 0x563f1493bed0 2024-04-26T07:54:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd907f5640 1 --2- 172.21.15.62:0/1808526491 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc68036e60 0x7fbc68039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd94b33800 1 Processor -- start 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd94b33800 1 -- start start 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd907f5640 1 --2- 172.21.15.62:0/1808526491 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc68036e60 0x7fbc68039320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x563f149283b0 tx=0x7fbd8004baa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd94b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f149495f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd94b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f14919550 con 0x563f149491d0 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd90ff6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f149495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd90ff6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f149495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33816/0 (socket says 172.21.15.62:33816) 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.705+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2199456339 learned_addr learned my addr 172.21.15.62:0/2199456339 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.706+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2199456339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f14949bc0 con 0x563f149491d0 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.706+0000 7fbd90ff6640 1 --2- 172.21.15.62:0/2199456339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f149495f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbd8804cf20 tx=0x7fbd88011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c1845cf0ae9119 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.706+0000 7fbc6f7fe640 1 -- 172.21.15.62:0/2199456339 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88046070 con 0x563f149491d0 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.706+0000 7fbc6f7fe640 1 -- 172.21.15.62:0/2199456339 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd880168f0 con 0x563f149491d0 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.706+0000 7fbc6f7fe640 1 -- 172.21.15.62:0/2199456339 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8803d070 con 0x563f149491d0 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.706+0000 7fbd94b33800 1 -- 172.21.15.62:0/2199456339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 msgr2=0x563f149495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.706+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2199456339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f149495f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbd8804cf20 tx=0x7fbd88011700 comp rx=0 tx=0).stop 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.706+0000 7fbd94b33800 1 -- 172.21.15.62:0/2199456339 shutdown_connections 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2199456339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f149495f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd94b33800 1 -- 172.21.15.62:0/2199456339 >> 172.21.15.62:0/2199456339 conn(0x563f14945530 msgr2=0x563f14943590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd94b33800 1 -- 172.21.15.62:0/2199456339 shutdown_connections 2024-04-26T07:54:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd94b33800 1 -- 172.21.15.62:0/2199456339 wait complete. 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd94b33800 1 Processor -- start 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd94b33800 1 -- start start 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd94b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f14950800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd94b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f1494a330 con 0x563f149491d0 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd90ff6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f14950800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd90ff6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f14950800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33818/0 (socket says 172.21.15.62:33818) 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 learned_addr learned my addr 172.21.15.62:0/2694414374 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.707+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f14950d40 con 0x563f149491d0 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.708+0000 7fbd90ff6640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f14950800 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbd8804cf20 tx=0x7fbd8804ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.708+0000 7fbc6dffb640 1 -- 172.21.15.62:0/2694414374 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8803b070 con 0x563f149491d0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.708+0000 7fbc6dffb640 1 -- 172.21.15.62:0/2694414374 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd880133b0 con 0x563f149491d0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.708+0000 7fbc6dffb640 1 -- 172.21.15.62:0/2694414374 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88041070 con 0x563f149491d0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.708+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f14950fd0 con 0x563f149491d0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.708+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f14953c80 con 0x563f149491d0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbc6dffb640 1 -- 172.21.15.62:0/2694414374 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbd88046d10 con 0x563f149491d0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbc6dffb640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc60036e60 0x7fbc60039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbc6dffb640 1 -- 172.21.15.62:0/2694414374 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbd8800e040 con 0x563f149491d0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbd907f5640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc60036e60 0x7fbc60039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1495c470 0x563f1495e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f1495f080 con 0x563f1495c470 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbd8fff4640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1495c470 0x563f1495e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.709+0000 7fbd907f5640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc60036e60 0x7fbc60039320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbd80045130 tx=0x7fbd80035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd8fff4640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1495c470 0x563f1495e930 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 20 realm 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f1495f450 con 0x563f1495c470 2024-04-26T07:54:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f1495fd20 con 0x563f1495c470 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149600c0 con 0x563f1495c470 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.710+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd94b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f14960b70 0x563f14962f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149636c0 con 0x563f14960b70 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd90ff6640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f14960b70 0x563f14962f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd90ff6640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f14960b70 0x563f14962f60 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd94b33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.711+0000 7fbd94b33800 20 searching for the correct realm 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.712+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563f14965770 0x563f14967c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.712+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.712+0000 7fbd907f5640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563f14965770 0x563f14967c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.712+0000 7fbd907f5640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563f14965770 0x563f14967c30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.712+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.712+0000 7fbd907f5640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbd8000f070 0x7fbd8004a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.712+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x7fbd8000f070 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.713+0000 7fbd8fff4640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbd8000f070 0x7fbd8004a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.713+0000 7fbd8fff4640 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbd8000f070 0x7fbd8004a0d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.713+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.713+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.713+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.713+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f1495c470 2024-04-26T07:54:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.714+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.714+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f1495c470 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.714+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.714+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.714+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.714+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.715+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.715+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x7fbd8000f070 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.715+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.715+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.715+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.715+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f1495c470 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.715+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.715+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.716+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.716+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f1495c470 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.716+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.716+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x7fbd8000f070 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.716+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.716+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.716+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.716+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.717+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.717+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.717+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.717+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.717+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.717+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.717+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.717+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f1495c470 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.718+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.718+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f1495c470 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.718+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.718+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.718+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.718+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.719+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.719+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x7fbd8000f070 2024-04-26T07:54:37.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.719+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.719+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f1495c470 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.719+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.719+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.719+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.719+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.720+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.720+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.720+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.720+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x7fbd8000f070 2024-04-26T07:54:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.720+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.720+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14965770 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.721+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.721+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f14960b70 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.721+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.721+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x563f1495c470 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.721+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.721+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563f14968300 con 0x7fbd8000f070 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f14964170 con 0x563f1495c470 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149645c0 con 0x563f1495c470 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.722+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f14964aa0 con 0x563f1495c470 2024-04-26T07:54:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 zone default found 2024-04-26T07:54:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 4 Realm: () 2024-04-26T07:54:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 zonegroup default 2024-04-26T07:54:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f14968780 con 0x563f14960b70 2024-04-26T07:54:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f1496a9b0 con 0x563f14965770 2024-04-26T07:54:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f1496ad50 con 0x563f14965770 2024-04-26T07:54:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 started sync module instance, tier type = 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.723+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f14969df0 con 0x7fbd8000f070 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.724+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.724+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94828928344592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f14969df0 con 0x7fbd8000f070 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.725+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496b710 con 0x563f1495c470 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.726+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94828928344592] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.726+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.726+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94828928342816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496b710 con 0x563f1495c470 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.726+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496c110 con 0x563f14965770 2024-04-26T07:54:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.727+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.727+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94828928351264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496c9b0 con 0x563f14965770 2024-04-26T07:54:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.727+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496d450 con 0x7fbd8000f070 2024-04-26T07:54:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.727+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94828928342816] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.728+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.728+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94828928356128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496d840 con 0x7fbd8000f070 2024-04-26T07:54:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.728+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94828928351264] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.728+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496dd50 con 0x563f1495c470 2024-04-26T07:54:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.729+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.729+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94828928353536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496dd50 con 0x563f1495c470 2024-04-26T07:54:37.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.729+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496ec50 con 0x563f14960b70 2024-04-26T07:54:37.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.732+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94828928356128] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.732+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.732+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94828928348768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496f070 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.732+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496fa30 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.732+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94828928353536] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.733+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.733+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94828928360768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496fa30 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.733+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f14970470 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.733+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94828928348768] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94828928360768] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94828928368448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496e760 con 0x563f14960b70 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd94b33800 20 add_watcher() i=0 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd94b33800 20 add_watcher() i=1 2024-04-26T07:54:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd94b33800 20 add_watcher() i=2 2024-04-26T07:54:37.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd94b33800 20 add_watcher() i=3 2024-04-26T07:54:37.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd94b33800 20 add_watcher() i=4 2024-04-26T07:54:37.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd94b33800 20 add_watcher() i=5 2024-04-26T07:54:37.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.734+0000 7fbd94b33800 20 add_watcher() i=6 2024-04-26T07:54:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.735+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94828928368448] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.735+0000 7fbd94b33800 20 add_watcher() i=7 2024-04-26T07:54:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.735+0000 7fbd94b33800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.735+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f14973460 con 0x563f1495c470 2024-04-26T07:54:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.735+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.735+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94828928365952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f14970980 con 0x563f1495c470 2024-04-26T07:54:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.736+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94828928365952] v27'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.736+0000 7fbc467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.736+0000 7fbd94b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.736+0000 7fbd94b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.736+0000 7fbd94b33800 5 note: GC not initialized 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbc457e2640 20 reqs_thread_entry: start 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbd94b33800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbd94b33800 20 Filter name: none 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbbb6ffd640 20 reqs_thread_entry: start 2024-04-26T07:54:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149a65c0 con 0x563f1495c470 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbd94b33800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.737+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149a7b10 con 0x7fbd8000f070 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149a7b10 con 0x563f1495c470 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T07:54:37.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 4.1a 4:5a581a9c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149a95c0 con 0x7fbd8000f070 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 4.16 4:6ac82eb8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149ac270 con 0x563f14965770 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 4.e 4:7264ccad:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149aed40 con 0x7fbd8000f070 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 4.24 4:27ab159e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149b17a0 con 0x563f14960b70 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 4.7 4:e3bd6437:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149b4100 con 0x563f14960b70 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:70 4.3b 4:de750cfa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149b6db0 con 0x563f14965770 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 4.22 4:476c90f1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149b9b10 con 0x563f1495c470 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:72 4.1d 4:ba0b4099:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149b4100 con 0x563f14965770 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.738+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 4.7 4:e33164c7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149be940 con 0x563f14960b70 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:74 4.2e 4:74fb3df0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149c1590 con 0x563f14965770 2024-04-26T07:54:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:75 4.34 4:2cf2cafa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149c4290 con 0x7fbd8000f070 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(71 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(70 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(65 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(67 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(72 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(74 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(68 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(75 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.739+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f149c4290 con 0x7fbd8000f070 2024-04-26T07:54:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.740+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(76 foo.buckets [call] v27'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.740+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f149c4290 con 0x7fbd8000f070 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.741+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(77 foo.buckets [call] v27'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.741+0000 7fbd94b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.741+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149c4290 con 0x563f1495c470 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.741+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.741+0000 7fbd94b33800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.741+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563f149c4290 con 0x7fbd8000f070 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.742+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.742+0000 7fbc467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.742+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94828928365952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f149c4290 con 0x563f1495c470 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.743+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94828928365952] v27'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.744+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94828928344592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496f580 con 0x7fbd8000f070 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.744+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94828928344592] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.744+0000 7fbd94b33800 20 remove_watcher() i=0 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.744+0000 7fbd94b33800 2 removed watcher, disabling cache 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.744+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94828928342816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496f580 con 0x563f1495c470 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.746+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94828928342816] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.746+0000 7fbd94b33800 20 remove_watcher() i=1 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.746+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94828928351264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496f580 con 0x563f14965770 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.747+0000 7fbd907f5640 1 -- 172.21.15.62:0/2694414374 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94828928351264] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003b040 con 0x563f14965770 2024-04-26T07:54:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.747+0000 7fbd94b33800 20 remove_watcher() i=2 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.747+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94828928356128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496bc20 con 0x7fbd8000f070 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.747+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94828928356128] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x7fbd8000f070 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.747+0000 7fbd94b33800 20 remove_watcher() i=3 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.747+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94828928353536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496cf20 con 0x563f1495c470 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.748+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94828928353536] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7805a040 con 0x563f1495c470 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.748+0000 7fbd94b33800 20 remove_watcher() i=4 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.748+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94828928348768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496c500 con 0x563f14960b70 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.749+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94828928348768] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.749+0000 7fbd94b33800 20 remove_watcher() i=5 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.749+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94828928360768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496b260 con 0x563f14960b70 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.750+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94828928360768] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.750+0000 7fbd94b33800 20 remove_watcher() i=6 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.750+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94828928368448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563f1496b260 con 0x563f14960b70 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd90ff6640 1 -- 172.21.15.62:0/2694414374 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94828928368448] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88023d70 con 0x563f14960b70 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 20 remove_watcher() i=7 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f14960b70 msgr2=0x563f14962f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f14960b70 0x563f14962f60 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1495c470 msgr2=0x563f1495e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1495c470 0x563f1495e930 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbd8000f070 msgr2=0x7fbd8004a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbd8000f070 0x7fbd8004a0d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563f14965770 msgr2=0x563f14967c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.751+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563f14965770 0x563f14967c30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc60036e60 msgr2=0x7fbc60039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc60036e60 0x7fbc60039320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbd80045130 tx=0x7fbd80035000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 msgr2=0x563f14950800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f14950800 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbd8804cf20 tx=0x7fbd8804ceb0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd8fff4640 1 -- 172.21.15.62:0/2694414374 reap_dead start 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 shutdown_connections 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/2694414374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f149491d0 0x563f14950800 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 >> 172.21.15.62:0/2694414374 conn(0x563f14945530 msgr2=0x563f14942b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 shutdown_connections 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/2694414374 wait complete. 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/1808526491 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc68036e60 msgr2=0x7fbc68039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1808526491 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc68036e60 0x7fbc68039320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x563f149283b0 tx=0x7fbd8004baa0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/1808526491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1493bed0 msgr2=0x563f1493c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1808526491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1493bed0 0x563f1493c2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x563f14921640 tx=0x7fbd880188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/1808526491 shutdown_connections 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1808526491 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc68036e60 0x7fbc68039320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1808526491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1493bed0 0x563f1493c2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/1808526491 >> 172.21.15.62:0/1808526491 conn(0x563f1492ff70 msgr2=0x563f14930370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/1808526491 shutdown_connections 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/1808526491 wait complete. 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f1492a290 msgr2=0x563f1492c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f1492a290 0x563f1492c680 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1482b990 msgr2=0x563f149279b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.752+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1482b990 0x563f149279b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc78036e60 msgr2=0x7fbc78039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc78036e60 0x7fbc78039320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd78054000 tx=0x7fbd7804e000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 msgr2=0x563f14920770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14920770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000b700 tx=0x7fbd80000bc0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 shutdown_connections 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563f1482b990 0x563f149279b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563f1492a290 0x563f1492c680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbc78036e60 0x7fbc78039320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 --2- 172.21.15.62:0/1006433848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f1479b100 0x563f14920770 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 >> 172.21.15.62:0/1006433848 conn(0x563f14821bb0 msgr2=0x563f14912d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 shutdown_connections 2024-04-26T07:54:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.753+0000 7fbd94b33800 1 -- 172.21.15.62:0/1006433848 wait complete. 2024-04-26T07:54:37.791 INFO:teuthology.orchestra.run.smithi062.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-04-26T07:54:37.741570Z","last_stats_update":"2024-04-26T07:54:37.740608Z"} 2024-04-26T07:54:37.792 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-04-26T07:54:37.741570Z', 'last_stats_update': '2024-04-26T07:54:37.740608Z'} 2024-04-26T07:54:37.797 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:37.797 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-26T07:54:37.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-26T07:54:37.798 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-04-26T07:54:37.879 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:37.879 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.882+0000 7f3299f0c800 1 Processor -- start 2024-04-26T07:54:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.882+0000 7f3299f0c800 1 -- start start 2024-04-26T07:54:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.882+0000 7f3299f0c800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x565252b2c960 0x565252b2cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.882+0000 7f3299f0c800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565252b2d3b0 con 0x565252b2f9a0 2024-04-26T07:54:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.882+0000 7f3299f0c800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5652529d0e20 con 0x565252b2c960 2024-04-26T07:54:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.882+0000 7f3297a0b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x565252b2c960 0x565252b2cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.882+0000 7f329720a640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x565252b2f9a0 0x565252b2fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36690/0 (socket says 172.21.15.62:36690) 2024-04-26T07:54:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.882+0000 7f329720a640 1 -- 172.21.15.62:0/3978933198 learned_addr learned my addr 172.21.15.62:0/3978933198 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.883+0000 7f3297a0b640 1 -- 172.21.15.62:0/3978933198 >> v1:172.21.15.1:6789/0 conn(0x565252b2f9a0 legacy=0x565252b2fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.883+0000 7f3297a0b640 1 -- 172.21.15.62:0/3978933198 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565252b30560 con 0x565252b2c960 2024-04-26T07:54:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3297a0b640 1 --2- 172.21.15.62:0/3978933198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252b2cd80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f328800a470 tx=0x7f328801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f7b22365c43d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3296a09640 1 -- 172.21.15.62:0/3978933198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3288057070 con 0x565252b2c960 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3296a09640 1 -- 172.21.15.62:0/3978933198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328804adc0 con 0x565252b2c960 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3296a09640 1 -- 172.21.15.62:0/3978933198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3288052590 con 0x565252b2c960 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3299f0c800 1 -- 172.21.15.62:0/3978933198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 msgr2=0x565252b2cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3978933198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252b2cd80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f328800a470 tx=0x7f328801ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3299f0c800 1 -- 172.21.15.62:0/3978933198 shutdown_connections 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3978933198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252b2cd80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3299f0c800 1 -- 172.21.15.62:0/3978933198 >> 172.21.15.62:0/3978933198 conn(0x565252b28360 msgr2=0x565252b2a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3299f0c800 1 -- 172.21.15.62:0/3978933198 shutdown_connections 2024-04-26T07:54:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.885+0000 7f3299f0c800 1 -- 172.21.15.62:0/3978933198 wait complete. 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.898+0000 7f3299f0c800 1 Processor -- start 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.898+0000 7f3299f0c800 1 -- start start 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.898+0000 7f3299f0c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c1fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.898+0000 7f3299f0c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565252a79d00 con 0x565252b2c960 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.898+0000 7f3297a0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c1fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.898+0000 7f3297a0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c1fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33840/0 (socket says 172.21.15.62:33840) 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.898+0000 7f3297a0b640 1 -- 172.21.15.62:0/4246904005 learned_addr learned my addr 172.21.15.62:0/4246904005 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.899+0000 7f3297a0b640 1 -- 172.21.15.62:0/4246904005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565252c20330 con 0x565252b2c960 2024-04-26T07:54:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.899+0000 7f3297a0b640 1 --2- 172.21.15.62:0/4246904005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c1fd60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f328801ced0 tx=0x7f328804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320f235c3779033d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.899+0000 7f3185e0b640 1 -- 172.21.15.62:0/4246904005 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3288057040 con 0x565252b2c960 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.899+0000 7f3185e0b640 1 -- 172.21.15.62:0/4246904005 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288063070 con 0x565252b2c960 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.899+0000 7f3185e0b640 1 -- 172.21.15.62:0/4246904005 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3288052800 con 0x565252b2c960 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 -- 172.21.15.62:0/4246904005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 msgr2=0x565252c1fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4246904005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c1fd60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f328801ced0 tx=0x7f328804c000 comp rx=0 tx=0).stop 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 -- 172.21.15.62:0/4246904005 shutdown_connections 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4246904005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c1fd60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 -- 172.21.15.62:0/4246904005 >> 172.21.15.62:0/4246904005 conn(0x565252b28360 msgr2=0x565252c1b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 -- 172.21.15.62:0/4246904005 shutdown_connections 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 -- 172.21.15.62:0/4246904005 wait complete. 2024-04-26T07:54:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 Processor -- start 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 -- start start 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c277f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.900+0000 7f3299f0c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565252b37e10 con 0x565252b2c960 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f3297a0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f3297a0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c277f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33842/0 (socket says 172.21.15.62:33842) 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f3297a0b640 1 -- 172.21.15.62:0/4261808930 learned_addr learned my addr 172.21.15.62:0/4261808930 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f3297a0b640 1 -- 172.21.15.62:0/4261808930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565252c27d30 con 0x565252b2c960 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f3297a0b640 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c277f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f328801ced0 tx=0x7f3288002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f317ffff640 1 -- 172.21.15.62:0/4261808930 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f328806d070 con 0x565252b2c960 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f317ffff640 1 -- 172.21.15.62:0/4261808930 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288052d20 con 0x565252b2c960 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565252c27fc0 con 0x565252b2c960 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f317ffff640 1 -- 172.21.15.62:0/4261808930 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3288057050 con 0x565252b2c960 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.901+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565252c2ac20 con 0x565252b2c960 2024-04-26T07:54:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.902+0000 7f317ffff640 1 -- 172.21.15.62:0/4261808930 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f328805d470 con 0x565252b2c960 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.902+0000 7f317ffff640 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3180036e60 0x7f3180039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.902+0000 7f317ffff640 1 -- 172.21.15.62:0/4261808930 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f328808e1d0 con 0x565252b2c960 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.902+0000 7f329720a640 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3180036e60 0x7f3180039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.902+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252b2f9a0 0x565252c2e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.902+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c2ef20 con 0x565252b2f9a0 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.903+0000 7f329820c640 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252b2f9a0 0x565252c2e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.903+0000 7f329720a640 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3180036e60 0x7f3180039320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f328c000f60 tx=0x7f328c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.903+0000 7f329820c640 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252b2f9a0 0x565252c2e9e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.903+0000 7f329820c640 1 -- 172.21.15.62:0/4261808930 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f329000a4a0 con 0x565252b2f9a0 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.903+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c2bf70 con 0x565252b2f9a0 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.904+0000 7f329820c640 1 -- 172.21.15.62:0/4261808930 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f329000a4a0 con 0x565252b2f9a0 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.904+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c31240 0x565252c33630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.904+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c33cd0 con 0x565252c31240 2024-04-26T07:54:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.904+0000 7f3297a0b640 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c31240 0x565252c33630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.904+0000 7f3297a0b640 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c31240 0x565252c33630 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.905+0000 7f3297a0b640 1 -- 172.21.15.62:0/4261808930 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3288078070 con 0x565252c31240 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.905+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c301f0 con 0x565252b2f9a0 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.905+0000 7f329820c640 1 -- 172.21.15.62:0/4261808930 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f329000a4a0 con 0x565252b2f9a0 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.905+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c30670 con 0x565252b2f9a0 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.905+0000 7f329820c640 1 -- 172.21.15.62:0/4261808930 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f329000a4a0 con 0x565252b2f9a0 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.906+0000 7f3299f0c800 1 Processor -- start 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.906+0000 7f3299f0c800 1 -- start start 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.906+0000 7f3299f0c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c42e50 0x565252c43270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.906+0000 7f3299f0c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565252a21170 con 0x565252c42e50 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.906+0000 7f329820c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c42e50 0x565252c43270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.906+0000 7f329820c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c42e50 0x565252c43270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33852/0 (socket says 172.21.15.62:33852) 2024-04-26T07:54:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.906+0000 7f329820c640 1 -- 172.21.15.62:0/3428746825 learned_addr learned my addr 172.21.15.62:0/3428746825 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.906+0000 7f329820c640 1 -- 172.21.15.62:0/3428746825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565252c437b0 con 0x565252c42e50 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.907+0000 7f329820c640 1 --2- 172.21.15.62:0/3428746825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c42e50 0x565252c43270 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x565252c2f310 tx=0x7f3290018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.907+0000 7f317d7fa640 1 -- 172.21.15.62:0/3428746825 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3290014450 con 0x565252c42e50 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.907+0000 7f317d7fa640 1 -- 172.21.15.62:0/3428746825 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3290014610 con 0x565252c42e50 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.907+0000 7f3299f0c800 1 -- 172.21.15.62:0/3428746825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565252c44220 con 0x565252c42e50 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.907+0000 7f317d7fa640 1 -- 172.21.15.62:0/3428746825 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3290014930 con 0x565252c42e50 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.907+0000 7f3299f0c800 1 -- 172.21.15.62:0/3428746825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565252c44720 con 0x565252c42e50 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f317d7fa640 1 -- 172.21.15.62:0/3428746825 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3290011040 con 0x565252c42e50 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f317d7fa640 1 --2- 172.21.15.62:0/3428746825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3170036eb0 0x7f3170039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f317d7fa640 1 -- 172.21.15.62:0/3428746825 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f329001e070 con 0x565252c42e50 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f3297a0b640 1 --2- 172.21.15.62:0/3428746825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3170036eb0 0x7f3170039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f3299f0c800 1 Processor -- start 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f3299f0c800 1 -- start start 2024-04-26T07:54:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f3297a0b640 1 --2- 172.21.15.62:0/3428746825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3170036eb0 0x7f3170039370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x565252c2f340 tx=0x7f328808e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f3299f0c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f3299f0c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565252c205f0 con 0x565252c50160 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f329820c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f329820c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33860/0 (socket says 172.21.15.62:33860) 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.908+0000 7f329820c640 1 -- 172.21.15.62:0/204531458 learned_addr learned my addr 172.21.15.62:0/204531458 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f329820c640 1 -- 172.21.15.62:0/204531458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565252c50b50 con 0x565252c50160 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f329820c640 1 --2- 172.21.15.62:0/204531458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c50580 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f329004d010 tx=0x7f329004d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fd07b6641774b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3176ffd640 1 -- 172.21.15.62:0/204531458 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3290046070 con 0x565252c50160 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3176ffd640 1 -- 172.21.15.62:0/204531458 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3290013e00 con 0x565252c50160 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3176ffd640 1 -- 172.21.15.62:0/204531458 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3290016930 con 0x565252c50160 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3299f0c800 1 -- 172.21.15.62:0/204531458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 msgr2=0x565252c50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3299f0c800 1 --2- 172.21.15.62:0/204531458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c50580 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f329004d010 tx=0x7f329004d210 comp rx=0 tx=0).stop 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3299f0c800 1 -- 172.21.15.62:0/204531458 shutdown_connections 2024-04-26T07:54:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3299f0c800 1 --2- 172.21.15.62:0/204531458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c50580 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3299f0c800 1 -- 172.21.15.62:0/204531458 >> 172.21.15.62:0/204531458 conn(0x565252c4c430 msgr2=0x565252c4a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3299f0c800 1 -- 172.21.15.62:0/204531458 shutdown_connections 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.909+0000 7f3299f0c800 1 -- 172.21.15.62:0/204531458 wait complete. 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.910+0000 7f3299f0c800 1 Processor -- start 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.910+0000 7f3299f0c800 1 -- start start 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.910+0000 7f3299f0c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.910+0000 7f3299f0c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565252c512e0 con 0x565252c50160 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.910+0000 7f329820c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.910+0000 7f329820c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33870/0 (socket says 172.21.15.62:33870) 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.910+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 learned_addr learned my addr 172.21.15.62:0/3527532665 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.910+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565252c57c00 con 0x565252c50160 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.911+0000 7f329820c640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c576c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3290013fd0 tx=0x7f329004cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.911+0000 7f31757fa640 1 -- 172.21.15.62:0/3527532665 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3290046040 con 0x565252c50160 2024-04-26T07:54:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.911+0000 7f31757fa640 1 -- 172.21.15.62:0/3527532665 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329002be30 con 0x565252c50160 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.911+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565252c57ef0 con 0x565252c50160 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.911+0000 7f31757fa640 1 -- 172.21.15.62:0/3527532665 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3290022bd0 con 0x565252c50160 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.911+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565252c5ab40 con 0x565252c50160 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.911+0000 7f31757fa640 1 -- 172.21.15.62:0/3527532665 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f329002b350 con 0x565252c50160 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.912+0000 7f31757fa640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3160036e60 0x7f3160039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.912+0000 7f31757fa640 1 -- 172.21.15.62:0/3527532665 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f3290034070 con 0x565252c50160 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.912+0000 7f3297a0b640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3160036e60 0x7f3160039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.912+0000 7f3297a0b640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3160036e60 0x7f3160039320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f328808c880 tx=0x7f3288090040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.912+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.912+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252c633b0 0x565252c65870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.912+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c65fc0 con 0x565252c633b0 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f329720a640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252c633b0 0x565252c65870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f329720a640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252c633b0 0x565252c65870 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f328c009050 con 0x565252c633b0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 20 realm 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c62800 con 0x565252c633b0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f328c009050 con 0x565252c633b0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c66ab0 con 0x565252c633b0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f328c009050 con 0x565252c633b0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.913+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.914+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c67380 con 0x565252c633b0 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.914+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f328c009050 con 0x565252c633b0 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.914+0000 7f3299f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.914+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.914+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c67cc0 0x565252c6a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.914+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c6a840 con 0x565252c67cc0 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.914+0000 7f329820c640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c67cc0 0x565252c6a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.914+0000 7f329820c640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c67cc0 0x565252c6a0b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.915+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.915+0000 7f3299f0c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.915+0000 7f3299f0c800 20 searching for the correct realm 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.915+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x565252c6c810 0x565252c6ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.915+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c6c810 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.915+0000 7f3297a0b640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x565252c6c810 0x565252c6ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.915+0000 7f3297a0b640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x565252c6c810 0x565252c6ecd0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.916+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.916+0000 7f3297a0b640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f328805e790 0x7f328807e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.916+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x7f328805e790 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.916+0000 7f329720a640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f328805e790 0x7f328807e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.916+0000 7f329720a640 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f328805e790 0x7f328807e500 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.916+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c009050 con 0x7f328805e790 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.916+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c67cc0 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.917+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.917+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c633b0 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.917+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c009050 con 0x565252c633b0 2024-04-26T07:54:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.917+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c633b0 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.917+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.917+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c67cc0 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.918+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.918+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c67cc0 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.918+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.918+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x7f328805e790 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.918+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c029040 con 0x7f328805e790 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.918+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c6c810 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.918+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.918+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c633b0 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.919+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.919+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c67cc0 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.919+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.919+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c633b0 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.919+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.920+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x7f328805e790 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.920+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f328c029040 con 0x7f328805e790 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.920+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f3a0 con 0x565252c6c810 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.920+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.920+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c6c810 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.920+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.920+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c67cc0 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.921+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.921+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c6c810 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.921+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.921+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c6c810 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.921+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.921+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c633b0 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.921+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.921+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c633b0 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.922+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.922+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c67cc0 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.922+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.922+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c6c810 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.922+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.922+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x7f328805e790 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.922+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c029040 con 0x7f328805e790 2024-04-26T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.922+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c633b0 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.923+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.923+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c67cc0 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.923+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.923+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c6c810 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.923+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.923+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c67cc0 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.923+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.923+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x7f328805e790 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.924+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c029040 con 0x7f328805e790 2024-04-26T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.924+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c6c810 2024-04-26T07:54:37.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.924+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.924+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c67cc0 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.924+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.924+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x565252c633b0 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.924+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.924+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f32880a5040 con 0x7f328805e790 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f328c029040 con 0x7f328805e790 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c6b200 con 0x565252c633b0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c6baa0 con 0x565252c633b0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c6ae40 con 0x565252c633b0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f328c029040 con 0x565252c633b0 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 zone default found 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 4 Realm: () 2024-04-26T07:54:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.925+0000 7f3299f0c800 20 zonegroup default 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c6f880 con 0x565252c67cc0 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3299f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c71b50 con 0x565252c6c810 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3299f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.926+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c71ef0 con 0x565252c6c810 2024-04-26T07:54:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.927+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.927+0000 7f3299f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.927+0000 7f3299f0c800 20 started sync module instance, tier type = 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.927+0000 7f3299f0c800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.927+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c70fe0 con 0x7f328805e790 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.928+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.928+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94911576085808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c70fe0 con 0x7f328805e790 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.928+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c72960 con 0x565252c633b0 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.929+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94911576085808] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.929+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.929+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94911576089712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c70fe0 con 0x565252c633b0 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.929+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c733b0 con 0x565252c6c810 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.930+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94911576089712] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.930+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.930+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94911576083248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c70f50 con 0x565252c6c810 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.930+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c74170 con 0x7f328805e790 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.931+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94911576083248] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.931+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.931+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94911576094672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c74560 con 0x7f328805e790 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.931+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c74f60 con 0x565252c633b0 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.932+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.932+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94911576099440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c74e90 con 0x565252c633b0 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.932+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94911576094672] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.932+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c75e90 con 0x565252c67cc0 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.933+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94911576099440] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.933+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.933+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94911576095808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c759a0 con 0x565252c67cc0 2024-04-26T07:54:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.933+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c76360 con 0x565252c67cc0 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.934+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94911576095808] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.935+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.935+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94911576101712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c76360 con 0x565252c67cc0 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.935+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c76dd0 con 0x565252c67cc0 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94911576107168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c77240 con 0x565252c67cc0 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f3299f0c800 20 add_watcher() i=0 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f3299f0c800 20 add_watcher() i=1 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f3299f0c800 20 add_watcher() i=2 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f3299f0c800 20 add_watcher() i=3 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f3299f0c800 20 add_watcher() i=4 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f3299f0c800 20 add_watcher() i=5 2024-04-26T07:54:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94911576101712] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f3299f0c800 20 add_watcher() i=6 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.936+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94911576107168] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.937+0000 7f3299f0c800 20 add_watcher() i=7 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.937+0000 7f3299f0c800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.937+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252c75eb0 con 0x565252c633b0 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.937+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.937+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94911576108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c75eb0 con 0x565252c633b0 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.938+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94911576108432] v27'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.938+0000 7f314dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.938+0000 7f3299f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.938+0000 7f3299f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.938+0000 7f3299f0c800 5 note: GC not initialized 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.938+0000 7f314cfe1640 20 reqs_thread_entry: start 2024-04-26T07:54:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.938+0000 7f3299f0c800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 20 Filter name: none 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f30c67fc640 20 reqs_thread_entry: start 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252cada50 con 0x565252c633b0 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252cad570 con 0x7f328805e790 2024-04-26T07:54:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.939+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252cb12c0 con 0x565252c633b0 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f3299f0c800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f3299f0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f3299f0c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f3299f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f3299f0c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f3299f0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f3299f0c800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.940+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252cb4a00 con 0x7f328805e790 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(65 foo.buckets [call] v27'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f3299f0c800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f3299f0c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252cb3b70 con 0x7f328805e790 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f3299f0c800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f3299f0c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f3299f0c800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.941+0000 7f3299f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.942+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252cb49a0 con 0x7f328805e790 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f3299f0c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f3299f0c800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f3299f0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94911576360048 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565252cb5e70 con 0x565252c67cc0 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== watch-notify(notify (1) cookie 94911576101712 notify 115964116994 ret 0) ==== 380+0+0 (crc 0 0 0) 0x565252c5ab40 con 0x565252c67cc0 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f3176ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94911576101712 notifier 4473 bl.length()=338 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(68 notify.6 [notify cookie 94911576360048 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f3176ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f3176ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f3176ffd640 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f315c003ea0 con 0x565252c67cc0 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.943+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.944+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== watch-notify(notify_complete (2) cookie 94911576360048 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565252c57ef0 con 0x565252c67cc0 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.945+0000 7f314dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.945+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94911576108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252cb29e0 con 0x565252c633b0 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.946+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94911576108432] v27'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.946+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94911576085808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c76d90 con 0x7f328805e790 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.947+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94911576085808] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.947+0000 7f3299f0c800 20 remove_watcher() i=0 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.947+0000 7f3299f0c800 2 removed watcher, disabling cache 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.947+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94911576089712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c71510 con 0x565252c633b0 2024-04-26T07:54:37.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.948+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94911576089712] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.948+0000 7f3299f0c800 20 remove_watcher() i=1 2024-04-26T07:54:37.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.948+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94911576083248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c72470 con 0x565252c6c810 2024-04-26T07:54:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.949+0000 7f3297a0b640 1 -- 172.21.15.62:0/3527532665 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94911576083248] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3288078070 con 0x565252c6c810 2024-04-26T07:54:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.949+0000 7f3299f0c800 20 remove_watcher() i=2 2024-04-26T07:54:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.949+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94911576094672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c72470 con 0x7f328805e790 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.950+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94911576094672] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x7f328805e790 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.950+0000 7f3299f0c800 20 remove_watcher() i=3 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.950+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94911576099440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c737d0 con 0x565252c633b0 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.951+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94911576099440] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f328c039040 con 0x565252c633b0 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.951+0000 7f3299f0c800 20 remove_watcher() i=4 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.951+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94911576095808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c72470 con 0x565252c67cc0 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.952+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94911576095808] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.952+0000 7f3299f0c800 20 remove_watcher() i=5 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.952+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94911576101712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c74a70 con 0x565252c67cc0 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.953+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94911576101712] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.953+0000 7f3299f0c800 20 remove_watcher() i=6 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.953+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94911576107168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565252c737d0 con 0x565252c67cc0 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f329820c640 1 -- 172.21.15.62:0/3527532665 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94911576107168] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329003d050 con 0x565252c67cc0 2024-04-26T07:54:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 20 remove_watcher() i=7 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c67cc0 msgr2=0x565252c6a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c67cc0 0x565252c6a0b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252c633b0 msgr2=0x565252c65870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252c633b0 0x565252c65870 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f328805e790 msgr2=0x7f328807e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f328805e790 0x7f328807e500 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x565252c6c810 msgr2=0x565252c6ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x565252c6c810 0x565252c6ecd0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3160036e60 msgr2=0x7f3160039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3160036e60 0x7f3160039320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f328808c880 tx=0x7f3288090040 comp rx=0 tx=0).stop 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 msgr2=0x565252c576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f329720a640 1 -- 172.21.15.62:0/3527532665 reap_dead start 2024-04-26T07:54:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c576c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3290013fd0 tx=0x7f329004cfa0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 shutdown_connections 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3527532665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c50160 0x565252c576c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 >> 172.21.15.62:0/3527532665 conn(0x565252c4c430 msgr2=0x565252c49a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 shutdown_connections 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3527532665 wait complete. 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3428746825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3170036eb0 msgr2=0x7f3170039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3428746825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3170036eb0 0x7f3170039370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x565252c2f340 tx=0x7f328808e040 comp rx=0 tx=0).stop 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3428746825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c42e50 msgr2=0x565252c43270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3428746825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c42e50 0x565252c43270 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x565252c2f310 tx=0x7f3290018830 comp rx=0 tx=0).stop 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 -- 172.21.15.62:0/3428746825 shutdown_connections 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3428746825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3170036eb0 0x7f3170039370 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.954+0000 7f3299f0c800 1 --2- 172.21.15.62:0/3428746825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252c42e50 0x565252c43270 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/3428746825 >> 172.21.15.62:0/3428746825 conn(0x565252c36ef0 msgr2=0x565252c372f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/3428746825 shutdown_connections 2024-04-26T07:54:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/3428746825 wait complete. 2024-04-26T07:54:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c31240 msgr2=0x565252c33630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c31240 0x565252c33630 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252b2f9a0 msgr2=0x565252c2e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252b2f9a0 0x565252c2e9e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3180036e60 msgr2=0x7f3180039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3180036e60 0x7f3180039320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f328c000f60 tx=0x7f328c0012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 msgr2=0x565252c277f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c277f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f328801ced0 tx=0x7f3288002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 shutdown_connections 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x565252b2f9a0 0x565252c2e9e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x565252c31240 0x565252c33630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3180036e60 0x7f3180039320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 --2- 172.21.15.62:0/4261808930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565252b2c960 0x565252c277f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 >> 172.21.15.62:0/4261808930 conn(0x565252b28360 msgr2=0x565252c19e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:37.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 shutdown_connections 2024-04-26T07:54:37.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:37.955+0000 7f3299f0c800 1 -- 172.21.15.62:0/4261808930 wait complete. 2024-04-26T07:54:37.970 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T07:54:37.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T07:54:37.970 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.025+0000 7f19c4887800 1 Processor -- start 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.025+0000 7f19c4887800 1 -- start start 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.026+0000 7f19c4887800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5579aa90d000 0x5579aa90d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.026+0000 7f19c4887800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579aa882290 con 0x5579aa90d960 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.026+0000 7f19c4887800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5579aa7b0e20 con 0x5579aa90d000 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.026+0000 7f19c2386640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5579aa90d000 0x5579aa90d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.026+0000 7f19c1b85640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5579aa90d960 0x5579aa90de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36696/0 (socket says 172.21.15.62:36696) 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.026+0000 7f19c1b85640 1 -- 172.21.15.62:0/3441378472 learned_addr learned my addr 172.21.15.62:0/3441378472 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.026+0000 7f19c2386640 1 -- 172.21.15.62:0/3441378472 >> v1:172.21.15.1:6789/0 conn(0x5579aa90d960 legacy=0x5579aa90de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.026+0000 7f19c2386640 1 -- 172.21.15.62:0/3441378472 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579aa90e520 con 0x5579aa90d000 2024-04-26T07:54:38.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.028+0000 7f19c2386640 1 --2- 172.21.15.62:0/3441378472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aa90d420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19b400a470 tx=0x7f19b401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dfeb23680d7ada server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.028+0000 7f19c1384640 1 -- 172.21.15.62:0/3441378472 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b4057070 con 0x5579aa90d000 2024-04-26T07:54:38.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.028+0000 7f19c1384640 1 -- 172.21.15.62:0/3441378472 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b4052570 con 0x5579aa90d000 2024-04-26T07:54:38.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.028+0000 7f19c1384640 1 -- 172.21.15.62:0/3441378472 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b4052870 con 0x5579aa90d000 2024-04-26T07:54:38.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.029+0000 7f19c4887800 1 -- 172.21.15.62:0/3441378472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 msgr2=0x5579aa90d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.029+0000 7f19c4887800 1 --2- 172.21.15.62:0/3441378472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aa90d420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19b400a470 tx=0x7f19b401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:38.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.029+0000 7f19c4887800 1 -- 172.21.15.62:0/3441378472 shutdown_connections 2024-04-26T07:54:38.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.029+0000 7f19c4887800 1 --2- 172.21.15.62:0/3441378472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aa90d420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.029+0000 7f19c4887800 1 -- 172.21.15.62:0/3441378472 >> 172.21.15.62:0/3441378472 conn(0x5579aa908be0 msgr2=0x5579aa90b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.029+0000 7f19c4887800 1 -- 172.21.15.62:0/3441378472 shutdown_connections 2024-04-26T07:54:38.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.029+0000 7f19c4887800 1 -- 172.21.15.62:0/3441378472 wait complete. 2024-04-26T07:54:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.041+0000 7f19c4887800 1 Processor -- start 2024-04-26T07:54:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.041+0000 7f19c4887800 1 -- start start 2024-04-26T07:54:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f19c4887800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa02240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f19c4887800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5579aa859d30 con 0x5579aa90d000 2024-04-26T07:54:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f19c2386640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa02240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f19c2386640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa02240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33884/0 (socket says 172.21.15.62:33884) 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f19c2386640 1 -- 172.21.15.62:0/4002469649 learned_addr learned my addr 172.21.15.62:0/4002469649 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f19c2386640 1 -- 172.21.15.62:0/4002469649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579aaa02810 con 0x5579aa90d000 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f19c2386640 1 --2- 172.21.15.62:0/4002469649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa02240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f19b4055040 tx=0x7f19b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cce8370c0f59356 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f18b0608640 1 -- 172.21.15.62:0/4002469649 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b4057070 con 0x5579aa90d000 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f18b0608640 1 -- 172.21.15.62:0/4002469649 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b4063070 con 0x5579aa90d000 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.042+0000 7f18b0608640 1 -- 172.21.15.62:0/4002469649 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b4052720 con 0x5579aa90d000 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.043+0000 7f19c4887800 1 -- 172.21.15.62:0/4002469649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 msgr2=0x5579aaa02240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.043+0000 7f19c4887800 1 --2- 172.21.15.62:0/4002469649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa02240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f19b4055040 tx=0x7f19b404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.043+0000 7f19c4887800 1 -- 172.21.15.62:0/4002469649 shutdown_connections 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.043+0000 7f19c4887800 1 --2- 172.21.15.62:0/4002469649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa02240 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.043+0000 7f19c4887800 1 -- 172.21.15.62:0/4002469649 >> 172.21.15.62:0/4002469649 conn(0x5579aa908be0 msgr2=0x5579aa9fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.043+0000 7f19c4887800 1 -- 172.21.15.62:0/4002469649 shutdown_connections 2024-04-26T07:54:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.043+0000 7f19c4887800 1 -- 172.21.15.62:0/4002469649 wait complete. 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c4887800 1 Processor -- start 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c4887800 1 -- start start 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c4887800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa09c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c4887800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5579aa90e9f0 con 0x5579aa90d000 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c2386640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa09c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c2386640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa09c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33892/0 (socket says 172.21.15.62:33892) 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c2386640 1 -- 172.21.15.62:0/3047814664 learned_addr learned my addr 172.21.15.62:0/3047814664 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c2386640 1 -- 172.21.15.62:0/3047814664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579aaa0a180 con 0x5579aa90d000 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.044+0000 7f19c2386640 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa09c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f19b4055040 tx=0x7f19b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.045+0000 7f18aee05640 1 -- 172.21.15.62:0/3047814664 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b405e480 con 0x5579aa90d000 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.045+0000 7f18aee05640 1 -- 172.21.15.62:0/3047814664 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b406c070 con 0x5579aa90d000 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.045+0000 7f18aee05640 1 -- 172.21.15.62:0/3047814664 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b405e750 con 0x5579aa90d000 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.045+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579aaa0a410 con 0x5579aa90d000 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.045+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579aaa0d070 con 0x5579aa90d000 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.045+0000 7f18aee05640 1 -- 172.21.15.62:0/3047814664 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f19b405e8f0 con 0x5579aa90d000 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.046+0000 7f18aee05640 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f18a8036e60 0x7f18a8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.046+0000 7f18aee05640 1 -- 172.21.15.62:0/3047814664 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f19b408f020 con 0x5579aa90d000 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.046+0000 7f19c1b85640 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f18a8036e60 0x7f18a8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.046+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aa90d960 0x5579aaa10e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.046+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa11400 con 0x5579aa90d960 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.046+0000 7f19c2b87640 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aa90d960 0x5579aaa10e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.046+0000 7f19c1b85640 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f18a8036e60 0x7f18a8039320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19b8000f60 tx=0x7f19b80012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.046+0000 7f19c2b87640 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aa90d960 0x5579aaa10e30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.047+0000 7f19c2b87640 1 -- 172.21.15.62:0/3047814664 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19bc00a4a0 con 0x5579aa90d960 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.047+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa0e400 con 0x5579aa90d960 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.047+0000 7f19c2b87640 1 -- 172.21.15.62:0/3047814664 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19bc00a4a0 con 0x5579aa90d960 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.047+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa13780 0x5579aaa15b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.047+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa16210 con 0x5579aaa13780 2024-04-26T07:54:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.047+0000 7f19c2386640 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa13780 0x5579aaa15b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.047+0000 7f19c2386640 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa13780 0x5579aaa15b70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.048+0000 7f19c2386640 1 -- 172.21.15.62:0/3047814664 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa13780 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.048+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa12730 con 0x5579aa90d960 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.048+0000 7f19c2b87640 1 -- 172.21.15.62:0/3047814664 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19bc00a4a0 con 0x5579aa90d960 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.048+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa12c10 con 0x5579aa90d960 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.048+0000 7f19c2b87640 1 -- 172.21.15.62:0/3047814664 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f19bc00a4a0 con 0x5579aa90d960 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.049+0000 7f19c4887800 1 Processor -- start 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.049+0000 7f19c4887800 1 -- start start 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.049+0000 7f19c4887800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa253c0 0x5579aaa257e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.049+0000 7f19c4887800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5579aa801170 con 0x5579aaa253c0 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.049+0000 7f19c2b87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa253c0 0x5579aaa257e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.049+0000 7f19c2b87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa253c0 0x5579aaa257e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33900/0 (socket says 172.21.15.62:33900) 2024-04-26T07:54:38.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.049+0000 7f19c2b87640 1 -- 172.21.15.62:0/247396722 learned_addr learned my addr 172.21.15.62:0/247396722 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.049+0000 7f19c2b87640 1 -- 172.21.15.62:0/247396722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579aaa25d20 con 0x5579aaa253c0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.050+0000 7f19c2b87640 1 --2- 172.21.15.62:0/247396722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa253c0 0x5579aaa257e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x5579aaa117e0 tx=0x7f19bc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.050+0000 7f18a7fff640 1 -- 172.21.15.62:0/247396722 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19bc014450 con 0x5579aaa253c0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.050+0000 7f18a7fff640 1 -- 172.21.15.62:0/247396722 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc0145f0 con 0x5579aaa253c0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.050+0000 7f19c4887800 1 -- 172.21.15.62:0/247396722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579aaa26790 con 0x5579aaa253c0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.050+0000 7f18a7fff640 1 -- 172.21.15.62:0/247396722 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19bc0148d0 con 0x5579aaa253c0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.050+0000 7f19c4887800 1 -- 172.21.15.62:0/247396722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579aaa26c90 con 0x5579aaa253c0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f18a7fff640 1 -- 172.21.15.62:0/247396722 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f19bc011040 con 0x5579aaa253c0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f18a7fff640 1 --2- 172.21.15.62:0/247396722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f189c036e60 0x7f189c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f18a7fff640 1 -- 172.21.15.62:0/247396722 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f19bc01e070 con 0x5579aaa253c0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f19c2386640 1 --2- 172.21.15.62:0/247396722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f189c036e60 0x7f189c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f19c4887800 1 Processor -- start 2024-04-26T07:54:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f19c4887800 1 -- start start 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f19c2386640 1 --2- 172.21.15.62:0/247396722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f189c036e60 0x7f189c039320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5579aaa118a0 tx=0x7f19b4052ef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f19c4887800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa32ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f19c4887800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5579aaa02ad0 con 0x5579aaa326a0 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.051+0000 7f19c2b87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa32ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.052+0000 7f19c2b87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa32ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33914/0 (socket says 172.21.15.62:33914) 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.052+0000 7f19c2b87640 1 -- 172.21.15.62:0/3859230100 learned_addr learned my addr 172.21.15.62:0/3859230100 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.052+0000 7f19c2b87640 1 -- 172.21.15.62:0/3859230100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579aaa33090 con 0x5579aaa326a0 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.052+0000 7f19c2b87640 1 --2- 172.21.15.62:0/3859230100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa32ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f19bc04d090 tx=0x7f19bc041420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d10e6280cbda15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.052+0000 7f18a5ffb640 1 -- 172.21.15.62:0/3859230100 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19bc013cb0 con 0x5579aaa326a0 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.052+0000 7f18a5ffb640 1 -- 172.21.15.62:0/3859230100 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc046e50 con 0x5579aaa326a0 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.052+0000 7f18a5ffb640 1 -- 172.21.15.62:0/3859230100 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19bc014a70 con 0x5579aaa326a0 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 -- 172.21.15.62:0/3859230100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 msgr2=0x5579aaa32ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 --2- 172.21.15.62:0/3859230100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa32ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f19bc04d090 tx=0x7f19bc041420 comp rx=0 tx=0).stop 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 -- 172.21.15.62:0/3859230100 shutdown_connections 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 --2- 172.21.15.62:0/3859230100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa32ac0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 -- 172.21.15.62:0/3859230100 >> 172.21.15.62:0/3859230100 conn(0x5579aaa2ea00 msgr2=0x5579aaa2ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 -- 172.21.15.62:0/3859230100 shutdown_connections 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 -- 172.21.15.62:0/3859230100 wait complete. 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 Processor -- start 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 -- start start 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa39c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c4887800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5579aaa337a0 con 0x5579aaa326a0 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c2b87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa39c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c2b87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa39c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33924/0 (socket says 172.21.15.62:33924) 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.053+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 learned_addr learned my addr 172.21.15.62:0/1816842140 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.054+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579aaa3a140 con 0x5579aaa326a0 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.054+0000 7f19c2b87640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa39c00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f19bc048010 tx=0x7f19bc04cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.054+0000 7f1893fff640 1 -- 172.21.15.62:0/1816842140 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19bc03b070 con 0x5579aaa326a0 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.054+0000 7f1893fff640 1 -- 172.21.15.62:0/1816842140 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc016940 con 0x5579aaa326a0 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.054+0000 7f1893fff640 1 -- 172.21.15.62:0/1816842140 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19bc022bd0 con 0x5579aaa326a0 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.054+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579aaa3a3d0 con 0x5579aaa326a0 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.054+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579aaa3d080 con 0x5579aaa326a0 2024-04-26T07:54:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.055+0000 7f1893fff640 1 -- 172.21.15.62:0/1816842140 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f19bc0133b0 con 0x5579aaa326a0 2024-04-26T07:54:38.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.055+0000 7f1893fff640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f188c036eb0 0x7f188c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.055+0000 7f1893fff640 1 -- 172.21.15.62:0/1816842140 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f19bc033070 con 0x5579aaa326a0 2024-04-26T07:54:38.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.055+0000 7f19c2386640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f188c036eb0 0x7f188c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.055+0000 7f19c2386640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f188c036eb0 0x7f188c039370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f19b4066fd0 tx=0x7f19b4084000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.055+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.055+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aaa456f0 0x5579aaa47bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.055+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa48300 con 0x5579aaa456f0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c1b85640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aaa456f0 0x5579aaa47bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c1b85640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aaa456f0 0x5579aaa47bb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b8009050 con 0x5579aaa456f0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c4887800 20 realm 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa44b40 con 0x5579aaa456f0 2024-04-26T07:54:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b8009050 con 0x5579aaa456f0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c4887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.056+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa48df0 con 0x5579aaa456f0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b8009050 con 0x5579aaa456f0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa496c0 con 0x5579aaa456f0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19b8009050 con 0x5579aaa456f0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c4887800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa4a000 0x5579aaa4c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa4cb80 con 0x5579aaa4a000 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c2b87640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa4a000 0x5579aaa4c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.057+0000 7f19c2b87640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa4a000 0x5579aaa4c3f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.058+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.058+0000 7f19c4887800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.058+0000 7f19c4887800 20 searching for the correct realm 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.058+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5579aaa4eb50 0x5579aaa51010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.058+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa4eb50 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.058+0000 7f19c2386640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5579aaa4eb50 0x5579aaa51010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.058+0000 7f19c2386640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5579aaa4eb50 0x5579aaa51010 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.059+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.059+0000 7f19c2386640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f19b4089070 0x7f19b4089450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.059+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x7f19b4089070 2024-04-26T07:54:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.059+0000 7f19c1b85640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f19b4089070 0x7f19b4089450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.059+0000 7f19c1b85640 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f19b4089070 0x7f19b4089450 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.059+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8009050 con 0x7f19b4089070 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.059+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa4a000 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.060+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.060+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa456f0 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.060+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8009050 con 0x5579aaa456f0 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.060+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa456f0 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.060+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.060+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa4a000 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.061+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.061+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa4a000 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.061+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.061+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x7f19b4089070 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.061+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8029040 con 0x7f19b4089070 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.061+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa4eb50 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.061+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.061+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa456f0 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.062+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.062+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa4a000 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.062+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.062+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa456f0 2024-04-26T07:54:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.062+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.062+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x7f19b4089070 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.062+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f19b8029040 con 0x7f19b4089070 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.062+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa516e0 con 0x5579aaa4eb50 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.063+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.063+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4eb50 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.063+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.063+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4a000 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.063+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.063+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4eb50 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.064+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.064+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4eb50 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.064+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.064+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa456f0 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.064+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.064+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa456f0 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.064+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.064+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4a000 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.065+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.065+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4eb50 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.065+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.065+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x7f19b4089070 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.065+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8029040 con 0x7f19b4089070 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.065+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa456f0 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.065+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.065+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4a000 2024-04-26T07:54:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.066+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.066+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4eb50 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.066+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.066+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4a000 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.066+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.066+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x7f19b4089070 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.066+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8029040 con 0x7f19b4089070 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.066+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4eb50 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa4a000 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x5579aaa456f0 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19b40a8040 con 0x7f19b4089070 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8029040 con 0x7f19b4089070 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c4887800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c4887800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c4887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c4887800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c4887800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c4887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.067+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa4d540 con 0x5579aaa456f0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa4dde0 con 0x5579aaa456f0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa4d180 con 0x5579aaa456f0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f19b8029040 con 0x5579aaa456f0 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 20 zone default found 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 4 Realm: () 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 20 zonegroup default 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.068+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa4da10 con 0x5579aaa4a000 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa53f20 con 0x5579aaa4eb50 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa542c0 con 0x5579aaa4eb50 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 20 started sync module instance, tier type = 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.069+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa53360 con 0x7f19b4089070 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.070+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x7f19b4089070 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.070+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93981042358368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa53360 con 0x7f19b4089070 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.070+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa54c80 con 0x5579aaa456f0 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.071+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93981042358368] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x7f19b4089070 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.072+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.072+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93981042362800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa53360 con 0x5579aaa456f0 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.072+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa55720 con 0x5579aaa4eb50 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.073+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.073+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93981042364944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa55fc0 con 0x5579aaa4eb50 2024-04-26T07:54:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.073+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa56a60 con 0x7f19b4089070 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.073+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93981042362800] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.074+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93981042364944] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.074+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x7f19b4089070 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.074+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93981042369840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa55b10 con 0x7f19b4089070 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.074+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa57300 con 0x5579aaa456f0 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.075+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.075+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93981042372096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa55b10 con 0x5579aaa456f0 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.075+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa57e50 con 0x5579aaa4a000 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.075+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93981042369840] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x7f19b4089070 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.076+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93981042372096] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.076+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.076+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93981042374944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa57e10 con 0x5579aaa4a000 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.076+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa586f0 con 0x5579aaa4a000 2024-04-26T07:54:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.077+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93981042374944] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.077+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.077+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93981042355888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa57e10 con 0x5579aaa4a000 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.077+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa58d50 con 0x5579aaa4a000 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.078+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93981042355888] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.078+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93981042378848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa58d50 con 0x5579aaa4a000 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 20 add_watcher() i=0 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 20 add_watcher() i=1 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 20 add_watcher() i=2 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 20 add_watcher() i=3 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 20 add_watcher() i=4 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 20 add_watcher() i=5 2024-04-26T07:54:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 20 add_watcher() i=6 2024-04-26T07:54:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93981042378848] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 20 add_watcher() i=7 2024-04-26T07:54:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.079+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa5c180 con 0x5579aaa456f0 2024-04-26T07:54:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.080+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.080+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93981042376816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa59640 con 0x5579aaa456f0 2024-04-26T07:54:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.081+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93981042376816] v27'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.081+0000 7f1878fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.081+0000 7f19c4887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.081+0000 7f19c4887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.081+0000 7f19c4887800 5 note: GC not initialized 2024-04-26T07:54:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.081+0000 7f17f37fe640 20 reqs_thread_entry: start 2024-04-26T07:54:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.081+0000 7f19c4887800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.081+0000 7f19c4887800 20 Filter name: none 2024-04-26T07:54:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f17f17fa640 20 reqs_thread_entry: start 2024-04-26T07:54:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:54:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa8f9e0 con 0x5579aaa4a000 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa8e020 con 0x5579aaa4a000 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T07:54:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.082+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa8e910 con 0x5579aaa4a000 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v27'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c4887800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c4887800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c4887800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93981042599008 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa92fd0 con 0x5579aaa4a000 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== watch-notify(notify (1) cookie 93981042374944 notify 115964116995 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5579aaa8f430 con 0x5579aaa4a000 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f18a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 93981042374944 notifier 4480 bl.length()=556 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f18a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f18a5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f18a5ffb640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1888003ea0 con 0x5579aaa4a000 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(65 notify.5 [notify cookie 93981042599008 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== watch-notify(notify_complete (2) cookie 93981042599008 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5579aaa3a140 con 0x5579aaa4a000 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.084+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa8e870 con 0x5579aaa4a000 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.085+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.085+0000 7f19c4887800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.085+0000 7f19c4887800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.085+0000 7f19c4887800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.085+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93981042598848 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa93480 con 0x5579aaa4eb50 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.086+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== watch-notify(notify (1) cookie 93981042364944 notify 115964116994 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f19b40a2040 con 0x5579aaa4eb50 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.086+0000 7f18a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 93981042364944 notifier 4480 bl.length()=177 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.086+0000 7f18a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.086+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(68 notify.2 [notify cookie 93981042598848 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.086+0000 7f18a57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.086+0000 7f18a57fa640 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f17f8003400 con 0x5579aaa4eb50 2024-04-26T07:54:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.086+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.086+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== watch-notify(notify_complete (2) cookie 93981042598848 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5579aaa0d070 con 0x5579aaa4eb50 2024-04-26T07:54:38.114 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T07:54:38.083828Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:38.083814Z","tags":[],"group_ids":[]} 2024-04-26T07:54:38.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.087+0000 7f1878fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.087+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93981042376816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa5bce0 con 0x5579aaa456f0 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.088+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93981042376816] v27'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.088+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93981042358368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa58030 con 0x7f19b4089070 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.089+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93981042358368] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x7f19b4089070 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.089+0000 7f19c4887800 20 remove_watcher() i=0 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.089+0000 7f19c4887800 2 removed watcher, disabling cache 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.089+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93981042362800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa53860 con 0x5579aaa456f0 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.090+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93981042362800] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.090+0000 7f19c4887800 20 remove_watcher() i=1 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.090+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93981042364944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa53860 con 0x5579aaa4eb50 2024-04-26T07:54:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.091+0000 7f19c2386640 1 -- 172.21.15.62:0/1816842140 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93981042364944] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4071990 con 0x5579aaa4eb50 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.091+0000 7f19c4887800 20 remove_watcher() i=2 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.091+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93981042369840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa53860 con 0x7f19b4089070 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.092+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93981042369840] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x7f19b4089070 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.092+0000 7f19c4887800 20 remove_watcher() i=3 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.092+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93981042372096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa56530 con 0x5579aaa456f0 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.094+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93981042372096] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8039040 con 0x5579aaa456f0 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.094+0000 7f19c4887800 20 remove_watcher() i=4 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.094+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93981042374944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa53860 con 0x5579aaa4a000 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.095+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93981042374944] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.095+0000 7f19c4887800 20 remove_watcher() i=5 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.095+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93981042355888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa56e00 con 0x5579aaa4a000 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.095+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93981042355888] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.095+0000 7f19c4887800 20 remove_watcher() i=6 2024-04-26T07:54:38.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.095+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93981042378848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579aaa56530 con 0x5579aaa4a000 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.096+0000 7f19c2b87640 1 -- 172.21.15.62:0/1816842140 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93981042378848] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19bc02a070 con 0x5579aaa4a000 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.096+0000 7f19c4887800 20 remove_watcher() i=7 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa4a000 msgr2=0x5579aaa4c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa4a000 0x5579aaa4c3f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aaa456f0 msgr2=0x5579aaa47bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aaa456f0 0x5579aaa47bb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f19b4089070 msgr2=0x7f19b4089450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f19b4089070 0x7f19b4089450 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5579aaa4eb50 msgr2=0x5579aaa51010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5579aaa4eb50 0x5579aaa51010 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f188c036eb0 msgr2=0x7f188c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f188c036eb0 0x7f188c039370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f19b4066fd0 tx=0x7f19b4084000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 msgr2=0x5579aaa39c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c1b85640 1 -- 172.21.15.62:0/1816842140 reap_dead start 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa39c00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f19bc048010 tx=0x7f19bc04cff0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 shutdown_connections 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/1816842140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa326a0 0x5579aaa39c00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 >> 172.21.15.62:0/1816842140 conn(0x5579aaa2ea00 msgr2=0x5579aaa2c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 shutdown_connections 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/1816842140 wait complete. 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/247396722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f189c036e60 msgr2=0x7f189c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/247396722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f189c036e60 0x7f189c039320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5579aaa118a0 tx=0x7f19b4052ef0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/247396722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa253c0 msgr2=0x5579aaa257e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/247396722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa253c0 0x5579aaa257e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x5579aaa117e0 tx=0x7f19bc018830 comp rx=0 tx=0).stop 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/247396722 shutdown_connections 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/247396722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f189c036e60 0x7f189c039320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 --2- 172.21.15.62:0/247396722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aaa253c0 0x5579aaa257e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/247396722 >> 172.21.15.62:0/247396722 conn(0x5579aaa19460 msgr2=0x5579aaa19860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/247396722 shutdown_connections 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.097+0000 7f19c4887800 1 -- 172.21.15.62:0/247396722 wait complete. 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa13780 msgr2=0x5579aaa15b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa13780 0x5579aaa15b70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aa90d960 msgr2=0x5579aaa10e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aa90d960 0x5579aaa10e30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f18a8036e60 msgr2=0x7f18a8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f18a8036e60 0x7f18a8039320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19b8000f60 tx=0x7f19b80012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 msgr2=0x5579aaa09c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa09c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f19b4055040 tx=0x7f19b4002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 shutdown_connections 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5579aa90d960 0x5579aaa10e30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5579aaa13780 0x5579aaa15b70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f18a8036e60 0x7f18a8039320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 --2- 172.21.15.62:0/3047814664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5579aa90d000 0x5579aaa09c40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 >> 172.21.15.62:0/3047814664 conn(0x5579aa908be0 msgr2=0x5579aa9fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 shutdown_connections 2024-04-26T07:54:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.098+0000 7f19c4887800 1 -- 172.21.15.62:0/3047814664 wait complete. 2024-04-26T07:54:38.139 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T07:54:38.083828Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:38.083814Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:38.145 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T07:54:38.153 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:38.153 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-04-26T07:54:38.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-04-26T07:54:38.154 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-04-26T07:54:38.199 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:38.199 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:38.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.201+0000 7fbfc1733800 1 Processor -- start 2024-04-26T07:54:38.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.201+0000 7fbfc1733800 1 -- start start 2024-04-26T07:54:38.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.201+0000 7fbfc1733800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fef6d1afa0 0x55fef6d1b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.201+0000 7fbfc1733800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fef6c90280 con 0x55fef6d1b900 2024-04-26T07:54:38.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.201+0000 7fbfc1733800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55fef6bbee20 con 0x55fef6d1afa0 2024-04-26T07:54:38.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.202+0000 7fbfbd3f5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fef6d1afa0 0x55fef6d1b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.202+0000 7fbfbd3f5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fef6d1afa0 0x55fef6d1b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33936/0 (socket says 172.21.15.62:33936) 2024-04-26T07:54:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.202+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/3124777146 learned_addr learned my addr 172.21.15.62:0/3124777146 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.202+0000 7fbfbcbf4640 1 --1- 172.21.15.62:0/3124777146 >> v1:172.21.15.1:6789/0 conn(0x55fef6d1b900 0x55fef6d1bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36710/0 (socket says 172.21.15.62:36710) 2024-04-26T07:54:38.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.202+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/3124777146 >> v1:172.21.15.1:6789/0 conn(0x55fef6d1b900 legacy=0x55fef6d1bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.202+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/3124777146 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef6d1c4c0 con 0x55fef6d1afa0 2024-04-26T07:54:38.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.204+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/3124777146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6d1b3c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0005fd0 tx=0x7fbfb001cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feae8ffef24c994 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.204+0000 7fbfb7fff640 1 -- 172.21.15.62:0/3124777146 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0052540 con 0x55fef6d1afa0 2024-04-26T07:54:38.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.204+0000 7fbfb7fff640 1 -- 172.21.15.62:0/3124777146 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb004e070 con 0x55fef6d1afa0 2024-04-26T07:54:38.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.204+0000 7fbfb7fff640 1 -- 172.21.15.62:0/3124777146 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0052890 con 0x55fef6d1afa0 2024-04-26T07:54:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.205+0000 7fbfc1733800 1 -- 172.21.15.62:0/3124777146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 msgr2=0x55fef6d1b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.205+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3124777146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6d1b3c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0005fd0 tx=0x7fbfb001cd80 comp rx=0 tx=0).stop 2024-04-26T07:54:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.205+0000 7fbfc1733800 1 -- 172.21.15.62:0/3124777146 shutdown_connections 2024-04-26T07:54:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.205+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3124777146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6d1b3c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.205+0000 7fbfc1733800 1 -- 172.21.15.62:0/3124777146 >> 172.21.15.62:0/3124777146 conn(0x55fef6d16b80 msgr2=0x55fef6d18fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.205+0000 7fbfc1733800 1 -- 172.21.15.62:0/3124777146 shutdown_connections 2024-04-26T07:54:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.205+0000 7fbfc1733800 1 -- 172.21.15.62:0/3124777146 wait complete. 2024-04-26T07:54:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.217+0000 7fbfc1733800 1 Processor -- start 2024-04-26T07:54:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.217+0000 7fbfc1733800 1 -- start start 2024-04-26T07:54:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.218+0000 7fbfc1733800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e10070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.218+0000 7fbfc1733800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fef6c67cd0 con 0x55fef6d1afa0 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.218+0000 7fbfbd3f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e10070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.218+0000 7fbfbd3f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e10070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33944/0 (socket says 172.21.15.62:33944) 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.218+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/1936534470 learned_addr learned my addr 172.21.15.62:0/1936534470 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.218+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/1936534470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef6e10640 con 0x55fef6d1afa0 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.218+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/1936534470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e10070 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbfb001ba70 tx=0x7fbfb004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f5cc432a965ee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbeab606640 1 -- 172.21.15.62:0/1936534470 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0052820 con 0x55fef6d1afa0 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbeab606640 1 -- 172.21.15.62:0/1936534470 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb0062070 con 0x55fef6d1afa0 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbeab606640 1 -- 172.21.15.62:0/1936534470 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0052b10 con 0x55fef6d1afa0 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbfc1733800 1 -- 172.21.15.62:0/1936534470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 msgr2=0x55fef6e10070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbfc1733800 1 --2- 172.21.15.62:0/1936534470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e10070 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbfb001ba70 tx=0x7fbfb004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbfc1733800 1 -- 172.21.15.62:0/1936534470 shutdown_connections 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbfc1733800 1 --2- 172.21.15.62:0/1936534470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e10070 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbfc1733800 1 -- 172.21.15.62:0/1936534470 >> 172.21.15.62:0/1936534470 conn(0x55fef6d16b80 msgr2=0x55fef6e0b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.219+0000 7fbfc1733800 1 -- 172.21.15.62:0/1936534470 shutdown_connections 2024-04-26T07:54:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.220+0000 7fbfc1733800 1 -- 172.21.15.62:0/1936534470 wait complete. 2024-04-26T07:54:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.220+0000 7fbfc1733800 1 Processor -- start 2024-04-26T07:54:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.220+0000 7fbfc1733800 1 -- start start 2024-04-26T07:54:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.220+0000 7fbfc1733800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e17b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.220+0000 7fbfc1733800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fef6d1c9f0 con 0x55fef6d1afa0 2024-04-26T07:54:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.220+0000 7fbfbd3f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e17b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.220+0000 7fbfbd3f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e17b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33960/0 (socket says 172.21.15.62:33960) 2024-04-26T07:54:38.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.220+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/3891365097 learned_addr learned my addr 172.21.15.62:0/3891365097 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.221+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/3891365097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef6e18040 con 0x55fef6d1afa0 2024-04-26T07:54:38.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.221+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e17b00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000a190 tx=0x7fbfb0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.221+0000 7fbea9e03640 1 -- 172.21.15.62:0/3891365097 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0071570 con 0x55fef6d1afa0 2024-04-26T07:54:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.221+0000 7fbea9e03640 1 -- 172.21.15.62:0/3891365097 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb0058040 con 0x55fef6d1afa0 2024-04-26T07:54:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.221+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef6e182d0 con 0x55fef6d1afa0 2024-04-26T07:54:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.221+0000 7fbea9e03640 1 -- 172.21.15.62:0/3891365097 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0071840 con 0x55fef6d1afa0 2024-04-26T07:54:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.221+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef6e1af30 con 0x55fef6d1afa0 2024-04-26T07:54:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.222+0000 7fbea9e03640 1 -- 172.21.15.62:0/3891365097 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbfb0050070 con 0x55fef6d1afa0 2024-04-26T07:54:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.222+0000 7fbea9e03640 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbea4036e60 0x7fbea4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.222+0000 7fbea9e03640 1 -- 172.21.15.62:0/3891365097 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbfb008ed20 con 0x55fef6d1afa0 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.222+0000 7fbfbcbf4640 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbea4036e60 0x7fbea4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.222+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6d1b900 0x55fef6e1ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.222+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e1f230 con 0x55fef6d1b900 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.223+0000 7fbfbdbf6640 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6d1b900 0x55fef6e1ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.223+0000 7fbfbcbf4640 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbea4036e60 0x7fbea4039320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8000f60 tx=0x7fbfa8001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.223+0000 7fbfbdbf6640 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6d1b900 0x55fef6e1ecf0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.223+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/3891365097 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfb80083e0 con 0x55fef6d1b900 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.223+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e1c280 con 0x55fef6d1b900 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.223+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/3891365097 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfb80083e0 con 0x55fef6d1b900 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.224+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e21570 0x55fef6e23960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.224+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e24030 con 0x55fef6e21570 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.224+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e21570 0x55fef6e23960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.224+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e21570 0x55fef6e23960 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.225+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/3891365097 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e21570 2024-04-26T07:54:38.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.225+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e20520 con 0x55fef6d1b900 2024-04-26T07:54:38.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.225+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/3891365097 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfb80083e0 con 0x55fef6d1b900 2024-04-26T07:54:38.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.225+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e209c0 con 0x55fef6d1b900 2024-04-26T07:54:38.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.225+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/3891365097 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbfb80083e0 con 0x55fef6d1b900 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfc1733800 1 Processor -- start 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfc1733800 1 -- start start 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfc1733800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e331d0 0x55fef6e335f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfc1733800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fef6c0f170 con 0x55fef6e331d0 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfbdbf6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e331d0 0x55fef6e335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfbdbf6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e331d0 0x55fef6e335f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33972/0 (socket says 172.21.15.62:33972) 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/3356757246 learned_addr learned my addr 172.21.15.62:0/3356757246 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/3356757246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef6e33b30 con 0x55fef6e331d0 2024-04-26T07:54:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.226+0000 7fbfbdbf6640 1 --2- 172.21.15.62:0/3356757246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e331d0 0x55fef6e335f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55fef6e18980 tx=0x7fbfb800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.227+0000 7fbea2ffd640 1 -- 172.21.15.62:0/3356757246 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb8007d00 con 0x55fef6e331d0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.227+0000 7fbea2ffd640 1 -- 172.21.15.62:0/3356757246 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb801e020 con 0x55fef6e331d0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.227+0000 7fbfc1733800 1 -- 172.21.15.62:0/3356757246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef6e345a0 con 0x55fef6e331d0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.227+0000 7fbea2ffd640 1 -- 172.21.15.62:0/3356757246 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb8019420 con 0x55fef6e331d0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.227+0000 7fbfc1733800 1 -- 172.21.15.62:0/3356757246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef6e34aa0 con 0x55fef6e331d0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.227+0000 7fbea2ffd640 1 -- 172.21.15.62:0/3356757246 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbfb8016040 con 0x55fef6e331d0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbea2ffd640 1 --2- 172.21.15.62:0/3356757246 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe94036eb0 0x7fbe94039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbea2ffd640 1 -- 172.21.15.62:0/3356757246 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbfb801f030 con 0x55fef6e331d0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/3356757246 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe94036eb0 0x7fbe94039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfc1733800 1 Processor -- start 2024-04-26T07:54:38.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfc1733800 1 -- start start 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/3356757246 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe94036eb0 0x7fbe94039370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55fef6e1f6a0 tx=0x7fbfb008d1f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfc1733800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e40980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfc1733800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fef6e10900 con 0x55fef6e40560 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfbdbf6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e40980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfbdbf6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e40980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33980/0 (socket says 172.21.15.62:33980) 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2276896562 learned_addr learned my addr 172.21.15.62:0/2276896562 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.228+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2276896562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef6e40f50 con 0x55fef6e40560 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbfbdbf6640 1 --2- 172.21.15.62:0/2276896562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e40980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8017020 tx=0x7fbfb804d030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2ed1a5aed2f9c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbea0ff9640 1 -- 172.21.15.62:0/2276896562 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb801d070 con 0x55fef6e40560 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbea0ff9640 1 -- 172.21.15.62:0/2276896562 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb804a030 con 0x55fef6e40560 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbea0ff9640 1 -- 172.21.15.62:0/2276896562 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb8014be0 con 0x55fef6e40560 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbfc1733800 1 -- 172.21.15.62:0/2276896562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 msgr2=0x55fef6e40980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2276896562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e40980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8017020 tx=0x7fbfb804d030 comp rx=0 tx=0).stop 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbfc1733800 1 -- 172.21.15.62:0/2276896562 shutdown_connections 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2276896562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e40980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbfc1733800 1 -- 172.21.15.62:0/2276896562 >> 172.21.15.62:0/2276896562 conn(0x55fef6e3c870 msgr2=0x55fef6e3a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbfc1733800 1 -- 172.21.15.62:0/2276896562 shutdown_connections 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.229+0000 7fbfc1733800 1 -- 172.21.15.62:0/2276896562 wait complete. 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfc1733800 1 Processor -- start 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfc1733800 1 -- start start 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfc1733800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e47ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfc1733800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fef6e416a0 con 0x55fef6e40560 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfbdbf6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e47ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfbdbf6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e47ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:33992/0 (socket says 172.21.15.62:33992) 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 learned_addr learned my addr 172.21.15.62:0/2148973186 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef6e48020 con 0x55fef6e40560 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.230+0000 7fbfbdbf6640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e47ae0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8018010 tx=0x7fbfb804cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.231+0000 7fbe92ffd640 1 -- 172.21.15.62:0/2148973186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb80173b0 con 0x55fef6e40560 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.231+0000 7fbe92ffd640 1 -- 172.21.15.62:0/2148973186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb8017550 con 0x55fef6e40560 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.231+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef6e482b0 con 0x55fef6e40560 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.231+0000 7fbe92ffd640 1 -- 172.21.15.62:0/2148973186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb8017830 con 0x55fef6e40560 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.231+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef6e4af60 con 0x55fef6e40560 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.231+0000 7fbe92ffd640 1 -- 172.21.15.62:0/2148973186 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbfb804eb80 con 0x55fef6e40560 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.231+0000 7fbe92ffd640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe88036e60 0x7fbe88039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.232+0000 7fbe92ffd640 1 -- 172.21.15.62:0/2148973186 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbfb8039c40 con 0x55fef6e40560 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.232+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe88036e60 0x7fbe88039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.232+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.232+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6e53540 0x55fef6e55a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.232+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e56150 con 0x55fef6e53540 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.232+0000 7fbfbcbf4640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6e53540 0x55fef6e55a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.232+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe88036e60 0x7fbe88039320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0052000 tx=0x7fbfb008b000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.232+0000 7fbfbcbf4640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6e53540 0x55fef6e55a00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfa800f610 con 0x55fef6e53540 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 realm 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e52990 con 0x55fef6e53540 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfa800f610 con 0x55fef6e53540 2024-04-26T07:54:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e56c30 con 0x55fef6e53540 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfa800f610 con 0x55fef6e53540 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e57500 con 0x55fef6e53540 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfa800f610 con 0x55fef6e53540 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e57db0 0x55fef6e5a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5a920 con 0x55fef6e57db0 2024-04-26T07:54:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.233+0000 7fbfbdbf6640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e57db0 0x55fef6e5a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.234+0000 7fbfbdbf6640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e57db0 0x55fef6e5a1c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.234+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.234+0000 7fbfc1733800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.234+0000 7fbfc1733800 20 searching for the correct realm 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.234+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fef6e5ca20 0x55fef6e5eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.234+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.234+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fef6e5ca20 0x55fef6e5eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.234+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fef6e5ca20 0x55fef6e5eee0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.235+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.235+0000 7fbfbd3f5640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbfb0052030 0x7fbfb00657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.235+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x7fbfb0052030 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.235+0000 7fbfbcbf4640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbfb0052030 0x7fbfb00657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.235+0000 7fbfbcbf4640 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbfb0052030 0x7fbfb00657d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.236+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa800f610 con 0x7fbfb0052030 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.236+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.236+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.236+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e53540 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.236+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa800f610 con 0x55fef6e53540 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.236+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e53540 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.237+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.237+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.237+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.237+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.237+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.237+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x7fbfb0052030 2024-04-26T07:54:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.237+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.237+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.238+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.238+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e53540 2024-04-26T07:54:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.238+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.238+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.238+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.238+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e53540 2024-04-26T07:54:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.238+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.238+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x7fbfb0052030 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.239+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.239+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.239+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.239+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.239+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.239+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e53540 2024-04-26T07:54:38.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e53540 2024-04-26T07:54:38.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.240+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.241+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.241+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.241+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.241+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x7fbfb0052030 2024-04-26T07:54:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.241+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.241+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e53540 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.241+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.241+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.242+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.242+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.242+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.242+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.243+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.243+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x7fbfb0052030 2024-04-26T07:54:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.243+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.243+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e5ca20 2024-04-26T07:54:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.243+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.243+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e57db0 2024-04-26T07:54:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.243+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.243+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x55fef6e53540 2024-04-26T07:54:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5f5b0 con 0x7fbfb0052030 2024-04-26T07:54:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5b420 con 0x55fef6e53540 2024-04-26T07:54:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5b870 con 0x55fef6e53540 2024-04-26T07:54:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.244+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5bd50 con 0x55fef6e53540 2024-04-26T07:54:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 20 zone default found 2024-04-26T07:54:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 4 Realm: () 2024-04-26T07:54:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 20 zonegroup default 2024-04-26T07:54:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e5fa30 con 0x55fef6e57db0 2024-04-26T07:54:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e61c60 con 0x55fef6e5ca20 2024-04-26T07:54:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.245+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e62000 con 0x55fef6e5ca20 2024-04-26T07:54:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.246+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.246+0000 7fbfc1733800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.246+0000 7fbfc1733800 20 started sync module instance, tier type = 2024-04-26T07:54:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.246+0000 7fbfc1733800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.246+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e610a0 con 0x7fbfb0052030 2024-04-26T07:54:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.247+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.247+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94553552327824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e610a0 con 0x7fbfb0052030 2024-04-26T07:54:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.247+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e628b0 con 0x55fef6e53540 2024-04-26T07:54:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.248+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94553552327824] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.248+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.248+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94553552331680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e610a0 con 0x55fef6e53540 2024-04-26T07:54:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.248+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e63300 con 0x55fef6e5ca20 2024-04-26T07:54:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.249+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.249+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94553552334352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e63b50 con 0x55fef6e5ca20 2024-04-26T07:54:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.249+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e64630 con 0x7fbfb0052030 2024-04-26T07:54:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.249+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94553552331680] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.250+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94553552334352] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.250+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.250+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94553552336544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e60bf0 con 0x7fbfb0052030 2024-04-26T07:54:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.250+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e64ed0 con 0x55fef6e53540 2024-04-26T07:54:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.251+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.251+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94553552341456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e652e0 con 0x55fef6e53540 2024-04-26T07:54:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.251+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e65db0 con 0x55fef6e57db0 2024-04-26T07:54:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.252+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94553552336544] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.252+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94553552341456] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.253+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.253+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94553552345248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e64df0 con 0x55fef6e57db0 2024-04-26T07:54:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.253+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e66390 con 0x55fef6e57db0 2024-04-26T07:54:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.254+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94553552345248] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.254+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.254+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94553552339168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e66390 con 0x55fef6e57db0 2024-04-26T07:54:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.254+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e66d50 con 0x55fef6e57db0 2024-04-26T07:54:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94553552339168] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94553552346848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e66f30 con 0x55fef6e57db0 2024-04-26T07:54:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfc1733800 20 add_watcher() i=0 2024-04-26T07:54:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfc1733800 20 add_watcher() i=1 2024-04-26T07:54:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfc1733800 20 add_watcher() i=2 2024-04-26T07:54:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfc1733800 20 add_watcher() i=3 2024-04-26T07:54:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfc1733800 20 add_watcher() i=4 2024-04-26T07:54:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfc1733800 20 add_watcher() i=5 2024-04-26T07:54:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.255+0000 7fbfc1733800 20 add_watcher() i=6 2024-04-26T07:54:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.256+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94553552346848] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.256+0000 7fbfc1733800 20 add_watcher() i=7 2024-04-26T07:54:38.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.256+0000 7fbfc1733800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:38.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.256+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e6a120 con 0x55fef6e53540 2024-04-26T07:54:38.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.256+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.256+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94553552349920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e673b0 con 0x55fef6e53540 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.257+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94553552349920] v27'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.257+0000 7fbe737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.257+0000 7fbfc1733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.257+0000 7fbfc1733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.257+0000 7fbfc1733800 5 note: GC not initialized 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.258+0000 7fbe727e4640 20 reqs_thread_entry: start 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.258+0000 7fbfc1733800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.258+0000 7fbfc1733800 20 Filter name: none 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.258+0000 7fbde3fff640 20 reqs_thread_entry: start 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.258+0000 7fbfc1733800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.258+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e9d3c0 con 0x7fbfb0052030 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.258+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.258+0000 7fbfc1733800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.259+0000 7fbe737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.259+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94553552349920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e9b1a0 con 0x55fef6e53540 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.260+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94553552349920] v27'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.260+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94553552327824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e9b1a0 con 0x7fbfb0052030 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.263+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94553552327824] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.263+0000 7fbfc1733800 20 remove_watcher() i=0 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.263+0000 7fbfc1733800 2 removed watcher, disabling cache 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.263+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94553552331680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e61490 con 0x55fef6e53540 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.264+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94553552331680] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.264+0000 7fbfc1733800 20 remove_watcher() i=1 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.264+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94553552334352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e9b1a0 con 0x55fef6e5ca20 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.265+0000 7fbfbd3f5640 1 -- 172.21.15.62:0/2148973186 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94553552334352] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb0077020 con 0x55fef6e5ca20 2024-04-26T07:54:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.265+0000 7fbfc1733800 20 remove_watcher() i=2 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.265+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94553552336544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e66ae0 con 0x7fbfb0052030 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.266+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94553552336544] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x7fbfb0052030 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.266+0000 7fbfc1733800 20 remove_watcher() i=3 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.266+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94553552341456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e66ae0 con 0x55fef6e53540 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.267+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94553552341456] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfa802b040 con 0x55fef6e53540 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.267+0000 7fbfc1733800 20 remove_watcher() i=4 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.267+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94553552345248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e649d0 con 0x55fef6e57db0 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.268+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94553552345248] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.268+0000 7fbfc1733800 20 remove_watcher() i=5 2024-04-26T07:54:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.268+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94553552339168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e66ae0 con 0x55fef6e57db0 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.269+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94553552339168] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.269+0000 7fbfc1733800 20 remove_watcher() i=6 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.269+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94553552346848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fef6e658a0 con 0x55fef6e57db0 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.270+0000 7fbfbdbf6640 1 -- 172.21.15.62:0/2148973186 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94553552346848] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb8035020 con 0x55fef6e57db0 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.270+0000 7fbfc1733800 20 remove_watcher() i=7 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e57db0 msgr2=0x55fef6e5a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e57db0 0x55fef6e5a1c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6e53540 msgr2=0x55fef6e55a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6e53540 0x55fef6e55a00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbfb0052030 msgr2=0x7fbfb00657d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbfb0052030 0x7fbfb00657d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fef6e5ca20 msgr2=0x55fef6e5eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fef6e5ca20 0x55fef6e5eee0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe88036e60 msgr2=0x7fbe88039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe88036e60 0x7fbe88039320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0052000 tx=0x7fbfb008b000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 msgr2=0x55fef6e47ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfbcbf4640 1 -- 172.21.15.62:0/2148973186 reap_dead start 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e47ae0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8018010 tx=0x7fbfb804cdc0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 shutdown_connections 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/2148973186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e40560 0x55fef6e47ae0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 >> 172.21.15.62:0/2148973186 conn(0x55fef6e3c870 msgr2=0x55fef6e39ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 shutdown_connections 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/2148973186 wait complete. 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/3356757246 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe94036eb0 msgr2=0x7fbe94039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3356757246 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe94036eb0 0x7fbe94039370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55fef6e1f6a0 tx=0x7fbfb008d1f0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/3356757246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e331d0 msgr2=0x55fef6e335f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3356757246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e331d0 0x55fef6e335f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55fef6e18980 tx=0x7fbfb800aea0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/3356757246 shutdown_connections 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3356757246 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe94036eb0 0x7fbe94039370 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3356757246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6e331d0 0x55fef6e335f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/3356757246 >> 172.21.15.62:0/3356757246 conn(0x55fef6e27270 msgr2=0x55fef6e27670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/3356757246 shutdown_connections 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.271+0000 7fbfc1733800 1 -- 172.21.15.62:0/3356757246 wait complete. 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e21570 msgr2=0x55fef6e23960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e21570 0x55fef6e23960 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6d1b900 msgr2=0x55fef6e1ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6d1b900 0x55fef6e1ecf0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbea4036e60 msgr2=0x7fbea4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbea4036e60 0x7fbea4039320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8000f60 tx=0x7fbfa8001370 comp rx=0 tx=0).stop 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 msgr2=0x55fef6e17b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e17b00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000a190 tx=0x7fbfb0003330 comp rx=0 tx=0).stop 2024-04-26T07:54:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 shutdown_connections 2024-04-26T07:54:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fef6d1b900 0x55fef6e1ecf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55fef6e21570 0x55fef6e23960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbea4036e60 0x7fbea4039320 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 --2- 172.21.15.62:0/3891365097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fef6d1afa0 0x55fef6e17b00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 >> 172.21.15.62:0/3891365097 conn(0x55fef6d16b80 msgr2=0x55fef6e0a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 shutdown_connections 2024-04-26T07:54:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.272+0000 7fbfc1733800 1 -- 172.21.15.62:0/3891365097 wait complete. 2024-04-26T07:54:38.318 INFO:teuthology.orchestra.run.smithi062.stdout:{"key":"bucket:myfoo","ver":{"tag":"_F3z_Dpy7YIoPQIlG0t_vX_4","ver":2},"mtime":"2024-04-26T07:54:37.943035Z","data":{"bucket":{"name":"myfoo","marker":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","bucket_id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-04-26T07:54:36.674214Z","linked":false,"has_bucket_info":false}} 2024-04-26T07:54:38.318 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_F3z_Dpy7YIoPQIlG0t_vX_4', 'ver': 2}, 'mtime': '2024-04-26T07:54:37.943035Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'bucket_id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-04-26T07:54:36.674214Z', 'linked': False, 'has_bucket_info': False}} 2024-04-26T07:54:38.318 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1'] 2024-04-26T07:54:38.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1'] 2024-04-26T07:54:38.319 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:38.411 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.409+0000 7f8f4d61f800 1 Processor -- start 2024-04-26T07:54:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.409+0000 7f8f4d61f800 1 -- start start 2024-04-26T07:54:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.409+0000 7f8f4d61f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x561f9c653760 0x561f9c653b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.409+0000 7f8f4d61f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f9c654200 con 0x561f9c6548d0 2024-04-26T07:54:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.409+0000 7f8f4d61f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x561f9c4f5e20 con 0x561f9c653760 2024-04-26T07:54:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.409+0000 7f8f4b125640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x561f9c653760 0x561f9c653b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.409+0000 7f8f4a924640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x561f9c6548d0 0x561f9c654d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36714/0 (socket says 172.21.15.62:36714) 2024-04-26T07:54:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.409+0000 7f8f4a924640 1 -- 172.21.15.62:0/3557750226 learned_addr learned my addr 172.21.15.62:0/3557750226 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.410+0000 7f8f4a123640 1 -- 172.21.15.62:0/3557750226 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122392742 0 0) 0x561f9c654200 con 0x561f9c6548d0 2024-04-26T07:54:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.410+0000 7f8f4a123640 1 -- 172.21.15.62:0/3557750226 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f34001e10 con 0x561f9c6548d0 2024-04-26T07:54:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.410+0000 7f8f4b125640 1 -- 172.21.15.62:0/3557750226 >> v1:172.21.15.1:6789/0 conn(0x561f9c6548d0 legacy=0x561f9c654d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.410+0000 7f8f4b125640 1 -- 172.21.15.62:0/3557750226 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9c655490 con 0x561f9c653760 2024-04-26T07:54:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4b125640 1 --2- 172.21.15.62:0/3557750226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c653b80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c005fd0 tx=0x7f8f3c01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9365949d966bf0c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4a123640 1 -- 172.21.15.62:0/3557750226 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c04adc0 con 0x561f9c653760 2024-04-26T07:54:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4a123640 1 -- 172.21.15.62:0/3557750226 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3c052430 con 0x561f9c653760 2024-04-26T07:54:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4a123640 1 -- 172.21.15.62:0/3557750226 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c052790 con 0x561f9c653760 2024-04-26T07:54:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3557750226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 msgr2=0x561f9c653b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3557750226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c653b80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c005fd0 tx=0x7f8f3c01cbe0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3557750226 shutdown_connections 2024-04-26T07:54:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3557750226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c653b80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3557750226 >> 172.21.15.62:0/3557750226 conn(0x561f9c64ed40 msgr2=0x561f9c651160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3557750226 shutdown_connections 2024-04-26T07:54:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.412+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3557750226 wait complete. 2024-04-26T07:54:38.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.425+0000 7f8f4d61f800 1 Processor -- start 2024-04-26T07:54:38.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.425+0000 7f8f4d61f800 1 -- start start 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.425+0000 7f8f4d61f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c744be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.425+0000 7f8f4d61f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561f9c59ecf0 con 0x561f9c653760 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.426+0000 7f8f4b125640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c744be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.426+0000 7f8f4b125640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c744be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34012/0 (socket says 172.21.15.62:34012) 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.426+0000 7f8f4b125640 1 -- 172.21.15.62:0/3016432604 learned_addr learned my addr 172.21.15.62:0/3016432604 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.426+0000 7f8f4b125640 1 -- 172.21.15.62:0/3016432604 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9c7451b0 con 0x561f9c653760 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.426+0000 7f8f4b125640 1 --2- 172.21.15.62:0/3016432604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c744be0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c007000 tx=0x7f8f3c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff181fd09544fd37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.426+0000 7f8e3960a640 1 -- 172.21.15.62:0/3016432604 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c063070 con 0x561f9c653760 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.426+0000 7f8e3960a640 1 -- 172.21.15.62:0/3016432604 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3c052980 con 0x561f9c653760 2024-04-26T07:54:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.426+0000 7f8e3960a640 1 -- 172.21.15.62:0/3016432604 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c052c60 con 0x561f9c653760 2024-04-26T07:54:38.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3016432604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 msgr2=0x561f9c744be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3016432604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c744be0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c007000 tx=0x7f8f3c04c000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3016432604 shutdown_connections 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3016432604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c744be0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3016432604 >> 172.21.15.62:0/3016432604 conn(0x561f9c64ed40 msgr2=0x561f9c740500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3016432604 shutdown_connections 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3016432604 wait complete. 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 Processor -- start 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 -- start start 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c74c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.427+0000 7f8f4d61f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561f9c65cda0 con 0x561f9c653760 2024-04-26T07:54:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8f4b125640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c74c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8f4b125640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c74c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34014/0 (socket says 172.21.15.62:34014) 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8f4b125640 1 -- 172.21.15.62:0/1197778783 learned_addr learned my addr 172.21.15.62:0/1197778783 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8f4b125640 1 -- 172.21.15.62:0/1197778783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9c74cbb0 con 0x561f9c653760 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8f4b125640 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c74c670 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c061040 tx=0x7f8f3c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8e37e07640 1 -- 172.21.15.62:0/1197778783 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c06b070 con 0x561f9c653760 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8e37e07640 1 -- 172.21.15.62:0/1197778783 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3c05e8f0 con 0x561f9c653760 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f9c74ce40 con 0x561f9c653760 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.428+0000 7f8e37e07640 1 -- 172.21.15.62:0/1197778783 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c063040 con 0x561f9c653760 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.429+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9c74faf0 con 0x561f9c653760 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.429+0000 7f8e37e07640 1 -- 172.21.15.62:0/1197778783 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f3c070450 con 0x561f9c653760 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.429+0000 7f8e37e07640 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e30036e60 0x7f8e30039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.429+0000 7f8e37e07640 1 -- 172.21.15.62:0/1197778783 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f8f3c08e520 con 0x561f9c653760 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.430+0000 7f8f4a924640 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e30036e60 0x7f8e30039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.430+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c6548d0 0x561f9c7538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.430+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c753df0 con 0x561f9c6548d0 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.430+0000 7f8f4b926640 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c6548d0 0x561f9c7538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.430+0000 7f8f4a924640 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e30036e60 0x7f8e30039320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f40000f60 tx=0x7f8f400010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.430+0000 7f8f4b926640 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c6548d0 0x561f9c7538b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.430+0000 7f8f4b926640 1 -- 172.21.15.62:0/1197778783 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c6548d0 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.430+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c750e40 con 0x561f9c6548d0 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.431+0000 7f8f4b926640 1 -- 172.21.15.62:0/1197778783 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c6548d0 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.431+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c756130 0x561f9c758520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.431+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c758bf0 con 0x561f9c756130 2024-04-26T07:54:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.431+0000 7f8f4b125640 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c756130 0x561f9c758520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.431+0000 7f8f4b125640 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c756130 0x561f9c758520 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.432+0000 7f8f4b125640 1 -- 172.21.15.62:0/1197778783 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c756130 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.432+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7550e0 con 0x561f9c6548d0 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.432+0000 7f8f4b926640 1 -- 172.21.15.62:0/1197778783 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c6548d0 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.432+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c755580 con 0x561f9c6548d0 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.432+0000 7f8f4b926640 1 -- 172.21.15.62:0/1197778783 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c6548d0 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.433+0000 7f8f4d61f800 1 Processor -- start 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.433+0000 7f8f4d61f800 1 -- start start 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.433+0000 7f8f4d61f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c767d90 0x561f9c7681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.433+0000 7f8f4d61f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561f9c546170 con 0x561f9c767d90 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.433+0000 7f8f4b926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c767d90 0x561f9c7681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.433+0000 7f8f4b926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c767d90 0x561f9c7681b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34028/0 (socket says 172.21.15.62:34028) 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.433+0000 7f8f4b926640 1 -- 172.21.15.62:0/3265140350 learned_addr learned my addr 172.21.15.62:0/3265140350 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.433+0000 7f8f4b926640 1 -- 172.21.15.62:0/3265140350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9c7686f0 con 0x561f9c767d90 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.434+0000 7f8f4b926640 1 --2- 172.21.15.62:0/3265140350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c767d90 0x561f9c7681b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x561f9c74d540 tx=0x7f8f4400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.434+0000 7f8e35602640 1 -- 172.21.15.62:0/3265140350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f44007d00 con 0x561f9c767d90 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.434+0000 7f8e35602640 1 -- 172.21.15.62:0/3265140350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4401e020 con 0x561f9c767d90 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.434+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3265140350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f9c769160 con 0x561f9c767d90 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.434+0000 7f8e35602640 1 -- 172.21.15.62:0/3265140350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f44019420 con 0x561f9c767d90 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.434+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3265140350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9c769660 con 0x561f9c767d90 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8e35602640 1 -- 172.21.15.62:0/3265140350 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f44016040 con 0x561f9c767d90 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8e35602640 1 --2- 172.21.15.62:0/3265140350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e24036eb0 0x7f8e24039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8e35602640 1 -- 172.21.15.62:0/3265140350 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f8f4401f030 con 0x561f9c767d90 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8f4b125640 1 --2- 172.21.15.62:0/3265140350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e24036eb0 0x7f8e24039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8f4d61f800 1 Processor -- start 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8f4b125640 1 --2- 172.21.15.62:0/3265140350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e24036eb0 0x7f8e24039370 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x561f9c754260 tx=0x7f8f3c06f770 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8f4d61f800 1 -- start start 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8f4d61f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c5c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.435+0000 7f8f4d61f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561f9c7454d0 con 0x561f9c5c8ce0 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4b926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c5c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4b926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c5c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34034/0 (socket says 172.21.15.62:34034) 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4b926640 1 -- 172.21.15.62:0/3522134383 learned_addr learned my addr 172.21.15.62:0/3522134383 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4b926640 1 -- 172.21.15.62:0/3522134383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9c5c7500 con 0x561f9c5c8ce0 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4b926640 1 --2- 172.21.15.62:0/3522134383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c5c9100 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8f4404ce50 tx=0x7f8f44017470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1183b9bc781f799b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8e2effd640 1 -- 172.21.15.62:0/3522134383 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f4401d070 con 0x561f9c5c8ce0 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8e2effd640 1 -- 172.21.15.62:0/3522134383 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4403f070 con 0x561f9c5c8ce0 2024-04-26T07:54:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8e2effd640 1 -- 172.21.15.62:0/3522134383 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f44017810 con 0x561f9c5c8ce0 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3522134383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 msgr2=0x561f9c5c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3522134383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c5c9100 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8f4404ce50 tx=0x7f8f44017470 comp rx=0 tx=0).stop 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3522134383 shutdown_connections 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3522134383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c5c9100 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.436+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3522134383 >> 172.21.15.62:0/3522134383 conn(0x561f9c771450 msgr2=0x561f9c76f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3522134383 shutdown_connections 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3522134383 wait complete. 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4d61f800 1 Processor -- start 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4d61f800 1 -- start start 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4d61f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c77e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4d61f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561f9c5c79d0 con 0x561f9c5c8ce0 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4b926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c77e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4b926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c77e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34040/0 (socket says 172.21.15.62:34040) 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 learned_addr learned my addr 172.21.15.62:0/2081472195 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.437+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9c77edc0 con 0x561f9c5c8ce0 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.438+0000 7f8f4b926640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c77e880 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8f44017fa0 tx=0x7f8f4404cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.438+0000 7f8e2d7fa640 1 -- 172.21.15.62:0/2081472195 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f4401d030 con 0x561f9c5c8ce0 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.438+0000 7f8e2d7fa640 1 -- 172.21.15.62:0/2081472195 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4404a070 con 0x561f9c5c8ce0 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.438+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f9c77f050 con 0x561f9c5c8ce0 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.438+0000 7f8e2d7fa640 1 -- 172.21.15.62:0/2081472195 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f44015840 con 0x561f9c5c8ce0 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.438+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9c781d00 con 0x561f9c5c8ce0 2024-04-26T07:54:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.438+0000 7f8e2d7fa640 1 -- 172.21.15.62:0/2081472195 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f4404eb60 con 0x561f9c5c8ce0 2024-04-26T07:54:38.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.439+0000 7f8e2d7fa640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e14036eb0 0x7f8e14039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.439+0000 7f8e2d7fa640 1 -- 172.21.15.62:0/2081472195 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f8f44038c70 con 0x561f9c5c8ce0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.439+0000 7f8f4b125640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e14036eb0 0x7f8e14039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.439+0000 7f8f4b125640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e14036eb0 0x7f8e14039370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c06f8e0 tx=0x7f8f3c07d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.439+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.439+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c78a3e0 0x561f9c78c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.439+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c78cff0 con 0x561f9c78a3e0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.439+0000 7f8f4a924640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c78a3e0 0x561f9c78c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4a924640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c78a3e0 0x561f9c78c8a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f40009050 con 0x561f9c78a3e0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 20 realm 2024-04-26T07:54:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c789830 con 0x561f9c78a3e0 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f40009050 con 0x561f9c78a3e0 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c78dae0 con 0x561f9c78a3e0 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f40009050 con 0x561f9c78a3e0 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.440+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c78e3b0 con 0x561f9c78a3e0 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.441+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f40009050 con 0x561f9c78a3e0 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.441+0000 7f8f4d61f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.441+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.441+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c78edd0 0x561f9c7911c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.441+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7918b0 con 0x561f9c78edd0 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.441+0000 7f8f4b926640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c78edd0 0x561f9c7911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.441+0000 7f8f4b926640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c78edd0 0x561f9c7911c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.442+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.442+0000 7f8f4d61f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.442+0000 7f8f4d61f800 20 searching for the correct realm 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.442+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561f9c793880 0x561f9c795d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.442+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c793880 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.442+0000 7f8f4b125640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561f9c793880 0x561f9c795d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.442+0000 7f8f4b125640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561f9c793880 0x561f9c795d40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.443+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.443+0000 7f8f4b125640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f3c070070 0x7f8f3c08f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.443+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x7f8f3c070070 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.443+0000 7f8f4a924640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f3c070070 0x7f8f3c08f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.443+0000 7f8f4a924640 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f3c070070 0x7f8f3c08f850 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.443+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40009050 con 0x7f8f3c070070 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.443+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c78edd0 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.444+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.444+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c78a3e0 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.444+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40009050 con 0x561f9c78a3e0 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.444+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c78a3e0 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.444+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.444+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c78edd0 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.444+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.444+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c78edd0 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.445+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.445+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x7f8f3c070070 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.445+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40029040 con 0x7f8f3c070070 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.445+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c793880 2024-04-26T07:54:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.445+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.445+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c78a3e0 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.445+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.446+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c78edd0 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.446+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.446+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c78a3e0 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.446+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.446+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x7f8f3c070070 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.446+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f40029040 con 0x7f8f3c070070 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.446+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796410 con 0x561f9c793880 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.447+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.447+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c793880 2024-04-26T07:54:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.447+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.447+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78edd0 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.447+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.447+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c793880 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.447+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.447+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c793880 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.448+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.448+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78a3e0 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.448+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.448+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78a3e0 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.448+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.448+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78edd0 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.449+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.449+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c793880 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.449+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.449+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x7f8f3c070070 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.449+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40029040 con 0x7f8f3c070070 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.449+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78a3e0 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.449+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.449+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78edd0 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.450+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.450+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c793880 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.450+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.450+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78edd0 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.450+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.450+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x7f8f3c070070 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.450+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40029040 con 0x7f8f3c070070 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.450+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c793880 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.451+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.451+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78edd0 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.451+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.451+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x561f9c78a3e0 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f8f3c09c040 con 0x7f8f3c070070 2024-04-26T07:54:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f40029040 con 0x7f8f3c070070 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c792270 con 0x561f9c78a3e0 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c792b10 con 0x561f9c78a3e0 2024-04-26T07:54:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.452+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c791eb0 con 0x561f9c78a3e0 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f40029040 con 0x561f9c78a3e0 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 zone default found 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 4 Realm: () 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 zonegroup default 2024-04-26T07:54:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c796940 con 0x561f9c78edd0 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c798c10 con 0x561f9c793880 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c798fb0 con 0x561f9c793880 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.453+0000 7f8f4d61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.454+0000 7f8f4d61f800 20 started sync module instance, tier type = 2024-04-26T07:54:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.454+0000 7f8f4d61f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.454+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7980a0 con 0x7f8f3c070070 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.455+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.455+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94693769184720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7980a0 con 0x7f8f3c070070 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.455+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7999c0 con 0x561f9c78a3e0 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.456+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.456+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94693769188624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c799de0 con 0x561f9c78a3e0 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.456+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79a8b0 con 0x561f9c793880 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.456+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94693769184720] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.457+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.457+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94693769192352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79acd0 con 0x561f9c793880 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.457+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94693769188624] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.457+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c799930 con 0x7f8f3c070070 2024-04-26T07:54:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.458+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94693769192352] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.458+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.458+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94693769182192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79b690 con 0x7f8f3c070070 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.458+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79c050 con 0x561f9c78a3e0 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.459+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94693769182192] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.459+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.459+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94693769196480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79c050 con 0x561f9c78a3e0 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.459+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79ca10 con 0x561f9c78edd0 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.460+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94693769196480] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.460+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.460+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94693769201504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79c050 con 0x561f9c78edd0 2024-04-26T07:54:38.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.460+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79d460 con 0x561f9c78edd0 2024-04-26T07:54:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.461+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94693769201504] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.461+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.461+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94693769203568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79d640 con 0x561f9c78edd0 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.462+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79de90 con 0x561f9c78edd0 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.462+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94693769203568] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.462+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94693769205312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79e280 con 0x561f9c78edd0 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4d61f800 20 add_watcher() i=0 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4d61f800 20 add_watcher() i=1 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4d61f800 20 add_watcher() i=2 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4d61f800 20 add_watcher() i=3 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4d61f800 20 add_watcher() i=4 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4d61f800 20 add_watcher() i=5 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4d61f800 20 add_watcher() i=6 2024-04-26T07:54:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.463+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94693769205312] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.464+0000 7f8f4d61f800 20 add_watcher() i=7 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.464+0000 7f8f4d61f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.464+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7a12b0 con 0x561f9c78a3e0 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.464+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.464+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94693769206832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79e730 con 0x561f9c78a3e0 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.465+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94693769206832] v27'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.465+0000 7f8e01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.465+0000 7f8f4d61f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.465+0000 7f8f4d61f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.465+0000 7f8f4d61f800 5 note: GC not initialized 2024-04-26T07:54:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.465+0000 7f8e00fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.465+0000 7f8f4d61f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 20 Filter name: none 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8d7a7fc640 20 reqs_thread_entry: start 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7d4ae0 con 0x561f9c78edd0 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:54:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.466+0000 7f8f4d61f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7d6bc0 con 0x7f8f3c070070 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7d8610 con 0x561f9c78a3e0 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(64 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.467+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7dcbe0 con 0x7f8f3c070070 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.468+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(65 foo.buckets [call] v27'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.468+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7e2ae0 con 0x561f9c78a3e0 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(66 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8f4d61f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8f4d61f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8f4d61f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8f4d61f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1, ofs0, ns] 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94693769445088 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7dd010 con 0x561f9c78edd0 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== watch-notify(notify (1) cookie 94693769201504 notify 115964116996 ret 0) ==== 794+0+0 (crc 0 0 0) 0x561f9c77f050 con 0x561f9c78edd0 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8e2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94693769201504 notifier 4494 bl.length()=752 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8e2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8e2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8e2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(67 notify.5 [notify cookie 94693769445088 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.470+0000 7f8e2effd640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8e10003ea0 con 0x561f9c78edd0 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.471+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.471+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== watch-notify(notify_complete (2) cookie 94693769445088 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561f9c77edc0 con 0x561f9c78edd0 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.471+0000 7f8f4d61f800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_sources= new_sources= 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.471+0000 7f8f4d61f800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential sources added=[] removed=[] 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.471+0000 7f8f4d61f800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_dests= new_dests= 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.471+0000 7f8f4d61f800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential dests added=[] removed=[] 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.471+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7d7ee0 con 0x561f9c78edd0 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.472+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(69 fud.buckets [call] v27'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.472+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7e2310 con 0x7f8f3c070070 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8f4d61f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8f4d61f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8f4d61f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T07:54:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94693769445088 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7e17b0 con 0x561f9c78edd0 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== watch-notify(notify (1) cookie 94693769203568 notify 115964116997 ret 0) ==== 356+0+0 (crc 0 0 0) 0x561f9c5c7500 con 0x561f9c78edd0 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8e2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94693769203568 notifier 4494 bl.length()=314 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8e2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8e2effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.473+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(71 notify.6 [notify cookie 94693769445088 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.474+0000 7f8e2effd640 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8e10003ea0 con 0x561f9c78edd0 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.474+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.474+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== watch-notify(notify_complete (2) cookie 94693769445088 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561f9c769660 con 0x561f9c78edd0 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.475+0000 7f8e01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.475+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94693769206832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c785c00 con 0x561f9c78a3e0 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.476+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94693769206832] v27'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.476+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94693769184720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79dc00 con 0x7f8f3c070070 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.478+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94693769184720] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.478+0000 7f8f4d61f800 20 remove_watcher() i=0 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.478+0000 7f8f4d61f800 2 removed watcher, disabling cache 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.478+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94693769188624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7985d0 con 0x561f9c78a3e0 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.480+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94693769188624] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.480+0000 7f8f4d61f800 20 remove_watcher() i=1 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.480+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94693769192352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7985d0 con 0x561f9c793880 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.481+0000 7f8f4b125640 1 -- 172.21.15.62:0/2081472195 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94693769192352] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3c06d070 con 0x561f9c793880 2024-04-26T07:54:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.481+0000 7f8f4d61f800 20 remove_watcher() i=2 2024-04-26T07:54:38.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.481+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94693769182192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79a3a0 con 0x7f8f3c070070 2024-04-26T07:54:38.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.482+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94693769182192] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x7f8f3c070070 2024-04-26T07:54:38.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.482+0000 7f8f4d61f800 20 remove_watcher() i=3 2024-04-26T07:54:38.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.482+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94693769196480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7985d0 con 0x561f9c78a3e0 2024-04-26T07:54:38.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.483+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94693769196480] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f40039040 con 0x561f9c78a3e0 2024-04-26T07:54:38.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.483+0000 7f8f4d61f800 20 remove_watcher() i=4 2024-04-26T07:54:38.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.483+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94693769201504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c797bf0 con 0x561f9c78edd0 2024-04-26T07:54:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.484+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94693769201504] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.484+0000 7f8f4d61f800 20 remove_watcher() i=5 2024-04-26T07:54:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.484+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94693769203568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c7985d0 con 0x561f9c78edd0 2024-04-26T07:54:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.485+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94693769203568] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.485+0000 7f8f4d61f800 20 remove_watcher() i=6 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.485+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94693769205312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561f9c79c760 con 0x561f9c78edd0 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4b926640 1 -- 172.21.15.62:0/2081472195 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94693769205312] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f440083e0 con 0x561f9c78edd0 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 20 remove_watcher() i=7 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c78edd0 msgr2=0x561f9c7911c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c78edd0 0x561f9c7911c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c78a3e0 msgr2=0x561f9c78c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c78a3e0 0x561f9c78c8a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f3c070070 msgr2=0x7f8f3c08f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f3c070070 0x7f8f3c08f850 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561f9c793880 msgr2=0x561f9c795d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561f9c793880 0x561f9c795d40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e14036eb0 msgr2=0x7f8e14039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e14036eb0 0x7f8e14039370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c06f8e0 tx=0x7f8f3c07d000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 msgr2=0x561f9c77e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4a924640 1 -- 172.21.15.62:0/2081472195 reap_dead start 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c77e880 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8f44017fa0 tx=0x7f8f4404cde0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 shutdown_connections 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/2081472195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c5c8ce0 0x561f9c77e880 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 >> 172.21.15.62:0/2081472195 conn(0x561f9c771450 msgr2=0x561f9c76eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 shutdown_connections 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.486+0000 7f8f4d61f800 1 -- 172.21.15.62:0/2081472195 wait complete. 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3265140350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e24036eb0 msgr2=0x7f8e24039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3265140350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e24036eb0 0x7f8e24039370 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x561f9c754260 tx=0x7f8f3c06f770 comp rx=0 tx=0).stop 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3265140350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c767d90 msgr2=0x561f9c7681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3265140350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c767d90 0x561f9c7681b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x561f9c74d540 tx=0x7f8f4400aea0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3265140350 shutdown_connections 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3265140350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e24036eb0 0x7f8e24039370 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/3265140350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c767d90 0x561f9c7681b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3265140350 >> 172.21.15.62:0/3265140350 conn(0x561f9c75be30 msgr2=0x561f9c75c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3265140350 shutdown_connections 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/3265140350 wait complete. 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c756130 msgr2=0x561f9c758520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c756130 0x561f9c758520 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c6548d0 msgr2=0x561f9c7538b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c6548d0 0x561f9c7538b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e30036e60 msgr2=0x7f8e30039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e30036e60 0x7f8e30039320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f40000f60 tx=0x7f8f400010a0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 msgr2=0x561f9c74c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c74c670 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c061040 tx=0x7f8f3c003330 comp rx=0 tx=0).stop 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 shutdown_connections 2024-04-26T07:54:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561f9c6548d0 0x561f9c7538b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x561f9c756130 0x561f9c758520 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e30036e60 0x7f8e30039320 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 --2- 172.21.15.62:0/1197778783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561f9c653760 0x561f9c74c670 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 >> 172.21.15.62:0/1197778783 conn(0x561f9c64ed40 msgr2=0x561f9c73ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 shutdown_connections 2024-04-26T07:54:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.487+0000 7f8f4d61f800 1 -- 172.21.15.62:0/1197778783 wait complete. 2024-04-26T07:54:38.499 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T07:54:38.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T07:54:38.499 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T07:54:38.544 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:38.544 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:38.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.546+0000 7f7454f1f800 1 Processor -- start 2024-04-26T07:54:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.546+0000 7f7454f1f800 1 -- start start 2024-04-26T07:54:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.546+0000 7f7454f1f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55e35f05c740 0x55e35f05cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.547+0000 7f7454f1f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e35f05d1e0 con 0x55e35f05d8b0 2024-04-26T07:54:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.547+0000 7f7454f1f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55e35eefee20 con 0x55e35f05c740 2024-04-26T07:54:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.547+0000 7f7450bc3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55e35f05c740 0x55e35f05cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.547+0000 7f7450bc3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55e35f05c740 0x55e35f05cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34054/0 (socket says 172.21.15.62:34054) 2024-04-26T07:54:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.547+0000 7f7450bc3640 1 -- 172.21.15.62:0/2516625107 learned_addr learned my addr 172.21.15.62:0/2516625107 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.547+0000 7f74503c2640 1 --1- 172.21.15.62:0/2516625107 >> v1:172.21.15.1:6789/0 conn(0x55e35f05d8b0 0x55e35f05dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36730/0 (socket says 172.21.15.62:36730) 2024-04-26T07:54:38.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.547+0000 7f7450bc3640 1 -- 172.21.15.62:0/2516625107 >> v1:172.21.15.1:6789/0 conn(0x55e35f05d8b0 legacy=0x55e35f05dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.547+0000 7f7450bc3640 1 -- 172.21.15.62:0/2516625107 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35f05e470 con 0x55e35f05c740 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.549+0000 7f7450bc3640 1 --2- 172.21.15.62:0/2516625107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f05cb60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f744000a520 tx=0x7f744001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f7d012cb1e40ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.549+0000 7f744fbc1640 1 -- 172.21.15.62:0/2516625107 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7440057070 con 0x55e35f05c740 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.549+0000 7f744fbc1640 1 -- 172.21.15.62:0/2516625107 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7440052570 con 0x55e35f05c740 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.549+0000 7f744fbc1640 1 -- 172.21.15.62:0/2516625107 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7440052870 con 0x55e35f05c740 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.550+0000 7f7454f1f800 1 -- 172.21.15.62:0/2516625107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 msgr2=0x55e35f05cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.550+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2516625107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f05cb60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f744000a520 tx=0x7f744001d010 comp rx=0 tx=0).stop 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.550+0000 7f7454f1f800 1 -- 172.21.15.62:0/2516625107 shutdown_connections 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.550+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2516625107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f05cb60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.550+0000 7f7454f1f800 1 -- 172.21.15.62:0/2516625107 >> 172.21.15.62:0/2516625107 conn(0x55e35f057d20 msgr2=0x55e35f05a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.550+0000 7f7454f1f800 1 -- 172.21.15.62:0/2516625107 shutdown_connections 2024-04-26T07:54:38.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.550+0000 7f7454f1f800 1 -- 172.21.15.62:0/2516625107 wait complete. 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.562+0000 7f7454f1f800 1 Processor -- start 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.562+0000 7f7454f1f800 1 -- start start 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.563+0000 7f7454f1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35efd2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.563+0000 7f7454f1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e35efa7cd0 con 0x55e35f05c740 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.563+0000 7f7450bc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35efd2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.563+0000 7f7450bc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35efd2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34066/0 (socket says 172.21.15.62:34066) 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.563+0000 7f7450bc3640 1 -- 172.21.15.62:0/2808123335 learned_addr learned my addr 172.21.15.62:0/2808123335 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.563+0000 7f7450bc3640 1 -- 172.21.15.62:0/2808123335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35efd05f0 con 0x55e35f05c740 2024-04-26T07:54:38.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.563+0000 7f7450bc3640 1 --2- 172.21.15.62:0/2808123335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35efd2030 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7440055040 tx=0x7f744004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f82cee5ebb1df3c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.563+0000 7f733ee0d640 1 -- 172.21.15.62:0/2808123335 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7440057040 con 0x55e35f05c740 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f733ee0d640 1 -- 172.21.15.62:0/2808123335 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7440052850 con 0x55e35f05c740 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f733ee0d640 1 -- 172.21.15.62:0/2808123335 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7440052b50 con 0x55e35f05c740 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f7454f1f800 1 -- 172.21.15.62:0/2808123335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 msgr2=0x55e35efd2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2808123335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35efd2030 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7440055040 tx=0x7f744004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f7454f1f800 1 -- 172.21.15.62:0/2808123335 shutdown_connections 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2808123335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35efd2030 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f7454f1f800 1 -- 172.21.15.62:0/2808123335 >> 172.21.15.62:0/2808123335 conn(0x55e35f057d20 msgr2=0x55e35f1496c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f7454f1f800 1 -- 172.21.15.62:0/2808123335 shutdown_connections 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.564+0000 7f7454f1f800 1 -- 172.21.15.62:0/2808123335 wait complete. 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7454f1f800 1 Processor -- start 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7454f1f800 1 -- start start 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7454f1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7454f1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e35f065d80 con 0x55e35f05c740 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7450bc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7450bc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34078/0 (socket says 172.21.15.62:34078) 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7450bc3640 1 -- 172.21.15.62:0/2756606526 learned_addr learned my addr 172.21.15.62:0/2756606526 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7450bc3640 1 -- 172.21.15.62:0/2756606526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35f157fb0 con 0x55e35f05c740 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.565+0000 7f7450bc3640 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f157a70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f744000a520 tx=0x7f7440003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.566+0000 7f733d60a640 1 -- 172.21.15.62:0/2756606526 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7440073070 con 0x55e35f05c740 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.566+0000 7f733d60a640 1 -- 172.21.15.62:0/2756606526 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744005d570 con 0x55e35f05c740 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.566+0000 7f733d60a640 1 -- 172.21.15.62:0/2756606526 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7440057070 con 0x55e35f05c740 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.566+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e35f158240 con 0x55e35f05c740 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.566+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e35f15aef0 con 0x55e35f05c740 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.566+0000 7f733d60a640 1 -- 172.21.15.62:0/2756606526 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7440076070 con 0x55e35f05c740 2024-04-26T07:54:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.567+0000 7f733d60a640 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7338036e60 0x7f7338039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.567+0000 7f733d60a640 1 -- 172.21.15.62:0/2756606526 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f744008e480 con 0x55e35f05c740 2024-04-26T07:54:38.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.567+0000 7f74503c2640 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7338036e60 0x7f7338039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.567+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f05d8b0 0x55e35f15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.567+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f15f1f0 con 0x55e35f05d8b0 2024-04-26T07:54:38.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.567+0000 7f74513c4640 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f05d8b0 0x55e35f15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.567+0000 7f74503c2640 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7338036e60 0x7f7338039320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7438000f60 tx=0x7f7438001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.567+0000 7f74513c4640 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f05d8b0 0x55e35f15ecb0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.568+0000 7f74513c4640 1 -- 172.21.15.62:0/2756606526 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744800a4a0 con 0x55e35f05d8b0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.568+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f15c280 con 0x55e35f05d8b0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.568+0000 7f74513c4640 1 -- 172.21.15.62:0/2756606526 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f744800a4a0 con 0x55e35f05d8b0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.568+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f161540 0x55e35f163930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.568+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f164020 con 0x55e35f161540 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.568+0000 7f7450bc3640 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f161540 0x55e35f163930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.569+0000 7f7450bc3640 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f161540 0x55e35f163930 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.569+0000 7f7450bc3640 1 -- 172.21.15.62:0/2756606526 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7440075030 con 0x55e35f161540 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.569+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1604f0 con 0x55e35f05d8b0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.569+0000 7f74513c4640 1 -- 172.21.15.62:0/2756606526 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f744800a4a0 con 0x55e35f05d8b0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.569+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1609d0 con 0x55e35f05d8b0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.569+0000 7f74513c4640 1 -- 172.21.15.62:0/2756606526 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f744800a4a0 con 0x55e35f05d8b0 2024-04-26T07:54:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.570+0000 7f7454f1f800 1 Processor -- start 2024-04-26T07:54:38.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.570+0000 7f7454f1f800 1 -- start start 2024-04-26T07:54:38.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.570+0000 7f7454f1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1731d0 0x55e35f1735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.570+0000 7f7454f1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e35ef4f170 con 0x55e35f1731d0 2024-04-26T07:54:38.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.570+0000 7f74513c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1731d0 0x55e35f1735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.570+0000 7f74513c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1731d0 0x55e35f1735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34084/0 (socket says 172.21.15.62:34084) 2024-04-26T07:54:38.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.570+0000 7f74513c4640 1 -- 172.21.15.62:0/1427403886 learned_addr learned my addr 172.21.15.62:0/1427403886 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.570+0000 7f74513c4640 1 -- 172.21.15.62:0/1427403886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35f173b30 con 0x55e35f1731d0 2024-04-26T07:54:38.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.571+0000 7f74513c4640 1 --2- 172.21.15.62:0/1427403886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1731d0 0x55e35f1735f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55e35f15f5f0 tx=0x7f7448018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.571+0000 7f73367fc640 1 -- 172.21.15.62:0/1427403886 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7448014450 con 0x55e35f1731d0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.571+0000 7f73367fc640 1 -- 172.21.15.62:0/1427403886 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7448014610 con 0x55e35f1731d0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.571+0000 7f7454f1f800 1 -- 172.21.15.62:0/1427403886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e35f1745a0 con 0x55e35f1731d0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.571+0000 7f73367fc640 1 -- 172.21.15.62:0/1427403886 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7448014930 con 0x55e35f1731d0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.571+0000 7f7454f1f800 1 -- 172.21.15.62:0/1427403886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e35f174aa0 con 0x55e35f1731d0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.571+0000 7f73367fc640 1 -- 172.21.15.62:0/1427403886 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7448011040 con 0x55e35f1731d0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f73367fc640 1 --2- 172.21.15.62:0/1427403886 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7328036e60 0x7f7328039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f73367fc640 1 -- 172.21.15.62:0/1427403886 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f744801e070 con 0x55e35f1731d0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f7450bc3640 1 --2- 172.21.15.62:0/1427403886 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7328036e60 0x7f7328039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f7454f1f800 1 Processor -- start 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f7454f1f800 1 -- start start 2024-04-26T07:54:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f7450bc3640 1 --2- 172.21.15.62:0/1427403886 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7328036e60 0x7f7328039320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55e35f15f690 tx=0x7f7440006970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f7454f1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f1808e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f7454f1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e35efd08b0 con 0x55e35f1804e0 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f74513c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f1808e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f74513c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f1808e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34092/0 (socket says 172.21.15.62:34092) 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.572+0000 7f74513c4640 1 -- 172.21.15.62:0/1920355524 learned_addr learned my addr 172.21.15.62:0/1920355524 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f74513c4640 1 -- 172.21.15.62:0/1920355524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35f180eb0 con 0x55e35f1804e0 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f74513c4640 1 --2- 172.21.15.62:0/1920355524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f1808e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f744804cf00 tx=0x7f7448011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9119c1ad1f8fe363 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f7327fff640 1 -- 172.21.15.62:0/1920355524 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74480168f0 con 0x55e35f1804e0 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f7327fff640 1 -- 172.21.15.62:0/1920355524 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7448014ad0 con 0x55e35f1804e0 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f7327fff640 1 -- 172.21.15.62:0/1920355524 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7448046590 con 0x55e35f1804e0 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f7454f1f800 1 -- 172.21.15.62:0/1920355524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 msgr2=0x55e35f1808e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1920355524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f1808e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f744804cf00 tx=0x7f7448011f20 comp rx=0 tx=0).stop 2024-04-26T07:54:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f7454f1f800 1 -- 172.21.15.62:0/1920355524 shutdown_connections 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1920355524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f1808e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.573+0000 7f7454f1f800 1 -- 172.21.15.62:0/1920355524 >> 172.21.15.62:0/1920355524 conn(0x55e35f17c7b0 msgr2=0x55e35f17a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f7454f1f800 1 -- 172.21.15.62:0/1920355524 shutdown_connections 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f7454f1f800 1 -- 172.21.15.62:0/1920355524 wait complete. 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f7454f1f800 1 Processor -- start 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f7454f1f800 1 -- start start 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f7454f1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f187a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f7454f1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e35f181660 con 0x55e35f1804e0 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f74513c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f187a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f74513c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f187a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34098/0 (socket says 172.21.15.62:34098) 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 learned_addr learned my addr 172.21.15.62:0/1948626518 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.574+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35f187f50 con 0x55e35f1804e0 2024-04-26T07:54:38.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.575+0000 7f74513c4640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f187a10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7448043040 tx=0x7f744804ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.575+0000 7f73267fc640 1 -- 172.21.15.62:0/1948626518 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7448014c80 con 0x55e35f1804e0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.575+0000 7f73267fc640 1 -- 172.21.15.62:0/1948626518 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744804e2f0 con 0x55e35f1804e0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.575+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e35f1881e0 con 0x55e35f1804e0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.575+0000 7f73267fc640 1 -- 172.21.15.62:0/1948626518 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744804e610 con 0x55e35f1804e0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.575+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e35f18ae90 con 0x55e35f1804e0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.576+0000 7f73267fc640 1 -- 172.21.15.62:0/1948626518 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f74480472b0 con 0x55e35f1804e0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.576+0000 7f73267fc640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f731c036eb0 0x7f731c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.576+0000 7f73267fc640 1 -- 172.21.15.62:0/1948626518 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f7448033070 con 0x55e35f1804e0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.576+0000 7f7450bc3640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f731c036eb0 0x7f731c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.576+0000 7f7450bc3640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f731c036eb0 0x7f731c039370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7440077520 tx=0x7f7440079000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.576+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.576+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f193510 0x55e35f1959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.576+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f196120 con 0x55e35f193510 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f74503c2640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f193510 0x55e35f1959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f74503c2640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f193510 0x55e35f1959d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743800f610 con 0x55e35f193510 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f7454f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f7454f1f800 20 realm 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f192960 con 0x55e35f193510 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743800f610 con 0x55e35f193510 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f7454f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f7454f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.577+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f196c10 con 0x55e35f193510 2024-04-26T07:54:38.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743800f610 con 0x55e35f193510 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f7454f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1974e0 con 0x55e35f193510 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f743800f610 con 0x55e35f193510 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f7454f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f197f00 0x55e35f19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19a9e0 con 0x55e35f197f00 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.578+0000 7f74513c4640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f197f00 0x55e35f19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.579+0000 7f74513c4640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f197f00 0x55e35f19a2f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.579+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.579+0000 7f7454f1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.579+0000 7f7454f1f800 20 searching for the correct realm 2024-04-26T07:54:38.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.579+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55e35f19c9b0 0x55e35f19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.579+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.579+0000 7f7450bc3640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55e35f19c9b0 0x55e35f19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.579+0000 7f7450bc3640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55e35f19c9b0 0x55e35f19ee70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.580+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.580+0000 7f7450bc3640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7440089040 0x7f744005d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.580+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x7f7440089040 2024-04-26T07:54:38.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.580+0000 7f74503c2640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7440089040 0x7f744005d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.580+0000 7f74503c2640 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7440089040 0x7f744005d850 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.580+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743800f610 con 0x7f7440089040 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.581+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.581+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.581+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f193510 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.581+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743800f610 con 0x55e35f193510 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.581+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f193510 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.581+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.581+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.582+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.582+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.582+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.582+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x7f7440089040 2024-04-26T07:54:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.582+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.582+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.582+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.582+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f193510 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.583+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.583+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.583+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.583+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f193510 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.583+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.583+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x7f7440089040 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.583+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.583+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.584+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.584+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.584+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.584+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.584+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.584+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.585+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.585+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.585+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.585+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f193510 2024-04-26T07:54:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.585+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.585+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f193510 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.585+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.585+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.586+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.586+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.586+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.586+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x7f7440089040 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.586+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.586+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f193510 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.587+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.587+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.587+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.587+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.587+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.587+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.588+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.588+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x7f7440089040 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.588+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.588+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f19c9b0 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.588+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.588+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f197f00 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.588+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.588+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x55e35f193510 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f540 con 0x7f7440089040 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19b3a0 con 0x55e35f193510 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19afb0 con 0x55e35f193510 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.589+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19bd10 con 0x55e35f193510 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 20 zone default found 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 4 Realm: () 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 20 zonegroup default 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f19f9c0 con 0x55e35f197f00 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a1c70 con 0x55e35f19c9b0 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.590+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a2010 con 0x55e35f19c9b0 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.591+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.591+0000 7f7454f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.591+0000 7f7454f1f800 20 started sync module instance, tier type = 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.591+0000 7f7454f1f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.591+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a1100 con 0x7f7440089040 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.592+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.592+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94435041482240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a1100 con 0x7f7440089040 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.592+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a2a50 con 0x55e35f193510 2024-04-26T07:54:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.593+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.593+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94435041486112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a2a50 con 0x55e35f193510 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.593+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94435041482240] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.593+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a3a50 con 0x55e35f19c9b0 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.594+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.594+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94435041490240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a3e70 con 0x55e35f19c9b0 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.594+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a4870 con 0x7f7440089040 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.594+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94435041486112] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.595+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94435041490240] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.595+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.595+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94435041479760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a2df0 con 0x7f7440089040 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.595+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a5280 con 0x55e35f193510 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.596+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.596+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94435041496528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a56a0 con 0x55e35f193510 2024-04-26T07:54:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.596+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a6060 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.596+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94435041479760] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.597+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94435041496528] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.598+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.598+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94435041500080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a56a0 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.598+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a6050 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.599+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94435041500080] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.599+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.599+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94435041497584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a6ae0 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.599+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a7330 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94435041497584] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94435041504048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a7400 con 0x55e35f197f00 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f7454f1f800 20 add_watcher() i=0 2024-04-26T07:54:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f7454f1f800 20 add_watcher() i=1 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f7454f1f800 20 add_watcher() i=2 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f7454f1f800 20 add_watcher() i=3 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f7454f1f800 20 add_watcher() i=4 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f7454f1f800 20 add_watcher() i=5 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.600+0000 7f7454f1f800 20 add_watcher() i=6 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.601+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94435041504048] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.601+0000 7f7454f1f800 20 add_watcher() i=7 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.601+0000 7f7454f1f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.601+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1aa710 con 0x55e35f193510 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.601+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.601+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94435041505472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a7990 con 0x55e35f193510 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.602+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94435041505472] v27'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.602+0000 7f7306fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.602+0000 7f7454f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:38.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.602+0000 7f7454f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:38.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.602+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1aa020 con 0x55e35f193510 2024-04-26T07:54:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.603+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.603+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b3a10 con 0x55e35f197f00 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.605+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.605+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b3fc0 con 0x55e35f19c9b0 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.606+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.606+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b4360 con 0x55e35f193510 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.607+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'113 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.607+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b48d0 con 0x7f7440089040 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.608+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.608+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b4d80 con 0x55e35f19c9b0 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.609+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.609+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5120 con 0x55e35f193510 2024-04-26T07:54:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.610+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.610+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f197f00 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.611+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.611+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x7f7440089040 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.612+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.612+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.613+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.613+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x7f7440089040 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.614+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.614+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f197f00 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.615+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.615+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x7f7440089040 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.616+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.616+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f197f00 2024-04-26T07:54:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.617+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.617+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f193510 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.618+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.618+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.620+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.620+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x7f7440089040 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.621+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.621+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.622+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.622+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f193510 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.623+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.623+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f193510 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.624+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.624+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.625+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.625+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x7f7440089040 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.626+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.626+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.627+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.627+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.628+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.628+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.629+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.629+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.630+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.630+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5570 con 0x55e35f197f00 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.631+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.631+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5570 con 0x55e35f19c9b0 2024-04-26T07:54:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.632+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.632+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f197f00 2024-04-26T07:54:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.633+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.633+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f19c9b0 2024-04-26T07:54:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.634+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.634+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x55e35f197f00 2024-04-26T07:54:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.635+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.635+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1b5540 con 0x7f7440089040 2024-04-26T07:54:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.636+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7305fe3640 20 reqs_thread_entry: start 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 20 Filter name: none 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f72777fe640 20 reqs_thread_entry: start 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1e0460 con 0x55e35f197f00 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.637+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1e2ef0 con 0x55e35f197f00 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.638+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.639+0000 7f7306fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.639+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94435041505472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f18fbd0 con 0x55e35f193510 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.640+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94435041505472] v27'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.640+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94435041482240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a70c0 con 0x7f7440089040 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.641+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94435041482240] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.641+0000 7f7454f1f800 20 remove_watcher() i=0 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.641+0000 7f7454f1f800 2 removed watcher, disabling cache 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.641+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94435041486112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a70c0 con 0x55e35f193510 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.642+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94435041486112] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.642+0000 7f7454f1f800 20 remove_watcher() i=1 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.642+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94435041490240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a70c0 con 0x55e35f19c9b0 2024-04-26T07:54:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.643+0000 7f7450bc3640 1 -- 172.21.15.62:0/1948626518 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94435041490240] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7440075030 con 0x55e35f19c9b0 2024-04-26T07:54:38.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.643+0000 7f7454f1f800 20 remove_watcher() i=2 2024-04-26T07:54:38.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.643+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94435041479760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a3540 con 0x7f7440089040 2024-04-26T07:54:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.644+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94435041479760] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x7f7440089040 2024-04-26T07:54:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.644+0000 7f7454f1f800 20 remove_watcher() i=3 2024-04-26T07:54:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.644+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94435041496528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a70c0 con 0x55e35f193510 2024-04-26T07:54:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.645+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94435041496528] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743802b040 con 0x55e35f193510 2024-04-26T07:54:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.645+0000 7f7454f1f800 20 remove_watcher() i=4 2024-04-26T07:54:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.645+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94435041500080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a4dd0 con 0x55e35f197f00 2024-04-26T07:54:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.646+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94435041500080] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.646+0000 7f7454f1f800 20 remove_watcher() i=5 2024-04-26T07:54:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.646+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94435041497584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a70c0 con 0x55e35f197f00 2024-04-26T07:54:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.647+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94435041497584] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.647+0000 7f7454f1f800 20 remove_watcher() i=6 2024-04-26T07:54:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.647+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94435041504048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e35f1a5bb0 con 0x55e35f197f00 2024-04-26T07:54:38.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f74513c4640 1 -- 172.21.15.62:0/1948626518 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94435041504048] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744802a070 con 0x55e35f197f00 2024-04-26T07:54:38.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 20 remove_watcher() i=7 2024-04-26T07:54:38.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f197f00 msgr2=0x55e35f19a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f197f00 0x55e35f19a2f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f193510 msgr2=0x55e35f1959d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f193510 0x55e35f1959d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7440089040 msgr2=0x7f744005d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7440089040 0x7f744005d850 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55e35f19c9b0 msgr2=0x55e35f19ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55e35f19c9b0 0x55e35f19ee70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f731c036eb0 msgr2=0x7f731c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f731c036eb0 0x7f731c039370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7440077520 tx=0x7f7440079000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f74503c2640 1 -- 172.21.15.62:0/1948626518 reap_dead start 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 msgr2=0x55e35f187a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f187a10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7448043040 tx=0x7f744804ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 shutdown_connections 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1948626518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1804e0 0x55e35f187a10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 >> 172.21.15.62:0/1948626518 conn(0x55e35f17c7b0 msgr2=0x55e35f179e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 shutdown_connections 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.648+0000 7f7454f1f800 1 -- 172.21.15.62:0/1948626518 wait complete. 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/1427403886 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7328036e60 msgr2=0x7f7328039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1427403886 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7328036e60 0x7f7328039320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55e35f15f690 tx=0x7f7440006970 comp rx=0 tx=0).stop 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/1427403886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1731d0 msgr2=0x55e35f1735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1427403886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1731d0 0x55e35f1735f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55e35f15f5f0 tx=0x7f7448018830 comp rx=0 tx=0).stop 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/1427403886 shutdown_connections 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1427403886 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7328036e60 0x7f7328039320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/1427403886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f1731d0 0x55e35f1735f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/1427403886 >> 172.21.15.62:0/1427403886 conn(0x55e35f167270 msgr2=0x55e35f167670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/1427403886 shutdown_connections 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/1427403886 wait complete. 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f161540 msgr2=0x55e35f163930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f161540 0x55e35f163930 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f05d8b0 msgr2=0x55e35f15ecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f05d8b0 0x55e35f15ecb0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7338036e60 msgr2=0x7f7338039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7338036e60 0x7f7338039320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7438000f60 tx=0x7f7438001370 comp rx=0 tx=0).stop 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 msgr2=0x55e35f157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f157a70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f744000a520 tx=0x7f7440003020 comp rx=0 tx=0).stop 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 shutdown_connections 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55e35f05d8b0 0x55e35f15ecb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55e35f161540 0x55e35f163930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7338036e60 0x7f7338039320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 --2- 172.21.15.62:0/2756606526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e35f05c740 0x55e35f157a70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 >> 172.21.15.62:0/2756606526 conn(0x55e35f057d20 msgr2=0x55e35efd0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 shutdown_connections 2024-04-26T07:54:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.649+0000 7f7454f1f800 1 -- 172.21.15.62:0/2756606526 wait complete. 2024-04-26T07:54:38.656 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T07:54:38.656 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-26T07:54:38.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-26T07:54:38.657 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-04-26T07:54:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2abb13e800 1 Processor -- start 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2abb13e800 1 -- start start 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2abb13e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559b2b97cfd0 0x559b2b97d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2abb13e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b2b8f2260 con 0x559b2b97d930 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2abb13e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x559b2b820e20 con 0x559b2b97cfd0 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2ab8c3d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559b2b97cfd0 0x559b2b97d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2ab8c3d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559b2b97cfd0 0x559b2b97d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34108/0 (socket says 172.21.15.62:34108) 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/848550269 learned_addr learned my addr 172.21.15.62:0/848550269 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.706+0000 7f2ab843c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x559b2b97d930 0x559b2b97dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36732/0 (socket says 172.21.15.62:36732) 2024-04-26T07:54:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.707+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/848550269 >> v1:172.21.15.1:6789/0 conn(0x559b2b97d930 legacy=0x559b2b97dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.707+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/848550269 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2b97e4f0 con 0x559b2b97cfd0 2024-04-26T07:54:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.708+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/848550269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2b97d3f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800a520 tx=0x7f2aa801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1463ac6ce60bf513 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2ab7c3b640 1 -- 172.21.15.62:0/848550269 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa8057070 con 0x559b2b97cfd0 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2ab7c3b640 1 -- 172.21.15.62:0/848550269 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa8052570 con 0x559b2b97cfd0 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2ab7c3b640 1 -- 172.21.15.62:0/848550269 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa804ae60 con 0x559b2b97cfd0 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2abb13e800 1 -- 172.21.15.62:0/848550269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 msgr2=0x559b2b97d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2abb13e800 1 --2- 172.21.15.62:0/848550269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2b97d3f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800a520 tx=0x7f2aa801d010 comp rx=0 tx=0).stop 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2abb13e800 1 -- 172.21.15.62:0/848550269 shutdown_connections 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2abb13e800 1 --2- 172.21.15.62:0/848550269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2b97d3f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2abb13e800 1 -- 172.21.15.62:0/848550269 >> 172.21.15.62:0/848550269 conn(0x559b2b978bb0 msgr2=0x559b2b97afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2abb13e800 1 -- 172.21.15.62:0/848550269 shutdown_connections 2024-04-26T07:54:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.709+0000 7f2abb13e800 1 -- 172.21.15.62:0/848550269 wait complete. 2024-04-26T07:54:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.722+0000 7f2abb13e800 1 Processor -- start 2024-04-26T07:54:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.722+0000 7f2abb13e800 1 -- start start 2024-04-26T07:54:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.722+0000 7f2abb13e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba72160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.722+0000 7f2abb13e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b2b8c9d00 con 0x559b2b97cfd0 2024-04-26T07:54:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.722+0000 7f2ab8c3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba72160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.722+0000 7f2ab8c3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba72160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34124/0 (socket says 172.21.15.62:34124) 2024-04-26T07:54:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.722+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/4021797043 learned_addr learned my addr 172.21.15.62:0/4021797043 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.723+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/4021797043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2ba72730 con 0x559b2b97cfd0 2024-04-26T07:54:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.723+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/4021797043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba72160 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8055040 tx=0x7f2aa804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bfe1e2081157f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.723+0000 7f29a6e0d640 1 -- 172.21.15.62:0/4021797043 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa8057040 con 0x559b2b97cfd0 2024-04-26T07:54:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.723+0000 7f29a6e0d640 1 -- 172.21.15.62:0/4021797043 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa8052720 con 0x559b2b97cfd0 2024-04-26T07:54:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.723+0000 7f29a6e0d640 1 -- 172.21.15.62:0/4021797043 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa8052a40 con 0x559b2b97cfd0 2024-04-26T07:54:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 -- 172.21.15.62:0/4021797043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 msgr2=0x559b2ba72160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 --2- 172.21.15.62:0/4021797043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba72160 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8055040 tx=0x7f2aa804c000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 -- 172.21.15.62:0/4021797043 shutdown_connections 2024-04-26T07:54:38.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 --2- 172.21.15.62:0/4021797043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba72160 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 -- 172.21.15.62:0/4021797043 >> 172.21.15.62:0/4021797043 conn(0x559b2b978bb0 msgr2=0x559b2ba6da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 -- 172.21.15.62:0/4021797043 shutdown_connections 2024-04-26T07:54:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 -- 172.21.15.62:0/4021797043 wait complete. 2024-04-26T07:54:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 Processor -- start 2024-04-26T07:54:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 -- start start 2024-04-26T07:54:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba79ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2abb13e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b2b97e9c0 con 0x559b2b97cfd0 2024-04-26T07:54:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2ab8c3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba79ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2ab8c3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba79ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34134/0 (socket says 172.21.15.62:34134) 2024-04-26T07:54:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.724+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/311314425 learned_addr learned my addr 172.21.15.62:0/311314425 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.725+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/311314425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2ba7a1e0 con 0x559b2b97cfd0 2024-04-26T07:54:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.725+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba79ca0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8052540 tx=0x7f2aa8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.725+0000 7f29a560a640 1 -- 172.21.15.62:0/311314425 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa8073070 con 0x559b2b97cfd0 2024-04-26T07:54:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.725+0000 7f29a560a640 1 -- 172.21.15.62:0/311314425 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa805d440 con 0x559b2b97cfd0 2024-04-26T07:54:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.725+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b2ba7a470 con 0x559b2b97cfd0 2024-04-26T07:54:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.725+0000 7f29a560a640 1 -- 172.21.15.62:0/311314425 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa8057070 con 0x559b2b97cfd0 2024-04-26T07:54:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.725+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2ba7d0d0 con 0x559b2b97cfd0 2024-04-26T07:54:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.726+0000 7f29a560a640 1 -- 172.21.15.62:0/311314425 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2aa8076070 con 0x559b2b97cfd0 2024-04-26T07:54:38.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.726+0000 7f29a560a640 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f29a0036e60 0x7f29a0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.726+0000 7f29a560a640 1 -- 172.21.15.62:0/311314425 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2aa808e2d0 con 0x559b2b97cfd0 2024-04-26T07:54:38.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.726+0000 7f2ab843c640 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f29a0036e60 0x7f29a0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.726+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2b97d930 0x559b2ba80e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.726+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2ba813d0 con 0x559b2b97d930 2024-04-26T07:54:38.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.726+0000 7f2ab943e640 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2b97d930 0x559b2ba80e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.727+0000 7f2ab843c640 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f29a0036e60 0x7f29a0039320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2aac000f60 tx=0x7f2aac001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.727+0000 7f2ab943e640 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2b97d930 0x559b2ba80e90 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.727+0000 7f2ab943e640 1 -- 172.21.15.62:0/311314425 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ab000a4a0 con 0x559b2b97d930 2024-04-26T07:54:38.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.727+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2ba7e460 con 0x559b2b97d930 2024-04-26T07:54:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.727+0000 7f2ab943e640 1 -- 172.21.15.62:0/311314425 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ab000a4a0 con 0x559b2b97d930 2024-04-26T07:54:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.727+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2ba83700 0x559b2ba85af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.727+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2ba861e0 con 0x559b2ba83700 2024-04-26T07:54:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.728+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2ba83700 0x559b2ba85af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.728+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2ba83700 0x559b2ba85af0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.728+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/311314425 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2aa8075030 con 0x559b2ba83700 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.728+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2ba826b0 con 0x559b2b97d930 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.729+0000 7f2ab943e640 1 -- 172.21.15.62:0/311314425 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ab000a4a0 con 0x559b2b97d930 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.729+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2ba82b90 con 0x559b2b97d930 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.729+0000 7f2ab943e640 1 -- 172.21.15.62:0/311314425 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ab000a4a0 con 0x559b2b97d930 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.729+0000 7f2abb13e800 1 Processor -- start 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.729+0000 7f2abb13e800 1 -- start start 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2abb13e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2ba952e0 0x559b2ba95700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2abb13e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b2b871170 con 0x559b2ba952e0 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2ab943e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2ba952e0 0x559b2ba95700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2ab943e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2ba952e0 0x559b2ba95700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34138/0 (socket says 172.21.15.62:34138) 2024-04-26T07:54:38.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2ab943e640 1 -- 172.21.15.62:0/3924766883 learned_addr learned my addr 172.21.15.62:0/3924766883 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2ab943e640 1 -- 172.21.15.62:0/3924766883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2ba95c40 con 0x559b2ba952e0 2024-04-26T07:54:38.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2ab943e640 1 --2- 172.21.15.62:0/3924766883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2ba952e0 0x559b2ba95700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x559b2ba817b0 tx=0x7f2ab0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f299e7fc640 1 -- 172.21.15.62:0/3924766883 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab0014450 con 0x559b2ba952e0 2024-04-26T07:54:38.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f299e7fc640 1 -- 172.21.15.62:0/3924766883 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab0014610 con 0x559b2ba952e0 2024-04-26T07:54:38.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2abb13e800 1 -- 172.21.15.62:0/3924766883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b2ba966b0 con 0x559b2ba952e0 2024-04-26T07:54:38.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f299e7fc640 1 -- 172.21.15.62:0/3924766883 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab0014930 con 0x559b2ba952e0 2024-04-26T07:54:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.730+0000 7f2abb13e800 1 -- 172.21.15.62:0/3924766883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2ba96bb0 con 0x559b2ba952e0 2024-04-26T07:54:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.731+0000 7f299e7fc640 1 -- 172.21.15.62:0/3924766883 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2ab0011040 con 0x559b2ba952e0 2024-04-26T07:54:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.731+0000 7f299e7fc640 1 --2- 172.21.15.62:0/3924766883 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2990036eb0 0x7f2990039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.731+0000 7f299e7fc640 1 -- 172.21.15.62:0/3924766883 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2ab001e070 con 0x559b2ba952e0 2024-04-26T07:54:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.731+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/3924766883 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2990036eb0 0x7f2990039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2abb13e800 1 Processor -- start 2024-04-26T07:54:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2abb13e800 1 -- start start 2024-04-26T07:54:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/3924766883 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2990036eb0 0x7f2990039370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x559b2ba81850 tx=0x7f2aa8006a70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2abb13e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2abb13e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b2ba729f0 con 0x559b2baa2640 2024-04-26T07:54:38.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2ab943e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2ab943e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34148/0 (socket says 172.21.15.62:34148) 2024-04-26T07:54:38.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2ab943e640 1 -- 172.21.15.62:0/2415422403 learned_addr learned my addr 172.21.15.62:0/2415422403 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2ab943e640 1 -- 172.21.15.62:0/2415422403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2baa3030 con 0x559b2baa2640 2024-04-26T07:54:38.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f2ab943e640 1 --2- 172.21.15.62:0/2415422403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa2a60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2ab004cf70 tx=0x7f2ab004d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1c08a8028a4123 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f298ffff640 1 -- 172.21.15.62:0/2415422403 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab0046070 con 0x559b2baa2640 2024-04-26T07:54:38.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f298ffff640 1 -- 172.21.15.62:0/2415422403 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab00168f0 con 0x559b2baa2640 2024-04-26T07:54:38.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.732+0000 7f298ffff640 1 -- 172.21.15.62:0/2415422403 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab0013dd0 con 0x559b2baa2640 2024-04-26T07:54:38.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 -- 172.21.15.62:0/2415422403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 msgr2=0x559b2baa2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2415422403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa2a60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2ab004cf70 tx=0x7f2ab004d220 comp rx=0 tx=0).stop 2024-04-26T07:54:38.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 -- 172.21.15.62:0/2415422403 shutdown_connections 2024-04-26T07:54:38.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2415422403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa2a60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 -- 172.21.15.62:0/2415422403 >> 172.21.15.62:0/2415422403 conn(0x559b2ba9e8c0 msgr2=0x559b2ba9c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 -- 172.21.15.62:0/2415422403 shutdown_connections 2024-04-26T07:54:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 -- 172.21.15.62:0/2415422403 wait complete. 2024-04-26T07:54:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 Processor -- start 2024-04-26T07:54:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 -- start start 2024-04-26T07:54:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.733+0000 7f2abb13e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b2baa3790 con 0x559b2baa2640 2024-04-26T07:54:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f2ab943e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f2ab943e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34158/0 (socket says 172.21.15.62:34158) 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 learned_addr learned my addr 172.21.15.62:0/2944268722 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2baaa0c0 con 0x559b2baa2640 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f2ab943e640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa9b80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0044040 tx=0x7f2ab004cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f298e7fc640 1 -- 172.21.15.62:0/2944268722 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab003b070 con 0x559b2baa2640 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f298e7fc640 1 -- 172.21.15.62:0/2944268722 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab0022a50 con 0x559b2baa2640 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b2baaa350 con 0x559b2baa2640 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.734+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2baad000 con 0x559b2baa2640 2024-04-26T07:54:38.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.735+0000 7f298e7fc640 1 -- 172.21.15.62:0/2944268722 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab0046040 con 0x559b2baa2640 2024-04-26T07:54:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.735+0000 7f298e7fc640 1 -- 172.21.15.62:0/2944268722 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2ab002b350 con 0x559b2baa2640 2024-04-26T07:54:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.735+0000 7f298e7fc640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2984036df0 0x7f29840392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.735+0000 7f298e7fc640 1 -- 172.21.15.62:0/2944268722 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2ab0033070 con 0x559b2baa2640 2024-04-26T07:54:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.735+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2984036df0 0x7f29840392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2984036df0 0x7f29840392b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2aa808c940 tx=0x7f2aa8084000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2bab5840 0x559b2bab7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bab8450 con 0x559b2bab5840 2024-04-26T07:54:38.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2ab843c640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2bab5840 0x559b2bab7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2ab843c640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2bab5840 0x559b2bab7d00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aac00f610 con 0x559b2bab5840 2024-04-26T07:54:38.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2abb13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2abb13e800 20 realm 2024-04-26T07:54:38.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bab4c90 con 0x559b2bab5840 2024-04-26T07:54:38.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.736+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aac00f610 con 0x559b2bab5840 2024-04-26T07:54:38.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:38.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bab8f40 con 0x559b2bab5840 2024-04-26T07:54:38.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aac00f610 con 0x559b2bab5840 2024-04-26T07:54:38.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bab9810 con 0x559b2bab5840 2024-04-26T07:54:38.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2aac00f610 con 0x559b2bab5840 2024-04-26T07:54:38.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2baba230 0x559b2babc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2babcd10 con 0x559b2baba230 2024-04-26T07:54:38.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.737+0000 7f2ab943e640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2baba230 0x559b2babc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.738+0000 7f2ab943e640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2baba230 0x559b2babc620 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.738+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.738+0000 7f2abb13e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:38.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.738+0000 7f2abb13e800 20 searching for the correct realm 2024-04-26T07:54:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.738+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559b2babed10 0x559b2bac11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.738+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.738+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559b2babed10 0x559b2bac11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.738+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559b2babed10 0x559b2bac11d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.739+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.739+0000 7f2ab8c3d640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2aa8089070 0x7f2aa805d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.739+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x7f2aa8089070 2024-04-26T07:54:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.739+0000 7f2ab843c640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2aa8089070 0x7f2aa805d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.739+0000 7f2ab843c640 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2aa8089070 0x7f2aa805d720 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.739+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac00f610 con 0x7f2aa8089070 2024-04-26T07:54:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.739+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.740+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.740+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2bab5840 2024-04-26T07:54:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.740+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac00f610 con 0x559b2bab5840 2024-04-26T07:54:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.740+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2bab5840 2024-04-26T07:54:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.741+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.741+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.741+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.741+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.741+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.741+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x7f2aa8089070 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.741+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.741+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.742+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.742+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2bab5840 2024-04-26T07:54:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.742+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.742+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.742+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.742+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2bab5840 2024-04-26T07:54:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.742+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.742+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x7f2aa8089070 2024-04-26T07:54:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.743+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.743+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.743+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.743+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.743+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.743+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2bab5840 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2bab5840 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.744+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.745+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.745+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.745+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.745+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.745+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x7f2aa8089070 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.745+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.745+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2bab5840 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.746+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.746+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.746+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.746+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.746+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.746+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.746+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.746+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x7f2aa8089070 2024-04-26T07:54:38.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.747+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.747+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2babed10 2024-04-26T07:54:38.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.747+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.747+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2baba230 2024-04-26T07:54:38.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.747+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.747+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x559b2bab5840 2024-04-26T07:54:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac18a0 con 0x7f2aa8089070 2024-04-26T07:54:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2babe260 con 0x559b2bab5840 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2babd210 con 0x559b2bab5840 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.748+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2babdbd0 con 0x559b2bab5840 2024-04-26T07:54:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 zone default found 2024-04-26T07:54:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 4 Realm: () 2024-04-26T07:54:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 zonegroup default 2024-04-26T07:54:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac21d0 con 0x559b2baba230 2024-04-26T07:54:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac4480 con 0x559b2babed10 2024-04-26T07:54:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac4820 con 0x559b2babed10 2024-04-26T07:54:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.749+0000 7f2abb13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.750+0000 7f2abb13e800 20 started sync module instance, tier type = 2024-04-26T07:54:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.750+0000 7f2abb13e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.750+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac3910 con 0x7f2aa8089070 2024-04-26T07:54:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.750+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.750+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94124941000240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac3910 con 0x7f2aa8089070 2024-04-26T07:54:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.750+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac51e0 con 0x559b2bab5840 2024-04-26T07:54:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.752+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94124941000240] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.752+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.752+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94124941004560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac3910 con 0x559b2bab5840 2024-04-26T07:54:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.752+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac5c30 con 0x559b2babed10 2024-04-26T07:54:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.753+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.753+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94124941006656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac64d0 con 0x559b2babed10 2024-04-26T07:54:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.753+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac6f40 con 0x7f2aa8089070 2024-04-26T07:54:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.753+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94124941004560] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.754+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94124941006656] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.754+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.754+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94124941008928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac3460 con 0x7f2aa8089070 2024-04-26T07:54:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.754+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac7810 con 0x559b2bab5840 2024-04-26T07:54:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.755+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94124941008928] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.755+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.755+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94124941011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac7760 con 0x559b2bab5840 2024-04-26T07:54:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.755+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac8220 con 0x559b2baba230 2024-04-26T07:54:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.756+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94124941011472] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.756+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.756+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94124941016912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac7760 con 0x559b2baba230 2024-04-26T07:54:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.756+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac8c30 con 0x559b2baba230 2024-04-26T07:54:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.757+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.757+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94124941019008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac8be0 con 0x559b2baba230 2024-04-26T07:54:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.757+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac9bd0 con 0x559b2baba230 2024-04-26T07:54:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.757+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94124941016912] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94124941022880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac9b90 con 0x559b2baba230 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94124941019008] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2abb13e800 20 add_watcher() i=0 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2abb13e800 20 add_watcher() i=1 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2abb13e800 20 add_watcher() i=2 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2abb13e800 20 add_watcher() i=3 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2abb13e800 20 add_watcher() i=4 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2abb13e800 20 add_watcher() i=5 2024-04-26T07:54:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.758+0000 7f2abb13e800 20 add_watcher() i=6 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.759+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94124941022880] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.759+0000 7f2abb13e800 20 add_watcher() i=7 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.759+0000 7f2abb13e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.759+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac9050 con 0x559b2bab5840 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.760+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.760+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94124941013680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac9050 con 0x559b2bab5840 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.761+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94124941013680] v27'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.761+0000 7f296efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.761+0000 7f2abb13e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.761+0000 7f2abb13e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.761+0000 7f2abb13e800 5 note: GC not initialized 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.761+0000 7f296dfe3640 20 reqs_thread_entry: start 2024-04-26T07:54:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.761+0000 7f2abb13e800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 20 Filter name: none 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f28df7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bb003f0 con 0x559b2baba230 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.762+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bb024d0 con 0x7f2aa8089070 2024-04-26T07:54:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:38.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:38.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:38.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bb03e90 con 0x559b2bab5840 2024-04-26T07:54:38.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(64 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.763+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bb052f0 con 0x559b2baba230 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.764+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(65 fud.buckets [call] v27'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.764+0000 7f2abb13e800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.764+0000 7f2abb13e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.764+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bb056f0 con 0x7f2aa8089070 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.765+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.765+0000 7f2abb13e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.765+0000 7f2abb13e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.765+0000 7f2abb13e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.765+0000 7f2abb13e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.765+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bb0b2e0 con 0x7f2aa8089070 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2abb13e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2abb13e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2abb13e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94124941274608 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559b2bb087b0 con 0x559b2baba230 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== watch-notify(notify (1) cookie 94124941019008 notify 115964116998 ret 0) ==== 380+0+0 (crc 0 0 0) 0x559b2baad000 con 0x559b2baba230 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f298ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94124941019008 notifier 4508 bl.length()=338 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f298ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f298ffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f298ffff640 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f297c003ea0 con 0x559b2baba230 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(68 notify.6 [notify cookie 94124941274608 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.766+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== watch-notify(notify_complete (2) cookie 94124941274608 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559b2baaa350 con 0x559b2baba230 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.767+0000 7f296efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.767+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94124941013680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bb00960 con 0x559b2bab5840 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.768+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94124941013680] v27'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.768+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94124941000240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac72b0 con 0x7f2aa8089070 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.769+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94124941000240] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.769+0000 7f2abb13e800 20 remove_watcher() i=0 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.769+0000 7f2abb13e800 2 removed watcher, disabling cache 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.769+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94124941004560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac72b0 con 0x559b2bab5840 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.770+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94124941004560] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.770+0000 7f2abb13e800 20 remove_watcher() i=1 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.770+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94124941006656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac72b0 con 0x559b2babed10 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.771+0000 7f2ab8c3d640 1 -- 172.21.15.62:0/2944268722 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94124941006656] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aa8097070 con 0x559b2babed10 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.771+0000 7f2abb13e800 20 remove_watcher() i=2 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.771+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94124941008928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac3e10 con 0x7f2aa8089070 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.772+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94124941008928] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x7f2aa8089070 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.772+0000 7f2abb13e800 20 remove_watcher() i=3 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.772+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94124941011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac6020 con 0x559b2bab5840 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.773+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94124941011472] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aac02b040 con 0x559b2bab5840 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.773+0000 7f2abb13e800 20 remove_watcher() i=4 2024-04-26T07:54:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.773+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94124941016912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac6020 con 0x559b2baba230 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.774+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94124941016912] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.774+0000 7f2abb13e800 20 remove_watcher() i=5 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.774+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94124941019008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac7f50 con 0x559b2baba230 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.775+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94124941019008] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.775+0000 7f2abb13e800 20 remove_watcher() i=6 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.775+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94124941022880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559b2bac6020 con 0x559b2baba230 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2ab943e640 1 -- 172.21.15.62:0/2944268722 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94124941022880] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ab002a070 con 0x559b2baba230 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 20 remove_watcher() i=7 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2baba230 msgr2=0x559b2babc620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2baba230 0x559b2babc620 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2bab5840 msgr2=0x559b2bab7d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2bab5840 0x559b2bab7d00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2aa8089070 msgr2=0x7f2aa805d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2aa8089070 0x7f2aa805d720 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559b2babed10 msgr2=0x559b2bac11d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559b2babed10 0x559b2bac11d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2984036df0 msgr2=0x7f29840392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2984036df0 0x7f29840392b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2aa808c940 tx=0x7f2aa8084000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 msgr2=0x559b2baa9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 --2- 172.21.15.62:0/2944268722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2baa2640 0x559b2baa9b80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0044040 tx=0x7f2ab004cf00 comp rx=0 tx=0).stop 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 reap_dead start 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2ab843c640 1 -- 172.21.15.62:0/2944268722 reap_dead start 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 shutdown_connections 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.776+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 >> 172.21.15.62:0/2944268722 conn(0x559b2ba9e8c0 msgr2=0x559b2ba9bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 shutdown_connections 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/2944268722 wait complete. 2024-04-26T07:54:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/3924766883 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2990036eb0 msgr2=0x7f2990039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/3924766883 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2990036eb0 0x7f2990039370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x559b2ba81850 tx=0x7f2aa8006a70 comp rx=0 tx=0).stop 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/3924766883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2ba952e0 msgr2=0x559b2ba95700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/3924766883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2ba952e0 0x559b2ba95700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x559b2ba817b0 tx=0x7f2ab0018830 comp rx=0 tx=0).stop 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/3924766883 shutdown_connections 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/3924766883 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2990036eb0 0x7f2990039370 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/3924766883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2ba952e0 0x559b2ba95700 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/3924766883 >> 172.21.15.62:0/3924766883 conn(0x559b2ba89380 msgr2=0x559b2ba89780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/3924766883 shutdown_connections 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/3924766883 wait complete. 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2ba83700 msgr2=0x559b2ba85af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2ba83700 0x559b2ba85af0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2b97d930 msgr2=0x559b2ba80e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2b97d930 0x559b2ba80e90 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f29a0036e60 msgr2=0x7f29a0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f29a0036e60 0x7f29a0039320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2aac000f60 tx=0x7f2aac001370 comp rx=0 tx=0).stop 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 msgr2=0x559b2ba79ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba79ca0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8052540 tx=0x7f2aa8003020 comp rx=0 tx=0).stop 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 shutdown_connections 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559b2b97d930 0x559b2ba80e90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559b2ba83700 0x559b2ba85af0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f29a0036e60 0x7f29a0039320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 --2- 172.21.15.62:0/311314425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b2b97cfd0 0x559b2ba79ca0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 >> 172.21.15.62:0/311314425 conn(0x559b2b978bb0 msgr2=0x559b2ba6c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.777+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 shutdown_connections 2024-04-26T07:54:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.778+0000 7f2abb13e800 1 -- 172.21.15.62:0/311314425 wait complete. 2024-04-26T07:54:38.826 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1'] 2024-04-26T07:54:38.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1'] 2024-04-26T07:54:38.826 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:38.874 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:38.874 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872f525800 1 Processor -- start 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872f525800 1 -- start start 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872f525800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55894b0ef190 0x55894b0ed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872f525800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55894b0ee130 con 0x55894b0edc80 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872f525800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55894b01be20 con 0x55894b0ef190 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872b2b7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55894b0ef190 0x55894b0ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872b2b7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55894b0ef190 0x55894b0ed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34162/0 (socket says 172.21.15.62:34162) 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872aab6640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55894b0edc80 0x55894b1815d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36746/0 (socket says 172.21.15.62:36746) 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.877+0000 7f872b2b7640 1 -- 172.21.15.62:0/4083934724 learned_addr learned my addr 172.21.15.62:0/4083934724 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.878+0000 7f872b2b7640 1 -- 172.21.15.62:0/4083934724 >> v1:172.21.15.1:6789/0 conn(0x55894b0edc80 legacy=0x55894b1815d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.878+0000 7f872a2b5640 1 -- 172.21.15.62:0/4083934724 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039980334 0 0) 0x55894b0ee130 con 0x55894b0edc80 2024-04-26T07:54:38.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.878+0000 7f872b2b7640 1 -- 172.21.15.62:0/4083934724 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894b0ee330 con 0x55894b0ef190 2024-04-26T07:54:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872b2b7640 1 --2- 172.21.15.62:0/4083934724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0ef190 0x55894b0ed740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f871c00a520 tx=0x7f871c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1574f3170c70280 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872a2b5640 1 -- 172.21.15.62:0/4083934724 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c057070 con 0x55894b0ef190 2024-04-26T07:54:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872a2b5640 1 -- 172.21.15.62:0/4083934724 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c052570 con 0x55894b0ef190 2024-04-26T07:54:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872a2b5640 1 -- 172.21.15.62:0/4083934724 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c052870 con 0x55894b0ef190 2024-04-26T07:54:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872f525800 1 -- 172.21.15.62:0/4083934724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0ef190 msgr2=0x55894b0ed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872f525800 1 --2- 172.21.15.62:0/4083934724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0ef190 0x55894b0ed740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f871c00a520 tx=0x7f871c01d010 comp rx=0 tx=0).stop 2024-04-26T07:54:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872f525800 1 -- 172.21.15.62:0/4083934724 shutdown_connections 2024-04-26T07:54:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872f525800 1 --2- 172.21.15.62:0/4083934724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0ef190 0x55894b0ed740 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872f525800 1 -- 172.21.15.62:0/4083934724 >> 172.21.15.62:0/4083934724 conn(0x55894b174d40 msgr2=0x55894b177160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.880+0000 7f872f525800 1 -- 172.21.15.62:0/4083934724 shutdown_connections 2024-04-26T07:54:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.881+0000 7f872f525800 1 -- 172.21.15.62:0/4083934724 wait complete. 2024-04-26T07:54:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.893+0000 7f872f525800 1 Processor -- start 2024-04-26T07:54:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.893+0000 7f872f525800 1 -- start start 2024-04-26T07:54:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.893+0000 7f872f525800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b26cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.893+0000 7f872f525800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55894b0c4cf0 con 0x55894b0edc80 2024-04-26T07:54:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.894+0000 7f872b2b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b26cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.894+0000 7f872b2b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b26cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34176/0 (socket says 172.21.15.62:34176) 2024-04-26T07:54:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.894+0000 7f872b2b7640 1 -- 172.21.15.62:0/2757160557 learned_addr learned my addr 172.21.15.62:0/2757160557 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.894+0000 7f872b2b7640 1 -- 172.21.15.62:0/2757160557 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894b26d380 con 0x55894b0edc80 2024-04-26T07:54:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.894+0000 7f872b2b7640 1 --2- 172.21.15.62:0/2757160557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b26cdb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f871c00a520 tx=0x7f871c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07309d07f49ddaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.894+0000 7f861960a640 1 -- 172.21.15.62:0/2757160557 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c062070 con 0x55894b0edc80 2024-04-26T07:54:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.894+0000 7f861960a640 1 -- 172.21.15.62:0/2757160557 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c052850 con 0x55894b0edc80 2024-04-26T07:54:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.894+0000 7f861960a640 1 -- 172.21.15.62:0/2757160557 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c057040 con 0x55894b0edc80 2024-04-26T07:54:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 -- 172.21.15.62:0/2757160557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 msgr2=0x55894b26cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 --2- 172.21.15.62:0/2757160557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b26cdb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f871c00a520 tx=0x7f871c04c000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 -- 172.21.15.62:0/2757160557 shutdown_connections 2024-04-26T07:54:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 --2- 172.21.15.62:0/2757160557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b26cdb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 -- 172.21.15.62:0/2757160557 >> 172.21.15.62:0/2757160557 conn(0x55894b174d40 msgr2=0x55894b2686d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 -- 172.21.15.62:0/2757160557 shutdown_connections 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 -- 172.21.15.62:0/2757160557 wait complete. 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 Processor -- start 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.895+0000 7f872f525800 1 -- start start 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.896+0000 7f872f525800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b274810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.896+0000 7f872f525800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55894b184fa0 con 0x55894b0edc80 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.896+0000 7f872b2b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b274810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.896+0000 7f872b2b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b274810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34180/0 (socket says 172.21.15.62:34180) 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.896+0000 7f872b2b7640 1 -- 172.21.15.62:0/3849471457 learned_addr learned my addr 172.21.15.62:0/3849471457 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.896+0000 7f872b2b7640 1 -- 172.21.15.62:0/3849471457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894b274d50 con 0x55894b0edc80 2024-04-26T07:54:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.897+0000 7f872b2b7640 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b274810 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f871c005400 tx=0x7f871c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.897+0000 7f8617e07640 1 -- 172.21.15.62:0/3849471457 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c057050 con 0x55894b0edc80 2024-04-26T07:54:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.897+0000 7f8617e07640 1 -- 172.21.15.62:0/3849471457 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c067580 con 0x55894b0edc80 2024-04-26T07:54:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.897+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55894b274fe0 con 0x55894b0edc80 2024-04-26T07:54:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.897+0000 7f8617e07640 1 -- 172.21.15.62:0/3849471457 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c062040 con 0x55894b0edc80 2024-04-26T07:54:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.897+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894b277c40 con 0x55894b0edc80 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.897+0000 7f8617e07640 1 -- 172.21.15.62:0/3849471457 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f871c067a70 con 0x55894b0edc80 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.898+0000 7f8617e07640 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8610036eb0 0x7f8610039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.898+0000 7f8617e07640 1 -- 172.21.15.62:0/3849471457 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f871c08ec00 con 0x55894b0edc80 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.898+0000 7f872aab6640 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8610036eb0 0x7f8610039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.898+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b0ef190 0x55894b27ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.898+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b27bf40 con 0x55894b0ef190 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.898+0000 7f872bab8640 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b0ef190 0x55894b27ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.898+0000 7f872aab6640 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8610036eb0 0x7f8610039370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f87200013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.898+0000 7f872bab8640 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b0ef190 0x55894b27ba00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.899+0000 7f872bab8640 1 -- 172.21.15.62:0/3849471457 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f872400a4a0 con 0x55894b0ef190 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.899+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b278f90 con 0x55894b0ef190 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.899+0000 7f872bab8640 1 -- 172.21.15.62:0/3849471457 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f872400a4a0 con 0x55894b0ef190 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.899+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b27e210 0x55894b280600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.899+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b280ca0 con 0x55894b27e210 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.899+0000 7f872b2b7640 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b27e210 0x55894b280600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.900+0000 7f872b2b7640 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b27e210 0x55894b280600 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.900+0000 7f872b2b7640 1 -- 172.21.15.62:0/3849471457 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f871c064070 con 0x55894b27e210 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.900+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b27d1c0 con 0x55894b0ef190 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.900+0000 7f872bab8640 1 -- 172.21.15.62:0/3849471457 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f872400a4a0 con 0x55894b0ef190 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.900+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b27d660 con 0x55894b0ef190 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.901+0000 7f872bab8640 1 -- 172.21.15.62:0/3849471457 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f872400a4a0 con 0x55894b0ef190 2024-04-26T07:54:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.901+0000 7f872f525800 1 Processor -- start 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.901+0000 7f872f525800 1 -- start start 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.901+0000 7f872f525800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b28fdf0 0x55894b290210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.901+0000 7f872f525800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55894b06c170 con 0x55894b28fdf0 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.901+0000 7f872bab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b28fdf0 0x55894b290210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.901+0000 7f872bab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b28fdf0 0x55894b290210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34192/0 (socket says 172.21.15.62:34192) 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.902+0000 7f872bab8640 1 -- 172.21.15.62:0/982224323 learned_addr learned my addr 172.21.15.62:0/982224323 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.902+0000 7f872bab8640 1 -- 172.21.15.62:0/982224323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894b290750 con 0x55894b28fdf0 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.902+0000 7f872bab8640 1 --2- 172.21.15.62:0/982224323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b28fdf0 0x55894b290210 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55894b27c2e0 tx=0x7f8724018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.902+0000 7f8615602640 1 -- 172.21.15.62:0/982224323 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8724014450 con 0x55894b28fdf0 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.902+0000 7f8615602640 1 -- 172.21.15.62:0/982224323 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87240145f0 con 0x55894b28fdf0 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.902+0000 7f872f525800 1 -- 172.21.15.62:0/982224323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55894b2911c0 con 0x55894b28fdf0 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.902+0000 7f8615602640 1 -- 172.21.15.62:0/982224323 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87240148d0 con 0x55894b28fdf0 2024-04-26T07:54:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.902+0000 7f872f525800 1 -- 172.21.15.62:0/982224323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894b2916c0 con 0x55894b28fdf0 2024-04-26T07:54:38.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.903+0000 7f8615602640 1 -- 172.21.15.62:0/982224323 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8724011040 con 0x55894b28fdf0 2024-04-26T07:54:38.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.903+0000 7f8615602640 1 --2- 172.21.15.62:0/982224323 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8604036eb0 0x7f8604039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.903+0000 7f8615602640 1 -- 172.21.15.62:0/982224323 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f872401e070 con 0x55894b28fdf0 2024-04-26T07:54:38.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.903+0000 7f872b2b7640 1 --2- 172.21.15.62:0/982224323 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8604036eb0 0x7f8604039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.903+0000 7f872f525800 1 Processor -- start 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.903+0000 7f872b2b7640 1 --2- 172.21.15.62:0/982224323 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8604036eb0 0x7f8604039370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55894b27c340 tx=0x7f871c06ff90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f872f525800 1 -- start start 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f872f525800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b29d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f872f525800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55894b26d640 con 0x55894b29d160 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f872bab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b29d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f872bab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b29d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34196/0 (socket says 172.21.15.62:34196) 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f872bab8640 1 -- 172.21.15.62:0/3252538911 learned_addr learned my addr 172.21.15.62:0/3252538911 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f872bab8640 1 -- 172.21.15.62:0/3252538911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894b29db50 con 0x55894b29d160 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f872bab8640 1 --2- 172.21.15.62:0/3252538911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b29d580 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f872404d050 tx=0x7f8724011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a05a6eeca2b510 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f860effd640 1 -- 172.21.15.62:0/3252538911 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8724013cb0 con 0x55894b29d160 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f860effd640 1 -- 172.21.15.62:0/3252538911 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8724013e50 con 0x55894b29d160 2024-04-26T07:54:38.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.904+0000 7f860effd640 1 -- 172.21.15.62:0/3252538911 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8724014ba0 con 0x55894b29d160 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 -- 172.21.15.62:0/3252538911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 msgr2=0x55894b29d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 --2- 172.21.15.62:0/3252538911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b29d580 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f872404d050 tx=0x7f8724011970 comp rx=0 tx=0).stop 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 -- 172.21.15.62:0/3252538911 shutdown_connections 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 --2- 172.21.15.62:0/3252538911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b29d580 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 -- 172.21.15.62:0/3252538911 >> 172.21.15.62:0/3252538911 conn(0x55894b299430 msgr2=0x55894b297490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 -- 172.21.15.62:0/3252538911 shutdown_connections 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 -- 172.21.15.62:0/3252538911 wait complete. 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 Processor -- start 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 -- start start 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b2a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.905+0000 7f872f525800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55894b29e2e0 con 0x55894b29d160 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f872bab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b2a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f872bab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b2a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34204/0 (socket says 172.21.15.62:34204) 2024-04-26T07:54:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 learned_addr learned my addr 172.21.15.62:0/519657291 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894b2a4bc0 con 0x55894b29d160 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f872bab8640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b2a4680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f872403f040 tx=0x7f872404cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f860d7fa640 1 -- 172.21.15.62:0/519657291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f872403c070 con 0x55894b29d160 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f860d7fa640 1 -- 172.21.15.62:0/519657291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8724016940 con 0x55894b29d160 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55894b2a4e50 con 0x55894b29d160 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f860d7fa640 1 -- 172.21.15.62:0/519657291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8724022c90 con 0x55894b29d160 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.906+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894b2a7b00 con 0x55894b29d160 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.907+0000 7f860d7fa640 1 -- 172.21.15.62:0/519657291 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f87240133b0 con 0x55894b29d160 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.907+0000 7f860d7fa640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f85f4036e60 0x7f85f4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.907+0000 7f860d7fa640 1 -- 172.21.15.62:0/519657291 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f8724033030 con 0x55894b29d160 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.907+0000 7f872b2b7640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f85f4036e60 0x7f85f4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872b2b7640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f85f4036e60 0x7f85f4039320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f871c006700 tx=0x7f871c08b000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b2b03b0 0x55894b2b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2b2fc0 con 0x55894b2b03b0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872aab6640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b2b03b0 0x55894b2b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872aab6640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b2b03b0 0x55894b2b2870 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f872000f5f0 con 0x55894b2b03b0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872f525800 20 realm 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.908+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2af800 con 0x55894b2b03b0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f872000f5f0 con 0x55894b2b03b0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2b3ab0 con 0x55894b2b03b0 2024-04-26T07:54:38.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f872000f5f0 con 0x55894b2b03b0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2b4380 con 0x55894b2b03b0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f872000f5f0 con 0x55894b2b03b0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b2b4da0 0x55894b2b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.909+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2b7900 con 0x55894b2b4da0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.910+0000 7f872bab8640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b2b4da0 0x55894b2b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.910+0000 7f872bab8640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b2b4da0 0x55894b2b7190 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.910+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.910+0000 7f872f525800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.910+0000 7f872f525800 20 searching for the correct realm 2024-04-26T07:54:38.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.910+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55894b2b98b0 0x55894b2bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.910+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.910+0000 7f872b2b7640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55894b2b98b0 0x55894b2bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.911+0000 7f872b2b7640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55894b2b98b0 0x55894b2bbd70 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.911+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.911+0000 7f872b2b7640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f871c087040 0x7f871c08e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.911+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x7f871c087040 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.911+0000 7f872aab6640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f871c087040 0x7f871c08e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.912+0000 7f872aab6640 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f871c087040 0x7f871c08e3d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:38.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.912+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872000f5f0 con 0x7f871c087040 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.912+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.912+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.912+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b03b0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.912+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872000f5f0 con 0x55894b2b03b0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.912+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b03b0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.913+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.913+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.913+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.913+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.913+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.913+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x7f871c087040 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.913+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.913+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.914+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.914+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b03b0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.914+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.914+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.914+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.914+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b03b0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.915+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.915+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x7f871c087040 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.915+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.915+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.915+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.915+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.915+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.915+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.916+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.916+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.916+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.916+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.916+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.916+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b03b0 2024-04-26T07:54:38.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.916+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.916+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b03b0 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.917+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.917+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.917+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.917+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.917+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.917+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x7f871c087040 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.917+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.917+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b03b0 2024-04-26T07:54:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.918+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.918+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.918+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.918+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.918+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.918+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.919+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.919+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x7f871c087040 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.919+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.919+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b98b0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.919+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.919+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b4da0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.919+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.919+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x55894b2b03b0 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc440 con 0x7f871c087040 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2b82c0 con 0x55894b2b03b0 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2b7ed0 con 0x55894b2b03b0 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.920+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2b8bf0 con 0x55894b2b03b0 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 20 zone default found 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 4 Realm: () 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 20 zonegroup default 2024-04-26T07:54:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bc8c0 con 0x55894b2b4da0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.921+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2beb70 con 0x55894b2b98b0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bef10 con 0x55894b2b98b0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872f525800 20 started sync module instance, tier type = 2024-04-26T07:54:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872f525800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.922+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2be000 con 0x7f871c087040 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.923+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.923+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94048160048416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2be000 con 0x7f871c087040 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.923+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bf940 con 0x55894b2b03b0 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.924+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.924+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94048160052368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bf8f0 con 0x55894b2b03b0 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.924+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94048160048416] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.924+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bdb50 con 0x55894b2b98b0 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.925+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.925+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94048160056288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c0cb0 con 0x55894b2b98b0 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.925+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c16b0 con 0x7f871c087040 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.925+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94048160052368] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.926+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94048160056288] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.926+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.926+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94048160057344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bfd10 con 0x7f871c087040 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.926+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c1f80 con 0x55894b2b03b0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.927+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.927+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94048160062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c2350 con 0x55894b2b03b0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.927+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c2e50 con 0x55894b2b4da0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.927+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94048160057344] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.928+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94048160062080] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.929+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.929+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94048160065856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c1ea0 con 0x55894b2b4da0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.929+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c36f0 con 0x55894b2b4da0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.929+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94048160065856] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.930+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.930+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94048160059840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c1ea0 con 0x55894b2b4da0 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.930+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c3db0 con 0x55894b2b4da0 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94048160069776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c3db0 con 0x55894b2b4da0 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872f525800 20 add_watcher() i=0 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872f525800 20 add_watcher() i=1 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872f525800 20 add_watcher() i=2 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872f525800 20 add_watcher() i=3 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872f525800 20 add_watcher() i=4 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872f525800 20 add_watcher() i=5 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94048160059840] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.931+0000 7f872f525800 20 add_watcher() i=6 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.932+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94048160069776] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.932+0000 7f872f525800 20 add_watcher() i=7 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.932+0000 7f872f525800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.932+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c3240 con 0x55894b2b03b0 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.932+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.932+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94048160072096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c3240 con 0x55894b2b03b0 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.933+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94048160072096] v27'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.933+0000 7f85e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.933+0000 7f872f525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.933+0000 7f872f525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.933+0000 7f872f525800 5 note: GC not initialized 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.933+0000 7f85e0fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 20 Filter name: none 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f855a7fc640 20 reqs_thread_entry: start 2024-04-26T07:54:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2faa90 con 0x55894b2b03b0 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.934+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2fa5b0 con 0x7f871c087040 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:38.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 20 rados->read ofs=0 len=0 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b2fe2f0 con 0x55894b2b03b0 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(64 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.935+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b302aa0 con 0x55894b2b4da0 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.936+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(65 fud.buckets [call] v27'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.937+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b3089a0 con 0x55894b2b03b0 2024-04-26T07:54:38.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(66 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f872002b040 con 0x55894b2b03b0 2024-04-26T07:54:38.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:38.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872f525800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872f525800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872f525800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1, ofs0, ns] 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94048160311728 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b302ed0 con 0x55894b2b4da0 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== watch-notify(notify (1) cookie 94048160065856 notify 115964116999 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55894b2a7b00 con 0x55894b2b4da0 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f860effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94048160065856 notifier 4515 bl.length()=752 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f860effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f860effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f860effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f860effd640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f85f0003ea0 con 0x55894b2b4da0 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(67 notify.5 [notify cookie 94048160311728 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.938+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.939+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== watch-notify(notify_complete (2) cookie 94048160311728 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55894b2a4e50 con 0x55894b2b4da0 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.939+0000 7f872f525800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_sources= new_sources= 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.939+0000 7f872f525800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential sources added=[] removed=[] 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.939+0000 7f872f525800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_dests= new_dests= 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.939+0000 7f872f525800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential dests added=[] removed=[] 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.939+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b3071c0 con 0x7f871c087040 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.940+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(69 foo.buckets [call] v27'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f872002b040 con 0x7f871c087040 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.940+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b3081d0 con 0x7f871c087040 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f8720047040 con 0x7f871c087040 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f872f525800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f872f525800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f872f525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94048160311696 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55894b307670 con 0x55894b2b4da0 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== watch-notify(notify (1) cookie 94048160059840 notify 115964117000 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55894b2a4bc0 con 0x55894b2b4da0 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f860e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 94048160059840 notifier 4515 bl.length()=314 2024-04-26T07:54:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f860e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f860e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f860e7fc640 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8560003400 con 0x55894b2b4da0 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.941+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(71 notify.6 [notify cookie 94048160311696 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.942+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.942+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== watch-notify(notify_complete (2) cookie 94048160311696 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55894b29db50 con 0x55894b2b4da0 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.943+0000 7f85e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.943+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94048160072096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2ff540 con 0x55894b2b03b0 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.944+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94048160072096] v27'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8720047040 con 0x55894b2b03b0 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.944+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94048160048416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c4150 con 0x7f871c087040 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.945+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94048160048416] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8720047040 con 0x7f871c087040 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.945+0000 7f872f525800 20 remove_watcher() i=0 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.945+0000 7f872f525800 2 removed watcher, disabling cache 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.945+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94048160052368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2be500 con 0x55894b2b03b0 2024-04-26T07:54:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.946+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94048160052368] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8720047040 con 0x55894b2b03b0 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.946+0000 7f872f525800 20 remove_watcher() i=1 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.946+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94048160056288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2bf490 con 0x55894b2b98b0 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.947+0000 7f872b2b7640 1 -- 172.21.15.62:0/519657291 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94048160056288] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c097030 con 0x55894b2b98b0 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.947+0000 7f872f525800 20 remove_watcher() i=2 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.947+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94048160057344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c03e0 con 0x7f871c087040 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.948+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94048160057344] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8720047040 con 0x7f871c087040 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.948+0000 7f872f525800 20 remove_watcher() i=3 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.948+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94048160062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2be500 con 0x55894b2b03b0 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.949+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94048160062080] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8720047040 con 0x55894b2b03b0 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.949+0000 7f872f525800 20 remove_watcher() i=4 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.949+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94048160065856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c1a80 con 0x55894b2b4da0 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.950+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94048160065856] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.950+0000 7f872f525800 20 remove_watcher() i=5 2024-04-26T07:54:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.950+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94048160059840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c1a80 con 0x55894b2b4da0 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.951+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94048160059840] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.951+0000 7f872f525800 20 remove_watcher() i=6 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.951+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94048160069776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55894b2c11c0 con 0x55894b2b4da0 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872bab8640 1 -- 172.21.15.62:0/519657291 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94048160069776] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f872404ed70 con 0x55894b2b4da0 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 20 remove_watcher() i=7 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b2b4da0 msgr2=0x55894b2b7190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b2b4da0 0x55894b2b7190 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b2b03b0 msgr2=0x55894b2b2870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b2b03b0 0x55894b2b2870 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f871c087040 msgr2=0x7f871c08e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f871c087040 0x7f871c08e3d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55894b2b98b0 msgr2=0x55894b2bbd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55894b2b98b0 0x55894b2bbd70 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f85f4036e60 msgr2=0x7f85f4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f85f4036e60 0x7f85f4039320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f871c006700 tx=0x7f871c08b000 comp rx=0 tx=0).stop 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 msgr2=0x55894b2a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/519657291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b29d160 0x55894b2a4680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f872403f040 tx=0x7f872404cfb0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872aab6640 1 -- 172.21.15.62:0/519657291 reap_dead start 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 shutdown_connections 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 >> 172.21.15.62:0/519657291 conn(0x55894b299430 msgr2=0x55894b296a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 shutdown_connections 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/519657291 wait complete. 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/982224323 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8604036eb0 msgr2=0x7f8604039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/982224323 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8604036eb0 0x7f8604039370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55894b27c340 tx=0x7f871c06ff90 comp rx=0 tx=0).stop 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/982224323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b28fdf0 msgr2=0x55894b290210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/982224323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b28fdf0 0x55894b290210 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55894b27c2e0 tx=0x7f8724018830 comp rx=0 tx=0).stop 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/982224323 shutdown_connections 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/982224323 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8604036eb0 0x7f8604039370 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 --2- 172.21.15.62:0/982224323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b28fdf0 0x55894b290210 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/982224323 >> 172.21.15.62:0/982224323 conn(0x55894b283e90 msgr2=0x55894b284290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/982224323 shutdown_connections 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.952+0000 7f872f525800 1 -- 172.21.15.62:0/982224323 wait complete. 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b27e210 msgr2=0x55894b280600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b27e210 0x55894b280600 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b0ef190 msgr2=0x55894b27ba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b0ef190 0x55894b27ba00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8610036eb0 msgr2=0x7f8610039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8610036eb0 0x7f8610039370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f87200013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 msgr2=0x55894b274810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b274810 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f871c005400 tx=0x7f871c002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 shutdown_connections 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55894b0ef190 0x55894b27ba00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55894b27e210 0x55894b280600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8610036eb0 0x7f8610039370 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 --2- 172.21.15.62:0/3849471457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55894b0edc80 0x55894b274810 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:38.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 >> 172.21.15.62:0/3849471457 conn(0x55894b174d40 msgr2=0x55894b266ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:38.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 shutdown_connections 2024-04-26T07:54:38.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:38.953+0000 7f872f525800 1 -- 172.21.15.62:0/3849471457 wait complete. 2024-04-26T07:54:38.965 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T07:54:38.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T07:54:38.965 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T07:54:39.011 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.012+0000 7f75dc80e800 1 Processor -- start 2024-04-26T07:54:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.012+0000 7f75dc80e800 1 -- start start 2024-04-26T07:54:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75dc80e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56271c435ae0 0x56271c43e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75dc80e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56271c3a88d0 con 0x56271c433fa0 2024-04-26T07:54:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75dc80e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x56271c2d7e20 con 0x56271c435ae0 2024-04-26T07:54:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75d9b0c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56271c435ae0 0x56271c43e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75d9b0c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56271c435ae0 0x56271c43e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34212/0 (socket says 172.21.15.62:34212) 2024-04-26T07:54:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75da30d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x56271c433fa0 0x56271c4343c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36760/0 (socket says 172.21.15.62:36760) 2024-04-26T07:54:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75d9b0c640 1 -- 172.21.15.62:0/84852922 learned_addr learned my addr 172.21.15.62:0/84852922 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75d9b0c640 1 -- 172.21.15.62:0/84852922 >> v1:172.21.15.1:6789/0 conn(0x56271c433fa0 legacy=0x56271c4343c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.013+0000 7f75d9b0c640 1 -- 172.21.15.62:0/84852922 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271c43fb30 con 0x56271c435ae0 2024-04-26T07:54:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.015+0000 7f75d9b0c640 1 --2- 172.21.15.62:0/84852922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c435ae0 0x56271c43e5e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f75d000a520 tx=0x7f75d001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9deb0322688bfd00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.015+0000 7f75d930b640 1 -- 172.21.15.62:0/84852922 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0057070 con 0x56271c435ae0 2024-04-26T07:54:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.015+0000 7f75d930b640 1 -- 172.21.15.62:0/84852922 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d0052570 con 0x56271c435ae0 2024-04-26T07:54:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.015+0000 7f75d930b640 1 -- 172.21.15.62:0/84852922 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0052870 con 0x56271c435ae0 2024-04-26T07:54:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.016+0000 7f75dc80e800 1 -- 172.21.15.62:0/84852922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c435ae0 msgr2=0x56271c43e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.016+0000 7f75dc80e800 1 --2- 172.21.15.62:0/84852922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c435ae0 0x56271c43e5e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f75d000a520 tx=0x7f75d001d010 comp rx=0 tx=0).stop 2024-04-26T07:54:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.016+0000 7f75dc80e800 1 -- 172.21.15.62:0/84852922 shutdown_connections 2024-04-26T07:54:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.016+0000 7f75dc80e800 1 --2- 172.21.15.62:0/84852922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c435ae0 0x56271c43e5e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.016+0000 7f75dc80e800 1 -- 172.21.15.62:0/84852922 >> 172.21.15.62:0/84852922 conn(0x56271c42fba0 msgr2=0x56271c431fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.016+0000 7f75dc80e800 1 -- 172.21.15.62:0/84852922 shutdown_connections 2024-04-26T07:54:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.016+0000 7f75dc80e800 1 -- 172.21.15.62:0/84852922 wait complete. 2024-04-26T07:54:39.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.032+0000 7f75dc80e800 1 Processor -- start 2024-04-26T07:54:39.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.033+0000 7f75dc80e800 1 -- start start 2024-04-26T07:54:39.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.033+0000 7f75dc80e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c528fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.033+0000 7f75dc80e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56271c380cd0 con 0x56271c433fa0 2024-04-26T07:54:39.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.033+0000 7f75da30d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c528fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.033+0000 7f75da30d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c528fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34222/0 (socket says 172.21.15.62:34222) 2024-04-26T07:54:39.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.033+0000 7f75da30d640 1 -- 172.21.15.62:0/3578893448 learned_addr learned my addr 172.21.15.62:0/3578893448 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.033+0000 7f75da30d640 1 -- 172.21.15.62:0/3578893448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271c529590 con 0x56271c433fa0 2024-04-26T07:54:39.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.034+0000 7f75da30d640 1 --2- 172.21.15.62:0/3578893448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c528fc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f75cc001e90 tx=0x7f75cc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854c175b77f4e739 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.034+0000 7f74c8608640 1 -- 172.21.15.62:0/3578893448 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75cc00e5c0 con 0x56271c433fa0 2024-04-26T07:54:39.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.034+0000 7f74c8608640 1 -- 172.21.15.62:0/3578893448 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc006070 con 0x56271c433fa0 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.034+0000 7f74c8608640 1 -- 172.21.15.62:0/3578893448 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75cc00e890 con 0x56271c433fa0 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 -- 172.21.15.62:0/3578893448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 msgr2=0x56271c528fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 --2- 172.21.15.62:0/3578893448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c528fc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f75cc001e90 tx=0x7f75cc00b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 -- 172.21.15.62:0/3578893448 shutdown_connections 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 --2- 172.21.15.62:0/3578893448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c528fc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 -- 172.21.15.62:0/3578893448 >> 172.21.15.62:0/3578893448 conn(0x56271c42fba0 msgr2=0x56271c5248e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 -- 172.21.15.62:0/3578893448 shutdown_connections 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 -- 172.21.15.62:0/3578893448 wait complete. 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 Processor -- start 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 -- start start 2024-04-26T07:54:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c535050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75dc80e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56271c43edf0 con 0x56271c433fa0 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75da30d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c535050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75da30d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c535050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34226/0 (socket says 172.21.15.62:34226) 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.035+0000 7f75da30d640 1 -- 172.21.15.62:0/1692320723 learned_addr learned my addr 172.21.15.62:0/1692320723 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.036+0000 7f75da30d640 1 -- 172.21.15.62:0/1692320723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271c535590 con 0x56271c433fa0 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.036+0000 7f75da30d640 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c535050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00c010 tx=0x7f75cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.036+0000 7f74c6e05640 1 -- 172.21.15.62:0/1692320723 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75cc00f8d0 con 0x56271c433fa0 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.036+0000 7f74c6e05640 1 -- 172.21.15.62:0/1692320723 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc00fa90 con 0x56271c433fa0 2024-04-26T07:54:39.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.036+0000 7f74c6e05640 1 -- 172.21.15.62:0/1692320723 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75cc00fdb0 con 0x56271c433fa0 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.036+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56271c535820 con 0x56271c433fa0 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.036+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56271c538370 con 0x56271c433fa0 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.037+0000 7f74c6e05640 1 -- 172.21.15.62:0/1692320723 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f75cc017070 con 0x56271c433fa0 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.037+0000 7f74c6e05640 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74c0036eb0 0x7f74c0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.037+0000 7f74c6e05640 1 -- 172.21.15.62:0/1692320723 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f75cc015020 con 0x56271c433fa0 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.037+0000 7f75d9b0c640 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74c0036eb0 0x7f74c0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.037+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c435ae0 0x56271c53c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.037+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c53c700 con 0x56271c435ae0 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.037+0000 7f75dab0e640 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c435ae0 0x56271c53c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.038+0000 7f75d9b0c640 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74c0036eb0 0x7f74c0039370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f75d0054000 tx=0x7f75d004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.038+0000 7f75dab0e640 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c435ae0 0x56271c53c130 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.038+0000 7f75dab0e640 1 -- 172.21.15.62:0/1692320723 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d400a4a0 con 0x56271c435ae0 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.038+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c539700 con 0x56271c435ae0 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.038+0000 7f75dab0e640 1 -- 172.21.15.62:0/1692320723 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75d400a4a0 con 0x56271c435ae0 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.038+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c53ea30 0x56271c540e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.038+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c541510 con 0x56271c53ea30 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.038+0000 7f75da30d640 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c53ea30 0x56271c540e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.039+0000 7f75da30d640 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c53ea30 0x56271c540e20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.039+0000 7f75da30d640 1 -- 172.21.15.62:0/1692320723 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c53ea30 2024-04-26T07:54:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.039+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c53d9e0 con 0x56271c435ae0 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.039+0000 7f75dab0e640 1 -- 172.21.15.62:0/1692320723 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75d400a4a0 con 0x56271c435ae0 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.039+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c53dec0 con 0x56271c435ae0 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.040+0000 7f75dab0e640 1 -- 172.21.15.62:0/1692320723 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f75d400a4a0 con 0x56271c435ae0 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.040+0000 7f75dc80e800 1 Processor -- start 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.040+0000 7f75dc80e800 1 -- start start 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.040+0000 7f75dc80e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c550680 0x56271c550aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.040+0000 7f75dc80e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56271c328170 con 0x56271c550680 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.040+0000 7f75dab0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c550680 0x56271c550aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.040+0000 7f75dab0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c550680 0x56271c550aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34242/0 (socket says 172.21.15.62:34242) 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.040+0000 7f75dab0e640 1 -- 172.21.15.62:0/894569337 learned_addr learned my addr 172.21.15.62:0/894569337 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.041+0000 7f75dab0e640 1 -- 172.21.15.62:0/894569337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271c550fe0 con 0x56271c550680 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.041+0000 7f75dab0e640 1 --2- 172.21.15.62:0/894569337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c550680 0x56271c550aa0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x56271c53cae0 tx=0x7f75d4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.041+0000 7f74bffff640 1 -- 172.21.15.62:0/894569337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4014450 con 0x56271c550680 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.041+0000 7f74bffff640 1 -- 172.21.15.62:0/894569337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d4014610 con 0x56271c550680 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.041+0000 7f75dc80e800 1 -- 172.21.15.62:0/894569337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56271c551a50 con 0x56271c550680 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.041+0000 7f74bffff640 1 -- 172.21.15.62:0/894569337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4014930 con 0x56271c550680 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.041+0000 7f75dc80e800 1 -- 172.21.15.62:0/894569337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56271c551f50 con 0x56271c550680 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f74bffff640 1 -- 172.21.15.62:0/894569337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f75d4011040 con 0x56271c550680 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f74bffff640 1 --2- 172.21.15.62:0/894569337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74b4036eb0 0x7f74b4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f74bffff640 1 -- 172.21.15.62:0/894569337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f75d401e070 con 0x56271c550680 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f75da30d640 1 --2- 172.21.15.62:0/894569337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74b4036eb0 0x7f74b4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f75dc80e800 1 Processor -- start 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f75dc80e800 1 -- start start 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f75dc80e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c55ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f75dc80e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56271c529910 con 0x56271c55d990 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f75da30d640 1 --2- 172.21.15.62:0/894569337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74b4036eb0 0x7f74b4039370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x56271c53cb80 tx=0x7f75cc028f70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.042+0000 7f75dab0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c55ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f75dab0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c55ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34256/0 (socket says 172.21.15.62:34256) 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f75dab0e640 1 -- 172.21.15.62:0/3051900106 learned_addr learned my addr 172.21.15.62:0/3051900106 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f75dab0e640 1 -- 172.21.15.62:0/3051900106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271c55e380 con 0x56271c55d990 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f75dab0e640 1 --2- 172.21.15.62:0/3051900106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c55ddb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f75d404cf70 tx=0x7f75d40138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4cded19a3ff77d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f74bdffb640 1 -- 172.21.15.62:0/3051900106 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4046070 con 0x56271c55d990 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f74bdffb640 1 -- 172.21.15.62:0/3051900106 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d4013dd0 con 0x56271c55d990 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f74bdffb640 1 -- 172.21.15.62:0/3051900106 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4014c00 con 0x56271c55d990 2024-04-26T07:54:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f75dc80e800 1 -- 172.21.15.62:0/3051900106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 msgr2=0x56271c55ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.043+0000 7f75dc80e800 1 --2- 172.21.15.62:0/3051900106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c55ddb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f75d404cf70 tx=0x7f75d40138f0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 -- 172.21.15.62:0/3051900106 shutdown_connections 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 --2- 172.21.15.62:0/3051900106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c55ddb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 -- 172.21.15.62:0/3051900106 >> 172.21.15.62:0/3051900106 conn(0x56271c559c60 msgr2=0x56271c557cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 -- 172.21.15.62:0/3051900106 shutdown_connections 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 -- 172.21.15.62:0/3051900106 wait complete. 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 Processor -- start 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 -- start start 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c564eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dc80e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56271c55eb10 con 0x56271c55d990 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dab0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c564eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dab0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c564eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34264/0 (socket says 172.21.15.62:34264) 2024-04-26T07:54:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 learned_addr learned my addr 172.21.15.62:0/2296494350 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.044+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271c5653f0 con 0x56271c55d990 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.045+0000 7f75dab0e640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c564eb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f75d4048010 tx=0x7f75d404cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.045+0000 7f74abfff640 1 -- 172.21.15.62:0/2296494350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d403b070 con 0x56271c55d990 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.045+0000 7f74abfff640 1 -- 172.21.15.62:0/2296494350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d4022e20 con 0x56271c55d990 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.045+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56271c5656e0 con 0x56271c55d990 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.045+0000 7f74abfff640 1 -- 172.21.15.62:0/2296494350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4046040 con 0x56271c55d990 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.045+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56271c568330 con 0x56271c55d990 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.046+0000 7f74abfff640 1 -- 172.21.15.62:0/2296494350 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f75d402b350 con 0x56271c55d990 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.046+0000 7f74abfff640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74a4036e10 0x7f74a40392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.046+0000 7f74abfff640 1 -- 172.21.15.62:0/2296494350 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f75d4033070 con 0x56271c55d990 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.046+0000 7f75da30d640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74a4036e10 0x7f74a40392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.046+0000 7f75da30d640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74a4036e10 0x7f74a40392d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75cc000fb0 tx=0x7f75cc031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.046+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.046+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c570bf0 0x56271c5730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.046+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c573800 con 0x56271c570bf0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75d9b0c640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c570bf0 0x56271c5730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75d9b0c640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c570bf0 0x56271c5730b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75dc80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75dc80e800 20 realm 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c573bd0 con 0x56271c570bf0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75dc80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75dc80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.047+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c5744a0 con 0x56271c570bf0 2024-04-26T07:54:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dc80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c574840 con 0x56271c570bf0 2024-04-26T07:54:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dc80e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c5755a0 0x56271c577990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c577fa0 con 0x56271c5755a0 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dab0e640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c5755a0 0x56271c577990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.048+0000 7f75dab0e640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c5755a0 0x56271c577990 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.049+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.049+0000 7f75dc80e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.049+0000 7f75dc80e800 20 searching for the correct realm 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.049+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56271c579f70 0x56271c57c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.049+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.049+0000 7f75da30d640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56271c579f70 0x56271c57c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.049+0000 7f75da30d640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56271c579f70 0x56271c57c430 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.050+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.050+0000 7f75da30d640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f75cc00f070 0x7f75cc019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.050+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x7f75cc00f070 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.050+0000 7f75d9b0c640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f75cc00f070 0x7f75cc019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.050+0000 7f75d9b0c640 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f75cc00f070 0x7f75cc019860 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.050+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.050+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.051+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.051+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c570bf0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.051+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.051+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c570bf0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.051+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.051+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.051+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.051+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.052+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.052+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x7f75cc00f070 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.052+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.052+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.052+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.052+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c570bf0 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.052+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.052+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.053+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.053+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c570bf0 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.053+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.053+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x7f75cc00f070 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.053+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.053+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.054+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.054+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.054+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.054+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.054+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.054+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.054+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.054+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.055+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.055+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c570bf0 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.055+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.055+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c570bf0 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.055+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.055+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.056+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.056+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.056+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.056+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x7f75cc00f070 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.056+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.056+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c570bf0 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.056+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.056+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.057+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.057+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.057+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.057+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.057+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.057+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x7f75cc00f070 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.057+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.057+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c579f70 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.058+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.058+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c5755a0 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.058+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.058+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x56271c570bf0 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.058+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.058+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cb00 con 0x7f75cc00f070 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c578960 con 0x56271c570bf0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c5785a0 con 0x56271c570bf0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c579300 con 0x56271c570bf0 2024-04-26T07:54:39.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 zone default found 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 4 Realm: () 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 zonegroup default 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.059+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c57cfa0 con 0x56271c5755a0 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c57f270 con 0x56271c579f70 2024-04-26T07:54:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c57f610 con 0x56271c579f70 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 20 started sync module instance, tier type = 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.060+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c57e6b0 con 0x7f75cc00f070 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.061+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.061+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725979235088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c57ed70 con 0x7f75cc00f070 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.062+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c57ffd0 con 0x56271c570bf0 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.062+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725979235088] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.063+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.063+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725979236384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c57ffd0 con 0x56271c570bf0 2024-04-26T07:54:39.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.063+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c580a60 con 0x56271c579f70 2024-04-26T07:54:39.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.064+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.064+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725979243824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c581330 con 0x56271c579f70 2024-04-26T07:54:39.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.064+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c581dd0 con 0x7f75cc00f070 2024-04-26T07:54:39.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.064+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725979236384] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.065+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725979243824] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.065+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.065+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725979246208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c57fb20 con 0x7f75cc00f070 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.065+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c582670 con 0x56271c570bf0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.066+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.066+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725979251056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c582590 con 0x56271c570bf0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.067+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c583570 con 0x56271c5755a0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.067+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725979246208] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.068+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725979251056] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.068+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.068+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725979253344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c583080 con 0x56271c5755a0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.068+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c583e40 con 0x56271c5755a0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.069+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.069+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725979256912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c584120 con 0x56271c5755a0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.069+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c584ae0 con 0x56271c5755a0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.069+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725979253344] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725979256912] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725979257968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c584090 con 0x56271c5755a0 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dc80e800 20 add_watcher() i=0 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dc80e800 20 add_watcher() i=1 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dc80e800 20 add_watcher() i=2 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dc80e800 20 add_watcher() i=3 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dc80e800 20 add_watcher() i=4 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dc80e800 20 add_watcher() i=5 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.070+0000 7f75dc80e800 20 add_watcher() i=6 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.071+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725979257968] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.071+0000 7f75dc80e800 20 add_watcher() i=7 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.071+0000 7f75dc80e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.071+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c587b10 con 0x56271c570bf0 2024-04-26T07:54:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.072+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.072+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725979260464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c584f70 con 0x56271c570bf0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.073+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725979260464] v27'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.073+0000 7f7490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.073+0000 7f75dc80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.073+0000 7f75dc80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.073+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c590500 con 0x56271c570bf0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.074+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.074+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c590bd0 con 0x56271c5755a0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.075+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.075+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c590bd0 con 0x56271c579f70 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.076+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.076+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c591670 con 0x56271c570bf0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.077+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'122 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.077+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c58e300 con 0x7f75cc00f070 2024-04-26T07:54:39.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.078+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.078+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c58e300 con 0x56271c579f70 2024-04-26T07:54:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.079+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.079+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c591f80 con 0x56271c570bf0 2024-04-26T07:54:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.080+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.080+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x56271c5755a0 2024-04-26T07:54:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.081+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.081+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x7f75cc00f070 2024-04-26T07:54:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.082+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.082+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x56271c579f70 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.083+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.083+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x7f75cc00f070 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.084+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.084+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x56271c5755a0 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.086+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.086+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x7f75cc00f070 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.087+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.087+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x56271c5755a0 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.088+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.088+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x56271c570bf0 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.089+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.089+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c592430 con 0x56271c579f70 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.090+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.090+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5924c0 con 0x7f75cc00f070 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.091+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.091+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5924c0 con 0x56271c579f70 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.092+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.092+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5924c0 con 0x56271c570bf0 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.093+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.093+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5924c0 con 0x56271c570bf0 2024-04-26T07:54:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.094+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.094+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5924c0 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.095+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.095+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x7f75cc00f070 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.096+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.096+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.097+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.097+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.098+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.098+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.099+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.099+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c579f70 2024-04-26T07:54:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.101+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.102+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c5755a0 2024-04-26T07:54:39.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.103+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.103+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c579f70 2024-04-26T07:54:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.104+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.104+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c5755a0 2024-04-26T07:54:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.105+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.105+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c579f70 2024-04-26T07:54:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.106+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.106+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x56271c5755a0 2024-04-26T07:54:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.107+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.108+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5929c0 con 0x7f75cc00f070 2024-04-26T07:54:39.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.108+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f740b7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:39.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f75dc80e800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f75dc80e800 20 Filter name: none 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f74097fa640 20 reqs_thread_entry: start 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f75dc80e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f75dc80e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c5bd770 con 0x56271c5755a0 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.109+0000 7f75dc80e800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.110+0000 7f75dc80e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.110+0000 7f75dc80e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.110+0000 7f75dc80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.110+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c5c0200 con 0x56271c5755a0 2024-04-26T07:54:39.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.110+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.110+0000 7f75dc80e800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T07:54:39.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.110+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5be1e0 con 0x56271c5755a0 2024-04-26T07:54:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.111+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v27'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.111+0000 7f75dc80e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T07:54:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.111+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94725979499760 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c5c0870 con 0x56271c579f70 2024-04-26T07:54:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.111+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== watch-notify(notify (1) cookie 94725979243824 notify 115964116995 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56271c58de50 con 0x56271c579f70 2024-04-26T07:54:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.111+0000 7f74bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94725979243824 notifier 4522 bl.length()=170 2024-04-26T07:54:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.111+0000 7f74bdffb640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f74a0003d60 con 0x56271c579f70 2024-04-26T07:54:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.111+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(97 notify.2 [notify cookie 94725979499760 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.112+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.112+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== watch-notify(notify_complete (2) cookie 94725979499760 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56271c568330 con 0x56271c579f70 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.112+0000 7f75dc80e800 10 removing email index: 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.112+0000 7f75dc80e800 10 removing user buckets index 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.112+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5c07f0 con 0x56271c5755a0 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(99 fud.buckets [delete] v27'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f75dc80e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94725979506672 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c5bfd00 con 0x56271c5755a0 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== watch-notify(notify (1) cookie 94725979256912 notify 115964117001 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56271c58e950 con 0x56271c5755a0 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f74bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94725979256912 notifier 4522 bl.length()=160 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f74bd7fa640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f74100032c0 con 0x56271c5755a0 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(100 notify.6 [notify cookie 94725979506672 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.113+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== watch-notify(notify_complete (2) cookie 94725979506672 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56271c5656e0 con 0x56271c5755a0 2024-04-26T07:54:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.114+0000 7f75dc80e800 10 removing user index: fud 2024-04-26T07:54:39.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.114+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5c07f0 con 0x56271c5755a0 2024-04-26T07:54:39.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.114+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== osd_op_reply(102 fud [call,call,delete] v27'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.114+0000 7f75dc80e800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.115+0000 7f75dc80e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.115+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94725979506672 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56271c5becf0 con 0x56271c5755a0 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.115+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== watch-notify(notify (1) cookie 94725979253344 notify 115964117002 ret 0) ==== 194+0+0 (crc 0 0 0) 0x56271c5656e0 con 0x56271c5755a0 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.115+0000 7f74bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94725979253344 notifier 4522 bl.length()=152 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.115+0000 7f74bdffb640 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f74a0003d60 con 0x56271c5755a0 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.115+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(103 notify.5 [notify cookie 94725979506672 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.115+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.115+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== watch-notify(notify_complete (2) cookie 94725979506672 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56271c5653f0 con 0x56271c5755a0 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.116+0000 7f7490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.116+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725979260464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5c07f0 con 0x56271c570bf0 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.117+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94725979260464] v27'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.117+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725979235088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5c07f0 con 0x7f75cc00f070 2024-04-26T07:54:39.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.118+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94725979235088] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.118+0000 7f75dc80e800 20 remove_watcher() i=0 2024-04-26T07:54:39.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.118+0000 7f75dc80e800 2 removed watcher, disabling cache 2024-04-26T07:54:39.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.118+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725979236384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5c07f0 con 0x56271c570bf0 2024-04-26T07:54:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.119+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94725979236384] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.119+0000 7f75dc80e800 20 remove_watcher() i=1 2024-04-26T07:54:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.119+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725979243824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c5c07f0 con 0x56271c579f70 2024-04-26T07:54:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.120+0000 7f75da30d640 1 -- 172.21.15.62:0/2296494350 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94725979243824] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75cc02e070 con 0x56271c579f70 2024-04-26T07:54:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.120+0000 7f75dc80e800 20 remove_watcher() i=2 2024-04-26T07:54:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.120+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725979246208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c580530 con 0x7f75cc00f070 2024-04-26T07:54:39.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.121+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94725979246208] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x7f75cc00f070 2024-04-26T07:54:39.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.121+0000 7f75dc80e800 20 remove_watcher() i=3 2024-04-26T07:54:39.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.121+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725979251056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c580530 con 0x56271c570bf0 2024-04-26T07:54:39.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.122+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94725979251056] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d005a040 con 0x56271c570bf0 2024-04-26T07:54:39.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.122+0000 7f75dc80e800 20 remove_watcher() i=4 2024-04-26T07:54:39.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.122+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725979253344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c582170 con 0x56271c5755a0 2024-04-26T07:54:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.123+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94725979253344] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.123+0000 7f75dc80e800 20 remove_watcher() i=5 2024-04-26T07:54:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.123+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725979256912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c580530 con 0x56271c5755a0 2024-04-26T07:54:39.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.124+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94725979256912] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.124+0000 7f75dc80e800 20 remove_watcher() i=6 2024-04-26T07:54:39.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.124+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725979257968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56271c582170 con 0x56271c5755a0 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dab0e640 1 -- 172.21.15.62:0/2296494350 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94725979257968] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d402a070 con 0x56271c5755a0 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 20 remove_watcher() i=7 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c5755a0 msgr2=0x56271c577990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c5755a0 0x56271c577990 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c570bf0 msgr2=0x56271c5730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c570bf0 0x56271c5730b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f75cc00f070 msgr2=0x7f75cc019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f75cc00f070 0x7f75cc019860 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56271c579f70 msgr2=0x56271c57c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56271c579f70 0x56271c57c430 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74a4036e10 msgr2=0x7f74a40392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74a4036e10 0x7f74a40392d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75cc000fb0 tx=0x7f75cc031000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75d9b0c640 1 -- 172.21.15.62:0/2296494350 reap_dead start 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 msgr2=0x56271c564eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.125+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c564eb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f75d4048010 tx=0x7f75d404cf00 comp rx=0 tx=0).stop 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 shutdown_connections 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 --2- 172.21.15.62:0/2296494350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c55d990 0x56271c564eb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 >> 172.21.15.62:0/2296494350 conn(0x56271c559c60 msgr2=0x56271c557c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 shutdown_connections 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/2296494350 wait complete. 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/894569337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74b4036eb0 msgr2=0x7f74b4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 --2- 172.21.15.62:0/894569337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74b4036eb0 0x7f74b4039370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x56271c53cb80 tx=0x7f75cc028f70 comp rx=0 tx=0).stop 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/894569337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c550680 msgr2=0x56271c550aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 --2- 172.21.15.62:0/894569337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c550680 0x56271c550aa0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x56271c53cae0 tx=0x7f75d4018830 comp rx=0 tx=0).stop 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/894569337 shutdown_connections 2024-04-26T07:54:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 --2- 172.21.15.62:0/894569337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74b4036eb0 0x7f74b4039370 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 --2- 172.21.15.62:0/894569337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c550680 0x56271c550aa0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/894569337 >> 172.21.15.62:0/894569337 conn(0x56271c544720 msgr2=0x56271c544b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/894569337 shutdown_connections 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/894569337 wait complete. 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c53ea30 msgr2=0x56271c540e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c53ea30 0x56271c540e20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c435ae0 msgr2=0x56271c53c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.126+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c435ae0 0x56271c53c130 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74c0036eb0 msgr2=0x7f74c0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74c0036eb0 0x7f74c0039370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f75d0054000 tx=0x7f75d004e000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 msgr2=0x56271c535050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c535050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00c010 tx=0x7f75cc000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 shutdown_connections 2024-04-26T07:54:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56271c435ae0 0x56271c53c130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56271c53ea30 0x56271c540e20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f74c0036eb0 0x7f74c0039370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 --2- 172.21.15.62:0/1692320723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271c433fa0 0x56271c535050 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 >> 172.21.15.62:0/1692320723 conn(0x56271c42fba0 msgr2=0x56271c5230e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 shutdown_connections 2024-04-26T07:54:39.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.127+0000 7f75dc80e800 1 -- 172.21.15.62:0/1692320723 wait complete. 2024-04-26T07:54:39.134 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T07:54:39.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T07:54:39.134 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-26T07:54:39.189 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:39.189 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.191+0000 7f74a2f2f800 1 Processor -- start 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.191+0000 7f74a2f2f800 1 -- start start 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.191+0000 7f74a2f2f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5585dbc816e0 0x5585dbc81b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.191+0000 7f74a2f2f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585dbc82180 con 0x5585dbc82850 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.192+0000 7f74a2f2f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5585dbb23e20 con 0x5585dbc816e0 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.192+0000 7f749ebae640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5585dbc816e0 0x5585dbc81b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.192+0000 7f749e3ad640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5585dbc82850 0x5585dbc82cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36774/0 (socket says 172.21.15.62:36774) 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.192+0000 7f749ebae640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5585dbc816e0 0x5585dbc81b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34280/0 (socket says 172.21.15.62:34280) 2024-04-26T07:54:39.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.192+0000 7f749e3ad640 1 -- 172.21.15.62:0/2668901525 learned_addr learned my addr 172.21.15.62:0/2668901525 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:39.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.192+0000 7f749ebae640 1 -- 172.21.15.62:0/2668901525 >> v1:172.21.15.1:6789/0 conn(0x5585dbc82850 legacy=0x5585dbc82cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.192+0000 7f749ebae640 1 -- 172.21.15.62:0/2668901525 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dbc83410 con 0x5585dbc816e0 2024-04-26T07:54:39.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.192+0000 7f749dbac640 1 -- 172.21.15.62:0/2668901525 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585284333 0 0) 0x5585dbc82180 con 0x5585dbc82850 2024-04-26T07:54:39.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.194+0000 7f749ebae640 1 --2- 172.21.15.62:0/2668901525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbc81b00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f749000a470 tx=0x7f749001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec47ed1d9b246787 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.194+0000 7f749dbac640 1 -- 172.21.15.62:0/2668901525 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7490057070 con 0x5585dbc816e0 2024-04-26T07:54:39.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.194+0000 7f749dbac640 1 -- 172.21.15.62:0/2668901525 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749004adc0 con 0x5585dbc816e0 2024-04-26T07:54:39.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.194+0000 7f749dbac640 1 -- 172.21.15.62:0/2668901525 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7490052590 con 0x5585dbc816e0 2024-04-26T07:54:39.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.195+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2668901525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 msgr2=0x5585dbc81b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.195+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2668901525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbc81b00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f749000a470 tx=0x7f749001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:39.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.195+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2668901525 shutdown_connections 2024-04-26T07:54:39.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.195+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2668901525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbc81b00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.195+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2668901525 >> 172.21.15.62:0/2668901525 conn(0x5585dbc7ccc0 msgr2=0x5585dbc7f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.195+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2668901525 shutdown_connections 2024-04-26T07:54:39.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.195+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2668901525 wait complete. 2024-04-26T07:54:39.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.207+0000 7f74a2f2f800 1 Processor -- start 2024-04-26T07:54:39.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.207+0000 7f74a2f2f800 1 -- start start 2024-04-26T07:54:39.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.208+0000 7f74a2f2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbd72c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.208+0000 7f74a2f2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5585dbbccc70 con 0x5585dbc816e0 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.208+0000 7f749ebae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbd72c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.208+0000 7f749ebae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbd72c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34282/0 (socket says 172.21.15.62:34282) 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.208+0000 7f749ebae640 1 -- 172.21.15.62:0/2466142970 learned_addr learned my addr 172.21.15.62:0/2466142970 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.208+0000 7f749ebae640 1 -- 172.21.15.62:0/2466142970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dbd731d0 con 0x5585dbc816e0 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.208+0000 7f749ebae640 1 --2- 172.21.15.62:0/2466142970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbd72c00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7490055040 tx=0x7f749004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaf746f474e7083 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f738ce09640 1 -- 172.21.15.62:0/2466142970 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7490057040 con 0x5585dbc816e0 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f738ce09640 1 -- 172.21.15.62:0/2466142970 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7490063070 con 0x5585dbc816e0 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f738ce09640 1 -- 172.21.15.62:0/2466142970 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f749005d790 con 0x5585dbc816e0 2024-04-26T07:54:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2466142970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 msgr2=0x5585dbd72c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2466142970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbd72c00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7490055040 tx=0x7f749004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2466142970 shutdown_connections 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2466142970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbd72c00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2466142970 >> 172.21.15.62:0/2466142970 conn(0x5585dbc7ccc0 msgr2=0x5585dbd6e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2466142970 shutdown_connections 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.209+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2466142970 wait complete. 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.210+0000 7f74a2f2f800 1 Processor -- start 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.210+0000 7f74a2f2f800 1 -- start start 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.210+0000 7f74a2f2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbbf6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.210+0000 7f74a2f2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5585dbc8ad20 con 0x5585dbc816e0 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.210+0000 7f749ebae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbbf6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.210+0000 7f749ebae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbbf6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34296/0 (socket says 172.21.15.62:34296) 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.210+0000 7f749ebae640 1 -- 172.21.15.62:0/704305104 learned_addr learned my addr 172.21.15.62:0/704305104 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.210+0000 7f749ebae640 1 -- 172.21.15.62:0/704305104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dbbf7470 con 0x5585dbc816e0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.211+0000 7f749ebae640 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbbf6f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7490060040 tx=0x7f7490002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.211+0000 7f738b606640 1 -- 172.21.15.62:0/704305104 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7490057050 con 0x5585dbc816e0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.211+0000 7f738b606640 1 -- 172.21.15.62:0/704305104 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749005dcd0 con 0x5585dbc816e0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.211+0000 7f738b606640 1 -- 172.21.15.62:0/704305104 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7490052440 con 0x5585dbc816e0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.211+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585dbbf56c0 con 0x5585dbc816e0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.211+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585dbbf5c40 con 0x5585dbc816e0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f738b606640 1 -- 172.21.15.62:0/704305104 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7490052600 con 0x5585dbc816e0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f738b606640 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7384036eb0 0x7f7384039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f738b606640 1 -- 172.21.15.62:0/704305104 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f749008e290 con 0x5585dbc816e0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f749e3ad640 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7384036eb0 0x7f7384039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbc82850 0x5585dbd83ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbd84010 con 0x5585dbc82850 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f749f3af640 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbc82850 0x5585dbd83ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f749e3ad640 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7384036eb0 0x7f7384039370 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7488000c00 tx=0x7f74880013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.212+0000 7f749f3af640 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbc82850 0x5585dbd83ad0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.213+0000 7f749f3af640 1 -- 172.21.15.62:0/704305104 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f749800a4a0 con 0x5585dbc82850 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.213+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbbf60d0 con 0x5585dbc82850 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.213+0000 7f749f3af640 1 -- 172.21.15.62:0/704305104 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f749800a4a0 con 0x5585dbc82850 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.213+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbd862e0 0x5585dbd886d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.213+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbd88d70 con 0x5585dbd862e0 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.213+0000 7f749ebae640 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbd862e0 0x5585dbd886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.214+0000 7f749ebae640 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbd862e0 0x5585dbd886d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.214+0000 7f749ebae640 1 -- 172.21.15.62:0/704305104 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7490078070 con 0x5585dbd862e0 2024-04-26T07:54:39.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.214+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbd85290 con 0x5585dbc82850 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.214+0000 7f749f3af640 1 -- 172.21.15.62:0/704305104 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f749800a4a0 con 0x5585dbc82850 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.214+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbd85770 con 0x5585dbc82850 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.214+0000 7f749f3af640 1 -- 172.21.15.62:0/704305104 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f749800a4a0 con 0x5585dbc82850 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.215+0000 7f74a2f2f800 1 Processor -- start 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.215+0000 7f74a2f2f800 1 -- start start 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.215+0000 7f74a2f2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbd97f20 0x5585dbd98340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.215+0000 7f74a2f2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5585dbb74170 con 0x5585dbd97f20 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.215+0000 7f749f3af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbd97f20 0x5585dbd98340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.215+0000 7f749f3af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbd97f20 0x5585dbd98340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34298/0 (socket says 172.21.15.62:34298) 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.215+0000 7f749f3af640 1 -- 172.21.15.62:0/1642203121 learned_addr learned my addr 172.21.15.62:0/1642203121 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.215+0000 7f749f3af640 1 -- 172.21.15.62:0/1642203121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dbd98880 con 0x5585dbd97f20 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.216+0000 7f749f3af640 1 --2- 172.21.15.62:0/1642203121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbd97f20 0x5585dbd98340 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x5585dbbf6920 tx=0x7f74980188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.216+0000 7f7388e01640 1 -- 172.21.15.62:0/1642203121 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7498014450 con 0x5585dbd97f20 2024-04-26T07:54:39.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.216+0000 7f7388e01640 1 -- 172.21.15.62:0/1642203121 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74980145f0 con 0x5585dbd97f20 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.216+0000 7f74a2f2f800 1 -- 172.21.15.62:0/1642203121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585dbd992f0 con 0x5585dbd97f20 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.216+0000 7f7388e01640 1 -- 172.21.15.62:0/1642203121 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74980148d0 con 0x5585dbd97f20 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.216+0000 7f74a2f2f800 1 -- 172.21.15.62:0/1642203121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585dbd997f0 con 0x5585dbd97f20 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.216+0000 7f7388e01640 1 -- 172.21.15.62:0/1642203121 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7498011040 con 0x5585dbd97f20 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f7388e01640 1 --2- 172.21.15.62:0/1642203121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7378036eb0 0x7f7378039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f7388e01640 1 -- 172.21.15.62:0/1642203121 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f749801e070 con 0x5585dbd97f20 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f749ebae640 1 --2- 172.21.15.62:0/1642203121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7378036eb0 0x7f7378039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f74a2f2f800 1 Processor -- start 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f74a2f2f800 1 -- start start 2024-04-26T07:54:39.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f749ebae640 1 --2- 172.21.15.62:0/1642203121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7378036eb0 0x7f7378039370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5585dbd84420 tx=0x7f749008e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f74a2f2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbda5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f74a2f2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5585dbd73490 con 0x5585dbda51e0 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f749f3af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbda5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f749f3af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbda5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34300/0 (socket says 172.21.15.62:34300) 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.217+0000 7f749f3af640 1 -- 172.21.15.62:0/4250466687 learned_addr learned my addr 172.21.15.62:0/4250466687 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f749f3af640 1 -- 172.21.15.62:0/4250466687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dbda5bd0 con 0x5585dbda51e0 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f749f3af640 1 --2- 172.21.15.62:0/4250466687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbda5600 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f749804cf00 tx=0x7f7498011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aed6f0948a9a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f73827fc640 1 -- 172.21.15.62:0/4250466687 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74980411b0 con 0x5585dbda51e0 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f73827fc640 1 -- 172.21.15.62:0/4250466687 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7498013c90 con 0x5585dbda51e0 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f73827fc640 1 -- 172.21.15.62:0/4250466687 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f749802ba60 con 0x5585dbda51e0 2024-04-26T07:54:39.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f74a2f2f800 1 -- 172.21.15.62:0/4250466687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 msgr2=0x5585dbda5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/4250466687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbda5600 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f749804cf00 tx=0x7f7498011700 comp rx=0 tx=0).stop 2024-04-26T07:54:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f74a2f2f800 1 -- 172.21.15.62:0/4250466687 shutdown_connections 2024-04-26T07:54:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/4250466687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbda5600 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f74a2f2f800 1 -- 172.21.15.62:0/4250466687 >> 172.21.15.62:0/4250466687 conn(0x5585dbda1540 msgr2=0x5585dbd9f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f74a2f2f800 1 -- 172.21.15.62:0/4250466687 shutdown_connections 2024-04-26T07:54:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.218+0000 7f74a2f2f800 1 -- 172.21.15.62:0/4250466687 wait complete. 2024-04-26T07:54:39.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f74a2f2f800 1 Processor -- start 2024-04-26T07:54:39.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f74a2f2f800 1 -- start start 2024-04-26T07:54:39.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f74a2f2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbdac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f74a2f2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5585dbda6340 con 0x5585dbda51e0 2024-04-26T07:54:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f749f3af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbdac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f749f3af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbdac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34314/0 (socket says 172.21.15.62:34314) 2024-04-26T07:54:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 learned_addr learned my addr 172.21.15.62:0/2192944942 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dbdacd50 con 0x5585dbda51e0 2024-04-26T07:54:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.219+0000 7f749f3af640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbdac810 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7498011be0 tx=0x7f749800a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.220+0000 7f7380ff9640 1 -- 172.21.15.62:0/2192944942 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7498013e40 con 0x5585dbda51e0 2024-04-26T07:54:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.220+0000 7f7380ff9640 1 -- 172.21.15.62:0/2192944942 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749802b560 con 0x5585dbda51e0 2024-04-26T07:54:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.220+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585dbdacfe0 con 0x5585dbda51e0 2024-04-26T07:54:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.220+0000 7f7380ff9640 1 -- 172.21.15.62:0/2192944942 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f749802b840 con 0x5585dbda51e0 2024-04-26T07:54:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.220+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585dbdafc90 con 0x5585dbda51e0 2024-04-26T07:54:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.220+0000 7f7380ff9640 1 -- 172.21.15.62:0/2192944942 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f749804e380 con 0x5585dbda51e0 2024-04-26T07:54:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.221+0000 7f7380ff9640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7368036e60 0x7f7368039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.221+0000 7f7380ff9640 1 -- 172.21.15.62:0/2192944942 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f749800e040 con 0x5585dbda51e0 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.221+0000 7f749ebae640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7368036e60 0x7f7368039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.221+0000 7f749ebae640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7368036e60 0x7f7368039320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f749005efd0 tx=0x7f7490082000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.221+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.221+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbdb8520 0x5585dbdba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.221+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdbb130 con 0x5585dbdb8520 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.221+0000 7f749e3ad640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbdb8520 0x5585dbdba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f749e3ad640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbdb8520 0x5585dbdba9e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f748800f5f0 con 0x5585dbdb8520 2024-04-26T07:54:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 20 realm 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdb7970 con 0x5585dbdb8520 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f748800f5f0 con 0x5585dbdb8520 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdbbc20 con 0x5585dbdb8520 2024-04-26T07:54:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f748800f5f0 con 0x5585dbdb8520 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.222+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdbc4f0 con 0x5585dbdb8520 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f748800f5f0 con 0x5585dbdb8520 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f74a2f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbdbcf10 0x5585dbdbf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdbfa70 con 0x5585dbdbcf10 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f749f3af640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbdbcf10 0x5585dbdbf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f749f3af640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbdbcf10 0x5585dbdbf300 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f74a2f2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f74a2f2f800 20 searching for the correct realm 2024-04-26T07:54:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5585dbdc1a20 0x5585dbdc3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.223+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.224+0000 7f749ebae640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5585dbdc1a20 0x5585dbdc3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.224+0000 7f749ebae640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5585dbdc1a20 0x5585dbdc3ee0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.224+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.225+0000 7f749ebae640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7490088040 0x7f749005b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.225+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x7f7490088040 2024-04-26T07:54:39.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.225+0000 7f749e3ad640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7490088040 0x7f749005b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.225+0000 7f749e3ad640 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7490088040 0x7f749005b370 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.225+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748800f5f0 con 0x7f7490088040 2024-04-26T07:54:39.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.225+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.226+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.226+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdb8520 2024-04-26T07:54:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.226+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748800f5f0 con 0x5585dbdb8520 2024-04-26T07:54:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.226+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdb8520 2024-04-26T07:54:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.226+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.226+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.226+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.226+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.227+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.227+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x7f7490088040 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.227+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.227+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.227+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.227+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdb8520 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.227+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.227+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdb8520 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x7f7490088040 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.228+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.229+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.229+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.229+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.229+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.229+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.229+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdb8520 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.229+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.229+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdb8520 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.230+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.230+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.230+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.230+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.230+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.230+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x7f7490088040 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.230+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.231+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdb8520 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.231+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.231+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.231+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.231+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.231+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.231+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.232+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.232+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x7f7490088040 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.232+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.232+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.232+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.232+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdbcf10 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.232+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.232+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x5585dbdb8520 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc45b0 con 0x7f7490088040 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc0430 con 0x5585dbdb8520 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc0cd0 con 0x5585dbdb8520 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.233+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc0070 con 0x5585dbdb8520 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 20 zone default found 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 4 Realm: () 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 20 zonegroup default 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc4a30 con 0x5585dbdbcf10 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc6cb0 con 0x5585dbdc1a20 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc7050 con 0x5585dbdc1a20 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.234+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.235+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.235+0000 7f74a2f2f800 20 started sync module instance, tier type = 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.235+0000 7f74a2f2f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.235+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc6140 con 0x7f7490088040 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.236+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.236+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94033407665808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc6140 con 0x7f7490088040 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.236+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc7a10 con 0x5585dbdb8520 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.237+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94033407665808] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.237+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.237+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94033407670080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc6140 con 0x5585dbdb8520 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.237+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc8480 con 0x5585dbdc1a20 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.238+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94033407670080] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.238+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.238+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94033407663248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc60b0 con 0x5585dbdc1a20 2024-04-26T07:54:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.238+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc9340 con 0x7f7490088040 2024-04-26T07:54:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.239+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94033407663248] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.239+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.239+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94033407676048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc9760 con 0x7f7490088040 2024-04-26T07:54:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.239+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdca120 con 0x5585dbdb8520 2024-04-26T07:54:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.240+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.240+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94033407679600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdca540 con 0x5585dbdb8520 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.240+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94033407676048] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.240+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdcafc0 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.241+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94033407679600] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.241+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.241+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94033407677104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdca540 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.241+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdcb890 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.242+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94033407677104] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.243+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.243+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94033407681136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdcb890 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.243+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdcc290 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.243+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94033407681136] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94033407688096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdcb840 con 0x5585dbdbcf10 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f74a2f2f800 20 add_watcher() i=0 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f74a2f2f800 20 add_watcher() i=1 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f74a2f2f800 20 add_watcher() i=2 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f74a2f2f800 20 add_watcher() i=3 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f74a2f2f800 20 add_watcher() i=4 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f74a2f2f800 20 add_watcher() i=5 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.244+0000 7f74a2f2f800 20 add_watcher() i=6 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.245+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94033407688096] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.245+0000 7f74a2f2f800 20 add_watcher() i=7 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.245+0000 7f74a2f2f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.245+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdcf710 con 0x5585dbdb8520 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.245+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.245+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94033407685984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdccbd0 con 0x5585dbdb8520 2024-04-26T07:54:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.246+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94033407685984] v27'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.246+0000 7f73557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.246+0000 7f74a2f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.246+0000 7f74a2f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.246+0000 7f74a2f2f800 5 note: GC not initialized 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f72cffff640 20 reqs_thread_entry: start 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 20 Filter name: none 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f72cdffb640 20 reqs_thread_entry: start 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbe03160 con 0x5585dbdbcf10 2024-04-26T07:54:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.247+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbe016f0 con 0x5585dbdbcf10 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.248+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.248+0000 7f74a2f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.248+0000 7f74a2f2f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T07:54:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.248+0000 7f74a2f2f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.248+0000 7f74a2f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.248+0000 7f74a2f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.248+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbe05e10 con 0x5585dbdbcf10 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v27'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f74a2f2f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f74a2f2f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f74a2f2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94033407924176 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbe068e0 con 0x7f7490088040 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== watch-notify(notify (1) cookie 94033407676048 notify 115964117010 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f7488018040 con 0x7f7490088040 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f73827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117010 cookie 94033407676048 notifier 4529 bl.length()=610 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(65 notify.3 [notify cookie 94033407924176 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f73827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f73827fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T07:54:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f73827fc640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f7364003ea0 con 0x7f7490088040 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.249+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.250+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== watch-notify(notify_complete (2) cookie 94033407924176 notify 115964117010 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f748802f970 con 0x7f7490088040 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.250+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbe057a0 con 0x5585dbdbcf10 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v27'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f74a2f2f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f74a2f2f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f74a2f2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94033407924080 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5585dbe068e0 con 0x5585dbdc1a20 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== watch-notify(notify (1) cookie 94033407663248 notify 115964116996 ret 0) ==== 234+0+0 (crc 0 0 0) 0x5585dbbf5c40 con 0x5585dbdc1a20 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f73827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94033407663248 notifier 4529 bl.length()=192 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f73827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f73827fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:54:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f73827fc640 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f7364003ea0 con 0x5585dbdc1a20 2024-04-26T07:54:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(68 notify.2 [notify cookie 94033407924080 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.251+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== watch-notify(notify_complete (2) cookie 94033407924080 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5585dbbf56c0 con 0x5585dbdc1a20 2024-04-26T07:54:39.311 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T07:54:39.249256Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:39.249243Z","tags":[],"group_ids":[]} 2024-04-26T07:54:39.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.252+0000 7f73557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.252+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94033407685984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdcf2f0 con 0x5585dbdb8520 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.253+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94033407685984] v27'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.253+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94033407665808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdcb530 con 0x7f7490088040 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.254+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94033407665808] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.254+0000 7f74a2f2f800 20 remove_watcher() i=0 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.254+0000 7f74a2f2f800 2 removed watcher, disabling cache 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.254+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94033407670080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc6690 con 0x5585dbdb8520 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.255+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94033407670080] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.255+0000 7f74a2f2f800 20 remove_watcher() i=1 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.255+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94033407663248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc7740 con 0x5585dbdc1a20 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.256+0000 7f749ebae640 1 -- 172.21.15.62:0/2192944942 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94033407663248] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7490095040 con 0x5585dbdc1a20 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.256+0000 7f74a2f2f800 20 remove_watcher() i=2 2024-04-26T07:54:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.256+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94033407676048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc5c90 con 0x7f7490088040 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.257+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94033407676048] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x7f7490088040 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.257+0000 7f74a2f2f800 20 remove_watcher() i=3 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.257+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94033407679600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc5c90 con 0x5585dbdb8520 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.258+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94033407679600] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f748802b040 con 0x5585dbdb8520 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.258+0000 7f74a2f2f800 20 remove_watcher() i=4 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.258+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94033407677104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc9c70 con 0x5585dbdbcf10 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.259+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94033407677104] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.259+0000 7f74a2f2f800 20 remove_watcher() i=5 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.259+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94033407681136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdc9c70 con 0x5585dbdbcf10 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.260+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94033407681136] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.260+0000 7f74a2f2f800 20 remove_watcher() i=6 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.260+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94033407688096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5585dbdca270 con 0x5585dbdbcf10 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f749f3af640 1 -- 172.21.15.62:0/2192944942 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94033407688096] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f749802a070 con 0x5585dbdbcf10 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 20 remove_watcher() i=7 2024-04-26T07:54:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbdbcf10 msgr2=0x5585dbdbf300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbdbcf10 0x5585dbdbf300 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbdb8520 msgr2=0x5585dbdba9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbdb8520 0x5585dbdba9e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7490088040 msgr2=0x7f749005b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7490088040 0x7f749005b370 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5585dbdc1a20 msgr2=0x5585dbdc3ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.261+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5585dbdc1a20 0x5585dbdc3ee0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7368036e60 msgr2=0x7f7368039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7368036e60 0x7f7368039320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f749005efd0 tx=0x7f7490082000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 msgr2=0x5585dbdac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/2192944942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbda51e0 0x5585dbdac810 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7498011be0 tx=0x7f749800a0e0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 reap_dead start 2024-04-26T07:54:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f749e3ad640 1 -- 172.21.15.62:0/2192944942 reap_dead start 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 shutdown_connections 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 >> 172.21.15.62:0/2192944942 conn(0x5585dbda1540 msgr2=0x5585dbd9eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 shutdown_connections 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/2192944942 wait complete. 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/1642203121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7378036eb0 msgr2=0x7f7378039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/1642203121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7378036eb0 0x7f7378039370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5585dbd84420 tx=0x7f749008e040 comp rx=0 tx=0).stop 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/1642203121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbd97f20 msgr2=0x5585dbd98340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/1642203121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbd97f20 0x5585dbd98340 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x5585dbbf6920 tx=0x7f74980188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/1642203121 shutdown_connections 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/1642203121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7378036eb0 0x7f7378039370 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/1642203121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbd97f20 0x5585dbd98340 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/1642203121 >> 172.21.15.62:0/1642203121 conn(0x5585dbd8bfc0 msgr2=0x5585dbd8c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/1642203121 shutdown_connections 2024-04-26T07:54:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/1642203121 wait complete. 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbd862e0 msgr2=0x5585dbd886d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbd862e0 0x5585dbd886d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbc82850 msgr2=0x5585dbd83ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbc82850 0x5585dbd83ad0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7384036eb0 msgr2=0x7f7384039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.262+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7384036eb0 0x7f7384039370 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7488000c00 tx=0x7f74880013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 msgr2=0x5585dbbf6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbbf6f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7490060040 tx=0x7f7490002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 shutdown_connections 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5585dbc82850 0x5585dbd83ad0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5585dbd862e0 0x5585dbd886d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7384036eb0 0x7f7384039370 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 --2- 172.21.15.62:0/704305104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5585dbc816e0 0x5585dbbf6f30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 >> 172.21.15.62:0/704305104 conn(0x5585dbc7ccc0 msgr2=0x5585dbd6cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 shutdown_connections 2024-04-26T07:54:39.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.263+0000 7f74a2f2f800 1 -- 172.21.15.62:0/704305104 wait complete. 2024-04-26T07:54:39.323 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T07:54:39.249256Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:39.249243Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:39.323 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T07:54:39.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T07:54:39.323 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-04-26T07:54:39.372 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:39.373 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:39.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.375+0000 7fb0a5b51800 1 Processor -- start 2024-04-26T07:54:39.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.375+0000 7fb0a5b51800 1 -- start start 2024-04-26T07:54:39.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.375+0000 7fb0a5b51800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5653baf39aa0 0x5653baf39ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.375+0000 7fb0a5b51800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5653baf3a540 con 0x5653baf3a820 2024-04-26T07:54:39.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.375+0000 7fb0a5b51800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5653baddce20 con 0x5653baf39aa0 2024-04-26T07:54:39.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.376+0000 7fb0a3657640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5653baf39aa0 0x5653baf39ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.376+0000 7fb0a2e56640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5653baf3a820 0x5653baf3acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36780/0 (socket says 172.21.15.62:36780) 2024-04-26T07:54:39.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.376+0000 7fb0a2e56640 1 -- 172.21.15.62:0/4261107319 learned_addr learned my addr 172.21.15.62:0/4261107319 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:39.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.376+0000 7fb0a3657640 1 -- 172.21.15.62:0/4261107319 >> v1:172.21.15.1:6789/0 conn(0x5653baf3a820 legacy=0x5653baf3acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.376+0000 7fb0a3657640 1 -- 172.21.15.62:0/4261107319 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653baf3b3e0 con 0x5653baf39aa0 2024-04-26T07:54:39.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a3657640 1 --2- 172.21.15.62:0/4261107319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf39ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb09400a470 tx=0x7fb09401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc252a346759dedb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a2655640 1 -- 172.21.15.62:0/4261107319 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094057070 con 0x5653baf39aa0 2024-04-26T07:54:39.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a2655640 1 -- 172.21.15.62:0/4261107319 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09404adc0 con 0x5653baf39aa0 2024-04-26T07:54:39.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a2655640 1 -- 172.21.15.62:0/4261107319 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094052590 con 0x5653baf39aa0 2024-04-26T07:54:39.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4261107319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 msgr2=0x5653baf39ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/4261107319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf39ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb09400a470 tx=0x7fb09401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:39.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4261107319 shutdown_connections 2024-04-26T07:54:39.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/4261107319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf39ec0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4261107319 >> 172.21.15.62:0/4261107319 conn(0x5653baf34340 msgr2=0x5653baf36760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4261107319 shutdown_connections 2024-04-26T07:54:39.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.378+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4261107319 wait complete. 2024-04-26T07:54:39.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.391+0000 7fb0a5b51800 1 Processor -- start 2024-04-26T07:54:39.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.391+0000 7fb0a5b51800 1 -- start start 2024-04-26T07:54:39.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.391+0000 7fb0a5b51800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf391a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.391+0000 7fb0a5b51800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5653bae85cf0 con 0x5653baf39aa0 2024-04-26T07:54:39.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.391+0000 7fb0a3657640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.391+0000 7fb0a3657640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf391a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34338/0 (socket says 172.21.15.62:34338) 2024-04-26T07:54:39.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.391+0000 7fb0a3657640 1 -- 172.21.15.62:0/1413447842 learned_addr learned my addr 172.21.15.62:0/1413447842 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.392+0000 7fb0a3657640 1 -- 172.21.15.62:0/1413447842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bb02eae0 con 0x5653baf39aa0 2024-04-26T07:54:39.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.392+0000 7fb0a3657640 1 --2- 172.21.15.62:0/1413447842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf391a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb094055040 tx=0x7fb09404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa00219d354a8f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.392+0000 7faf9160a640 1 -- 172.21.15.62:0/1413447842 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094057040 con 0x5653baf39aa0 2024-04-26T07:54:39.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.392+0000 7faf9160a640 1 -- 172.21.15.62:0/1413447842 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb094063070 con 0x5653baf39aa0 2024-04-26T07:54:39.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.392+0000 7faf9160a640 1 -- 172.21.15.62:0/1413447842 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09405d790 con 0x5653baf39aa0 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 -- 172.21.15.62:0/1413447842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 msgr2=0x5653baf391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/1413447842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf391a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb094055040 tx=0x7fb09404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 -- 172.21.15.62:0/1413447842 shutdown_connections 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/1413447842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653baf391a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 -- 172.21.15.62:0/1413447842 >> 172.21.15.62:0/1413447842 conn(0x5653baf34340 msgr2=0x5653bb0265d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 -- 172.21.15.62:0/1413447842 shutdown_connections 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 -- 172.21.15.62:0/1413447842 wait complete. 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 Processor -- start 2024-04-26T07:54:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 -- start start 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653bb02c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.393+0000 7fb0a5b51800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5653baf42cf0 con 0x5653baf39aa0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7fb0a3657640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653bb02c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7fb0a3657640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653bb02c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34352/0 (socket says 172.21.15.62:34352) 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7fb0a3657640 1 -- 172.21.15.62:0/3326610605 learned_addr learned my addr 172.21.15.62:0/3326610605 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7fb0a3657640 1 -- 172.21.15.62:0/3326610605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bb02c900 con 0x5653baf39aa0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7fb0a3657640 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653bb02c3c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb09400a470 tx=0x7fb094002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7faf8fe07640 1 -- 172.21.15.62:0/3326610605 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094057050 con 0x5653baf39aa0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7faf8fe07640 1 -- 172.21.15.62:0/3326610605 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09405dd40 con 0x5653baf39aa0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653bb02ab00 con 0x5653baf39aa0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7faf8fe07640 1 -- 172.21.15.62:0/3326610605 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094052570 con 0x5653baf39aa0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.394+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bb02b080 con 0x5653baf39aa0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.395+0000 7faf8fe07640 1 -- 172.21.15.62:0/3326610605 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb094052820 con 0x5653baf39aa0 2024-04-26T07:54:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.395+0000 7faf8fe07640 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf88036e60 0x7faf88039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.395+0000 7faf8fe07640 1 -- 172.21.15.62:0/3326610605 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fb09408e330 con 0x5653baf39aa0 2024-04-26T07:54:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.395+0000 7fb0a2e56640 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf88036e60 0x7faf88039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.395+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653baf3a820 0x5653bb03cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.395+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb03d1d0 con 0x5653baf3a820 2024-04-26T07:54:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.396+0000 7fb0a3e58640 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653baf3a820 0x5653bb03cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.396+0000 7fb0a2e56640 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf88036e60 0x7faf88039320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb098000f60 tx=0x7fb0980012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.396+0000 7fb0a3e58640 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653baf3a820 0x5653bb03cc00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.396+0000 7fb0a3e58640 1 -- 172.21.15.62:0/3326610605 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb09c00a4a0 con 0x5653baf3a820 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.396+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb02b580 con 0x5653baf3a820 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.396+0000 7fb0a3e58640 1 -- 172.21.15.62:0/3326610605 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb09c00a4a0 con 0x5653baf3a820 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.397+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb03f500 0x5653bb0418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.397+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb041f90 con 0x5653bb03f500 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.397+0000 7fb0a3657640 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb03f500 0x5653bb0418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.397+0000 7fb0a3657640 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb03f500 0x5653bb0418f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.397+0000 7fb0a3657640 1 -- 172.21.15.62:0/3326610605 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb094078070 con 0x5653bb03f500 2024-04-26T07:54:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.397+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb03e4b0 con 0x5653baf3a820 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.398+0000 7fb0a3e58640 1 -- 172.21.15.62:0/3326610605 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb09c00a4a0 con 0x5653baf3a820 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.398+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb03e990 con 0x5653baf3a820 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.398+0000 7fb0a3e58640 1 -- 172.21.15.62:0/3326610605 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb09c00a4a0 con 0x5653baf3a820 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.398+0000 7fb0a5b51800 1 Processor -- start 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.398+0000 7fb0a5b51800 1 -- start start 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a5b51800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb051140 0x5653bb051560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a5b51800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5653bae2d170 con 0x5653bb051140 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a3e58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb051140 0x5653bb051560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a3e58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb051140 0x5653bb051560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34366/0 (socket says 172.21.15.62:34366) 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a3e58640 1 -- 172.21.15.62:0/4216792098 learned_addr learned my addr 172.21.15.62:0/4216792098 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a3e58640 1 -- 172.21.15.62:0/4216792098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bb051aa0 con 0x5653bb051140 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a3e58640 1 --2- 172.21.15.62:0/4216792098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb051140 0x5653bb051560 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5653bb02bdb0 tx=0x7fb09c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7faf8d602640 1 -- 172.21.15.62:0/4216792098 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09c014450 con 0x5653bb051140 2024-04-26T07:54:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7faf8d602640 1 -- 172.21.15.62:0/4216792098 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c0145f0 con 0x5653bb051140 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4216792098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653bb052510 con 0x5653bb051140 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7faf8d602640 1 -- 172.21.15.62:0/4216792098 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09c0148d0 con 0x5653bb051140 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.399+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4216792098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bb052a10 con 0x5653bb051140 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.400+0000 7faf8d602640 1 -- 172.21.15.62:0/4216792098 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb09c011040 con 0x5653bb051140 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.400+0000 7faf8d602640 1 --2- 172.21.15.62:0/4216792098 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf7c036e60 0x7faf7c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.400+0000 7faf8d602640 1 -- 172.21.15.62:0/4216792098 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fb09c01e070 con 0x5653bb051140 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.400+0000 7fb0a3657640 1 --2- 172.21.15.62:0/4216792098 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf7c036e60 0x7faf7c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a5b51800 1 Processor -- start 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a5b51800 1 -- start start 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a3657640 1 --2- 172.21.15.62:0/4216792098 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf7c036e60 0x7faf7c039320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5653bb03d620 tx=0x7fb094066f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a5b51800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb05e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a5b51800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5653bb02ed70 con 0x5653bb05e520 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a3e58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb05e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a3e58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb05e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34372/0 (socket says 172.21.15.62:34372) 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a3e58640 1 -- 172.21.15.62:0/3327575030 learned_addr learned my addr 172.21.15.62:0/3327575030 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a3e58640 1 -- 172.21.15.62:0/3327575030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bb05ef10 con 0x5653bb05e520 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.401+0000 7fb0a3e58640 1 --2- 172.21.15.62:0/3327575030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb05e940 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0114f0 tx=0x7fb09c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1004fb0b2de78443 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7faf86ffd640 1 -- 172.21.15.62:0/3327575030 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09c03d050 con 0x5653bb05e520 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7faf86ffd640 1 -- 172.21.15.62:0/3327575030 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c0167c0 con 0x5653bb05e520 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7faf86ffd640 1 -- 172.21.15.62:0/3327575030 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09c013c50 con 0x5653bb05e520 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3327575030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 msgr2=0x5653bb05e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3327575030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb05e940 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0114f0 tx=0x7fb09c011f20 comp rx=0 tx=0).stop 2024-04-26T07:54:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3327575030 shutdown_connections 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3327575030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb05e940 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3327575030 >> 172.21.15.62:0/3327575030 conn(0x5653bb05a7a0 msgr2=0x5653bb058800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3327575030 shutdown_connections 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3327575030 wait complete. 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 Processor -- start 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.402+0000 7fb0a5b51800 1 -- start start 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a5b51800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb065a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a5b51800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5653bb05f640 con 0x5653bb05e520 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a3e58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a3e58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb065a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34384/0 (socket says 172.21.15.62:34384) 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 learned_addr learned my addr 172.21.15.62:0/343783598 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bb065f40 con 0x5653bb05e520 2024-04-26T07:54:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a3e58640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb065a00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb09c011f60 tx=0x7fb09c04ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7faf857fa640 1 -- 172.21.15.62:0/343783598 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09c03a070 con 0x5653bb05e520 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7faf857fa640 1 -- 172.21.15.62:0/343783598 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c042040 con 0x5653bb05e520 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7faf857fa640 1 -- 172.21.15.62:0/343783598 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09c046040 con 0x5653bb05e520 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653bb0661d0 con 0x5653bb05e520 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.403+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bb068e80 con 0x5653bb05e520 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.404+0000 7faf857fa640 1 -- 172.21.15.62:0/343783598 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb09c046d10 con 0x5653bb05e520 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.404+0000 7faf857fa640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf6c036e60 0x7faf6c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.404+0000 7faf857fa640 1 -- 172.21.15.62:0/343783598 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fb09c00e040 con 0x5653bb05e520 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.404+0000 7fb0a3657640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf6c036e60 0x7faf6c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a3657640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf6c036e60 0x7faf6c039320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5653bb042390 tx=0x7fb094082000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653bb0716d0 0x5653bb073b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0742e0 con 0x5653bb0716d0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a2e56640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653bb0716d0 0x5653bb073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a2e56640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653bb0716d0 0x5653bb073b90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb098009050 con 0x5653bb0716d0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a5b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a5b51800 20 realm 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.405+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb070b20 con 0x5653bb0716d0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb098009050 con 0x5653bb0716d0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb074dd0 con 0x5653bb0716d0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb098009050 con 0x5653bb0716d0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0756a0 con 0x5653bb0716d0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb098009050 con 0x5653bb0716d0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb075fe0 0x5653bb0783d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb078b60 con 0x5653bb075fe0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.406+0000 7fb0a3e58640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb075fe0 0x5653bb0783d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.407+0000 7fb0a3e58640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb075fe0 0x5653bb0783d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.407+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.407+0000 7fb0a5b51800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.407+0000 7fb0a5b51800 20 searching for the correct realm 2024-04-26T07:54:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.407+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5653bb07ab30 0x5653bb07cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.407+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.407+0000 7fb0a3657640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5653bb07ab30 0x5653bb07cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.407+0000 7fb0a3657640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5653bb07ab30 0x5653bb07cff0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.408+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.408+0000 7fb0a3657640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb09409b040 0x7fb0940686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.408+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x7fb09409b040 2024-04-26T07:54:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.408+0000 7fb0a2e56640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb09409b040 0x7fb0940686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.408+0000 7fb0a2e56640 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb09409b040 0x7fb0940686f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.409+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098009050 con 0x7fb09409b040 2024-04-26T07:54:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.409+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.409+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.409+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb0716d0 2024-04-26T07:54:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.409+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098009050 con 0x5653bb0716d0 2024-04-26T07:54:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.409+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb0716d0 2024-04-26T07:54:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.409+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.409+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.410+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.410+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.410+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.410+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x7fb09409b040 2024-04-26T07:54:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.410+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098029040 con 0x7fb09409b040 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.410+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.410+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.410+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb0716d0 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.411+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.411+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.411+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.411+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb0716d0 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.411+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.411+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x7fb09409b040 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.412+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb098029040 con 0x7fb09409b040 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.412+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.412+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.412+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.412+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.412+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.412+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.412+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.413+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.413+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.413+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.413+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb0716d0 2024-04-26T07:54:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.413+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.413+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb0716d0 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.413+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.413+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.414+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.414+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.414+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.414+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x7fb09409b040 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.414+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098029040 con 0x7fb09409b040 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.414+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb0716d0 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.414+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.415+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.415+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.415+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.415+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.415+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.415+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.415+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x7fb09409b040 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.416+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098029040 con 0x7fb09409b040 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.416+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb07ab30 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.416+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.416+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb075fe0 2024-04-26T07:54:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.416+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.416+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x5653bb0716d0 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.416+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.416+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07d6c0 con 0x7fb09409b040 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098029040 con 0x7fb09409b040 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb079520 con 0x5653bb0716d0 2024-04-26T07:54:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb079dc0 con 0x5653bb0716d0 2024-04-26T07:54:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb079160 con 0x5653bb0716d0 2024-04-26T07:54:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb098029040 con 0x5653bb0716d0 2024-04-26T07:54:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 zone default found 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 4 Realm: () 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 zonegroup default 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.417+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07db80 con 0x5653bb075fe0 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07fe50 con 0x5653bb07ab30 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0801f0 con 0x5653bb07ab30 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 20 started sync module instance, tier type = 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.418+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07f2e0 con 0x7fb09409b040 2024-04-26T07:54:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.419+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098039040 con 0x7fb09409b040 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.419+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94917620135952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07f2e0 con 0x7fb09409b040 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.419+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb080c40 con 0x5653bb0716d0 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.421+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098039040 con 0x5653bb0716d0 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.421+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94917620135952] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098039040 con 0x7fb09409b040 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.421+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94917620139856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb080bf0 con 0x5653bb0716d0 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.421+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07ee50 con 0x5653bb07ab30 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.421+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94917620139856] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098039040 con 0x5653bb0716d0 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.422+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.422+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94917620142128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb081bb0 con 0x5653bb07ab30 2024-04-26T07:54:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.422+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb082570 con 0x7fb09409b040 2024-04-26T07:54:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.423+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94917620142128] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.423+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098039040 con 0x7fb09409b040 2024-04-26T07:54:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.423+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94917620146368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb082990 con 0x7fb09409b040 2024-04-26T07:54:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.423+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb083220 con 0x5653bb0716d0 2024-04-26T07:54:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.424+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098039040 con 0x5653bb0716d0 2024-04-26T07:54:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.424+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94917620148624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb082db0 con 0x5653bb0716d0 2024-04-26T07:54:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.424+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb084150 con 0x5653bb075fe0 2024-04-26T07:54:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.424+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94917620146368] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098039040 con 0x7fb09409b040 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.425+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94917620148624] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098039040 con 0x5653bb0716d0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.425+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.425+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94917620151824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb083c60 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.425+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0849f0 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.426+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.426+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94917620151824] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.426+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94917620155632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb084e40 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.426+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0824e0 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94917620147424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0858e0 con 0x5653bb075fe0 2024-04-26T07:54:39.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a5b51800 20 add_watcher() i=0 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a5b51800 20 add_watcher() i=1 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a5b51800 20 add_watcher() i=2 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a5b51800 20 add_watcher() i=3 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a5b51800 20 add_watcher() i=4 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a5b51800 20 add_watcher() i=5 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94917620155632] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.427+0000 7fb0a5b51800 20 add_watcher() i=6 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.428+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94917620147424] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.428+0000 7fb0a5b51800 20 add_watcher() i=7 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.428+0000 7fb0a5b51800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.428+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0858e0 con 0x5653bb0716d0 2024-04-26T07:54:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.429+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb098039040 con 0x5653bb0716d0 2024-04-26T07:54:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.429+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94917620159536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0861f0 con 0x5653bb0716d0 2024-04-26T07:54:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94917620159536] v27'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb098039040 con 0x5653bb0716d0 2024-04-26T07:54:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7faf59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a5b51800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a5b51800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a5b51800 5 note: GC not initialized 2024-04-26T07:54:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7faf58fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a5b51800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a5b51800 20 Filter name: none 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7faed27fc640 20 reqs_thread_entry: start 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a5b51800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.430+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0bc200 con 0x5653bb075fe0 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a5b51800 20 rados_obj.operate() r=0 bl.length=419 2024-04-26T07:54:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a5b51800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a5b51800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a5b51800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a5b51800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0bbc50 con 0x7fb09409b040 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.431+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb098039040 con 0x7fb09409b040 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0bf9b0 con 0x5653bb0716d0 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(64 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb098039040 con 0x5653bb0716d0 2024-04-26T07:54:39.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-04-26T07:54:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.432+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c40b0 con 0x7fb09409b040 2024-04-26T07:54:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.433+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(65 foo.buckets [call] v27'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb098039040 con 0x7fb09409b040 2024-04-26T07:54:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.433+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:66 8.1e 8:783134b2:root::.bucket.meta.testx%3amyfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c79c0 con 0x5653bb075fe0 2024-04-26T07:54:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [create,call,writefull 0~412,setxattr (203)] v27'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x7 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1, ofs0, ns] 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94917620422208 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c7340 con 0x5653bb0716d0 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== watch-notify(notify (1) cookie 94917620148624 notify 115964117003 ret 0) ==== 889+0+0 (crc 0 0 0) 0x5653bb0bfda0 con 0x5653bb0716d0 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7faf86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94917620148624 notifier 4536 bl.length()=847 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7faf86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x7 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(67 notify.4 [notify cookie 94917620422208 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb098039040 con 0x5653bb0716d0 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7faf86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7faf86ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7faf86ffd640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7faf68003ea0 con 0x5653bb0716d0 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== watch-notify(notify_complete (2) cookie 94917620422208 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5653bb0befa0 con 0x5653bb0716d0 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 20 handle_bi_update(): bucket=testx:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_sources= new_sources= 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 20 handle_bi_update(): bucket=testx:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential sources added=[] removed=[] 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 20 handle_bi_update(): bucket=testx:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_dests= new_dests= 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 20 handle_bi_update(): bucket=testx:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential dests added=[] removed=[] 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.435+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c3130 con 0x5653bb0716d0 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.436+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v27'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.436+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c6650 con 0x5653bb0716d0 2024-04-26T07:54:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.437+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v27'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.437+0000 7fb0a5b51800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.437+0000 7fb0a5b51800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.437+0000 7fb0a5b51800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.437+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94917620411840 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c3690 con 0x5653bb0716d0 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== watch-notify(notify (1) cookie 94917620148624 notify 115964117004 ret 0) ==== 390+0+0 (crc 0 0 0) 0x5653bb0c7e00 con 0x5653bb0716d0 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7faf86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 94917620148624 notifier 4536 bl.length()=348 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7faf86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7faf86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [notify cookie 94917620411840 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7faf86ffd640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7faf68003ea0 con 0x5653bb0716d0 2024-04-26T07:54:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== watch-notify(notify_complete (2) cookie 94917620411840 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5653bb0c7c00 con 0x5653bb0716d0 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.438+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c3270 con 0x7fb09409b040 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.439+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(73 myfoo [call,delete] v27'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fb098044040 con 0x7fb09409b040 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.439+0000 7fb0a5b51800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.439+0000 7fb0a5b51800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.439+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94917620411840 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c3690 con 0x5653bb075fe0 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.440+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== watch-notify(notify (1) cookie 94917620155632 notify 115964117003 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5653bb0c3bb0 con 0x5653bb075fe0 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.440+0000 7faf86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94917620155632 notifier 4536 bl.length()=149 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.440+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(74 notify.6 [notify cookie 94917620411840 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.440+0000 7faf86ffd640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7faf68003ea0 con 0x5653bb075fe0 2024-04-26T07:54:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.440+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== watch-notify(notify_complete (2) cookie 94917620411840 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb09c05e020 con 0x5653bb075fe0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.440+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.440+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c66f0 con 0x5653bb0716d0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(76 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call,delete] v27'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7fb0a5b51800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 from cache 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7fb0a5b51800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1, ofs0, ns] 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94917620400208 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0c3270 con 0x5653bb075fe0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== watch-notify(notify (1) cookie 94917620151824 notify 115964117004 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7fb09c05e020 con 0x5653bb075fe0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7faf867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 94917620151824 notifier 4536 bl.length()=206 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(77 notify.5 [notify cookie 94917620400208 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7faf867fc640 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7faed80032c0 con 0x5653bb075fe0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== watch-notify(notify_complete (2) cookie 94917620400208 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5653bb0661d0 con 0x5653bb075fe0 2024-04-26T07:54:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.442+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.443+0000 7faf59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.443+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94917620159536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb088090 con 0x5653bb0716d0 2024-04-26T07:54:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.444+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94917620159536] v27'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.444+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94917620135952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb085430 con 0x7fb09409b040 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.445+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94917620135952] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098044040 con 0x7fb09409b040 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.445+0000 7fb0a5b51800 20 remove_watcher() i=0 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.445+0000 7fb0a5b51800 2 removed watcher, disabling cache 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.445+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94917620139856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07f810 con 0x5653bb0716d0 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.447+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94917620139856] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.447+0000 7fb0a5b51800 20 remove_watcher() i=1 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.447+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94917620142128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb07f810 con 0x5653bb07ab30 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.448+0000 7fb0a3657640 1 -- 172.21.15.62:0/343783598 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94917620142128] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094078070 con 0x5653bb07ab30 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.448+0000 7fb0a5b51800 20 remove_watcher() i=2 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.448+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94917620146368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb081030 con 0x7fb09409b040 2024-04-26T07:54:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.449+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94917620146368] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098044040 con 0x7fb09409b040 2024-04-26T07:54:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.449+0000 7fb0a5b51800 20 remove_watcher() i=3 2024-04-26T07:54:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.449+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94917620148624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0820c0 con 0x5653bb0716d0 2024-04-26T07:54:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.450+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94917620148624] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098044040 con 0x5653bb0716d0 2024-04-26T07:54:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.450+0000 7fb0a5b51800 20 remove_watcher() i=4 2024-04-26T07:54:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.450+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94917620151824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb082990 con 0x5653bb075fe0 2024-04-26T07:54:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.451+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94917620151824] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.451+0000 7fb0a5b51800 20 remove_watcher() i=5 2024-04-26T07:54:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.451+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94917620155632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb0820c0 con 0x5653bb075fe0 2024-04-26T07:54:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.452+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94917620155632] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.452+0000 7fb0a5b51800 20 remove_watcher() i=6 2024-04-26T07:54:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.452+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94917620147424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653bb083610 con 0x5653bb075fe0 2024-04-26T07:54:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a3e58640 1 -- 172.21.15.62:0/343783598 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94917620147424] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09c055070 con 0x5653bb075fe0 2024-04-26T07:54:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 20 remove_watcher() i=7 2024-04-26T07:54:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb075fe0 msgr2=0x5653bb0783d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb075fe0 0x5653bb0783d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653bb0716d0 msgr2=0x5653bb073b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653bb0716d0 0x5653bb073b90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb09409b040 msgr2=0x7fb0940686f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb09409b040 0x7fb0940686f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5653bb07ab30 msgr2=0x5653bb07cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5653bb07ab30 0x5653bb07cff0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf6c036e60 msgr2=0x7faf6c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf6c036e60 0x7faf6c039320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5653bb042390 tx=0x7fb094082000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 msgr2=0x5653bb065a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a2e56640 1 -- 172.21.15.62:0/343783598 reap_dead start 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb065a00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb09c011f60 tx=0x7fb09c04ceb0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 shutdown_connections 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/343783598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb05e520 0x5653bb065a00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 >> 172.21.15.62:0/343783598 conn(0x5653bb05a7a0 msgr2=0x5653bb057e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 shutdown_connections 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.453+0000 7fb0a5b51800 1 -- 172.21.15.62:0/343783598 wait complete. 2024-04-26T07:54:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4216792098 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf7c036e60 msgr2=0x7faf7c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/4216792098 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf7c036e60 0x7faf7c039320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5653bb03d620 tx=0x7fb094066f90 comp rx=0 tx=0).stop 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4216792098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb051140 msgr2=0x5653bb051560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/4216792098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb051140 0x5653bb051560 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5653bb02bdb0 tx=0x7fb09c0188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4216792098 shutdown_connections 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/4216792098 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf7c036e60 0x7faf7c039320 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/4216792098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653bb051140 0x5653bb051560 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4216792098 >> 172.21.15.62:0/4216792098 conn(0x5653bb0451e0 msgr2=0x5653bb0455e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4216792098 shutdown_connections 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/4216792098 wait complete. 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb03f500 msgr2=0x5653bb0418f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb03f500 0x5653bb0418f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653baf3a820 msgr2=0x5653bb03cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653baf3a820 0x5653bb03cc00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf88036e60 msgr2=0x7faf88039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf88036e60 0x7faf88039320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb098000f60 tx=0x7fb0980012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 msgr2=0x5653bb02c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653bb02c3c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb09400a470 tx=0x7fb094002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 shutdown_connections 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5653baf3a820 0x5653bb03cc00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5653bb03f500 0x5653bb0418f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faf88036e60 0x7faf88039320 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 --2- 172.21.15.62:0/3326610605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5653baf39aa0 0x5653bb02c3c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 >> 172.21.15.62:0/3326610605 conn(0x5653baf34340 msgr2=0x5653bb024dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 shutdown_connections 2024-04-26T07:54:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.454+0000 7fb0a5b51800 1 -- 172.21.15.62:0/3326610605 wait complete. 2024-04-26T07:54:39.490 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-04-26T07:54:39.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-04-26T07:54:39.490 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-04-26T07:54:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.539+0000 7ff1fbba2800 1 Processor -- start 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.539+0000 7ff1fbba2800 1 -- start start 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.539+0000 7ff1fbba2800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55907df81b90 0x55907df83f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.539+0000 7ff1fbba2800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55907df84550 con 0x55907df7b970 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.539+0000 7ff1fbba2800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55907de1fe20 con 0x55907df81b90 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.540+0000 7ff1f8ea7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55907df81b90 0x55907df83f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.540+0000 7ff1f96a8640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55907df7b970 0x55907df7bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36790/0 (socket says 172.21.15.62:36790) 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.540+0000 7ff1f8ea7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55907df81b90 0x55907df83f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34398/0 (socket says 172.21.15.62:34398) 2024-04-26T07:54:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.540+0000 7ff1f96a8640 1 -- 172.21.15.62:0/4095054889 learned_addr learned my addr 172.21.15.62:0/4095054889 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:39.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.540+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/4095054889 >> v1:172.21.15.1:6789/0 conn(0x55907df7b970 legacy=0x55907df7bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.540+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/4095054889 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907df85730 con 0x55907df81b90 2024-04-26T07:54:39.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1f8ea7640 1 --2- 172.21.15.62:0/4095054889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df81b90 0x55907df83f80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000a470 tx=0x7ff1f001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f50b3fdd96f6332 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1ebfff640 1 -- 172.21.15.62:0/4095054889 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f0057070 con 0x55907df81b90 2024-04-26T07:54:39.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1ebfff640 1 -- 172.21.15.62:0/4095054889 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f0052570 con 0x55907df81b90 2024-04-26T07:54:39.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1ebfff640 1 -- 172.21.15.62:0/4095054889 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f0052870 con 0x55907df81b90 2024-04-26T07:54:39.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1fbba2800 1 -- 172.21.15.62:0/4095054889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df81b90 msgr2=0x55907df83f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/4095054889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df81b90 0x55907df83f80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000a470 tx=0x7ff1f001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:39.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1fbba2800 1 -- 172.21.15.62:0/4095054889 shutdown_connections 2024-04-26T07:54:39.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/4095054889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df81b90 0x55907df83f80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1fbba2800 1 -- 172.21.15.62:0/4095054889 >> 172.21.15.62:0/4095054889 conn(0x55907df77320 msgr2=0x55907df79740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1fbba2800 1 -- 172.21.15.62:0/4095054889 shutdown_connections 2024-04-26T07:54:39.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.542+0000 7ff1fbba2800 1 -- 172.21.15.62:0/4095054889 wait complete. 2024-04-26T07:54:39.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.555+0000 7ff1fbba2800 1 Processor -- start 2024-04-26T07:54:39.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.555+0000 7ff1fbba2800 1 -- start start 2024-04-26T07:54:39.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.555+0000 7ff1fbba2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907df7e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.555+0000 7ff1fbba2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55907dec8cd0 con 0x55907df7b970 2024-04-26T07:54:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.555+0000 7ff1f96a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907df7e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.556+0000 7ff1f96a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907df7e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34402/0 (socket says 172.21.15.62:34402) 2024-04-26T07:54:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.556+0000 7ff1f96a8640 1 -- 172.21.15.62:0/2642943602 learned_addr learned my addr 172.21.15.62:0/2642943602 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.556+0000 7ff1f96a8640 1 -- 172.21.15.62:0/2642943602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907df7c860 con 0x55907df7b970 2024-04-26T07:54:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.556+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/2642943602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907df7e2a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec001610 tx=0x7ff1ec006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94612afe9d548b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.556+0000 7ff0e7606640 1 -- 172.21.15.62:0/2642943602 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec004520 con 0x55907df7b970 2024-04-26T07:54:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.556+0000 7ff0e7606640 1 -- 172.21.15.62:0/2642943602 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec0046e0 con 0x55907df7b970 2024-04-26T07:54:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.556+0000 7ff0e7606640 1 -- 172.21.15.62:0/2642943602 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec004a80 con 0x55907df7b970 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2642943602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 msgr2=0x55907df7e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/2642943602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907df7e2a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec001610 tx=0x7ff1ec006f90 comp rx=0 tx=0).stop 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2642943602 shutdown_connections 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/2642943602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907df7e2a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2642943602 >> 172.21.15.62:0/2642943602 conn(0x55907df77320 msgr2=0x55907e06a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2642943602 shutdown_connections 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2642943602 wait complete. 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 Processor -- start 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 -- start start 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907e078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1fbba2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55907df849f0 con 0x55907df7b970 2024-04-26T07:54:39.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1f96a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907e078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1f96a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907e078a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34414/0 (socket says 172.21.15.62:34414) 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.557+0000 7ff1f96a8640 1 -- 172.21.15.62:0/3004071350 learned_addr learned my addr 172.21.15.62:0/3004071350 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.558+0000 7ff1f96a8640 1 -- 172.21.15.62:0/3004071350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907e078f50 con 0x55907df7b970 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.558+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907e078a10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00f000 tx=0x7ff1ec000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.558+0000 7ff0e5e03640 1 -- 172.21.15.62:0/3004071350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec022030 con 0x55907df7b970 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.558+0000 7ff0e5e03640 1 -- 172.21.15.62:0/3004071350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec019040 con 0x55907df7b970 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.558+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55907e0791e0 con 0x55907df7b970 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.558+0000 7ff0e5e03640 1 -- 172.21.15.62:0/3004071350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec014af0 con 0x55907df7b970 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.558+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907e07be90 con 0x55907df7b970 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.559+0000 7ff0e5e03640 1 -- 172.21.15.62:0/3004071350 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff1ec025070 con 0x55907df7b970 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.559+0000 7ff0e5e03640 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0e0036e60 0x7ff0e0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.559+0000 7ff0e5e03640 1 -- 172.21.15.62:0/3004071350 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ff1ec023070 con 0x55907df7b970 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.559+0000 7ff1f8ea7640 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0e0036e60 0x7ff0e0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.559+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907df81b90 0x55907e07fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.559+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0801d0 con 0x55907df81b90 2024-04-26T07:54:39.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.559+0000 7ff1f9ea9640 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907df81b90 0x55907e07fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.560+0000 7ff1f8ea7640 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0e0036e60 0x7ff0e0039320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0054000 tx=0x7ff1f004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.560+0000 7ff1f9ea9640 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907df81b90 0x55907e07fc50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.560+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/3004071350 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f40083e0 con 0x55907df81b90 2024-04-26T07:54:39.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.560+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e07d200 con 0x55907df81b90 2024-04-26T07:54:39.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.560+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/3004071350 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1f40083e0 con 0x55907df81b90 2024-04-26T07:54:39.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.560+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e082530 0x55907e084920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.560+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e085010 con 0x55907e082530 2024-04-26T07:54:39.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.561+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e082530 0x55907e084920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.561+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e082530 0x55907e084920 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.561+0000 7ff1f96a8640 1 -- 172.21.15.62:0/3004071350 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1ec00f030 con 0x55907e082530 2024-04-26T07:54:39.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.561+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0814e0 con 0x55907df81b90 2024-04-26T07:54:39.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.561+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/3004071350 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1f40083e0 con 0x55907df81b90 2024-04-26T07:54:39.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0819a0 con 0x55907df81b90 2024-04-26T07:54:39.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/3004071350 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1f40083e0 con 0x55907df81b90 2024-04-26T07:54:39.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1fbba2800 1 Processor -- start 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1fbba2800 1 -- start start 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1fbba2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0941c0 0x55907e0945e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1fbba2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55907de70170 con 0x55907e0941c0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1f9ea9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0941c0 0x55907e0945e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1f9ea9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0941c0 0x55907e0945e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34416/0 (socket says 172.21.15.62:34416) 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.562+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/2772824761 learned_addr learned my addr 172.21.15.62:0/2772824761 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.563+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/2772824761 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907e094b20 con 0x55907e0941c0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.563+0000 7ff1f9ea9640 1 --2- 172.21.15.62:0/2772824761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0941c0 0x55907e0945e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55907e079e10 tx=0x7ff1f400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.563+0000 7ff0deffd640 1 -- 172.21.15.62:0/2772824761 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4007d00 con 0x55907e0941c0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.563+0000 7ff0deffd640 1 -- 172.21.15.62:0/2772824761 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f401e020 con 0x55907e0941c0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.563+0000 7ff0deffd640 1 -- 172.21.15.62:0/2772824761 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4019590 con 0x55907e0941c0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.563+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2772824761 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55907e095590 con 0x55907e0941c0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.563+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2772824761 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907e095a90 con 0x55907e0941c0 2024-04-26T07:54:39.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.564+0000 7ff0deffd640 1 -- 172.21.15.62:0/2772824761 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff1f4016040 con 0x55907e0941c0 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.564+0000 7ff0deffd640 1 --2- 172.21.15.62:0/2772824761 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0d0036e60 0x7ff0d0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.564+0000 7ff0deffd640 1 -- 172.21.15.62:0/2772824761 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ff1f401f030 con 0x55907e0941c0 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.564+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/2772824761 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0d0036e60 0x7ff0d0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.564+0000 7ff1fbba2800 1 Processor -- start 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.564+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/2772824761 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0d0036e60 0x7ff0d0039320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55907e0806a0 tx=0x7ff1ec014c90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.564+0000 7ff1fbba2800 1 -- start start 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff1fbba2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff1fbba2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55907df7cbe0 con 0x55907e0a15b0 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff1f9ea9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff1f9ea9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34422/0 (socket says 172.21.15.62:34422) 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/3418130775 learned_addr learned my addr 172.21.15.62:0/3418130775 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/3418130775 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907e0a1fa0 con 0x55907e0a15b0 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff1f9ea9640 1 --2- 172.21.15.62:0/3418130775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a19d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff1f404ceb0 tx=0x7ff1f4014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed27eb2cfae5c768 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff0dcff9640 1 -- 172.21.15.62:0/3418130775 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f401d070 con 0x55907e0a15b0 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff0dcff9640 1 -- 172.21.15.62:0/3418130775 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f404a030 con 0x55907e0a15b0 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.565+0000 7ff0dcff9640 1 -- 172.21.15.62:0/3418130775 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4017dd0 con 0x55907e0a15b0 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3418130775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 msgr2=0x55907e0a19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3418130775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a19d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff1f404ceb0 tx=0x7ff1f4014f30 comp rx=0 tx=0).stop 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3418130775 shutdown_connections 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3418130775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a19d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3418130775 >> 172.21.15.62:0/3418130775 conn(0x55907e09d880 msgr2=0x55907e09b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3418130775 shutdown_connections 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3418130775 wait complete. 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 Processor -- start 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 -- start start 2024-04-26T07:54:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1fbba2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55907e0a2760 con 0x55907e0a15b0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.566+0000 7ff1f9ea9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff1f9ea9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34426/0 (socket says 172.21.15.62:34426) 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 learned_addr learned my addr 172.21.15.62:0/460750765 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907e0a8fd0 con 0x55907e0a15b0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff1f9ea9640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a8a90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40148c0 tx=0x7ff1f404ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff0ceffd640 1 -- 172.21.15.62:0/460750765 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4015510 con 0x55907e0a15b0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff0ceffd640 1 -- 172.21.15.62:0/460750765 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f40156d0 con 0x55907e0a15b0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55907e0a92c0 con 0x55907e0a15b0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff0ceffd640 1 -- 172.21.15.62:0/460750765 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4019730 con 0x55907e0a15b0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.567+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907e0abf10 con 0x55907e0a15b0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.568+0000 7ff0ceffd640 1 -- 172.21.15.62:0/460750765 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff1f40198d0 con 0x55907e0a15b0 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.568+0000 7ff0ceffd640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0c4036e60 0x7ff0c4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.568+0000 7ff0ceffd640 1 -- 172.21.15.62:0/460750765 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7ff1f4038c80 con 0x55907e0a15b0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.568+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0c4036e60 0x7ff0c4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.568+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.568+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0c4036e60 0x7ff0c4039320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec026520 tx=0x7ff1ec035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.568+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907e0b45a0 0x55907e0b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.568+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0b71b0 con 0x55907e0b45a0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1f8ea7640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907e0b45a0 0x55907e0b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1f8ea7640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907e0b45a0 0x55907e0b6a60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1fbba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1fbba2800 20 realm 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0b7580 con 0x55907e0b45a0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1fbba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1fbba2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.569+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0b7e50 con 0x55907e0b45a0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1fbba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0b81f0 con 0x55907e0b45a0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1fbba2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e0b8ca0 0x55907e0bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0bb810 con 0x55907e0b8ca0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1f9ea9640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e0b8ca0 0x55907e0bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.570+0000 7ff1f9ea9640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e0b8ca0 0x55907e0bb0b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.571+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.571+0000 7ff1fbba2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.571+0000 7ff1fbba2800 20 searching for the correct realm 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.571+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55907e0bd8c0 0x55907e0bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.571+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.571+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55907e0bd8c0 0x55907e0bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.571+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55907e0bd8c0 0x55907e0bfd80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.572+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.572+0000 7ff1f96a8640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff1ec055040 0x7ff1ec03f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.572+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x7ff1ec055040 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.572+0000 7ff1f8ea7640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff1ec055040 0x7ff1ec03f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.572+0000 7ff1f8ea7640 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff1ec055040 0x7ff1ec03f830 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.572+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.572+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.573+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.573+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b45a0 2024-04-26T07:54:39.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.573+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.573+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b45a0 2024-04-26T07:54:39.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.573+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.573+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.573+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.573+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.574+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.574+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x7ff1ec055040 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.574+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.574+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.574+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.574+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b45a0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.575+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.575+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.575+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.575+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b45a0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.575+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.575+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x7ff1ec055040 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.575+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.575+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.576+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.576+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.576+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.576+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.576+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.576+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.577+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.577+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.577+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.577+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b45a0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.577+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.577+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b45a0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.577+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.577+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.578+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.578+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.578+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.578+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x7ff1ec055040 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.578+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.578+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b45a0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.578+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.578+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.579+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.579+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.579+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.579+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.579+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.579+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x7ff1ec055040 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.580+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.580+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0bd8c0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.580+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.580+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b8ca0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.580+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.580+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x55907e0b45a0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.580+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.580+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c0450 con 0x7ff1ec055040 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0bc2c0 con 0x55907e0b45a0 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0bc710 con 0x55907e0b45a0 2024-04-26T07:54:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0bcbf0 con 0x55907e0b45a0 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 zone default found 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 4 Realm: () 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 zonegroup default 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.581+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c08d0 con 0x55907e0b8ca0 2024-04-26T07:54:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.582+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.582+0000 7ff1fbba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.582+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.582+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c2b00 con 0x55907e0bd8c0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.582+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.582+0000 7ff1fbba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.582+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.582+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c2ea0 con 0x55907e0bd8c0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.583+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.583+0000 7ff1fbba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.583+0000 7ff1fbba2800 20 started sync module instance, tier type = 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.583+0000 7ff1fbba2800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.583+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c1f40 con 0x7ff1ec055040 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.584+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.584+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94079078376240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c1f40 con 0x7ff1ec055040 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.584+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c3770 con 0x55907e0b45a0 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.585+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.585+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94079078380096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c3730 con 0x55907e0b45a0 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.585+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94079078376240] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.585+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c1a90 con 0x55907e0bd8c0 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.586+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94079078380096] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.586+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.586+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94079078382432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c4710 con 0x55907e0bd8c0 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.586+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c4fa0 con 0x7ff1ec055040 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.587+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94079078382432] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.587+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.587+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94079078384224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c53c0 con 0x7ff1ec055040 2024-04-26T07:54:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.587+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c5e00 con 0x55907e0b45a0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.588+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94079078384224] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.588+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.588+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94079078389968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c5dc0 con 0x55907e0b45a0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.588+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c6810 con 0x55907e0b8ca0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.589+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94079078389968] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.589+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.590+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94079078386352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c6810 con 0x55907e0b8ca0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.590+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c7220 con 0x55907e0b8ca0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.591+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.591+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94079078395248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c76a0 con 0x55907e0b8ca0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.591+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c81c0 con 0x55907e0b8ca0 2024-04-26T07:54:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.591+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94079078386352] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94079078395248] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94079078399120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c8180 con 0x55907e0b8ca0 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1fbba2800 20 add_watcher() i=0 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1fbba2800 20 add_watcher() i=1 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1fbba2800 20 add_watcher() i=2 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1fbba2800 20 add_watcher() i=3 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1fbba2800 20 add_watcher() i=4 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1fbba2800 20 add_watcher() i=5 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.592+0000 7ff1fbba2800 20 add_watcher() i=6 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.593+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94079078399120] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.593+0000 7ff1fbba2800 20 add_watcher() i=7 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.593+0000 7ff1fbba2800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.593+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0cb1b0 con 0x55907e0b45a0 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.593+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.593+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94079078392672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c8660 con 0x55907e0b45a0 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.594+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94079078392672] v27'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.594+0000 7ff0af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.594+0000 7ff1fbba2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.594+0000 7ff1fbba2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.594+0000 7ff1fbba2800 5 note: GC not initialized 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.595+0000 7ff0ae7e4640 20 reqs_thread_entry: start 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.595+0000 7ff1fbba2800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.595+0000 7ff1fbba2800 20 Filter name: none 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.595+0000 7ff01ffff640 20 reqs_thread_entry: start 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.595+0000 7ff1fbba2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.595+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55907e0fe2e0 con 0x55907e0b45a0 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.595+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.595+0000 7ff1fbba2800 20 rados_obj.operate() r=0 bl.length=193 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.596+0000 7ff0af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.596+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94079078392672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0caad0 con 0x55907e0b45a0 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.597+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94079078392672] v27'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.597+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94079078376240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c6360 con 0x7ff1ec055040 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.598+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94079078376240] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.598+0000 7ff1fbba2800 20 remove_watcher() i=0 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.598+0000 7ff1fbba2800 2 removed watcher, disabling cache 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.598+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94079078380096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c2330 con 0x55907e0b45a0 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.600+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94079078380096] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.600+0000 7ff1fbba2800 20 remove_watcher() i=1 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.600+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94079078382432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c2330 con 0x55907e0bd8c0 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.601+0000 7ff1f96a8640 1 -- 172.21.15.62:0/460750765 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94079078382432] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec052040 con 0x55907e0bd8c0 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.601+0000 7ff1fbba2800 20 remove_watcher() i=2 2024-04-26T07:54:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.601+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94079078384224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c3240 con 0x7ff1ec055040 2024-04-26T07:54:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.602+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94079078384224] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x7ff1ec055040 2024-04-26T07:54:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.602+0000 7ff1fbba2800 20 remove_watcher() i=3 2024-04-26T07:54:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.602+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94079078389968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c3240 con 0x55907e0b45a0 2024-04-26T07:54:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.603+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94079078389968] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f005a040 con 0x55907e0b45a0 2024-04-26T07:54:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.603+0000 7ff1fbba2800 20 remove_watcher() i=4 2024-04-26T07:54:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.603+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94079078386352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c58d0 con 0x55907e0b8ca0 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.604+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94079078386352] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.604+0000 7ff1fbba2800 20 remove_watcher() i=5 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.604+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94079078395248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c3240 con 0x55907e0b8ca0 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.605+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94079078395248] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.605+0000 7ff1fbba2800 20 remove_watcher() i=6 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.605+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94079078399120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55907e0c3240 con 0x55907e0b8ca0 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1f9ea9640 1 -- 172.21.15.62:0/460750765 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94079078399120] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f4034020 con 0x55907e0b8ca0 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 20 remove_watcher() i=7 2024-04-26T07:54:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e0b8ca0 msgr2=0x55907e0bb0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e0b8ca0 0x55907e0bb0b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907e0b45a0 msgr2=0x55907e0b6a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907e0b45a0 0x55907e0b6a60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff1ec055040 msgr2=0x7ff1ec03f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff1ec055040 0x7ff1ec03f830 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55907e0bd8c0 msgr2=0x55907e0bfd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55907e0bd8c0 0x55907e0bfd80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0c4036e60 msgr2=0x7ff0c4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0c4036e60 0x7ff0c4039320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec026520 tx=0x7ff1ec035000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 msgr2=0x55907e0a8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1f8ea7640 1 -- 172.21.15.62:0/460750765 reap_dead start 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a8a90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40148c0 tx=0x7ff1f404ce10 comp rx=0 tx=0).stop 2024-04-26T07:54:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 shutdown_connections 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/460750765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0a15b0 0x55907e0a8a90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 >> 172.21.15.62:0/460750765 conn(0x55907e09d880 msgr2=0x55907e09aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 shutdown_connections 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.606+0000 7ff1fbba2800 1 -- 172.21.15.62:0/460750765 wait complete. 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2772824761 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0d0036e60 msgr2=0x7ff0d0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/2772824761 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0d0036e60 0x7ff0d0039320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55907e0806a0 tx=0x7ff1ec014c90 comp rx=0 tx=0).stop 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2772824761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0941c0 msgr2=0x55907e0945e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/2772824761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0941c0 0x55907e0945e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55907e079e10 tx=0x7ff1f400aea0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2772824761 shutdown_connections 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/2772824761 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0d0036e60 0x7ff0d0039320 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/2772824761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907e0941c0 0x55907e0945e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2772824761 >> 172.21.15.62:0/2772824761 conn(0x55907e088260 msgr2=0x55907e088660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2772824761 shutdown_connections 2024-04-26T07:54:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/2772824761 wait complete. 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e082530 msgr2=0x55907e084920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e082530 0x55907e084920 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907df81b90 msgr2=0x55907e07fc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907df81b90 0x55907e07fc50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0e0036e60 msgr2=0x7ff0e0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0e0036e60 0x7ff0e0039320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0054000 tx=0x7ff1f004e000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 msgr2=0x55907e078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907e078a10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00f000 tx=0x7ff1ec000f40 comp rx=0 tx=0).stop 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 shutdown_connections 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55907df81b90 0x55907e07fc50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55907e082530 0x55907e084920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff0e0036e60 0x7ff0e0039320 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 --2- 172.21.15.62:0/3004071350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55907df7b970 0x55907e078a10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 >> 172.21.15.62:0/3004071350 conn(0x55907df77320 msgr2=0x55907df7d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 shutdown_connections 2024-04-26T07:54:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.607+0000 7ff1fbba2800 1 -- 172.21.15.62:0/3004071350 wait complete. 2024-04-26T07:54:39.614 INFO:teuthology.orchestra.run.smithi062.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"0CjTIBEX9pp8ZQJh8UPRIRko","ver":2},"mtime":"2024-04-26T07:54:39.437796Z","data":{"bucket":{"name":"myfoo","marker":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","bucket_id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-04-26T07:54:36.674214Z","linked":true,"has_bucket_info":false}} 2024-04-26T07:54:39.614 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '0CjTIBEX9pp8ZQJh8UPRIRko', 'ver': 2}, 'mtime': '2024-04-26T07:54:39.437796Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'bucket_id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-04-26T07:54:36.674214Z', 'linked': True, 'has_bucket_info': False}} 2024-04-26T07:54:39.614 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-26T07:54:39.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-26T07:54:39.615 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-04-26T07:54:39.701 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:39.701 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f8635613800 1 Processor -- start 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f8635613800 1 -- start start 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f8635613800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5604e1413110 0x5604e1415500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f8635613800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5604e1419550 con 0x5604e1415a40 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f8635613800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5604e12b4e20 con 0x5604e1413110 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f8630c6e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5604e1413110 0x5604e1415500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f862bfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5604e1415a40 0x5604e1417e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36802/0 (socket says 172.21.15.62:36802) 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f8630c6e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5604e1413110 0x5604e1415500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34442/0 (socket says 172.21.15.62:34442) 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.704+0000 7f862bfff640 1 -- 172.21.15.62:0/1426723895 learned_addr learned my addr 172.21.15.62:0/1426723895 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.705+0000 7f8630c6e640 1 -- 172.21.15.62:0/1426723895 >> v1:172.21.15.1:6789/0 conn(0x5604e1415a40 legacy=0x5604e1417e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.705+0000 7f8630c6e640 1 -- 172.21.15.62:0/1426723895 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e141a730 con 0x5604e1413110 2024-04-26T07:54:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.705+0000 7f862b7fe640 1 -- 172.21.15.62:0/1426723895 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94815743 0 0) 0x5604e1419550 con 0x5604e1415a40 2024-04-26T07:54:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f8630c6e640 1 --2- 172.21.15.62:0/1426723895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1415500 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f862400a470 tx=0x7f862401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a926fe5fdada67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f862b7fe640 1 -- 172.21.15.62:0/1426723895 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624057070 con 0x5604e1413110 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f862b7fe640 1 -- 172.21.15.62:0/1426723895 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8624052570 con 0x5604e1413110 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f862b7fe640 1 -- 172.21.15.62:0/1426723895 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624052870 con 0x5604e1413110 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f8635613800 1 -- 172.21.15.62:0/1426723895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 msgr2=0x5604e1415500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f8635613800 1 --2- 172.21.15.62:0/1426723895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1415500 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f862400a470 tx=0x7f862401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f8635613800 1 -- 172.21.15.62:0/1426723895 shutdown_connections 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f8635613800 1 --2- 172.21.15.62:0/1426723895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1415500 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f8635613800 1 -- 172.21.15.62:0/1426723895 >> 172.21.15.62:0/1426723895 conn(0x5604e140cbe0 msgr2=0x5604e140f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f8635613800 1 -- 172.21.15.62:0/1426723895 shutdown_connections 2024-04-26T07:54:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.707+0000 7f8635613800 1 -- 172.21.15.62:0/1426723895 wait complete. 2024-04-26T07:54:39.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.720+0000 7f8635613800 1 Processor -- start 2024-04-26T07:54:39.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.720+0000 7f8635613800 1 -- start start 2024-04-26T07:54:39.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.720+0000 7f8635613800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1503a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.720+0000 7f8635613800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604e135dd00 con 0x5604e1413110 2024-04-26T07:54:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.720+0000 7f8630c6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1503a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.721+0000 7f8630c6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1503a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34450/0 (socket says 172.21.15.62:34450) 2024-04-26T07:54:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.721+0000 7f8630c6e640 1 -- 172.21.15.62:0/3980612442 learned_addr learned my addr 172.21.15.62:0/3980612442 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.721+0000 7f8630c6e640 1 -- 172.21.15.62:0/3980612442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e1503fd0 con 0x5604e1413110 2024-04-26T07:54:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.721+0000 7f8630c6e640 1 --2- 172.21.15.62:0/3980612442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1503a00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8624055040 tx=0x7f862404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990937b3742d5ce8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.721+0000 7f851ee05640 1 -- 172.21.15.62:0/3980612442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624062070 con 0x5604e1413110 2024-04-26T07:54:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.721+0000 7f851ee05640 1 -- 172.21.15.62:0/3980612442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86240528d0 con 0x5604e1413110 2024-04-26T07:54:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.721+0000 7f851ee05640 1 -- 172.21.15.62:0/3980612442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624057040 con 0x5604e1413110 2024-04-26T07:54:39.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 -- 172.21.15.62:0/3980612442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 msgr2=0x5604e1503a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 --2- 172.21.15.62:0/3980612442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1503a00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8624055040 tx=0x7f862404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 -- 172.21.15.62:0/3980612442 shutdown_connections 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 --2- 172.21.15.62:0/3980612442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1503a00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 -- 172.21.15.62:0/3980612442 >> 172.21.15.62:0/3980612442 conn(0x5604e140cbe0 msgr2=0x5604e14ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 -- 172.21.15.62:0/3980612442 shutdown_connections 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 -- 172.21.15.62:0/3980612442 wait complete. 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 Processor -- start 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 -- start start 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1412a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.722+0000 7f8635613800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604e1419a20 con 0x5604e1413110 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f8630c6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1412a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f8630c6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1412a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34454/0 (socket says 172.21.15.62:34454) 2024-04-26T07:54:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f8630c6e640 1 -- 172.21.15.62:0/3706826156 learned_addr learned my addr 172.21.15.62:0/3706826156 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f8630c6e640 1 -- 172.21.15.62:0/3706826156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e1411160 con 0x5604e1413110 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f8630c6e640 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1412a70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8624000c00 tx=0x7f8624002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f851d602640 1 -- 172.21.15.62:0/3706826156 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624057050 con 0x5604e1413110 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f851d602640 1 -- 172.21.15.62:0/3706826156 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8624067660 con 0x5604e1413110 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f851d602640 1 -- 172.21.15.62:0/3706826156 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624062040 con 0x5604e1413110 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604e14113f0 con 0x5604e1413110 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.723+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e1411910 con 0x5604e1413110 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.724+0000 7f851d602640 1 -- 172.21.15.62:0/3706826156 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8624067940 con 0x5604e1413110 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.724+0000 7f851d602640 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8518036e60 0x7f8518039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.724+0000 7f851d602640 1 -- 172.21.15.62:0/3706826156 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f862408eb00 con 0x5604e1413110 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.724+0000 7f862bfff640 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8518036e60 0x7f8518039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.724+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1415a40 0x5604e15148f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.724+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1514e30 con 0x5604e1415a40 2024-04-26T07:54:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.725+0000 7f863146f640 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1415a40 0x5604e15148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.725+0000 7f863146f640 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1415a40 0x5604e15148f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.725+0000 7f862bfff640 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8518036e60 0x7f8518039320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f861c000c00 tx=0x7f861c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.725+0000 7f863146f640 1 -- 172.21.15.62:0/3706826156 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f862c00a4a0 con 0x5604e1415a40 2024-04-26T07:54:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.725+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1411d90 con 0x5604e1415a40 2024-04-26T07:54:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.725+0000 7f863146f640 1 -- 172.21.15.62:0/3706826156 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f862c00a4a0 con 0x5604e1415a40 2024-04-26T07:54:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.726+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e1516f60 0x5604e1519420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.726+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1519bb0 con 0x5604e1516f60 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.726+0000 7f8630c6e640 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e1516f60 0x5604e1519420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.726+0000 7f8630c6e640 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e1516f60 0x5604e1519420 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.726+0000 7f8630c6e640 1 -- 172.21.15.62:0/3706826156 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8624064070 con 0x5604e1516f60 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.726+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1515760 con 0x5604e1415a40 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.727+0000 7f863146f640 1 -- 172.21.15.62:0/3706826156 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f862c00a4a0 con 0x5604e1415a40 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.727+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1515c40 con 0x5604e1415a40 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.727+0000 7f863146f640 1 -- 172.21.15.62:0/3706826156 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f862c00a4a0 con 0x5604e1415a40 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.727+0000 7f8635613800 1 Processor -- start 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.727+0000 7f8635613800 1 -- start start 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.727+0000 7f8635613800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1528d20 0x5604e1529140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.727+0000 7f8635613800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604e1305170 con 0x5604e1528d20 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f863146f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1528d20 0x5604e1529140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f863146f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1528d20 0x5604e1529140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34460/0 (socket says 172.21.15.62:34460) 2024-04-26T07:54:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f863146f640 1 -- 172.21.15.62:0/3513539324 learned_addr learned my addr 172.21.15.62:0/3513539324 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f863146f640 1 -- 172.21.15.62:0/3513539324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e1529680 con 0x5604e1528d20 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f863146f640 1 --2- 172.21.15.62:0/3513539324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1528d20 0x5604e1529140 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x5604e1515220 tx=0x7f862c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f85167fc640 1 -- 172.21.15.62:0/3513539324 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c014450 con 0x5604e1528d20 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f85167fc640 1 -- 172.21.15.62:0/3513539324 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c014610 con 0x5604e1528d20 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f8635613800 1 -- 172.21.15.62:0/3513539324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604e152a0f0 con 0x5604e1528d20 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f85167fc640 1 -- 172.21.15.62:0/3513539324 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c014930 con 0x5604e1528d20 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.728+0000 7f8635613800 1 -- 172.21.15.62:0/3513539324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e152a5f0 con 0x5604e1528d20 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.729+0000 7f85167fc640 1 -- 172.21.15.62:0/3513539324 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f862c011040 con 0x5604e1528d20 2024-04-26T07:54:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.729+0000 7f85167fc640 1 --2- 172.21.15.62:0/3513539324 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8508036e60 0x7f8508039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.729+0000 7f85167fc640 1 -- 172.21.15.62:0/3513539324 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f862c01e070 con 0x5604e1528d20 2024-04-26T07:54:39.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.729+0000 7f8630c6e640 1 --2- 172.21.15.62:0/3513539324 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8508036e60 0x7f8508039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f8635613800 1 Processor -- start 2024-04-26T07:54:39.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f8635613800 1 -- start start 2024-04-26T07:54:39.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f8630c6e640 1 --2- 172.21.15.62:0/3513539324 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8508036e60 0x7f8508039320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5604e15162d0 tx=0x7f862408cee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f8635613800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e15364d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f8635613800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604e1504290 con 0x5604e15360b0 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f863146f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e15364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f863146f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e15364d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34472/0 (socket says 172.21.15.62:34472) 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f863146f640 1 -- 172.21.15.62:0/955047403 learned_addr learned my addr 172.21.15.62:0/955047403 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f863146f640 1 -- 172.21.15.62:0/955047403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e1536aa0 con 0x5604e15360b0 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f863146f640 1 --2- 172.21.15.62:0/955047403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e15364d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f862c04d080 tx=0x7f862c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135a477ccaaf3ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f8507fff640 1 -- 172.21.15.62:0/955047403 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c046070 con 0x5604e15360b0 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f8507fff640 1 -- 172.21.15.62:0/955047403 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c013c90 con 0x5604e15360b0 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.730+0000 7f8507fff640 1 -- 172.21.15.62:0/955047403 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c046210 con 0x5604e15360b0 2024-04-26T07:54:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 -- 172.21.15.62:0/955047403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 msgr2=0x5604e15364d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 --2- 172.21.15.62:0/955047403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e15364d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f862c04d080 tx=0x7f862c011700 comp rx=0 tx=0).stop 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 -- 172.21.15.62:0/955047403 shutdown_connections 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 --2- 172.21.15.62:0/955047403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e15364d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 -- 172.21.15.62:0/955047403 >> 172.21.15.62:0/955047403 conn(0x5604e1532380 msgr2=0x5604e15303e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 -- 172.21.15.62:0/955047403 shutdown_connections 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 -- 172.21.15.62:0/955047403 wait complete. 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 Processor -- start 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 -- start start 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e153d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.731+0000 7f8635613800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604e15371c0 con 0x5604e15360b0 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f863146f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e153d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f863146f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e153d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34476/0 (socket says 172.21.15.62:34476) 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 learned_addr learned my addr 172.21.15.62:0/2223150951 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e153da80 con 0x5604e15360b0 2024-04-26T07:54:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f863146f640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e153d540 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f862c011740 tx=0x7f862c04d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f85067fc640 1 -- 172.21.15.62:0/2223150951 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c03b070 con 0x5604e15360b0 2024-04-26T07:54:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f85067fc640 1 -- 172.21.15.62:0/2223150951 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c013e40 con 0x5604e15360b0 2024-04-26T07:54:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604e153dd10 con 0x5604e15360b0 2024-04-26T07:54:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f85067fc640 1 -- 172.21.15.62:0/2223150951 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c046040 con 0x5604e15360b0 2024-04-26T07:54:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.732+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e15409c0 con 0x5604e15360b0 2024-04-26T07:54:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.733+0000 7f85067fc640 1 -- 172.21.15.62:0/2223150951 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f862c02b350 con 0x5604e15360b0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.733+0000 7f85067fc640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f84fc036e60 0x7f84fc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.733+0000 7f85067fc640 1 -- 172.21.15.62:0/2223150951 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f862c033070 con 0x5604e15360b0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.733+0000 7f8630c6e640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f84fc036e60 0x7f84fc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f8630c6e640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f84fc036e60 0x7f84fc039320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8624052dc0 tx=0x7f862408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1549260 0x5604e154b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e154be70 con 0x5604e1549260 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f862bfff640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1549260 0x5604e154b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f862bfff640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1549260 0x5604e154b720 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861c00f5f0 con 0x5604e1549260 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f8635613800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f8635613800 20 realm 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.734+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e15486b0 con 0x5604e1549260 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861c00f5f0 con 0x5604e1549260 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e154c960 con 0x5604e1549260 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861c00f5f0 con 0x5604e1549260 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e154d230 con 0x5604e1549260 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f861c00f5f0 con 0x5604e1549260 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e154dc50 0x5604e1550040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e15507b0 con 0x5604e154dc50 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.735+0000 7f863146f640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e154dc50 0x5604e1550040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.736+0000 7f863146f640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e154dc50 0x5604e1550040 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.736+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.736+0000 7f8635613800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.736+0000 7f8635613800 20 searching for the correct realm 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.736+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604e1552760 0x5604e1554c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.736+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e1552760 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.736+0000 7f8630c6e640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604e1552760 0x5604e1554c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.736+0000 7f8630c6e640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604e1552760 0x5604e1554c20 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.737+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.737+0000 7f8630c6e640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f862409b040 0x7f862408e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.737+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x7f862409b040 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.737+0000 7f862bfff640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f862409b040 0x7f862408e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.737+0000 7f862bfff640 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f862409b040 0x7f862408e100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.738+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c00f5f0 con 0x7f862409b040 2024-04-26T07:54:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.738+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e154dc50 2024-04-26T07:54:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.738+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.738+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e1549260 2024-04-26T07:54:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.738+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c00f5f0 con 0x5604e1549260 2024-04-26T07:54:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.738+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e1549260 2024-04-26T07:54:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.739+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.739+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e154dc50 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.739+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.739+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e154dc50 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.739+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.739+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x7f862409b040 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.740+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.740+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e1552760 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.740+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.740+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e1549260 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.740+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.740+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e154dc50 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.740+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.740+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e1549260 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.741+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.741+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x7f862409b040 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.741+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.741+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5604e15552f0 con 0x5604e1552760 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.741+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.741+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1552760 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.741+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.741+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e154dc50 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.742+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.742+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1552760 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.742+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.742+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1552760 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.743+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.743+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1549260 2024-04-26T07:54:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.743+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.743+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1549260 2024-04-26T07:54:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.743+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.743+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e154dc50 2024-04-26T07:54:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.743+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.743+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1552760 2024-04-26T07:54:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.744+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.744+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x7f862409b040 2024-04-26T07:54:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.744+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.744+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1549260 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.744+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.744+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e154dc50 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.744+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.744+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1552760 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.745+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.745+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e154dc50 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.745+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.745+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x7f862409b040 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.745+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.745+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1552760 2024-04-26T07:54:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.746+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.746+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e154dc50 2024-04-26T07:54:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.746+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.746+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x5604e1549260 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.746+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.746+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f86240a9040 con 0x7f862409b040 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1551170 con 0x5604e1549260 2024-04-26T07:54:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1551a10 con 0x5604e1549260 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1550db0 con 0x5604e1549260 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 zone default found 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 4 Realm: () 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:39.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 zonegroup default 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.747+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e15557e0 con 0x5604e154dc50 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1557ab0 con 0x5604e1552760 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1557e50 con 0x5604e1552760 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 20 started sync module instance, tier type = 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.748+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1556f40 con 0x7f862409b040 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.749+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.749+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94578960331888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1556f40 con 0x7f862409b040 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.749+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1558860 con 0x5604e1549260 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.751+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94578960331888] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.751+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.751+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94578960329840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1558860 con 0x5604e1549260 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.751+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1559260 con 0x5604e1552760 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.752+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94578960329840] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.752+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.752+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94578960335792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e15587d0 con 0x5604e1552760 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.752+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155a010 con 0x7f862409b040 2024-04-26T07:54:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.755+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94578960335792] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.755+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.755+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94578960340560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155a400 con 0x7f862409b040 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.755+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155ae00 con 0x5604e1549260 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.756+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94578960340560] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.756+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.756+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94578960341616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155adc0 con 0x5604e1549260 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.756+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155b840 con 0x5604e154dc50 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.757+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94578960341616] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.757+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.757+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94578960348528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155adc0 con 0x5604e154dc50 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.757+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155c290 con 0x5604e154dc50 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.758+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.758+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94578960348528] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.758+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94578960350624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155c1c0 con 0x5604e154dc50 2024-04-26T07:54:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.758+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155cce0 con 0x5604e154dc50 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94578960350624] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94578960345360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155cca0 con 0x5604e154dc50 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f8635613800 20 add_watcher() i=0 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f8635613800 20 add_watcher() i=1 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f8635613800 20 add_watcher() i=2 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f8635613800 20 add_watcher() i=3 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f8635613800 20 add_watcher() i=4 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f8635613800 20 add_watcher() i=5 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.759+0000 7f8635613800 20 add_watcher() i=6 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.760+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94578960345360] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.760+0000 7f8635613800 20 add_watcher() i=7 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.760+0000 7f8635613800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.760+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1560160 con 0x5604e1549260 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.761+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.761+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94578960353728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155d680 con 0x5604e1549260 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94578960353728] v27'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f84e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f8635613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f8635613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f8635613800 5 note: GC not initialized 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f84e5fe3640 20 reqs_thread_entry: start 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f8635613800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f8635613800 20 Filter name: none 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f84577fe640 20 reqs_thread_entry: start 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f8635613800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.762+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e15938d0 con 0x5604e1549260 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1593420 con 0x5604e1549260 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 20 rados_obj.operate() r=0 bl.length=193 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T07:54:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.763+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 8.1e 8:783134b2:root::.bucket.meta.testx%3amyfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e1597570 con 0x5604e154dc50 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f8635613800 20 rados_obj.operate() r=0 bl.length=412 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f8635613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f8635613800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f8635613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f8635613800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f8635613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f8635613800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.764+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e159b7e0 con 0x5604e1549260 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.765+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v27'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.765+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e159f0f0 con 0x5604e1549260 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.766+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(66 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [create,call,writefull 0~379,setxattr (123)] v27'7 uv7 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.766+0000 7f8635613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x7 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.766+0000 7f8635613800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.766+0000 7f8635613800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.766+0000 7f8635613800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1, ofs0, ns] 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.766+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94578960617104 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e159ead0 con 0x5604e154dc50 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== watch-notify(notify (1) cookie 94578960348528 notify 115964117005 ret 0) ==== 770+0+0 (crc 0 0 0) 0x5604e1596ba0 con 0x5604e154dc50 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8507fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117005 cookie 94578960348528 notifier 4550 bl.length()=728 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8507fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x7 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8507fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8507fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(67 notify.5 [notify cookie 94578960617104 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8507fff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f84f4003ea0 con 0x5604e154dc50 2024-04-26T07:54:39.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== watch-notify(notify_complete (2) cookie 94578960617104 notify 115964117005 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5604e153dd10 con 0x5604e154dc50 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8635613800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_sources= new_sources= 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8635613800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential sources added=[] removed=[] 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8635613800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_dests= new_dests= 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8635613800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential dests added=[] removed=[] 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.767+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e159eb70 con 0x7f862409b040 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.768+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(69 foo.buckets [call] v27'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.768+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e159e070 con 0x7f862409b040 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.769+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.769+0000 7f8635613800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.769+0000 7f8635613800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.769+0000 7f8635613800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.769+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94578960623296 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e159f6f0 con 0x5604e154dc50 2024-04-26T07:54:39.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== watch-notify(notify (1) cookie 94578960350624 notify 115964117006 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5604e153da80 con 0x5604e154dc50 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f85077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 94578960350624 notifier 4550 bl.length()=314 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f85077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f85077fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(71 notify.6 [notify cookie 94578960623296 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f85077fe640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8464003400 con 0x5604e154dc50 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== watch-notify(notify_complete (2) cookie 94578960623296 notify 115964117006 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5604e1536aa0 con 0x5604e154dc50 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.770+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e159ed40 con 0x5604e1549260 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.771+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(73 testx/myfoo [call,delete] v27'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.771+0000 7f8635613800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.771+0000 7f8635613800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.771+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94578960623296 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e159be80 con 0x5604e1549260 2024-04-26T07:54:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.771+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify (1) cookie 94578960341616 notify 115964117005 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5604e159eb70 con 0x5604e1549260 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.771+0000 7f85077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117005 cookie 94578960341616 notifier 4550 bl.length()=155 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.771+0000 7f85077fe640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8464003400 con 0x5604e1549260 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.771+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(74 notify.4 [notify cookie 94578960623296 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.772+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.772+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== watch-notify(notify_complete (2) cookie 94578960623296 notify 115964117005 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5604e159dea0 con 0x5604e1549260 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.772+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 8.1e 8:783134b2:root::.bucket.meta.testx%3amyfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e159ed40 con 0x5604e154dc50 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.773+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call,delete] v27'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.773+0000 7f8635613800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 from cache 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.773+0000 7f8635613800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1, ofs0, ns] 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.773+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94578960623296 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604e159ed40 con 0x5604e1549260 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.773+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== watch-notify(notify (1) cookie 94578960341616 notify 115964117006 ret 0) ==== 254+0+0 (crc 0 0 0) 0x5604e159dea0 con 0x5604e1549260 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.773+0000 7f8507fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 94578960341616 notifier 4550 bl.length()=212 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.773+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(77 notify.4 [notify cookie 94578960623296 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.773+0000 7f8507fff640 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f84f4003ea0 con 0x5604e1549260 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.774+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== watch-notify(notify_complete (2) cookie 94578960623296 notify 115964117006 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5604e159f490 con 0x5604e1549260 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.774+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.775+0000 7f84e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.775+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94578960353728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e15974e0 con 0x5604e1549260 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.776+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94578960353728] v27'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.776+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94578960331888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e155c990 con 0x7f862409b040 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.777+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94578960331888] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.777+0000 7f8635613800 20 remove_watcher() i=0 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.777+0000 7f8635613800 2 removed watcher, disabling cache 2024-04-26T07:54:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.777+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94578960329840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1557470 con 0x5604e1549260 2024-04-26T07:54:39.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.778+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94578960329840] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.778+0000 7f8635613800 20 remove_watcher() i=1 2024-04-26T07:54:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.778+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94578960335792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1557470 con 0x5604e1552760 2024-04-26T07:54:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.779+0000 7f8630c6e640 1 -- 172.21.15.62:0/2223150951 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94578960335792] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8624097030 con 0x5604e1552760 2024-04-26T07:54:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.779+0000 7f8635613800 20 remove_watcher() i=2 2024-04-26T07:54:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.779+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94578960340560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e15583b0 con 0x7f862409b040 2024-04-26T07:54:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.780+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94578960340560] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x7f862409b040 2024-04-26T07:54:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.780+0000 7f8635613800 20 remove_watcher() i=3 2024-04-26T07:54:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.780+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94578960341616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1557470 con 0x5604e1549260 2024-04-26T07:54:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.781+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94578960341616] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c02b040 con 0x5604e1549260 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.781+0000 7f8635613800 20 remove_watcher() i=4 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.781+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94578960348528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e15583b0 con 0x5604e154dc50 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.782+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94578960348528] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.782+0000 7f8635613800 20 remove_watcher() i=5 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.782+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94578960350624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e1557470 con 0x5604e154dc50 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.783+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94578960350624] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.783+0000 7f8635613800 20 remove_watcher() i=6 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.784+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94578960345360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604e15583b0 con 0x5604e154dc50 2024-04-26T07:54:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.784+0000 7f863146f640 1 -- 172.21.15.62:0/2223150951 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94578960345360] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862c055070 con 0x5604e154dc50 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.784+0000 7f8635613800 20 remove_watcher() i=7 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e154dc50 msgr2=0x5604e1550040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e154dc50 0x5604e1550040 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1549260 msgr2=0x5604e154b720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1549260 0x5604e154b720 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f862409b040 msgr2=0x7f862408e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f862409b040 0x7f862408e100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604e1552760 msgr2=0x5604e1554c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604e1552760 0x5604e1554c20 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f84fc036e60 msgr2=0x7f84fc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f84fc036e60 0x7f84fc039320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8624052dc0 tx=0x7f862408a000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f862bfff640 1 -- 172.21.15.62:0/2223150951 reap_dead start 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 msgr2=0x5604e153d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e153d540 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f862c011740 tx=0x7f862c04d010 comp rx=0 tx=0).stop 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 shutdown_connections 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/2223150951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e15360b0 0x5604e153d540 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 >> 172.21.15.62:0/2223150951 conn(0x5604e1532380 msgr2=0x5604e152f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 shutdown_connections 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/2223150951 wait complete. 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/3513539324 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8508036e60 msgr2=0x7f8508039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/3513539324 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8508036e60 0x7f8508039320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5604e15162d0 tx=0x7f862408cee0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/3513539324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1528d20 msgr2=0x5604e1529140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/3513539324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1528d20 0x5604e1529140 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x5604e1515220 tx=0x7f862c018830 comp rx=0 tx=0).stop 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/3513539324 shutdown_connections 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/3513539324 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8508036e60 0x7f8508039320 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 --2- 172.21.15.62:0/3513539324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1528d20 0x5604e1529140 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/3513539324 >> 172.21.15.62:0/3513539324 conn(0x5604e151cdc0 msgr2=0x5604e151d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/3513539324 shutdown_connections 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.785+0000 7f8635613800 1 -- 172.21.15.62:0/3513539324 wait complete. 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e1516f60 msgr2=0x5604e1519420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e1516f60 0x5604e1519420 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1415a40 msgr2=0x5604e15148f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1415a40 0x5604e15148f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8518036e60 msgr2=0x7f8518039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8518036e60 0x7f8518039320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f861c000c00 tx=0x7f861c0013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 msgr2=0x5604e1412a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1412a70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8624000c00 tx=0x7f8624002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 shutdown_connections 2024-04-26T07:54:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604e1415a40 0x5604e15148f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5604e1516f60 0x5604e1519420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8518036e60 0x7f8518039320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 --2- 172.21.15.62:0/3706826156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604e1413110 0x5604e1412a70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 >> 172.21.15.62:0/3706826156 conn(0x5604e140cbe0 msgr2=0x5604e14fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 shutdown_connections 2024-04-26T07:54:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.786+0000 7f8635613800 1 -- 172.21.15.62:0/3706826156 wait complete. 2024-04-26T07:54:39.803 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T07:54:39.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T07:54:39.804 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-04-26T07:54:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.854+0000 7f56121a2800 1 Processor -- start 2024-04-26T07:54:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.854+0000 7f56121a2800 1 -- start start 2024-04-26T07:54:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.854+0000 7f56121a2800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x560a50c0e960 0x560a50c0ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.854+0000 7f56121a2800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a50c0f3b0 con 0x560a50c119a0 2024-04-26T07:54:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.854+0000 7f56121a2800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x560a50ab2e20 con 0x560a50c0e960 2024-04-26T07:54:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.855+0000 7f560fca8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x560a50c0e960 0x560a50c0ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.855+0000 7f560f4a7640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x560a50c119a0 0x560a50c11e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36814/0 (socket says 172.21.15.62:36814) 2024-04-26T07:54:39.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.855+0000 7f560f4a7640 1 -- 172.21.15.62:0/3368011568 learned_addr learned my addr 172.21.15.62:0/3368011568 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:39.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.855+0000 7f560fca8640 1 -- 172.21.15.62:0/3368011568 >> v1:172.21.15.1:6789/0 conn(0x560a50c119a0 legacy=0x560a50c11e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.855+0000 7f560fca8640 1 -- 172.21.15.62:0/3368011568 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a50c12560 con 0x560a50c0e960 2024-04-26T07:54:39.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f560fca8640 1 --2- 172.21.15.62:0/3368011568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50c0ed80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f560000a470 tx=0x7f560001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfac08cbb0492a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f560eca6640 1 -- 172.21.15.62:0/3368011568 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5600057070 con 0x560a50c0e960 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f560eca6640 1 -- 172.21.15.62:0/3368011568 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560004adc0 con 0x560a50c0e960 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f560eca6640 1 -- 172.21.15.62:0/3368011568 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5600052590 con 0x560a50c0e960 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f56121a2800 1 -- 172.21.15.62:0/3368011568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 msgr2=0x560a50c0ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f56121a2800 1 --2- 172.21.15.62:0/3368011568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50c0ed80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f560000a470 tx=0x7f560001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f56121a2800 1 -- 172.21.15.62:0/3368011568 shutdown_connections 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f56121a2800 1 --2- 172.21.15.62:0/3368011568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50c0ed80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f56121a2800 1 -- 172.21.15.62:0/3368011568 >> 172.21.15.62:0/3368011568 conn(0x560a50c0a360 msgr2=0x560a50c0c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.857+0000 7f56121a2800 1 -- 172.21.15.62:0/3368011568 shutdown_connections 2024-04-26T07:54:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.858+0000 7f56121a2800 1 -- 172.21.15.62:0/3368011568 wait complete. 2024-04-26T07:54:39.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.870+0000 7f56121a2800 1 Processor -- start 2024-04-26T07:54:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.870+0000 7f56121a2800 1 -- start start 2024-04-26T07:54:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.870+0000 7f56121a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d01cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.870+0000 7f56121a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a50b5bd00 con 0x560a50c0e960 2024-04-26T07:54:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.870+0000 7f560fca8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d01cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.870+0000 7f560fca8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d01cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34494/0 (socket says 172.21.15.62:34494) 2024-04-26T07:54:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.870+0000 7f560fca8640 1 -- 172.21.15.62:0/2089110264 learned_addr learned my addr 172.21.15.62:0/2089110264 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.871+0000 7f560fca8640 1 -- 172.21.15.62:0/2089110264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a50d022c0 con 0x560a50c0e960 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.871+0000 7f560fca8640 1 --2- 172.21.15.62:0/2089110264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d01cf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f560001ced0 tx=0x7f560004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc586b9c50d40a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.871+0000 7f54fde0b640 1 -- 172.21.15.62:0/2089110264 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5600057040 con 0x560a50c0e960 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.871+0000 7f54fde0b640 1 -- 172.21.15.62:0/2089110264 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5600063070 con 0x560a50c0e960 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.871+0000 7f54fde0b640 1 -- 172.21.15.62:0/2089110264 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5600052800 con 0x560a50c0e960 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 -- 172.21.15.62:0/2089110264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 msgr2=0x560a50d01cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 --2- 172.21.15.62:0/2089110264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d01cf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f560001ced0 tx=0x7f560004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 -- 172.21.15.62:0/2089110264 shutdown_connections 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 --2- 172.21.15.62:0/2089110264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d01cf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 -- 172.21.15.62:0/2089110264 >> 172.21.15.62:0/2089110264 conn(0x560a50c0a360 msgr2=0x560a50cfd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 -- 172.21.15.62:0/2089110264 shutdown_connections 2024-04-26T07:54:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 -- 172.21.15.62:0/2089110264 wait complete. 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 Processor -- start 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 -- start start 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d09750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f56121a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a50c19e10 con 0x560a50c0e960 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f560fca8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d09750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f560fca8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d09750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34508/0 (socket says 172.21.15.62:34508) 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.872+0000 7f560fca8640 1 -- 172.21.15.62:0/3429615126 learned_addr learned my addr 172.21.15.62:0/3429615126 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.873+0000 7f560fca8640 1 -- 172.21.15.62:0/3429615126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a50d09c90 con 0x560a50c0e960 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.873+0000 7f560fca8640 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d09750 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f560001ced0 tx=0x7f5600002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.873+0000 7f54f7fff640 1 -- 172.21.15.62:0/3429615126 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f560006d070 con 0x560a50c0e960 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.873+0000 7f54f7fff640 1 -- 172.21.15.62:0/3429615126 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5600052d20 con 0x560a50c0e960 2024-04-26T07:54:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.873+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a50d09f20 con 0x560a50c0e960 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.873+0000 7f54f7fff640 1 -- 172.21.15.62:0/3429615126 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5600057050 con 0x560a50c0e960 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.873+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a50d0cb80 con 0x560a50c0e960 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.874+0000 7f54f7fff640 1 -- 172.21.15.62:0/3429615126 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f560005d470 con 0x560a50c0e960 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.874+0000 7f54f7fff640 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54f8036e60 0x7f54f8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.874+0000 7f54f7fff640 1 -- 172.21.15.62:0/3429615126 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f560008e1d0 con 0x560a50c0e960 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.874+0000 7f560f4a7640 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54f8036e60 0x7f54f8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.874+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50c119a0 0x560a50d10940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.874+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d10e80 con 0x560a50c119a0 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.874+0000 7f56104a9640 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50c119a0 0x560a50d10940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.874+0000 7f560f4a7640 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54f8036e60 0x7f54f8039320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5604001d90 tx=0x7f56040012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.875+0000 7f56104a9640 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50c119a0 0x560a50d10940 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.875+0000 7f56104a9640 1 -- 172.21.15.62:0/3429615126 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f560800a4a0 con 0x560a50c119a0 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.875+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d11700 con 0x560a50c119a0 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.875+0000 7f56104a9640 1 -- 172.21.15.62:0/3429615126 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f560800a4a0 con 0x560a50c119a0 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.875+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d13010 0x560a50d154b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.875+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d15c40 con 0x560a50d13010 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.876+0000 7f560fca8640 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d13010 0x560a50d154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.876+0000 7f560fca8640 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d13010 0x560a50d154b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.876+0000 7f560fca8640 1 -- 172.21.15.62:0/3429615126 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5600078070 con 0x560a50d13010 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.876+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d11f80 con 0x560a50c119a0 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.877+0000 7f56104a9640 1 -- 172.21.15.62:0/3429615126 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f560800a4a0 con 0x560a50c119a0 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.877+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d12460 con 0x560a50c119a0 2024-04-26T07:54:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.877+0000 7f56104a9640 1 -- 172.21.15.62:0/3429615126 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f560800a4a0 con 0x560a50c119a0 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.877+0000 7f56121a2800 1 Processor -- start 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.877+0000 7f56121a2800 1 -- start start 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f56121a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d24de0 0x560a50d25200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f56121a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a50b03170 con 0x560a50d24de0 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f56104a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d24de0 0x560a50d25200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f56104a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d24de0 0x560a50d25200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34518/0 (socket says 172.21.15.62:34518) 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f56104a9640 1 -- 172.21.15.62:0/2665772180 learned_addr learned my addr 172.21.15.62:0/2665772180 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f56104a9640 1 -- 172.21.15.62:0/2665772180 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a50d25740 con 0x560a50d24de0 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f56104a9640 1 --2- 172.21.15.62:0/2665772180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d24de0 0x560a50d25200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x560a50d11220 tx=0x7f5608018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f54f57fa640 1 -- 172.21.15.62:0/2665772180 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5608014450 con 0x560a50d24de0 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f54f57fa640 1 -- 172.21.15.62:0/2665772180 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56080145f0 con 0x560a50d24de0 2024-04-26T07:54:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f56121a2800 1 -- 172.21.15.62:0/2665772180 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a50d261b0 con 0x560a50d24de0 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.878+0000 7f54f57fa640 1 -- 172.21.15.62:0/2665772180 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5608014910 con 0x560a50d24de0 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.879+0000 7f56121a2800 1 -- 172.21.15.62:0/2665772180 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a50d266b0 con 0x560a50d24de0 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.879+0000 7f54f57fa640 1 -- 172.21.15.62:0/2665772180 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5608011040 con 0x560a50d24de0 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.879+0000 7f54f57fa640 1 --2- 172.21.15.62:0/2665772180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54e8036e60 0x7f54e8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.879+0000 7f54f57fa640 1 -- 172.21.15.62:0/2665772180 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f560801e070 con 0x560a50d24de0 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.879+0000 7f560fca8640 1 --2- 172.21.15.62:0/2665772180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54e8036e60 0x7f54e8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56121a2800 1 Processor -- start 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56121a2800 1 -- start start 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f560fca8640 1 --2- 172.21.15.62:0/2665772180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54e8036e60 0x7f54e8039320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x560a50d0e040 tx=0x7f560008e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56121a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d32590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56121a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a50d02580 con 0x560a50d32170 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56104a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d32590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56104a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d32590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34526/0 (socket says 172.21.15.62:34526) 2024-04-26T07:54:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56104a9640 1 -- 172.21.15.62:0/3555798200 learned_addr learned my addr 172.21.15.62:0/3555798200 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56104a9640 1 -- 172.21.15.62:0/3555798200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a50d32b60 con 0x560a50d32170 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.880+0000 7f56104a9640 1 --2- 172.21.15.62:0/3555798200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d32590 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5608013cf0 tx=0x7f5608011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87bc9096bab67cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f54eeffd640 1 -- 172.21.15.62:0/3555798200 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5608016a90 con 0x560a50d32170 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f54eeffd640 1 -- 172.21.15.62:0/3555798200 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5608016440 con 0x560a50d32170 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f54eeffd640 1 -- 172.21.15.62:0/3555798200 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5608022c20 con 0x560a50d32170 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 -- 172.21.15.62:0/3555798200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 msgr2=0x560a50d32590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 --2- 172.21.15.62:0/3555798200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d32590 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5608013cf0 tx=0x7f5608011460 comp rx=0 tx=0).stop 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 -- 172.21.15.62:0/3555798200 shutdown_connections 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 --2- 172.21.15.62:0/3555798200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d32590 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 -- 172.21.15.62:0/3555798200 >> 172.21.15.62:0/3555798200 conn(0x560a50d2e440 msgr2=0x560a50d2c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 -- 172.21.15.62:0/3555798200 shutdown_connections 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 -- 172.21.15.62:0/3555798200 wait complete. 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 Processor -- start 2024-04-26T07:54:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.881+0000 7f56121a2800 1 -- start start 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56121a2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d39620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56121a2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a50d332f0 con 0x560a50d32170 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56104a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d39620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56104a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d39620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34532/0 (socket says 172.21.15.62:34532) 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 learned_addr learned my addr 172.21.15.62:0/2276995295 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a50d39b60 con 0x560a50d32170 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56104a9640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d39620 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5608043040 tx=0x7f560804cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f54ed7fa640 1 -- 172.21.15.62:0/2276995295 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f560803b070 con 0x560a50d32170 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f54ed7fa640 1 -- 172.21.15.62:0/2276995295 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56080133b0 con 0x560a50d32170 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a50d39df0 con 0x560a50d32170 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f54ed7fa640 1 -- 172.21.15.62:0/2276995295 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5608013690 con 0x560a50d32170 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.882+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a50d3caa0 con 0x560a50d32170 2024-04-26T07:54:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.883+0000 7f54ed7fa640 1 -- 172.21.15.62:0/2276995295 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f560804ed10 con 0x560a50d32170 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f54ed7fa640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54d8036e60 0x7f54d8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f54ed7fa640 1 -- 172.21.15.62:0/2276995295 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5608033070 con 0x560a50d32170 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f560fca8640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54d8036e60 0x7f54d8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50d45370 0x560a50d47830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d47f80 con 0x560a50d45370 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f560fca8640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54d8036e60 0x7f54d8039320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f560008c880 tx=0x7f5600090040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f560f4a7640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50d45370 0x560a50d47830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.884+0000 7f560f4a7640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50d45370 0x560a50d47830 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5604009050 con 0x560a50d45370 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 realm 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d447c0 con 0x560a50d45370 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5604009050 con 0x560a50d45370 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d48a70 con 0x560a50d45370 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5604009050 con 0x560a50d45370 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d49340 con 0x560a50d45370 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5604009050 con 0x560a50d45370 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d49c30 0x560a50d4c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.885+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d4c810 con 0x560a50d49c30 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.886+0000 7f56104a9640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d49c30 0x560a50d4c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.886+0000 7f56104a9640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d49c30 0x560a50d4c080 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.886+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.886+0000 7f56121a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.886+0000 7f56121a2800 20 searching for the correct realm 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.886+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560a50d4e7e0 0x560a50d50ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.886+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d4e7e0 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.887+0000 7f560fca8640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560a50d4e7e0 0x560a50d50ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.887+0000 7f560fca8640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560a50d4e7e0 0x560a50d50ca0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.887+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.887+0000 7f560fca8640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f560005e790 0x7f560007e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.887+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x7f560005e790 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.887+0000 7f560f4a7640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f560005e790 0x7f560007e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.888+0000 7f560f4a7640 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f560005e790 0x7f560007e500 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.888+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604009050 con 0x7f560005e790 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.888+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d49c30 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.888+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.888+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d45370 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.889+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604009050 con 0x560a50d45370 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.889+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d45370 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.889+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.889+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d49c30 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.889+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.889+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d49c30 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.889+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.889+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x7f560005e790 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.890+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604029040 con 0x7f560005e790 2024-04-26T07:54:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.890+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d4e7e0 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.890+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.890+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d45370 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.890+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.890+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d49c30 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.890+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d45370 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x7f560005e790 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5604029040 con 0x7f560005e790 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51370 con 0x560a50d4e7e0 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d4e7e0 2024-04-26T07:54:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.891+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d49c30 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.892+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.892+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d4e7e0 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.892+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.892+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d4e7e0 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.893+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.893+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d45370 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.893+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.893+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d45370 2024-04-26T07:54:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.893+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.893+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d49c30 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.893+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.893+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d4e7e0 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.894+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.894+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x7f560005e790 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.894+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604029040 con 0x7f560005e790 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.894+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d45370 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.894+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.894+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d49c30 2024-04-26T07:54:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.894+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.894+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d4e7e0 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.895+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.895+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d49c30 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.895+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.895+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x7f560005e790 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.895+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604029040 con 0x7f560005e790 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.895+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d4e7e0 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.895+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.895+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d49c30 2024-04-26T07:54:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x560a50d45370 2024-04-26T07:54:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f56000a5040 con 0x7f560005e790 2024-04-26T07:54:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5604029040 con 0x7f560005e790 2024-04-26T07:54:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d4d1d0 con 0x560a50d45370 2024-04-26T07:54:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.896+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d4ce10 con 0x560a50d45370 2024-04-26T07:54:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d4db70 con 0x560a50d45370 2024-04-26T07:54:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5604029040 con 0x560a50d45370 2024-04-26T07:54:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 20 zone default found 2024-04-26T07:54:39.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 4 Realm: () 2024-04-26T07:54:39.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:39.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 20 zonegroup default 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d51830 con 0x560a50d49c30 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.897+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d53b00 con 0x560a50d4e7e0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f56121a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d53ea0 con 0x560a50d4e7e0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f56121a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f56121a2800 20 started sync module instance, tier type = 2024-04-26T07:54:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f56121a2800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.898+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d52f90 con 0x7f560005e790 2024-04-26T07:54:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.899+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.899+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94602305811648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d52f90 con 0x7f560005e790 2024-04-26T07:54:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.899+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d548f0 con 0x560a50d45370 2024-04-26T07:54:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.900+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.900+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94602305811648] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.900+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94602305815520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d548b0 con 0x560a50d45370 2024-04-26T07:54:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.900+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d52ae0 con 0x560a50d4e7e0 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.901+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94602305815520] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.901+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.901+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94602305817824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d55890 con 0x560a50d4e7e0 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.901+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d56120 con 0x7f560005e790 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.902+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94602305817824] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.902+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.902+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94602305819616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d56510 con 0x7f560005e790 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.902+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d56f10 con 0x560a50d45370 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.903+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.903+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94602305825312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d56e40 con 0x560a50d45370 2024-04-26T07:54:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.903+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d57e60 con 0x560a50d49c30 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.905+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.905+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94602305829200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d57e20 con 0x560a50d49c30 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.905+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d58df0 con 0x560a50d49c30 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.906+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94602305829200] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.906+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.906+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94602305833216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d591e0 con 0x560a50d49c30 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.906+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94602305819616] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.906+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d59690 con 0x560a50d49c30 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.906+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94602305825312] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94602305821744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d57410 con 0x560a50d49c30 2024-04-26T07:54:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56121a2800 20 add_watcher() i=0 2024-04-26T07:54:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56121a2800 20 add_watcher() i=1 2024-04-26T07:54:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56121a2800 20 add_watcher() i=2 2024-04-26T07:54:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56121a2800 20 add_watcher() i=3 2024-04-26T07:54:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56121a2800 20 add_watcher() i=4 2024-04-26T07:54:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56121a2800 20 add_watcher() i=5 2024-04-26T07:54:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94602305833216] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.907+0000 7f56121a2800 20 add_watcher() i=6 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.909+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94602305821744] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.909+0000 7f56121a2800 20 add_watcher() i=7 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.909+0000 7f56121a2800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.909+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d58000 con 0x560a50d45370 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.909+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.909+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94602305835216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d58000 con 0x560a50d45370 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.910+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94602305835216] v27'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.910+0000 7f54c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.910+0000 7f56121a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.910+0000 7f56121a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.910+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d64e60 con 0x560a50d45370 2024-04-26T07:54:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.911+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.912+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d654f0 con 0x560a50d49c30 2024-04-26T07:54:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.912+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.913+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d654f0 con 0x560a50d4e7e0 2024-04-26T07:54:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.913+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.913+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d659a0 con 0x560a50d45370 2024-04-26T07:54:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.914+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'135 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.914+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d60c20 con 0x7f560005e790 2024-04-26T07:54:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.915+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.915+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d60be0 con 0x560a50d4e7e0 2024-04-26T07:54:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.916+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.916+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66480 con 0x560a50d45370 2024-04-26T07:54:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.918+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.918+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66480 con 0x560a50d49c30 2024-04-26T07:54:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.919+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.919+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d668a0 con 0x7f560005e790 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.920+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.920+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d668a0 con 0x560a50d4e7e0 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.921+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.921+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d668a0 con 0x7f560005e790 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.922+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.922+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d668a0 con 0x560a50d49c30 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.923+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.923+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x7f560005e790 2024-04-26T07:54:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.924+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.924+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d49c30 2024-04-26T07:54:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.925+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.925+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d45370 2024-04-26T07:54:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.926+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.927+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d4e7e0 2024-04-26T07:54:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.928+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.928+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66db0 con 0x7f560005e790 2024-04-26T07:54:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.929+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.929+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66db0 con 0x560a50d4e7e0 2024-04-26T07:54:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.930+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.930+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66db0 con 0x560a50d45370 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.931+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.931+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66db0 con 0x560a50d45370 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.932+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.932+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66db0 con 0x560a50d4e7e0 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.933+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.933+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x7f560005e790 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.934+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.934+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d4e7e0 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.935+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.935+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d4e7e0 2024-04-26T07:54:39.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.935+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.936+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d4e7e0 2024-04-26T07:54:39.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.936+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.936+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d4e7e0 2024-04-26T07:54:39.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.937+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.937+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d49c30 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.938+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.939+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d4e7e0 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.940+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.940+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d49c30 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.941+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.941+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d4e7e0 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.942+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.942+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x560a50d49c30 2024-04-26T07:54:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.943+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.943+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d66d20 con 0x7f560005e790 2024-04-26T07:54:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.944+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.944+0000 7f54c4fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.944+0000 7f56121a2800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.944+0000 7f56121a2800 20 Filter name: none 2024-04-26T07:54:39.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f543e7fc640 20 reqs_thread_entry: start 2024-04-26T07:54:39.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56121a2800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T07:54:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56121a2800 20 rados->read ofs=0 len=0 2024-04-26T07:54:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d91f00 con 0x560a50d49c30 2024-04-26T07:54:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56121a2800 20 rados_obj.operate() r=0 bl.length=419 2024-04-26T07:54:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56121a2800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-26T07:54:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56121a2800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T07:54:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56121a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.945+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d91e50 con 0x560a50d45370 2024-04-26T07:54:39.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.946+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.946+0000 7f56121a2800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T07:54:39.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.946+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d91e50 con 0x560a50d49c30 2024-04-26T07:54:39.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.947+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v27'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.947+0000 7f56121a2800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T07:54:39.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.947+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94602306073744 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d94d70 con 0x560a50d4e7e0 2024-04-26T07:54:39.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.947+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== watch-notify(notify (1) cookie 94602305817824 notify 115964116997 ret 0) ==== 212+0+0 (crc 0 0 0) 0x560a50d64e20 con 0x560a50d4e7e0 2024-04-26T07:54:39.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.947+0000 7f54eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94602305817824 notifier 4557 bl.length()=170 2024-04-26T07:54:39.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.947+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(97 notify.2 [notify cookie 94602306073744 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.947+0000 7f54eeffd640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f54d4003d60 con 0x560a50d4e7e0 2024-04-26T07:54:39.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.947+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.948+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== watch-notify(notify_complete (2) cookie 94602306073744 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f560009f040 con 0x560a50d4e7e0 2024-04-26T07:54:39.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.948+0000 7f56121a2800 10 removing email index: 2024-04-26T07:54:39.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.948+0000 7f56121a2800 10 removing user buckets index 2024-04-26T07:54:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.948+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d92930 con 0x560a50d45370 2024-04-26T07:54:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.948+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v27'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.948+0000 7f56121a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-04-26T07:54:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.948+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94602306073744 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d94d70 con 0x560a50d45370 2024-04-26T07:54:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.949+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== watch-notify(notify (1) cookie 94602305825312 notify 115964117007 ret 0) ==== 217+0+0 (crc 0 0 0) 0x560a50d3caa0 con 0x560a50d45370 2024-04-26T07:54:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.949+0000 7f54ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117007 cookie 94602305825312 notifier 4557 bl.length()=175 2024-04-26T07:54:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.949+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(100 notify.4 [notify cookie 94602306073744 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.949+0000 7f54ee7fc640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f54440032c0 con 0x560a50d45370 2024-04-26T07:54:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.949+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.949+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== watch-notify(notify_complete (2) cookie 94602306073744 notify 115964117007 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560a50d60450 con 0x560a50d45370 2024-04-26T07:54:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.949+0000 7f56121a2800 10 removing user index: testx$tenanteduser 2024-04-26T07:54:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.949+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d96ad0 con 0x560a50d49c30 2024-04-26T07:54:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.950+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v27'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.950+0000 7f56121a2800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-04-26T07:54:39.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.950+0000 7f56121a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-26T07:54:39.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.950+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94602306086432 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560a50d96a40 con 0x7f560005e790 2024-04-26T07:54:39.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.951+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== watch-notify(notify (1) cookie 94602305819616 notify 115964117011 ret 0) ==== 209+0+0 (crc 0 0 0) 0x560a50d60450 con 0x7f560005e790 2024-04-26T07:54:39.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.951+0000 7f54eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117011 cookie 94602305819616 notifier 4557 bl.length()=167 2024-04-26T07:54:39.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.951+0000 7f54eeffd640 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f54d4003d60 con 0x7f560005e790 2024-04-26T07:54:39.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.951+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(103 notify.3 [notify cookie 94602306086432 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.951+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== watch-notify(notify_complete (2) cookie 94602306086432 notify 115964117011 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560a50d64b10 con 0x7f560005e790 2024-04-26T07:54:39.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.951+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.952+0000 7f54c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:39.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.952+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94602305835216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d96ad0 con 0x560a50d45370 2024-04-26T07:54:39.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.953+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94602305835216] v27'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.953+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94602305811648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d5f8a0 con 0x7f560005e790 2024-04-26T07:54:39.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.954+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94602305811648] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.954+0000 7f56121a2800 20 remove_watcher() i=0 2024-04-26T07:54:39.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.954+0000 7f56121a2800 2 removed watcher, disabling cache 2024-04-26T07:54:39.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.954+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94602305815520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d534c0 con 0x560a50d45370 2024-04-26T07:54:39.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.955+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94602305815520] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.955+0000 7f56121a2800 20 remove_watcher() i=1 2024-04-26T07:54:39.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.955+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94602305817824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d534c0 con 0x560a50d4e7e0 2024-04-26T07:54:39.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.956+0000 7f560fca8640 1 -- 172.21.15.62:0/2276995295 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94602305817824] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600078070 con 0x560a50d4e7e0 2024-04-26T07:54:39.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.956+0000 7f56121a2800 20 remove_watcher() i=2 2024-04-26T07:54:39.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.956+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94602305819616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d534c0 con 0x7f560005e790 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.957+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94602305819616] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x7f560005e790 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.957+0000 7f56121a2800 20 remove_watcher() i=3 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.957+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94602305825312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d534c0 con 0x560a50d45370 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.958+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94602305825312] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5604039040 con 0x560a50d45370 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.958+0000 7f56121a2800 20 remove_watcher() i=4 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.958+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94602305829200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d56a20 con 0x560a50d49c30 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.959+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94602305829200] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.959+0000 7f56121a2800 20 remove_watcher() i=5 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.959+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94602305833216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d534c0 con 0x560a50d49c30 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.960+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94602305833216] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.960+0000 7f56121a2800 20 remove_watcher() i=6 2024-04-26T07:54:39.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.960+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94602305821744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560a50d96ad0 con 0x560a50d49c30 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56104a9640 1 -- 172.21.15.62:0/2276995295 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94602305821744] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5608046d70 con 0x560a50d49c30 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 20 remove_watcher() i=7 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d49c30 msgr2=0x560a50d4c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d49c30 0x560a50d4c080 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50d45370 msgr2=0x560a50d47830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50d45370 0x560a50d47830 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f560005e790 msgr2=0x7f560007e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f560005e790 0x7f560007e500 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560a50d4e7e0 msgr2=0x560a50d50ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560a50d4e7e0 0x560a50d50ca0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54d8036e60 msgr2=0x7f54d8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54d8036e60 0x7f54d8039320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f560008c880 tx=0x7f5600090040 comp rx=0 tx=0).stop 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 msgr2=0x560a50d39620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f560f4a7640 1 -- 172.21.15.62:0/2276995295 reap_dead start 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d39620 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5608043040 tx=0x7f560804cf10 comp rx=0 tx=0).stop 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 shutdown_connections 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 --2- 172.21.15.62:0/2276995295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d32170 0x560a50d39620 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 >> 172.21.15.62:0/2276995295 conn(0x560a50d2e440 msgr2=0x560a50d2baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 shutdown_connections 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.961+0000 7f56121a2800 1 -- 172.21.15.62:0/2276995295 wait complete. 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/2665772180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54e8036e60 msgr2=0x7f54e8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/2665772180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54e8036e60 0x7f54e8039320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x560a50d0e040 tx=0x7f560008e040 comp rx=0 tx=0).stop 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/2665772180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d24de0 msgr2=0x560a50d25200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/2665772180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d24de0 0x560a50d25200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x560a50d11220 tx=0x7f5608018830 comp rx=0 tx=0).stop 2024-04-26T07:54:39.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/2665772180 shutdown_connections 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/2665772180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54e8036e60 0x7f54e8039320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/2665772180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50d24de0 0x560a50d25200 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/2665772180 >> 172.21.15.62:0/2665772180 conn(0x560a50d18e80 msgr2=0x560a50d19280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/2665772180 shutdown_connections 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/2665772180 wait complete. 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d13010 msgr2=0x560a50d154b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d13010 0x560a50d154b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50c119a0 msgr2=0x560a50d10940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50c119a0 0x560a50d10940 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54f8036e60 msgr2=0x7f54f8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54f8036e60 0x7f54f8039320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5604001d90 tx=0x7f56040012f0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 msgr2=0x560a50d09750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d09750 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f560001ced0 tx=0x7f5600002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 shutdown_connections 2024-04-26T07:54:39.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560a50c119a0 0x560a50d10940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x560a50d13010 0x560a50d154b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f54f8036e60 0x7f54f8039320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 --2- 172.21.15.62:0/3429615126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a50c0e960 0x560a50d09750 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:39.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 >> 172.21.15.62:0/3429615126 conn(0x560a50c0a360 msgr2=0x560a50cfbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:39.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 shutdown_connections 2024-04-26T07:54:39.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:39.962+0000 7f56121a2800 1 -- 172.21.15.62:0/3429615126 wait complete. 2024-04-26T07:54:39.994 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-26T07:54:39.998 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-04-26T07:54:40.002 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:40.002 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-26T07:54:40.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-26T07:54:40.002 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-04-26T07:54:40.048 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:40.048 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.051+0000 7fe5d8323800 1 Processor -- start 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.051+0000 7fe5d8323800 1 -- start start 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.051+0000 7fe5d8323800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56356fb54ac0 0x56356fb54ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.051+0000 7fe5d8323800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56356fb55590 con 0x56356fb55840 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.051+0000 7fe5d8323800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x56356f9f7e20 con 0x56356fb54ac0 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.051+0000 7fe5d40b7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56356fb54ac0 0x56356fb54ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.051+0000 7fe5d38b6640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x56356fb55840 0x56356fb55cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36816/0 (socket says 172.21.15.62:36816) 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.051+0000 7fe5d38b6640 1 -- 172.21.15.62:0/1989025841 learned_addr learned my addr 172.21.15.62:0/1989025841 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.052+0000 7fe5d30b5640 1 -- 172.21.15.62:0/1989025841 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301708268 0 0) 0x56356fb55590 con 0x56356fb55840 2024-04-26T07:54:40.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.052+0000 7fe5d30b5640 1 -- 172.21.15.62:0/1989025841 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5c0001e10 con 0x56356fb55840 2024-04-26T07:54:40.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.052+0000 7fe5d40b7640 1 -- 172.21.15.62:0/1989025841 >> v1:172.21.15.1:6789/0 conn(0x56356fb55840 legacy=0x56356fb55cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.052+0000 7fe5d40b7640 1 -- 172.21.15.62:0/1989025841 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356fb56430 con 0x56356fb54ac0 2024-04-26T07:54:40.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/1989025841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fb54ee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400a470 tx=0x7fe5c401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92362029f61d2ba9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d30b5640 1 -- 172.21.15.62:0/1989025841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c4057070 con 0x56356fb54ac0 2024-04-26T07:54:40.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d30b5640 1 -- 172.21.15.62:0/1989025841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c404acc0 con 0x56356fb54ac0 2024-04-26T07:54:40.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d30b5640 1 -- 172.21.15.62:0/1989025841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c4052440 con 0x56356fb54ac0 2024-04-26T07:54:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d8323800 1 -- 172.21.15.62:0/1989025841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 msgr2=0x56356fb54ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d8323800 1 --2- 172.21.15.62:0/1989025841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fb54ee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400a470 tx=0x7fe5c401ce40 comp rx=0 tx=0).stop 2024-04-26T07:54:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d8323800 1 -- 172.21.15.62:0/1989025841 shutdown_connections 2024-04-26T07:54:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d8323800 1 --2- 172.21.15.62:0/1989025841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fb54ee0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d8323800 1 -- 172.21.15.62:0/1989025841 >> 172.21.15.62:0/1989025841 conn(0x56356fb4f360 msgr2=0x56356fb51780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d8323800 1 -- 172.21.15.62:0/1989025841 shutdown_connections 2024-04-26T07:54:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.054+0000 7fe5d8323800 1 -- 172.21.15.62:0/1989025841 wait complete. 2024-04-26T07:54:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.067+0000 7fe5d8323800 1 Processor -- start 2024-04-26T07:54:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.067+0000 7fe5d8323800 1 -- start start 2024-04-26T07:54:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.067+0000 7fe5d8323800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc46ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.067+0000 7fe5d8323800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56356faa0d00 con 0x56356fb54ac0 2024-04-26T07:54:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.068+0000 7fe5d40b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc46ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.068+0000 7fe5d40b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc46ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34554/0 (socket says 172.21.15.62:34554) 2024-04-26T07:54:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.068+0000 7fe5d40b7640 1 -- 172.21.15.62:0/330314502 learned_addr learned my addr 172.21.15.62:0/330314502 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.068+0000 7fe5d40b7640 1 -- 172.21.15.62:0/330314502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356fc47170 con 0x56356fb54ac0 2024-04-26T07:54:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.068+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/330314502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc46ba0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4000c00 tx=0x7fe5c404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcb047e9ffec786 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.068+0000 7fe4c260c640 1 -- 172.21.15.62:0/330314502 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c4057040 con 0x56356fb54ac0 2024-04-26T07:54:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.068+0000 7fe4c260c640 1 -- 172.21.15.62:0/330314502 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c4063070 con 0x56356fb54ac0 2024-04-26T07:54:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.068+0000 7fe4c260c640 1 -- 172.21.15.62:0/330314502 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c4052760 con 0x56356fb54ac0 2024-04-26T07:54:40.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 -- 172.21.15.62:0/330314502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 msgr2=0x56356fc46ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 --2- 172.21.15.62:0/330314502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc46ba0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4000c00 tx=0x7fe5c404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 -- 172.21.15.62:0/330314502 shutdown_connections 2024-04-26T07:54:40.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 --2- 172.21.15.62:0/330314502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc46ba0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 -- 172.21.15.62:0/330314502 >> 172.21.15.62:0/330314502 conn(0x56356fb4f360 msgr2=0x56356fc44f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 -- 172.21.15.62:0/330314502 shutdown_connections 2024-04-26T07:54:40.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 -- 172.21.15.62:0/330314502 wait complete. 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 Processor -- start 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.069+0000 7fe5d8323800 1 -- start start 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe5d8323800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc4e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe5d8323800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56356fb5dce0 con 0x56356fb54ac0 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe5d40b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc4e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe5d40b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc4e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34556/0 (socket says 172.21.15.62:34556) 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe5d40b7640 1 -- 172.21.15.62:0/425612597 learned_addr learned my addr 172.21.15.62:0/425612597 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe5d40b7640 1 -- 172.21.15.62:0/425612597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356fc4eb40 con 0x56356fb54ac0 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc4e600 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe5c401bb30 tx=0x7fe5c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe4c0e09640 1 -- 172.21.15.62:0/425612597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c406d070 con 0x56356fb54ac0 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe4c0e09640 1 -- 172.21.15.62:0/425612597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c4052cc0 con 0x56356fb54ac0 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56356fc4edd0 con 0x56356fb54ac0 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.070+0000 7fe4c0e09640 1 -- 172.21.15.62:0/425612597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c4057050 con 0x56356fb54ac0 2024-04-26T07:54:40.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.071+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356fc51a80 con 0x56356fb54ac0 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.071+0000 7fe4c0e09640 1 -- 172.21.15.62:0/425612597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe5c4070070 con 0x56356fb54ac0 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.071+0000 7fe4c0e09640 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4bc036eb0 0x7fe4bc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.071+0000 7fe4c0e09640 1 -- 172.21.15.62:0/425612597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fe5c408e210 con 0x56356fb54ac0 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.072+0000 7fe5d38b6640 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4bc036eb0 0x7fe4bc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.072+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fb55840 0x56356fc55840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.072+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc55e10 con 0x56356fb55840 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.072+0000 7fe5d48b8640 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fb55840 0x56356fc55840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.072+0000 7fe5d38b6640 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4bc036eb0 0x7fe4bc039370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc001db0 tx=0x7fe5bc001350 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.072+0000 7fe5d48b8640 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fb55840 0x56356fc55840 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.072+0000 7fe5d48b8640 1 -- 172.21.15.62:0/425612597 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5cc00a4a0 con 0x56356fb55840 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.072+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc52e10 con 0x56356fb55840 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.073+0000 7fe5d48b8640 1 -- 172.21.15.62:0/425612597 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe5cc00a4a0 con 0x56356fb55840 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.073+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc58140 0x56356fc5a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.073+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc5ac20 con 0x56356fc58140 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.073+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc58140 0x56356fc5a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.073+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc58140 0x56356fc5a530 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.074+0000 7fe5d40b7640 1 -- 172.21.15.62:0/425612597 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc58140 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.074+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc570f0 con 0x56356fb55840 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.074+0000 7fe5d48b8640 1 -- 172.21.15.62:0/425612597 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe5cc00a4a0 con 0x56356fb55840 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.074+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc57590 con 0x56356fb55840 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.074+0000 7fe5d48b8640 1 -- 172.21.15.62:0/425612597 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe5cc00a4a0 con 0x56356fb55840 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d8323800 1 Processor -- start 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d8323800 1 -- start start 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d8323800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc42ae0 0x56356fc40f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d8323800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56356fa48170 con 0x56356fc42ae0 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d48b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc42ae0 0x56356fc40f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d48b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc42ae0 0x56356fc40f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34566/0 (socket says 172.21.15.62:34566) 2024-04-26T07:54:40.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d48b8640 1 -- 172.21.15.62:0/327212085 learned_addr learned my addr 172.21.15.62:0/327212085 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d48b8640 1 -- 172.21.15.62:0/327212085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356fc41490 con 0x56356fc42ae0 2024-04-26T07:54:40.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.075+0000 7fe5d48b8640 1 --2- 172.21.15.62:0/327212085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc42ae0 0x56356fc40f50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x56356fc4fa00 tx=0x7fe5cc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.076+0000 7fe4b9ffb640 1 -- 172.21.15.62:0/327212085 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5cc014450 con 0x56356fc42ae0 2024-04-26T07:54:40.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.076+0000 7fe4b9ffb640 1 -- 172.21.15.62:0/327212085 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0145f0 con 0x56356fc42ae0 2024-04-26T07:54:40.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.076+0000 7fe5d8323800 1 -- 172.21.15.62:0/327212085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56356fc41720 con 0x56356fc42ae0 2024-04-26T07:54:40.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.076+0000 7fe4b9ffb640 1 -- 172.21.15.62:0/327212085 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5cc014910 con 0x56356fc42ae0 2024-04-26T07:54:40.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.076+0000 7fe5d8323800 1 -- 172.21.15.62:0/327212085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356fc41c20 con 0x56356fc42ae0 2024-04-26T07:54:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe4b9ffb640 1 -- 172.21.15.62:0/327212085 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe5cc011040 con 0x56356fc42ae0 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe4b9ffb640 1 --2- 172.21.15.62:0/327212085 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4ac036eb0 0x7fe4ac039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe4b9ffb640 1 -- 172.21.15.62:0/327212085 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fe5cc01e070 con 0x56356fc42ae0 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/327212085 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4ac036eb0 0x7fe4ac039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe5d8323800 1 Processor -- start 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe5d8323800 1 -- start start 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/327212085 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4ac036eb0 0x7fe4ac039370 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x56356fc56290 tx=0x7fe5c408c530 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe5d8323800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc796d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.077+0000 7fe5d8323800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56356fc47430 con 0x56356fc792b0 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.078+0000 7fe5d48b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.078+0000 7fe5d48b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc796d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34574/0 (socket says 172.21.15.62:34574) 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.078+0000 7fe5d48b8640 1 -- 172.21.15.62:0/1386668059 learned_addr learned my addr 172.21.15.62:0/1386668059 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.078+0000 7fe5d48b8640 1 -- 172.21.15.62:0/1386668059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356fc79ca0 con 0x56356fc792b0 2024-04-26T07:54:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.078+0000 7fe5d48b8640 1 --2- 172.21.15.62:0/1386668059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc796d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc04cfa0 tx=0x7fe5cc016a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90c70e23b60089 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.078+0000 7fe4b37fe640 1 -- 172.21.15.62:0/1386668059 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5cc046070 con 0x56356fc792b0 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.078+0000 7fe4b37fe640 1 -- 172.21.15.62:0/1386668059 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc046210 con 0x56356fc792b0 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.078+0000 7fe4b37fe640 1 -- 172.21.15.62:0/1386668059 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5cc014ab0 con 0x56356fc792b0 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 -- 172.21.15.62:0/1386668059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 msgr2=0x56356fc796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 --2- 172.21.15.62:0/1386668059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc796d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc04cfa0 tx=0x7fe5cc016a90 comp rx=0 tx=0).stop 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 -- 172.21.15.62:0/1386668059 shutdown_connections 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 --2- 172.21.15.62:0/1386668059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc796d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 -- 172.21.15.62:0/1386668059 >> 172.21.15.62:0/1386668059 conn(0x56356fc75580 msgr2=0x56356fc735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 -- 172.21.15.62:0/1386668059 shutdown_connections 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 -- 172.21.15.62:0/1386668059 wait complete. 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 Processor -- start 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 -- start start 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc80860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d8323800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56356fc7a430 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d48b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc80860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d48b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc80860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34580/0 (socket says 172.21.15.62:34580) 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.079+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 learned_addr learned my addr 172.21.15.62:0/497014441 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.080+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356fc80da0 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.080+0000 7fe5d48b8640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc80860 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc044040 tx=0x7fe5cc011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.080+0000 7fe4b1ffb640 1 -- 172.21.15.62:0/497014441 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5cc046040 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.080+0000 7fe4b1ffb640 1 -- 172.21.15.62:0/497014441 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc013a10 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.080+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56356fc81090 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.080+0000 7fe4b1ffb640 1 -- 172.21.15.62:0/497014441 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5cc0463c0 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.080+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356fc83ce0 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.081+0000 7fe4b1ffb640 1 -- 172.21.15.62:0/497014441 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe5cc046620 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.081+0000 7fe4b1ffb640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4a4036e10 0x7fe4a40392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.081+0000 7fe4b1ffb640 1 -- 172.21.15.62:0/497014441 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fe5cc033030 con 0x56356fc792b0 2024-04-26T07:54:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.081+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4a4036e10 0x7fe4a40392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.081+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fc8c5f0 0x56356fc8eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc8f200 con 0x56356fc8c5f0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4a4036e10 0x7fe4a40392d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56356fc5b020 tx=0x7fe5c4083000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d38b6640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fc8c5f0 0x56356fc8eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d38b6640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fc8c5f0 0x56356fc8eab0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5bc009050 con 0x56356fc8c5f0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 20 realm 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc8ba40 con 0x56356fc8c5f0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5bc009050 con 0x56356fc8c5f0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.082+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc8fcf0 con 0x56356fc8c5f0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5bc009050 con 0x56356fc8c5f0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d8323800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc905c0 con 0x56356fc8c5f0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe5bc009050 con 0x56356fc8c5f0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d8323800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc90fe0 0x56356fc933d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc93ad0 con 0x56356fc90fe0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.083+0000 7fe5d48b8640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc90fe0 0x56356fc933d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.084+0000 7fe5d48b8640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc90fe0 0x56356fc933d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.084+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.084+0000 7fe5d8323800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.084+0000 7fe5d8323800 20 searching for the correct realm 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.084+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56356fc95aa0 0x56356fc97f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.084+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.084+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56356fc95aa0 0x56356fc97f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.084+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56356fc95aa0 0x56356fc97f60 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.085+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.085+0000 7fe5d40b7640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe5c408a070 0x7fe5c408c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.085+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x7fe5c408a070 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.085+0000 7fe5d38b6640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe5c408a070 0x7fe5c408c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.085+0000 7fe5d38b6640 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe5c408a070 0x7fe5c408c970 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.086+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc009050 con 0x7fe5c408a070 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.086+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.086+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.086+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc8c5f0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.087+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc009050 con 0x56356fc8c5f0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.087+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc8c5f0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.087+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.087+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.087+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.087+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.087+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.087+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x7fe5c408a070 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.088+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc029040 con 0x7fe5c408a070 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.088+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.088+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.088+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc8c5f0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.088+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.088+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.089+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.089+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc8c5f0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.089+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.089+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x7fe5c408a070 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.089+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe5bc029040 con 0x7fe5c408a070 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.089+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.089+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.089+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc8c5f0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.090+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.091+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc8c5f0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.091+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.091+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.091+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.091+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.091+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.091+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x7fe5c408a070 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.092+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc029040 con 0x7fe5c408a070 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.092+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc8c5f0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.092+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.092+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.092+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.092+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.092+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.092+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.093+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.093+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x7fe5c408a070 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.093+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc029040 con 0x7fe5c408a070 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.093+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc95aa0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.093+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.093+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc90fe0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.093+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.093+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x56356fc8c5f0 2024-04-26T07:54:40.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98630 con 0x7fe5c408a070 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5bc029040 con 0x7fe5c408a070 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc94490 con 0x56356fc8c5f0 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc940d0 con 0x56356fc8c5f0 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.094+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc94e30 con 0x56356fc8c5f0 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe5bc029040 con 0x56356fc8c5f0 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 zone default found 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 4 Realm: () 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 zonegroup default 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc98ab0 con 0x56356fc90fe0 2024-04-26T07:54:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9ad60 con 0x56356fc95aa0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9b100 con 0x56356fc95aa0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 started sync module instance, tier type = 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.095+0000 7fe5d8323800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.096+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9a1f0 con 0x7fe5c408a070 2024-04-26T07:54:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.096+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.097+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94787508741872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9a1f0 con 0x7fe5c408a070 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.097+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9bb40 con 0x56356fc8c5f0 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.098+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94787508741872] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.098+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.098+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94787508745744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9a1f0 con 0x56356fc8c5f0 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.098+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9c590 con 0x56356fc95aa0 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.099+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.099+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94787508748448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9ce30 con 0x56356fc95aa0 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.099+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94787508745744] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.099+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9d680 con 0x7fe5c408a070 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.100+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94787508748448] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.100+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.100+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94787508750720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9d680 con 0x7fe5c408a070 2024-04-26T07:54:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.100+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9e160 con 0x56356fc8c5f0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.101+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.101+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94787508755568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9e160 con 0x56356fc8c5f0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.101+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9f080 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.101+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94787508750720] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.102+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.102+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94787508759408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9f040 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.102+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94787508755568] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.102+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9fb00 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.103+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94787508759408] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.103+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.103+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94787508752848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9f610 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.103+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fc9ffd0 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94787508763424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fca03f0 con 0x56356fc90fe0 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d8323800 20 add_watcher() i=0 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d8323800 20 add_watcher() i=1 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d8323800 20 add_watcher() i=2 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d8323800 20 add_watcher() i=3 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d8323800 20 add_watcher() i=4 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d8323800 20 add_watcher() i=5 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94787508752848] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.104+0000 7fe5d8323800 20 add_watcher() i=6 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.105+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94787508763424] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.105+0000 7fe5d8323800 20 add_watcher() i=7 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.105+0000 7fe5d8323800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.105+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fca03f0 con 0x56356fc8c5f0 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.105+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.105+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94787508764480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fca0de0 con 0x56356fc8c5f0 2024-04-26T07:54:40.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.106+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94787508764480] v27'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.106+0000 7fe48a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.107+0000 7fe5d8323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:40.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.107+0000 7fe5d8323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.107+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fca33d0 con 0x56356fc8c5f0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.108+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.108+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcac730 con 0x56356fc90fe0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.109+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.109+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcac730 con 0x56356fc95aa0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.110+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.110+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcad1f0 con 0x56356fc8c5f0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.111+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'140 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.111+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabe00 con 0x7fe5c408a070 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.112+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.112+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcadd50 con 0x56356fc95aa0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.113+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.113+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcadb80 con 0x56356fc8c5f0 2024-04-26T07:54:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.114+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.114+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcadb80 con 0x56356fc90fe0 2024-04-26T07:54:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.115+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.115+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae030 con 0x7fe5c408a070 2024-04-26T07:54:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.116+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.116+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae030 con 0x56356fc95aa0 2024-04-26T07:54:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.117+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.117+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae030 con 0x7fe5c408a070 2024-04-26T07:54:40.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.118+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.118+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae030 con 0x56356fc90fe0 2024-04-26T07:54:40.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.119+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.119+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x7fe5c408a070 2024-04-26T07:54:40.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.120+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.120+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x56356fc90fe0 2024-04-26T07:54:40.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.121+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.121+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x56356fc8c5f0 2024-04-26T07:54:40.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.122+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.122+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x56356fc95aa0 2024-04-26T07:54:40.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.123+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.123+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x7fe5c408a070 2024-04-26T07:54:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.124+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.124+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x56356fc95aa0 2024-04-26T07:54:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.125+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.125+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x56356fc8c5f0 2024-04-26T07:54:40.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.126+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.126+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x56356fc8c5f0 2024-04-26T07:54:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.127+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.127+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x56356fc95aa0 2024-04-26T07:54:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.129+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.129+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcae420 con 0x7fe5c408a070 2024-04-26T07:54:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.130+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.130+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabfd0 con 0x56356fc95aa0 2024-04-26T07:54:40.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.130+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.131+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabfd0 con 0x56356fc95aa0 2024-04-26T07:54:40.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.133+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.133+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabfd0 con 0x56356fc95aa0 2024-04-26T07:54:40.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.134+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.134+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabfd0 con 0x56356fc95aa0 2024-04-26T07:54:40.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.135+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.135+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabfd0 con 0x56356fc90fe0 2024-04-26T07:54:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.136+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.136+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabe00 con 0x56356fc95aa0 2024-04-26T07:54:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.137+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.137+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabe00 con 0x56356fc90fe0 2024-04-26T07:54:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.138+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.138+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabe00 con 0x56356fc95aa0 2024-04-26T07:54:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.139+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.139+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabe00 con 0x56356fc90fe0 2024-04-26T07:54:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.140+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.140+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fcabe00 con 0x7fe5c408a070 2024-04-26T07:54:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.141+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe4897e2640 20 reqs_thread_entry: start 2024-04-26T07:54:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 20 Filter name: none 2024-04-26T07:54:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe3faffd640 20 reqs_thread_entry: start 2024-04-26T07:54:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fcd9410 con 0x7fe5c408a070 2024-04-26T07:54:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.142+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fcdaee0 con 0x56356fc8c5f0 2024-04-26T07:54:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(95 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:40.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 20 get_obj_state: octx=0x7fe5bc00e5b0 obj=myfoo:four state=0x56356fcdc1a8 s->prefetch_data=0 2024-04-26T07:54:40.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:96 3.28s0 3:14d43226:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56356fcdcfd0 con 0x56356fc95aa0 2024-04-26T07:54:40.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(96 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 10 manifest: total_size = 4 2024-04-26T07:54:40.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 20 get_obj_state: setting s->obj_tag to 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.2488159358404478427 2024-04-26T07:54:40.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 20 get_obj_state: octx=0x7fe5bc00e5b0 obj=myfoo:four state=0x56356fcdc1a8 s->prefetch_data=0 2024-04-26T07:54:40.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 20 prepare_atomic_modification: state is not atomic. state=0x56356fcdc1a8 2024-04-26T07:54:40.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6 2024-04-26T07:54:40.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.143+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:97 4.22 4:476c90f1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce18a0 con 0x56356fc8c5f0 2024-04-26T07:54:40.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.144+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(97 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6 [stat,call,call] v27'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.144+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 3.28s0 3:14d43226:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce18a0 con 0x56356fc95aa0 2024-04-26T07:54:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.146+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(98 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1_four [call] v27'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.146+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 4.22 4:476c90f1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x56356fc8c5f0 2024-04-26T07:54:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.147+0000 7fe48a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.147+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94787508764480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x56356fc8c5f0 2024-04-26T07:54:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.147+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(99 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6 [stat,call,call] v27'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.147+0000 7fe4b37fe640 20 handle_completion(): completion ok for obj=four 2024-04-26T07:54:40.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.148+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94787508764480] v27'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.148+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94787508741872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x7fe5c408a070 2024-04-26T07:54:40.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.149+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94787508741872] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.149+0000 7fe5d8323800 20 remove_watcher() i=0 2024-04-26T07:54:40.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.149+0000 7fe5d8323800 2 removed watcher, disabling cache 2024-04-26T07:54:40.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.149+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94787508745744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x56356fc8c5f0 2024-04-26T07:54:40.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.150+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94787508745744] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.150+0000 7fe5d8323800 20 remove_watcher() i=1 2024-04-26T07:54:40.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.150+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94787508748448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x56356fc95aa0 2024-04-26T07:54:40.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.151+0000 7fe5d40b7640 1 -- 172.21.15.62:0/497014441 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94787508748448] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5c4079070 con 0x56356fc95aa0 2024-04-26T07:54:40.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.151+0000 7fe5d8323800 20 remove_watcher() i=2 2024-04-26T07:54:40.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.151+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94787508750720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x7fe5c408a070 2024-04-26T07:54:40.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.152+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94787508750720] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x7fe5c408a070 2024-04-26T07:54:40.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.152+0000 7fe5d8323800 20 remove_watcher() i=3 2024-04-26T07:54:40.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.152+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94787508755568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x56356fc8c5f0 2024-04-26T07:54:40.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.153+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94787508755568] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5bc039040 con 0x56356fc8c5f0 2024-04-26T07:54:40.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.153+0000 7fe5d8323800 20 remove_watcher() i=4 2024-04-26T07:54:40.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.153+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94787508759408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x56356fc90fe0 2024-04-26T07:54:40.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.154+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94787508759408] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.154+0000 7fe5d8323800 20 remove_watcher() i=5 2024-04-26T07:54:40.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.154+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94787508752848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x56356fc90fe0 2024-04-26T07:54:40.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.155+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94787508752848] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.155+0000 7fe5d8323800 20 remove_watcher() i=6 2024-04-26T07:54:40.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.155+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94787508763424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56356fce2330 con 0x56356fc90fe0 2024-04-26T07:54:40.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d48b8640 1 -- 172.21.15.62:0/497014441 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94787508763424] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5cc02a070 con 0x56356fc90fe0 2024-04-26T07:54:40.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 20 remove_watcher() i=7 2024-04-26T07:54:40.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc90fe0 msgr2=0x56356fc933d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc90fe0 0x56356fc933d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fc8c5f0 msgr2=0x56356fc8eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fc8c5f0 0x56356fc8eab0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe5c408a070 msgr2=0x7fe5c408c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe5c408a070 0x7fe5c408c970 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56356fc95aa0 msgr2=0x56356fc97f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.156+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56356fc95aa0 0x56356fc97f60 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4a4036e10 msgr2=0x7fe4a40392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4a4036e10 0x7fe4a40392d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56356fc5b020 tx=0x7fe5c4083000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 msgr2=0x56356fc80860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 --2- 172.21.15.62:0/497014441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc792b0 0x56356fc80860 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc044040 tx=0x7fe5cc011f90 comp rx=0 tx=0).stop 2024-04-26T07:54:40.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 reap_dead start 2024-04-26T07:54:40.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d38b6640 1 -- 172.21.15.62:0/497014441 reap_dead start 2024-04-26T07:54:40.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 shutdown_connections 2024-04-26T07:54:40.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 >> 172.21.15.62:0/497014441 conn(0x56356fc75580 msgr2=0x56356fc72be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 shutdown_connections 2024-04-26T07:54:40.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/497014441 wait complete. 2024-04-26T07:54:40.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/327212085 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4ac036eb0 msgr2=0x7fe4ac039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 --2- 172.21.15.62:0/327212085 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4ac036eb0 0x7fe4ac039370 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x56356fc56290 tx=0x7fe5c408c530 comp rx=0 tx=0).stop 2024-04-26T07:54:40.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/327212085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc42ae0 msgr2=0x56356fc40f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 --2- 172.21.15.62:0/327212085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc42ae0 0x56356fc40f50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x56356fc4fa00 tx=0x7fe5cc018830 comp rx=0 tx=0).stop 2024-04-26T07:54:40.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/327212085 shutdown_connections 2024-04-26T07:54:40.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 --2- 172.21.15.62:0/327212085 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4ac036eb0 0x7fe4ac039370 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 --2- 172.21.15.62:0/327212085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fc42ae0 0x56356fc40f50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/327212085 >> 172.21.15.62:0/327212085 conn(0x56356fc5de00 msgr2=0x56356fc5e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/327212085 shutdown_connections 2024-04-26T07:54:40.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/327212085 wait complete. 2024-04-26T07:54:40.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc58140 msgr2=0x56356fc5a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc58140 0x56356fc5a530 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fb55840 msgr2=0x56356fc55840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fb55840 0x56356fc55840 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.157+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4bc036eb0 msgr2=0x7fe4bc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4bc036eb0 0x7fe4bc039370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc001db0 tx=0x7fe5bc001350 comp rx=0 tx=0).stop 2024-04-26T07:54:40.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 msgr2=0x56356fc4e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc4e600 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe5c401bb30 tx=0x7fe5c4002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 shutdown_connections 2024-04-26T07:54:40.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56356fb55840 0x56356fc55840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56356fc58140 0x56356fc5a530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe4bc036eb0 0x7fe4bc039370 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 --2- 172.21.15.62:0/425612597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56356fb54ac0 0x56356fc4e600 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 >> 172.21.15.62:0/425612597 conn(0x56356fb4f360 msgr2=0x56356fc404b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 shutdown_connections 2024-04-26T07:54:40.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.158+0000 7fe5d8323800 1 -- 172.21.15.62:0/425612597 wait complete. 2024-04-26T07:54:40.184 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T07:54:40.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T07:54:40.185 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T07:54:40.230 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:40.230 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:40.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.232+0000 7f4406d42800 1 Processor -- start 2024-04-26T07:54:40.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.232+0000 7f4406d42800 1 -- start start 2024-04-26T07:54:40.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4406d42800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55b0b8a3bf80 0x55b0b8a3c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4406d42800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b0b89b12a0 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4406d42800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55b0b88dfe20 con 0x55b0b8a3bf80 2024-04-26T07:54:40.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4404841640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55b0b8a3bf80 0x55b0b8a3c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4404040640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55b0b8a3c8e0 0x55b0b8a3cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36826/0 (socket says 172.21.15.62:36826) 2024-04-26T07:54:40.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4404841640 1 --2- 172.21.15.62:0/778478532 >> v2:172.21.15.1:3300/0 conn(0x55b0b8a3bf80 0x55b0b8a3c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34592/0 (socket says 172.21.15.62:34592) 2024-04-26T07:54:40.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4404040640 1 -- 172.21.15.62:0/778478532 learned_addr learned my addr 172.21.15.62:0/778478532 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:40.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4404841640 1 -- 172.21.15.62:0/778478532 >> v1:172.21.15.1:6789/0 conn(0x55b0b8a3c8e0 legacy=0x55b0b8a3cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.233+0000 7f4404841640 1 -- 172.21.15.62:0/778478532 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0b8a3d4a0 con 0x55b0b8a3bf80 2024-04-26T07:54:40.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.235+0000 7f4404841640 1 --2- 172.21.15.62:0/778478532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8a3c3a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f43f400a470 tx=0x7f43f401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98cd591d4028fc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.235+0000 7f440383f640 1 -- 172.21.15.62:0/778478532 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4057070 con 0x55b0b8a3bf80 2024-04-26T07:54:40.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.235+0000 7f440383f640 1 -- 172.21.15.62:0/778478532 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f4052570 con 0x55b0b8a3bf80 2024-04-26T07:54:40.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.235+0000 7f440383f640 1 -- 172.21.15.62:0/778478532 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4052870 con 0x55b0b8a3bf80 2024-04-26T07:54:40.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.236+0000 7f4406d42800 1 -- 172.21.15.62:0/778478532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 msgr2=0x55b0b8a3c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.236+0000 7f4406d42800 1 --2- 172.21.15.62:0/778478532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8a3c3a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f43f400a470 tx=0x7f43f401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:40.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.236+0000 7f4406d42800 1 -- 172.21.15.62:0/778478532 shutdown_connections 2024-04-26T07:54:40.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.236+0000 7f4406d42800 1 --2- 172.21.15.62:0/778478532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8a3c3a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.236+0000 7f4406d42800 1 -- 172.21.15.62:0/778478532 >> 172.21.15.62:0/778478532 conn(0x55b0b8a37b80 msgr2=0x55b0b8a39fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.236+0000 7f4406d42800 1 -- 172.21.15.62:0/778478532 shutdown_connections 2024-04-26T07:54:40.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.236+0000 7f4406d42800 1 -- 172.21.15.62:0/778478532 wait complete. 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.249+0000 7f4406d42800 1 Processor -- start 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.249+0000 7f4406d42800 1 -- start start 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.249+0000 7f4406d42800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b31090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.249+0000 7f4406d42800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0b8988cd0 con 0x55b0b8a3bf80 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.249+0000 7f4404841640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b31090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.249+0000 7f4404841640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b31090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34602/0 (socket says 172.21.15.62:34602) 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.249+0000 7f4404841640 1 -- 172.21.15.62:0/891854199 learned_addr learned my addr 172.21.15.62:0/891854199 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.249+0000 7f4404841640 1 -- 172.21.15.62:0/891854199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0b8b31660 con 0x55b0b8a3bf80 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.250+0000 7f4404841640 1 --2- 172.21.15.62:0/891854199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b31090 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f43f4055040 tx=0x7f43f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b1fb008ee73a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.250+0000 7f42f2e0d640 1 -- 172.21.15.62:0/891854199 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4057040 con 0x55b0b8a3bf80 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.250+0000 7f42f2e0d640 1 -- 172.21.15.62:0/891854199 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f4052990 con 0x55b0b8a3bf80 2024-04-26T07:54:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.250+0000 7f42f2e0d640 1 -- 172.21.15.62:0/891854199 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4052c70 con 0x55b0b8a3bf80 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 -- 172.21.15.62:0/891854199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 msgr2=0x55b0b8b31090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 --2- 172.21.15.62:0/891854199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b31090 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f43f4055040 tx=0x7f43f404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 -- 172.21.15.62:0/891854199 shutdown_connections 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 --2- 172.21.15.62:0/891854199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b31090 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 -- 172.21.15.62:0/891854199 >> 172.21.15.62:0/891854199 conn(0x55b0b8a37b80 msgr2=0x55b0b8b2c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 -- 172.21.15.62:0/891854199 shutdown_connections 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 -- 172.21.15.62:0/891854199 wait complete. 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 Processor -- start 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 -- start start 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b38ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4406d42800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0b8a3d9d0 con 0x55b0b8a3bf80 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4404841640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b38ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4404841640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b38ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34606/0 (socket says 172.21.15.62:34606) 2024-04-26T07:54:40.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.251+0000 7f4404841640 1 -- 172.21.15.62:0/4026913325 learned_addr learned my addr 172.21.15.62:0/4026913325 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.252+0000 7f4404841640 1 -- 172.21.15.62:0/4026913325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0b8b38ff0 con 0x55b0b8a3bf80 2024-04-26T07:54:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.252+0000 7f4404841640 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b38ab0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f43f400a470 tx=0x7f43f4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.252+0000 7f42f160a640 1 -- 172.21.15.62:0/4026913325 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4073070 con 0x55b0b8a3bf80 2024-04-26T07:54:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.252+0000 7f42f160a640 1 -- 172.21.15.62:0/4026913325 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f405d650 con 0x55b0b8a3bf80 2024-04-26T07:54:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.252+0000 7f42f160a640 1 -- 172.21.15.62:0/4026913325 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4057070 con 0x55b0b8a3bf80 2024-04-26T07:54:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.252+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0b8b39280 con 0x55b0b8a3bf80 2024-04-26T07:54:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.252+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0b8b3bf30 con 0x55b0b8a3bf80 2024-04-26T07:54:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.253+0000 7f42f160a640 1 -- 172.21.15.62:0/4026913325 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f43f4076070 con 0x55b0b8a3bf80 2024-04-26T07:54:40.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.253+0000 7f42f160a640 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42ec036eb0 0x7f42ec039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.253+0000 7f42f160a640 1 -- 172.21.15.62:0/4026913325 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f43f408e610 con 0x55b0b8a3bf80 2024-04-26T07:54:40.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.253+0000 7f4404040640 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42ec036eb0 0x7f42ec039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.253+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8a3c8e0 0x55b0b8b3fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.253+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b40230 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.254+0000 7f4405042640 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8a3c8e0 0x55b0b8b3fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.254+0000 7f4404040640 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42ec036eb0 0x7f42ec039370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43f8001d90 tx=0x7f43f80012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.254+0000 7f4405042640 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8a3c8e0 0x55b0b8b3fcf0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.254+0000 7f4405042640 1 -- 172.21.15.62:0/4026913325 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43fc00a4a0 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.254+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b40af0 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.254+0000 7f4405042640 1 -- 172.21.15.62:0/4026913325 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43fc00a4a0 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.254+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b42400 0x55b0b8b448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.254+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b45030 con 0x55b0b8b42400 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.255+0000 7f4404841640 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b42400 0x55b0b8b448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.255+0000 7f4404841640 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b42400 0x55b0b8b448a0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.255+0000 7f4404841640 1 -- 172.21.15.62:0/4026913325 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b42400 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.255+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b41370 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.255+0000 7f4405042640 1 -- 172.21.15.62:0/4026913325 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43fc00a4a0 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.256+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b41850 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.256+0000 7f4405042640 1 -- 172.21.15.62:0/4026913325 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43fc00a4a0 con 0x55b0b8a3c8e0 2024-04-26T07:54:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.256+0000 7f4406d42800 1 Processor -- start 2024-04-26T07:54:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.256+0000 7f4406d42800 1 -- start start 2024-04-26T07:54:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.256+0000 7f4406d42800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b541f0 0x55b0b8b54610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.256+0000 7f4406d42800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0b8930170 con 0x55b0b8b541f0 2024-04-26T07:54:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f4405042640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b541f0 0x55b0b8b54610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f4405042640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b541f0 0x55b0b8b54610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34618/0 (socket says 172.21.15.62:34618) 2024-04-26T07:54:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f4405042640 1 -- 172.21.15.62:0/640835752 learned_addr learned my addr 172.21.15.62:0/640835752 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f4405042640 1 -- 172.21.15.62:0/640835752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0b8b54b50 con 0x55b0b8b541f0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f4405042640 1 --2- 172.21.15.62:0/640835752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b541f0 0x55b0b8b54610 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55b0b8b39cd0 tx=0x7f43fc012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f42ea7fc640 1 -- 172.21.15.62:0/640835752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc014450 con 0x55b0b8b541f0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f42ea7fc640 1 -- 172.21.15.62:0/640835752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc014610 con 0x55b0b8b541f0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f4406d42800 1 -- 172.21.15.62:0/640835752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0b8b555c0 con 0x55b0b8b541f0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f42ea7fc640 1 -- 172.21.15.62:0/640835752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc014930 con 0x55b0b8b541f0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.257+0000 7f4406d42800 1 -- 172.21.15.62:0/640835752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0b8b55ac0 con 0x55b0b8b541f0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.258+0000 7f42ea7fc640 1 -- 172.21.15.62:0/640835752 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f43fc011040 con 0x55b0b8b541f0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.258+0000 7f42ea7fc640 1 --2- 172.21.15.62:0/640835752 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42dc036eb0 0x7f42dc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.258+0000 7f42ea7fc640 1 -- 172.21.15.62:0/640835752 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f43fc01e070 con 0x55b0b8b541f0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.258+0000 7f4404841640 1 --2- 172.21.15.62:0/640835752 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42dc036eb0 0x7f42dc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.258+0000 7f4406d42800 1 Processor -- start 2024-04-26T07:54:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.258+0000 7f4406d42800 1 -- start start 2024-04-26T07:54:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f4404841640 1 --2- 172.21.15.62:0/640835752 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42dc036eb0 0x7f42dc039370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55b0b8b3d3f0 tx=0x7f43f4005240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f4406d42800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f4406d42800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0b8b31920 con 0x55b0b8b614b0 2024-04-26T07:54:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f4405042640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f4405042640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34620/0 (socket says 172.21.15.62:34620) 2024-04-26T07:54:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f4405042640 1 -- 172.21.15.62:0/1186265392 learned_addr learned my addr 172.21.15.62:0/1186265392 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f4405042640 1 -- 172.21.15.62:0/1186265392 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0b8b61ea0 con 0x55b0b8b614b0 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f4405042640 1 --2- 172.21.15.62:0/1186265392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b618d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f43fc04d090 tx=0x7f43fc02bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae09dab359c5d219 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f42dbfff640 1 -- 172.21.15.62:0/1186265392 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc047e60 con 0x55b0b8b614b0 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f42dbfff640 1 -- 172.21.15.62:0/1186265392 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc041200 con 0x55b0b8b614b0 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.259+0000 7f42dbfff640 1 -- 172.21.15.62:0/1186265392 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc02b350 con 0x55b0b8b614b0 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 -- 172.21.15.62:0/1186265392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 msgr2=0x55b0b8b618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 --2- 172.21.15.62:0/1186265392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b618d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f43fc04d090 tx=0x7f43fc02bef0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 -- 172.21.15.62:0/1186265392 shutdown_connections 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 --2- 172.21.15.62:0/1186265392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b618d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 -- 172.21.15.62:0/1186265392 >> 172.21.15.62:0/1186265392 conn(0x55b0b8b5d810 msgr2=0x55b0b8b5b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 -- 172.21.15.62:0/1186265392 shutdown_connections 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 -- 172.21.15.62:0/1186265392 wait complete. 2024-04-26T07:54:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 Processor -- start 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 -- start start 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b68ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.260+0000 7f4406d42800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0b8b62610 con 0x55b0b8b614b0 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f4405042640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b68ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f4405042640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b68ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34636/0 (socket says 172.21.15.62:34636) 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 learned_addr learned my addr 172.21.15.62:0/3047964021 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0b8b69020 con 0x55b0b8b614b0 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f4405042640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b68ae0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f43fc04bf80 tx=0x7f43fc04cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f42da7fc640 1 -- 172.21.15.62:0/3047964021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc047070 con 0x55b0b8b614b0 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f42da7fc640 1 -- 172.21.15.62:0/3047964021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc048040 con 0x55b0b8b614b0 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0b8b692b0 con 0x55b0b8b614b0 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f42da7fc640 1 -- 172.21.15.62:0/3047964021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc03c0c0 con 0x55b0b8b614b0 2024-04-26T07:54:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.261+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0b8b6bf60 con 0x55b0b8b614b0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.262+0000 7f42da7fc640 1 -- 172.21.15.62:0/3047964021 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f43fc022a80 con 0x55b0b8b614b0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.262+0000 7f42da7fc640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42d0037000 0x7f42d00394c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.262+0000 7f42da7fc640 1 -- 172.21.15.62:0/3047964021 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f43fc035030 con 0x55b0b8b614b0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.262+0000 7f4404841640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42d0037000 0x7f42d00394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.262+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.262+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8b747e0 0x55b0b8b76ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.262+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b773f0 con 0x55b0b8b747e0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.262+0000 7f4404040640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8b747e0 0x55b0b8b76ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4404841640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42d0037000 0x7f42d00394c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55b0b8b45430 tx=0x7f43f4082000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4404040640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8b747e0 0x55b0b8b76ca0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43f8009050 con 0x55b0b8b747e0 2024-04-26T07:54:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4406d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4406d42800 20 realm 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b73c80 con 0x55b0b8b747e0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43f8009050 con 0x55b0b8b747e0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4406d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4406d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.263+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b77ed0 con 0x55b0b8b747e0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43f8009050 con 0x55b0b8b747e0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4406d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b787a0 con 0x55b0b8b747e0 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43f8009050 con 0x55b0b8b747e0 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4406d42800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b79050 0x55b0b8b7b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b7bb80 con 0x55b0b8b79050 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4405042640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b79050 0x55b0b8b7b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.264+0000 7f4405042640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b79050 0x55b0b8b7b440 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.265+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.265+0000 7f4406d42800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.265+0000 7f4406d42800 20 searching for the correct realm 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.265+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b0b8b7dc20 0x55b0b8b800e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.265+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.265+0000 7f4404841640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b0b8b7dc20 0x55b0b8b800e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.265+0000 7f4404841640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b0b8b7dc20 0x55b0b8b800e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.266+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.266+0000 7f4404841640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f43f409c040 0x7f43f405d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.266+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x7f43f409c040 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.266+0000 7f4404040640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f43f409c040 0x7f43f405d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.266+0000 7f4404040640 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f43f409c040 0x7f43f405d970 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.267+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8009050 con 0x7f43f409c040 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.267+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.267+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.267+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b747e0 2024-04-26T07:54:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.267+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8009050 con 0x55b0b8b747e0 2024-04-26T07:54:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.267+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b747e0 2024-04-26T07:54:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.267+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.267+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.268+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.268+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.268+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.268+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x7f43f409c040 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.268+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.268+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.268+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.269+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b747e0 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.269+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.269+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.269+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.269+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b747e0 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.269+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.269+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x7f43f409c040 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.270+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.270+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.270+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.270+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.270+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.270+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b747e0 2024-04-26T07:54:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b747e0 2024-04-26T07:54:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.271+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.272+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.272+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.272+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.272+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x7f43f409c040 2024-04-26T07:54:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.272+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.272+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b747e0 2024-04-26T07:54:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.273+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.273+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.273+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.273+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.273+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.273+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.273+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.273+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x7f43f409c040 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.274+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.274+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.274+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.274+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b79050 2024-04-26T07:54:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.274+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.274+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x55b0b8b747e0 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b807b0 con 0x7f43f409c040 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b7c620 con 0x55b0b8b747e0 2024-04-26T07:54:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b7c230 con 0x55b0b8b747e0 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.275+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b7cf10 con 0x55b0b8b747e0 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 20 zone default found 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 4 Realm: () 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 20 zonegroup default 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b80c30 con 0x55b0b8b79050 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.276+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b7cad0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4406d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b82f80 con 0x55b0b8b7dc20 2024-04-26T07:54:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4406d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4406d42800 20 started sync module instance, tier type = 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4406d42800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.277+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b822f0 con 0x7f43f409c040 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.278+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.278+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94217501681680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b822f0 con 0x7f43f409c040 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.278+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b83b10 con 0x55b0b8b747e0 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.279+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94217501681680] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.279+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.279+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94217501685248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b822f0 con 0x55b0b8b747e0 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.279+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b84560 con 0x55b0b8b7dc20 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.281+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94217501685248] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.281+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.281+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94217501679168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b82260 con 0x55b0b8b7dc20 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.281+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b85340 con 0x7f43f409c040 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.282+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94217501679168] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.282+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.282+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94217501690240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b85760 con 0x7f43f409c040 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.282+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b86120 con 0x55b0b8b747e0 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.283+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.283+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94217501695088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b86090 con 0x55b0b8b747e0 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.283+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b870d0 con 0x55b0b8b79050 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.283+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94217501690240] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.284+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.284+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94217501695088] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.284+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94217501697296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b86bb0 con 0x55b0b8b79050 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.284+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b87970 con 0x55b0b8b79050 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.285+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94217501697296] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.285+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.285+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94217501691296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b87970 con 0x55b0b8b79050 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.285+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b88390 con 0x55b0b8b79050 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94217501703808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b88800 con 0x55b0b8b79050 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4406d42800 20 add_watcher() i=0 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4406d42800 20 add_watcher() i=1 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4406d42800 20 add_watcher() i=2 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4406d42800 20 add_watcher() i=3 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4406d42800 20 add_watcher() i=4 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4406d42800 20 add_watcher() i=5 2024-04-26T07:54:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94217501691296] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.286+0000 7f4406d42800 20 add_watcher() i=6 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.287+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94217501703808] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.287+0000 7f4406d42800 20 add_watcher() i=7 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.287+0000 7f4406d42800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.287+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b88800 con 0x55b0b8b747e0 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.287+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.287+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94217501705040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b891c0 con 0x55b0b8b747e0 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.288+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94217501705040] v27'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.288+0000 7f42bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.288+0000 7f4406d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.288+0000 7f4406d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.288+0000 7f4406d42800 5 note: GC not initialized 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f42b9fe3640 20 reqs_thread_entry: start 2024-04-26T07:54:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f4406d42800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f4406d42800 20 Filter name: none 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f422b7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bbeed0 con 0x7f43f409c040 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f4406d42800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.289+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bbf800 con 0x55b0b8b747e0 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(63 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4406d42800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4406d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bbf840 con 0x7f43f409c040 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f43f8029040 con 0x7f43f409c040 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4406d42800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4406d42800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.290+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bc0fb0 con 0x55b0b8b747e0 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f43f8029040 con 0x55b0b8b747e0 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 4.1a 4:5a581a9c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bc0560 con 0x7f43f409c040 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 4.16 4:6ac82eb8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bc5af0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 4.e 4:7264ccad:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bc8360 con 0x7f43f409c040 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 4.24 4:27ab159e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bca830 con 0x55b0b8b79050 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 4.7 4:e3bd6437:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bcd1d0 con 0x55b0b8b79050 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 4.3b 4:de750cfa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bcfb70 con 0x55b0b8b7dc20 2024-04-26T07:54:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 4.22 4:476c90f1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bd2a30 con 0x55b0b8b747e0 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(68 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43f8045060 con 0x7f43f409c040 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(66 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43f8045060 con 0x7f43f409c040 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 4.1d 4:ba0b4099:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bd5460 con 0x55b0b8b7dc20 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 4.7 4:e33164c7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bc6340 con 0x55b0b8b79050 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(70 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 4.2e 4:74fb3df0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bc7c00 con 0x55b0b8b7dc20 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:76 4.34 4:2cf2cafa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8bc6340 con 0x7f43f409c040 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(71 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(72 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f43f8045060 con 0x55b0b8b747e0 2024-04-26T07:54:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(73 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(75 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.8 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.291+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(76 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f43f8045060 con 0x7f43f409c040 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.292+0000 7f42bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.292+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94217501705040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8ba74c0 con 0x55b0b8b747e0 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.293+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94217501705040] v27'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43f8045060 con 0x55b0b8b747e0 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.293+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94217501681680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8ba74c0 con 0x7f43f409c040 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.294+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94217501681680] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8045060 con 0x7f43f409c040 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.294+0000 7f4406d42800 20 remove_watcher() i=0 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.294+0000 7f4406d42800 2 removed watcher, disabling cache 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.295+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94217501685248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8ba74c0 con 0x55b0b8b747e0 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.296+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94217501685248] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8045060 con 0x55b0b8b747e0 2024-04-26T07:54:40.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.296+0000 7f4406d42800 20 remove_watcher() i=1 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.296+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94217501679168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8ba74c0 con 0x55b0b8b7dc20 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.297+0000 7f4404841640 1 -- 172.21.15.62:0/3047964021 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94217501679168] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f4075030 con 0x55b0b8b7dc20 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.297+0000 7f4406d42800 20 remove_watcher() i=2 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.297+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94217501690240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8ba74c0 con 0x7f43f409c040 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.298+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94217501690240] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8045060 con 0x7f43f409c040 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.298+0000 7f4406d42800 20 remove_watcher() i=3 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.298+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94217501695088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b84980 con 0x55b0b8b747e0 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.299+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94217501695088] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f8045060 con 0x55b0b8b747e0 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.299+0000 7f4406d42800 20 remove_watcher() i=4 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.299+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94217501697296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8ba74c0 con 0x55b0b8b79050 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.300+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94217501697296] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.300+0000 7f4406d42800 20 remove_watcher() i=5 2024-04-26T07:54:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.300+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94217501691296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8b85c70 con 0x55b0b8b79050 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.301+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94217501691296] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.301+0000 7f4406d42800 20 remove_watcher() i=6 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.301+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94217501703808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0b8ba74c0 con 0x55b0b8b79050 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4405042640 1 -- 172.21.15.62:0/3047964021 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94217501703808] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc055070 con 0x55b0b8b79050 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 20 remove_watcher() i=7 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b79050 msgr2=0x55b0b8b7b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b79050 0x55b0b8b7b440 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8b747e0 msgr2=0x55b0b8b76ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8b747e0 0x55b0b8b76ca0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f43f409c040 msgr2=0x7f43f405d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f43f409c040 0x7f43f405d970 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b0b8b7dc20 msgr2=0x55b0b8b800e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b0b8b7dc20 0x55b0b8b800e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42d0037000 msgr2=0x7f42d00394c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42d0037000 0x7f42d00394c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55b0b8b45430 tx=0x7f43f4082000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 msgr2=0x55b0b8b68ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 --2- 172.21.15.62:0/3047964021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b614b0 0x55b0b8b68ae0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f43fc04bf80 tx=0x7f43fc04cff0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 reap_dead start 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4404040640 1 -- 172.21.15.62:0/3047964021 reap_dead start 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 shutdown_connections 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.302+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 >> 172.21.15.62:0/3047964021 conn(0x55b0b8b5d810 msgr2=0x55b0b8b5ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 shutdown_connections 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/3047964021 wait complete. 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/640835752 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42dc036eb0 msgr2=0x7f42dc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/640835752 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42dc036eb0 0x7f42dc039370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55b0b8b3d3f0 tx=0x7f43f4005240 comp rx=0 tx=0).stop 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/640835752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b541f0 msgr2=0x55b0b8b54610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/640835752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b541f0 0x55b0b8b54610 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55b0b8b39cd0 tx=0x7f43fc012fd0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/640835752 shutdown_connections 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/640835752 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42dc036eb0 0x7f42dc039370 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/640835752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8b541f0 0x55b0b8b54610 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/640835752 >> 172.21.15.62:0/640835752 conn(0x55b0b8b48290 msgr2=0x55b0b8b48690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/640835752 shutdown_connections 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/640835752 wait complete. 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b42400 msgr2=0x55b0b8b448a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b42400 0x55b0b8b448a0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8a3c8e0 msgr2=0x55b0b8b3fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8a3c8e0 0x55b0b8b3fcf0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42ec036eb0 msgr2=0x7f42ec039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42ec036eb0 0x7f42ec039370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43f8001d90 tx=0x7f43f80012f0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 msgr2=0x55b0b8b38ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b38ab0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f43f400a470 tx=0x7f43f4003020 comp rx=0 tx=0).stop 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 shutdown_connections 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b0b8a3c8e0 0x55b0b8b3fcf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55b0b8b42400 0x55b0b8b448a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f42ec036eb0 0x7f42ec039370 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 --2- 172.21.15.62:0/4026913325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0b8a3bf80 0x55b0b8b38ab0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.303+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 >> 172.21.15.62:0/4026913325 conn(0x55b0b8a37b80 msgr2=0x55b0b8b2b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.304+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 shutdown_connections 2024-04-26T07:54:40.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.304+0000 7f4406d42800 1 -- 172.21.15.62:0/4026913325 wait complete. 2024-04-26T07:54:40.322 INFO:teuthology.orchestra.run.smithi062.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"76158cff-5435-4eb7-bdd8-fb93108eac49","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","marker":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T07:54:39.766618Z","creation_time":"2024-04-26T07:54:36.674214Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T07:54:40.323 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T07:54:39.766618Z', 'creation_time': '2024-04-26T07:54:36.674214Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T07:54:40.323 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-04-26T07:54:40.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-04-26T07:54:40.323 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-04-26T07:54:40.405 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:40.405 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:40.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.407+0000 7f621e933800 1 Processor -- start 2024-04-26T07:54:40.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.407+0000 7f621e933800 1 -- start start 2024-04-26T07:54:40.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.407+0000 7f621e933800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55dbe9ba6b80 0x55dbe9ba8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.407+0000 7f621e933800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dbe9ba9540 con 0x55dbe9ba0960 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.407+0000 7f621e933800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55dbe9a44e20 con 0x55dbe9ba6b80 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.408+0000 7f6219ef1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55dbe9ba6b80 0x55dbe9ba8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.408+0000 7f621a6f2640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55dbe9ba0960 0x55dbe9ba0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36836/0 (socket says 172.21.15.62:36836) 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.408+0000 7f621a6f2640 1 -- 172.21.15.62:0/1076134809 learned_addr learned my addr 172.21.15.62:0/1076134809 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.408+0000 7f62196f0640 1 -- 172.21.15.62:0/1076134809 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886963638 0 0) 0x55dbe9ba9540 con 0x55dbe9ba0960 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.408+0000 7f62196f0640 1 -- 172.21.15.62:0/1076134809 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6204001e10 con 0x55dbe9ba0960 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.408+0000 7f6219ef1640 1 -- 172.21.15.62:0/1076134809 >> v1:172.21.15.1:6789/0 conn(0x55dbe9ba0960 legacy=0x55dbe9ba0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.408+0000 7f6219ef1640 1 -- 172.21.15.62:0/1076134809 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe9baa720 con 0x55dbe9ba6b80 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.410+0000 7f6219ef1640 1 --2- 172.21.15.62:0/1076134809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba6b80 0x55dbe9ba8f70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f621000a470 tx=0x7f621001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f355dbe6c65c9183 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.410+0000 7f62196f0640 1 -- 172.21.15.62:0/1076134809 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6210057070 con 0x55dbe9ba6b80 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.410+0000 7f62196f0640 1 -- 172.21.15.62:0/1076134809 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210052570 con 0x55dbe9ba6b80 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.410+0000 7f62196f0640 1 -- 172.21.15.62:0/1076134809 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6210052870 con 0x55dbe9ba6b80 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.410+0000 7f621e933800 1 -- 172.21.15.62:0/1076134809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba6b80 msgr2=0x55dbe9ba8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.410+0000 7f621e933800 1 --2- 172.21.15.62:0/1076134809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba6b80 0x55dbe9ba8f70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f621000a470 tx=0x7f621001cdb0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.411+0000 7f621e933800 1 -- 172.21.15.62:0/1076134809 shutdown_connections 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.411+0000 7f621e933800 1 --2- 172.21.15.62:0/1076134809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba6b80 0x55dbe9ba8f70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.411+0000 7f621e933800 1 -- 172.21.15.62:0/1076134809 >> 172.21.15.62:0/1076134809 conn(0x55dbe9b9c310 msgr2=0x55dbe9b9e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.411+0000 7f621e933800 1 -- 172.21.15.62:0/1076134809 shutdown_connections 2024-04-26T07:54:40.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.411+0000 7f621e933800 1 -- 172.21.15.62:0/1076134809 wait complete. 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.423+0000 7f621e933800 1 Processor -- start 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.423+0000 7f621e933800 1 -- start start 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.423+0000 7f621e933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9c93a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.423+0000 7f621e933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dbe9aedcc0 con 0x55dbe9ba0960 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.424+0000 7f621a6f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9c93a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.424+0000 7f621a6f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9c93a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34646/0 (socket says 172.21.15.62:34646) 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.424+0000 7f621a6f2640 1 -- 172.21.15.62:0/3739274003 learned_addr learned my addr 172.21.15.62:0/3739274003 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.424+0000 7f621a6f2640 1 -- 172.21.15.62:0/3739274003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe9c94030 con 0x55dbe9ba0960 2024-04-26T07:54:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.424+0000 7f621a6f2640 1 --2- 172.21.15.62:0/3739274003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9c93a60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f620c001de0 tx=0x7f620c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cddb9ff4e45e19e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.424+0000 7f6108608640 1 -- 172.21.15.62:0/3739274003 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f620c012020 con 0x55dbe9ba0960 2024-04-26T07:54:40.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.424+0000 7f6108608640 1 -- 172.21.15.62:0/3739274003 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c00e5a0 con 0x55dbe9ba0960 2024-04-26T07:54:40.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.424+0000 7f6108608640 1 -- 172.21.15.62:0/3739274003 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f620c00e900 con 0x55dbe9ba0960 2024-04-26T07:54:40.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.425+0000 7f621e933800 1 -- 172.21.15.62:0/3739274003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 msgr2=0x55dbe9c93a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.425+0000 7f621e933800 1 --2- 172.21.15.62:0/3739274003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9c93a60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f620c001de0 tx=0x7f620c00b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.425+0000 7f621e933800 1 -- 172.21.15.62:0/3739274003 shutdown_connections 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.425+0000 7f621e933800 1 --2- 172.21.15.62:0/3739274003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9c93a60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.425+0000 7f621e933800 1 -- 172.21.15.62:0/3739274003 >> 172.21.15.62:0/3739274003 conn(0x55dbe9b9c310 msgr2=0x55dbe9c8f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.425+0000 7f621e933800 1 -- 172.21.15.62:0/3739274003 shutdown_connections 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.425+0000 7f621e933800 1 -- 172.21.15.62:0/3739274003 wait complete. 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.425+0000 7f621e933800 1 Processor -- start 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.426+0000 7f621e933800 1 -- start start 2024-04-26T07:54:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.426+0000 7f621e933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9ba3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.426+0000 7f621e933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dbe9ba99e0 con 0x55dbe9ba0960 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.426+0000 7f621a6f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9ba3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.426+0000 7f621a6f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9ba3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34652/0 (socket says 172.21.15.62:34652) 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.426+0000 7f621a6f2640 1 -- 172.21.15.62:0/241047566 learned_addr learned my addr 172.21.15.62:0/241047566 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.426+0000 7f621a6f2640 1 -- 172.21.15.62:0/241047566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe9ba1980 con 0x55dbe9ba0960 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.426+0000 7f621a6f2640 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9ba3290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c010 tx=0x7f620c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.427+0000 7f6106e05640 1 -- 172.21.15.62:0/241047566 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f620c012030 con 0x55dbe9ba0960 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.427+0000 7f6106e05640 1 -- 172.21.15.62:0/241047566 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c01a7a0 con 0x55dbe9ba0960 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.427+0000 7f6106e05640 1 -- 172.21.15.62:0/241047566 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f620c01aa80 con 0x55dbe9ba0960 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.427+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbe9ba1c10 con 0x55dbe9ba0960 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.427+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe9ba2130 con 0x55dbe9ba0960 2024-04-26T07:54:40.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.427+0000 7f6106e05640 1 -- 172.21.15.62:0/241047566 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f620c015020 con 0x55dbe9ba0960 2024-04-26T07:54:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f6106e05640 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6100036eb0 0x7f6100039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f6106e05640 1 -- 172.21.15.62:0/241047566 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f620c020030 con 0x55dbe9ba0960 2024-04-26T07:54:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f6219ef1640 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6100036eb0 0x7f6100039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9ba6b80 0x55dbe9ca4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ca4f90 con 0x55dbe9ba6b80 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f621aef3640 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9ba6b80 0x55dbe9ca4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f6219ef1640 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6100036eb0 0x7f6100039370 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6210054000 tx=0x7f621004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f621aef3640 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9ba6b80 0x55dbe9ca4a50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f621aef3640 1 -- 172.21.15.62:0/241047566 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621400a4a0 con 0x55dbe9ba6b80 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.428+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ca58c0 con 0x55dbe9ba6b80 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.429+0000 7f621aef3640 1 -- 172.21.15.62:0/241047566 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f621400a4a0 con 0x55dbe9ba6b80 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.429+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9ca7340 0x55dbe9ca9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.429+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ca9f90 con 0x55dbe9ca7340 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.429+0000 7f621a6f2640 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9ca7340 0x55dbe9ca9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.429+0000 7f621a6f2640 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9ca7340 0x55dbe9ca9800 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.430+0000 7f621a6f2640 1 -- 172.21.15.62:0/241047566 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ca7340 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.430+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ca6140 con 0x55dbe9ba6b80 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.430+0000 7f621aef3640 1 -- 172.21.15.62:0/241047566 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f621400a4a0 con 0x55dbe9ba6b80 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.430+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ca6620 con 0x55dbe9ba6b80 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.430+0000 7f621aef3640 1 -- 172.21.15.62:0/241047566 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f621400a4a0 con 0x55dbe9ba6b80 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621e933800 1 Processor -- start 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621e933800 1 -- start start 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621e933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cb90d0 0x55dbe9cb94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621e933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dbe9ba37d0 con 0x55dbe9cb90d0 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621aef3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cb90d0 0x55dbe9cb94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621aef3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cb90d0 0x55dbe9cb94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34666/0 (socket says 172.21.15.62:34666) 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621aef3640 1 -- 172.21.15.62:0/415074295 learned_addr learned my addr 172.21.15.62:0/415074295 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621aef3640 1 -- 172.21.15.62:0/415074295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe9cb9a30 con 0x55dbe9cb90d0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.431+0000 7f621aef3640 1 --2- 172.21.15.62:0/415074295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cb90d0 0x55dbe9cb94f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x55dbe9ca5390 tx=0x7f6214018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.432+0000 7f60fffff640 1 -- 172.21.15.62:0/415074295 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6214014450 con 0x55dbe9cb90d0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.432+0000 7f60fffff640 1 -- 172.21.15.62:0/415074295 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6214014610 con 0x55dbe9cb90d0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.432+0000 7f60fffff640 1 -- 172.21.15.62:0/415074295 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6214014930 con 0x55dbe9cb90d0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.432+0000 7f621e933800 1 -- 172.21.15.62:0/415074295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbe9cba4a0 con 0x55dbe9cb90d0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.432+0000 7f621e933800 1 -- 172.21.15.62:0/415074295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe9cba9a0 con 0x55dbe9cb90d0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.432+0000 7f60fffff640 1 -- 172.21.15.62:0/415074295 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6214011040 con 0x55dbe9cb90d0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f60fffff640 1 --2- 172.21.15.62:0/415074295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60f4036eb0 0x7f60f4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f60fffff640 1 -- 172.21.15.62:0/415074295 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f621401e070 con 0x55dbe9cb90d0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621a6f2640 1 --2- 172.21.15.62:0/415074295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60f4036eb0 0x7f60f4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621e933800 1 Processor -- start 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621e933800 1 -- start start 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621a6f2640 1 --2- 172.21.15.62:0/415074295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60f4036eb0 0x7f60f4039370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55dbe9ba2740 tx=0x7f620c041040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621e933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9cc6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621e933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dbe9a95170 con 0x55dbe9cc6370 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621aef3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9cc6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621aef3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9cc6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34678/0 (socket says 172.21.15.62:34678) 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621aef3640 1 -- 172.21.15.62:0/1830296134 learned_addr learned my addr 172.21.15.62:0/1830296134 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.433+0000 7f621aef3640 1 -- 172.21.15.62:0/1830296134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe9cc6d60 con 0x55dbe9cc6370 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f621aef3640 1 --2- 172.21.15.62:0/1830296134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9cc6790 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f621404cfa0 tx=0x7f621404d250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf76c77b2092e37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f60fdffb640 1 -- 172.21.15.62:0/1830296134 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6214011330 con 0x55dbe9cc6370 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f60fdffb640 1 -- 172.21.15.62:0/1830296134 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62140114d0 con 0x55dbe9cc6370 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f60fdffb640 1 -- 172.21.15.62:0/1830296134 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6214046380 con 0x55dbe9cc6370 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f621e933800 1 -- 172.21.15.62:0/1830296134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 msgr2=0x55dbe9cc6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f621e933800 1 --2- 172.21.15.62:0/1830296134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9cc6790 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f621404cfa0 tx=0x7f621404d250 comp rx=0 tx=0).stop 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f621e933800 1 -- 172.21.15.62:0/1830296134 shutdown_connections 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f621e933800 1 --2- 172.21.15.62:0/1830296134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9cc6790 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f621e933800 1 -- 172.21.15.62:0/1830296134 >> 172.21.15.62:0/1830296134 conn(0x55dbe9cc2680 msgr2=0x55dbe9cc06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f621e933800 1 -- 172.21.15.62:0/1830296134 shutdown_connections 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.434+0000 7f621e933800 1 -- 172.21.15.62:0/1830296134 wait complete. 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621e933800 1 Processor -- start 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621e933800 1 -- start start 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621e933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9ccd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621e933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dbe9cc7330 con 0x55dbe9cc6370 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621aef3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9ccd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621aef3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9ccd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34682/0 (socket says 172.21.15.62:34682) 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 learned_addr learned my addr 172.21.15.62:0/3172302420 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe9ccdc70 con 0x55dbe9cc6370 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.435+0000 7f621aef3640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9ccd730 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6214011fd0 tx=0x7f621404cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.436+0000 7f60ebfff640 1 -- 172.21.15.62:0/3172302420 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6214032040 con 0x55dbe9cc6370 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.436+0000 7f60ebfff640 1 -- 172.21.15.62:0/3172302420 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621404e3f0 con 0x55dbe9cc6370 2024-04-26T07:54:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.436+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbe9ccdf00 con 0x55dbe9cc6370 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.436+0000 7f60ebfff640 1 -- 172.21.15.62:0/3172302420 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6214011330 con 0x55dbe9cc6370 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.436+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe9cd0bb0 con 0x55dbe9cc6370 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.436+0000 7f60ebfff640 1 -- 172.21.15.62:0/3172302420 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f621403e030 con 0x55dbe9cc6370 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.436+0000 7f60ebfff640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60e4036eb0 0x7f60e4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f60ebfff640 1 -- 172.21.15.62:0/3172302420 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f621403c070 con 0x55dbe9cc6370 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621a6f2640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60e4036eb0 0x7f60e4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9cd9350 0x55dbe9cdb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cdbf60 con 0x55dbe9cd9350 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f6219ef1640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9cd9350 0x55dbe9cdb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621a6f2640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60e4036eb0 0x7f60e4039370 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55dbe9caa390 tx=0x7f620c033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f6219ef1640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9cd9350 0x55dbe9cdb810 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621e933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621e933800 20 realm 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.437+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cdc330 con 0x55dbe9cd9350 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cdcc00 con 0x55dbe9cd9350 2024-04-26T07:54:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cdcfa0 con 0x55dbe9cd9350 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9cdda50 0x55dbe9cdfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.438+0000 7f621aef3640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9cdda50 0x55dbe9cdfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.439+0000 7f621aef3640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9cdda50 0x55dbe9cdfe60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.439+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.439+0000 7f621e933800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.439+0000 7f621e933800 20 searching for the correct realm 2024-04-26T07:54:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.439+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dbe9ce2670 0x55dbe9ce4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.439+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce5200 con 0x55dbe9ce2670 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.439+0000 7f621a6f2640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dbe9ce2670 0x55dbe9ce4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.439+0000 7f621a6f2640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dbe9ce2670 0x55dbe9ce4b30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.440+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.440+0000 7f621a6f2640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f620c017050 0x7f620c00d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.440+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce5200 con 0x7f620c017050 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.440+0000 7f6219ef1640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f620c017050 0x7f620c00d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.440+0000 7f6219ef1640 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f620c017050 0x7f620c00d3d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.441+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.441+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce5200 con 0x55dbe9cdda50 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.441+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.441+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cd9350 2024-04-26T07:54:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.441+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.441+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cd9350 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.442+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.442+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.442+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.442+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.442+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.442+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x7f620c017050 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.443+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.443+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9ce2670 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.443+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.443+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cd9350 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.443+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.443+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.443+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.443+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cd9350 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.444+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.444+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x7f620c017050 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.444+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.444+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9ce2670 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.444+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.444+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9ce2670 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.444+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.444+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9ce2670 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9ce2670 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cd9350 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cd9350 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.445+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.446+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.446+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9ce2670 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.446+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.446+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x7f620c017050 2024-04-26T07:54:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.446+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.446+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cd9350 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.446+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.446+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.447+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.447+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9ce2670 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.447+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.447+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.447+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.448+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x7f620c017050 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.448+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.448+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9ce2670 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.448+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.448+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cdda50 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.448+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.448+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x55dbe9cd9350 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce05c0 con 0x7f620c017050 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce0f70 con 0x55dbe9cd9350 2024-04-26T07:54:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cd9350 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.449+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1780 con 0x55dbe9cd9350 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 20 zone default found 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 4 Realm: () 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 20 zonegroup default 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1bb0 con 0x55dbe9cdda50 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.450+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce0b70 con 0x55dbe9ce2670 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621e933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621e933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce75d0 con 0x55dbe9ce2670 2024-04-26T07:54:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621e933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621e933800 20 started sync module instance, tier type = 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621e933800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.451+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce69a0 con 0x7f620c017050 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.452+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.452+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94403008818848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce69a0 con 0x7f620c017050 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.452+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce8150 con 0x55dbe9cd9350 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.453+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94403008818848] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.453+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.453+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94403008822304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce69a0 con 0x55dbe9cd9350 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.453+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce8c00 con 0x55dbe9ce2670 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.454+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94403008822304] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.454+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.454+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94403008816368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce6910 con 0x55dbe9ce2670 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.454+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce9ac0 con 0x7f620c017050 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.455+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94403008816368] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.456+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.456+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94403008828944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce9a30 con 0x7f620c017050 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.456+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cea980 con 0x55dbe9cd9350 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.457+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.457+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94403008832720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ceada0 con 0x55dbe9cd9350 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.457+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ceb810 con 0x55dbe9cdda50 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.457+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94403008828944] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.458+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94403008832720] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.458+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.458+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94403008836320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cea8f0 con 0x55dbe9cdda50 2024-04-26T07:54:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.458+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cec0b0 con 0x55dbe9cdda50 2024-04-26T07:54:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.459+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94403008836320] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.459+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.459+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94403008831152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cea8f0 con 0x55dbe9cdda50 2024-04-26T07:54:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.459+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cec710 con 0x55dbe9cdda50 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94403008831152] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94403008838656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cec6d0 con 0x55dbe9cdda50 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621e933800 20 add_watcher() i=0 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621e933800 20 add_watcher() i=1 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621e933800 20 add_watcher() i=2 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621e933800 20 add_watcher() i=3 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621e933800 20 add_watcher() i=4 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621e933800 20 add_watcher() i=5 2024-04-26T07:54:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.460+0000 7f621e933800 20 add_watcher() i=6 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.461+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94403008838656] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.461+0000 7f621e933800 20 add_watcher() i=7 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.461+0000 7f621e933800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.461+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cefb60 con 0x55dbe9cd9350 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.461+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.461+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94403008840688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cecfe0 con 0x55dbe9cd9350 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.462+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94403008840688] v27'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f60d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f621e933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f621e933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f621e933800 5 note: GC not initialized 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f604b7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f621e933800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f621e933800 20 Filter name: none 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f60497fa640 20 reqs_thread_entry: start 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.463+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9d22710 con 0x55dbe9cdda50 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.464+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(62 [pgnls start_epoch 27 out=254b] v27'36 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.464+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1bb0 con 0x55dbe9cdda50 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.464+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(63 [pgnls start_epoch 27 out=131b] v27'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.464+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1bb0 con 0x55dbe9ce2670 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.465+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.465+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1bb0 con 0x55dbe9cdda50 2024-04-26T07:54:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.466+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(65 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.466+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1bb0 con 0x55dbe9cd9350 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.466+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(66 [pgnls start_epoch 27 out=335b] v27'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.466+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x7f620c017050 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.466+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 [pgnls start_epoch 27 out=213b] v27'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.466+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.467+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(68 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.467+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.467+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(69 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.467+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.467+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(70 [pgnls start_epoch 27 out=213b] v27'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.467+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x7f620c017050 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.468+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(71 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.468+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x7f620c017050 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.468+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 [pgnls start_epoch 27 out=336b] v27'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.468+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.468+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=131b] v27'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.468+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.468+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=254b] v27'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.469+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.469+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(75 [pgnls start_epoch 27 out=90b] v27'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.469+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cd9350 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.469+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(76 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.469+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.469+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.469+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cd9350 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.470+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(78 [pgnls start_epoch 27 out=254b] v27'15 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.470+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.470+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(79 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.470+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.470+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(80 [pgnls start_epoch 27 out=172b] v27'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.470+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cd9350 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.470+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(81 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.470+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x7f620c017050 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.471+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(82 [pgnls start_epoch 27 out=276b] v27'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.471+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x7f620c017050 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.471+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(83 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.471+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cd9350 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.471+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(84 [pgnls start_epoch 27 out=295b] v27'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.471+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cdda50 2024-04-26T07:54:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.472+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(85 [pgnls start_epoch 27 out=172b] v27'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f6214035040 con 0x55dbe9cdda50 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.472+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x7f620c017050 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.473+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(86 [pgnls start_epoch 27 out=213b] v27'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.473+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cdda50 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.473+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(87 [pgnls start_epoch 27 out=172b] v27'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f6214069040 con 0x55dbe9cdda50 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.473+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.473+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(88 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.473+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.473+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(89 [pgnls start_epoch 27 out=90b] v27'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.473+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9ce2670 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.474+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(90 [pgnls start_epoch 27 out=90b] v27'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.474+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cd9350 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.474+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(91 [pgnls start_epoch 27 out=131b] v27'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.474+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x7f620c017050 2024-04-26T07:54:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.474+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(92 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.474+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1360 con 0x55dbe9cdda50 2024-04-26T07:54:40.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.475+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(93 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f6214069040 con 0x55dbe9cdda50 2024-04-26T07:54:40.498 INFO:teuthology.orchestra.run.smithi062.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-04-26T07:54:40.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.477+0000 7f60d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.477+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94403008840688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce1bb0 con 0x55dbe9cd9350 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.478+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94403008840688] v27'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.478+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94403008818848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cec3c0 con 0x7f620c017050 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.479+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94403008818848] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.479+0000 7f621e933800 20 remove_watcher() i=0 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.479+0000 7f621e933800 2 removed watcher, disabling cache 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.479+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94403008822304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce6ea0 con 0x55dbe9cd9350 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.480+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94403008822304] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.480+0000 7f621e933800 20 remove_watcher() i=1 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.480+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94403008816368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce6ea0 con 0x55dbe9ce2670 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.481+0000 7f621a6f2640 1 -- 172.21.15.62:0/3172302420 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94403008816368] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f620c00dcd0 con 0x55dbe9ce2670 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.481+0000 7f621e933800 20 remove_watcher() i=2 2024-04-26T07:54:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.481+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94403008828944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce64f0 con 0x7f620c017050 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.482+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94403008828944] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x7f620c017050 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.482+0000 7f621e933800 20 remove_watcher() i=3 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.482+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94403008832720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce9610 con 0x55dbe9cd9350 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.483+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94403008832720] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621005a040 con 0x55dbe9cd9350 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.483+0000 7f621e933800 20 remove_watcher() i=4 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.483+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94403008836320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce64f0 con 0x55dbe9cdda50 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.484+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94403008836320] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214069040 con 0x55dbe9cdda50 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.484+0000 7f621e933800 20 remove_watcher() i=5 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.484+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94403008831152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9cea4d0 con 0x55dbe9cdda50 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.485+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94403008831152] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214069040 con 0x55dbe9cdda50 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.485+0000 7f621e933800 20 remove_watcher() i=6 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.485+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94403008838656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbe9ce9610 con 0x55dbe9cdda50 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.486+0000 7f621aef3640 1 -- 172.21.15.62:0/3172302420 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94403008838656] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6214069040 con 0x55dbe9cdda50 2024-04-26T07:54:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.486+0000 7f621e933800 20 remove_watcher() i=7 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9cdda50 msgr2=0x55dbe9cdfe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9cdda50 0x55dbe9cdfe60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9cd9350 msgr2=0x55dbe9cdb810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9cd9350 0x55dbe9cdb810 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f620c017050 msgr2=0x7f620c00d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f620c017050 0x7f620c00d3d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dbe9ce2670 msgr2=0x55dbe9ce4b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dbe9ce2670 0x55dbe9ce4b30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60e4036eb0 msgr2=0x7f60e4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60e4036eb0 0x7f60e4039370 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55dbe9caa390 tx=0x7f620c033000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 msgr2=0x55dbe9ccd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f6219ef1640 1 -- 172.21.15.62:0/3172302420 reap_dead start 2024-04-26T07:54:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9ccd730 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6214011fd0 tx=0x7f621404cf30 comp rx=0 tx=0).stop 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 shutdown_connections 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/3172302420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cc6370 0x55dbe9ccd730 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 >> 172.21.15.62:0/3172302420 conn(0x55dbe9cc2680 msgr2=0x55dbe9cbfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 shutdown_connections 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/3172302420 wait complete. 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/415074295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60f4036eb0 msgr2=0x7f60f4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/415074295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60f4036eb0 0x7f60f4039370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55dbe9ba2740 tx=0x7f620c041040 comp rx=0 tx=0).stop 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/415074295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cb90d0 msgr2=0x55dbe9cb94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/415074295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cb90d0 0x55dbe9cb94f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x55dbe9ca5390 tx=0x7f6214018830 comp rx=0 tx=0).stop 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/415074295 shutdown_connections 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/415074295 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f60f4036eb0 0x7f60f4039370 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 --2- 172.21.15.62:0/415074295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9cb90d0 0x55dbe9cb94f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/415074295 >> 172.21.15.62:0/415074295 conn(0x55dbe9cad170 msgr2=0x55dbe9cad570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/415074295 shutdown_connections 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.487+0000 7f621e933800 1 -- 172.21.15.62:0/415074295 wait complete. 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9ca7340 msgr2=0x55dbe9ca9800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9ca7340 0x55dbe9ca9800 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9ba6b80 msgr2=0x55dbe9ca4a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9ba6b80 0x55dbe9ca4a50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6100036eb0 msgr2=0x7f6100039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6100036eb0 0x7f6100039370 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6210054000 tx=0x7f621004e000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 msgr2=0x55dbe9ba3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9ba3290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c010 tx=0x7f620c000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 shutdown_connections 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dbe9ba6b80 0x55dbe9ca4a50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55dbe9ca7340 0x55dbe9ca9800 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6100036eb0 0x7f6100039370 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 --2- 172.21.15.62:0/241047566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dbe9ba0960 0x55dbe9ba3290 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 >> 172.21.15.62:0/241047566 conn(0x55dbe9b9c310 msgr2=0x55dbe9c8dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 shutdown_connections 2024-04-26T07:54:40.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.488+0000 7f621e933800 1 -- 172.21.15.62:0/241047566 wait complete. 2024-04-26T07:54:40.509 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-04-26T07:54:40.509 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-26T07:54:40.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-26T07:54:40.510 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-26T07:54:40.588 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:40.588 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:40.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.590+0000 7fdec9c87800 1 Processor -- start 2024-04-26T07:54:40.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.591+0000 7fdec9c87800 1 -- start start 2024-04-26T07:54:40.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.591+0000 7fdec9c87800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557f121c5740 0x557f121c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.591+0000 7fdec9c87800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557f121c61e0 con 0x557f121c68b0 2024-04-26T07:54:40.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.591+0000 7fdec9c87800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x557f12067e20 con 0x557f121c5740 2024-04-26T07:54:40.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.591+0000 7fdec7786640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557f121c5740 0x557f121c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.591+0000 7fdec6f85640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x557f121c68b0 0x557f121c6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:36838/0 (socket says 172.21.15.62:36838) 2024-04-26T07:54:40.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.591+0000 7fdec6f85640 1 -- 172.21.15.62:0/4120996734 learned_addr learned my addr 172.21.15.62:0/4120996734 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:40.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.591+0000 7fdec7786640 1 -- 172.21.15.62:0/4120996734 >> v1:172.21.15.1:6789/0 conn(0x557f121c68b0 legacy=0x557f121c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.592+0000 7fdec7786640 1 -- 172.21.15.62:0/4120996734 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f121c7470 con 0x557f121c5740 2024-04-26T07:54:40.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.593+0000 7fdec7786640 1 --2- 172.21.15.62:0/4120996734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f121c5b60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800a470 tx=0x7fdeb801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3a8a4c53b38a62 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.593+0000 7fdec6784640 1 -- 172.21.15.62:0/4120996734 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8057070 con 0x557f121c5740 2024-04-26T07:54:40.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec6784640 1 -- 172.21.15.62:0/4120996734 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb804adc0 con 0x557f121c5740 2024-04-26T07:54:40.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec6784640 1 -- 172.21.15.62:0/4120996734 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8052590 con 0x557f121c5740 2024-04-26T07:54:40.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec9c87800 1 -- 172.21.15.62:0/4120996734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 msgr2=0x557f121c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec9c87800 1 --2- 172.21.15.62:0/4120996734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f121c5b60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800a470 tx=0x7fdeb801ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:40.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec9c87800 1 -- 172.21.15.62:0/4120996734 shutdown_connections 2024-04-26T07:54:40.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec9c87800 1 --2- 172.21.15.62:0/4120996734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f121c5b60 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec9c87800 1 -- 172.21.15.62:0/4120996734 >> 172.21.15.62:0/4120996734 conn(0x557f121c0d20 msgr2=0x557f121c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec9c87800 1 -- 172.21.15.62:0/4120996734 shutdown_connections 2024-04-26T07:54:40.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.594+0000 7fdec9c87800 1 -- 172.21.15.62:0/4120996734 wait complete. 2024-04-26T07:54:40.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.607+0000 7fdec9c87800 1 Processor -- start 2024-04-26T07:54:40.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.607+0000 7fdec9c87800 1 -- start start 2024-04-26T07:54:40.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.607+0000 7fdec9c87800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.607+0000 7fdec9c87800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f12110cd0 con 0x557f121c5740 2024-04-26T07:54:40.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.607+0000 7fdec7786640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.607+0000 7fdec7786640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122b6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34702/0 (socket says 172.21.15.62:34702) 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.607+0000 7fdec7786640 1 -- 172.21.15.62:0/3633399908 learned_addr learned my addr 172.21.15.62:0/3633399908 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.608+0000 7fdec7786640 1 -- 172.21.15.62:0/3633399908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f122b7370 con 0x557f121c5740 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.608+0000 7fdec7786640 1 --2- 172.21.15.62:0/3633399908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122b6da0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8055040 tx=0x7fdeb804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e323258ea5b809 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.608+0000 7fddb560a640 1 -- 172.21.15.62:0/3633399908 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8057040 con 0x557f121c5740 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.608+0000 7fddb560a640 1 -- 172.21.15.62:0/3633399908 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb8063070 con 0x557f121c5740 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.608+0000 7fddb560a640 1 -- 172.21.15.62:0/3633399908 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb805d790 con 0x557f121c5740 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 -- 172.21.15.62:0/3633399908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 msgr2=0x557f122b6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 --2- 172.21.15.62:0/3633399908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122b6da0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8055040 tx=0x7fdeb804c000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 -- 172.21.15.62:0/3633399908 shutdown_connections 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 --2- 172.21.15.62:0/3633399908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122b6da0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 -- 172.21.15.62:0/3633399908 >> 172.21.15.62:0/3633399908 conn(0x557f121c0d20 msgr2=0x557f122b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 -- 172.21.15.62:0/3633399908 shutdown_connections 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 -- 172.21.15.62:0/3633399908 wait complete. 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 Processor -- start 2024-04-26T07:54:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 -- start start 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.609+0000 7fdec9c87800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f121ced80 con 0x557f121c5740 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.610+0000 7fdec7786640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.610+0000 7fdec7786640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122be7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34706/0 (socket says 172.21.15.62:34706) 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.610+0000 7fdec7786640 1 -- 172.21.15.62:0/172829965 learned_addr learned my addr 172.21.15.62:0/172829965 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.610+0000 7fdec7786640 1 -- 172.21.15.62:0/172829965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f122bed30 con 0x557f121c5740 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.610+0000 7fdec7786640 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122be7f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800a470 tx=0x7fdeb8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.610+0000 7fddb3e07640 1 -- 172.21.15.62:0/172829965 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8057050 con 0x557f121c5740 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.611+0000 7fddb3e07640 1 -- 172.21.15.62:0/172829965 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb805dc90 con 0x557f121c5740 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.611+0000 7fddb3e07640 1 -- 172.21.15.62:0/172829965 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8052440 con 0x557f121c5740 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.611+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f122befc0 con 0x557f121c5740 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.611+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f122c1c70 con 0x557f121c5740 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.611+0000 7fddb3e07640 1 -- 172.21.15.62:0/172829965 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fdeb80525e0 con 0x557f121c5740 2024-04-26T07:54:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.611+0000 7fddb3e07640 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fddac036eb0 0x7fddac039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.612+0000 7fddb3e07640 1 -- 172.21.15.62:0/172829965 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fdeb808e240 con 0x557f121c5740 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.612+0000 7fdec6f85640 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fddac036eb0 0x7fddac039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.612+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f121c68b0 0x557f122c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.612+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f122c5f70 con 0x557f121c68b0 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.612+0000 7fdec7f87640 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f121c68b0 0x557f122c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.612+0000 7fdec6f85640 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fddac036eb0 0x7fddac039370 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdebc001d90 tx=0x7fdebc0012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.612+0000 7fdec7f87640 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f121c68b0 0x557f122c5a30 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.612+0000 7fdec7f87640 1 -- 172.21.15.62:0/172829965 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdec000a4a0 con 0x557f121c68b0 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.613+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f122c6810 con 0x557f121c68b0 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.613+0000 7fdec7f87640 1 -- 172.21.15.62:0/172829965 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdec000a4a0 con 0x557f121c68b0 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.613+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f122c8120 0x557f122ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.613+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f122cad50 con 0x557f122c8120 2024-04-26T07:54:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.613+0000 7fdec7786640 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f122c8120 0x557f122ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.613+0000 7fdec7786640 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f122c8120 0x557f122ca5c0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.614+0000 7fdec7786640 1 -- 172.21.15.62:0/172829965 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdeb8078070 con 0x557f122c8120 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.614+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f122c7090 con 0x557f121c68b0 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.614+0000 7fdec7f87640 1 -- 172.21.15.62:0/172829965 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdec000a4a0 con 0x557f121c68b0 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.614+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f122c7570 con 0x557f121c68b0 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.614+0000 7fdec7f87640 1 -- 172.21.15.62:0/172829965 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdec000a4a0 con 0x557f121c68b0 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec9c87800 1 Processor -- start 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec9c87800 1 -- start start 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec9c87800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f122d9f10 0x557f122da330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec9c87800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f120b8170 con 0x557f122d9f10 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec7f87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f122d9f10 0x557f122da330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec7f87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f122d9f10 0x557f122da330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34718/0 (socket says 172.21.15.62:34718) 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec7f87640 1 -- 172.21.15.62:0/1788269975 learned_addr learned my addr 172.21.15.62:0/1788269975 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec7f87640 1 -- 172.21.15.62:0/1788269975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f122da870 con 0x557f122d9f10 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.615+0000 7fdec7f87640 1 --2- 172.21.15.62:0/1788269975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f122d9f10 0x557f122da330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x557f122bfa10 tx=0x7fdec0012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.616+0000 7fddb1602640 1 -- 172.21.15.62:0/1788269975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec0014450 con 0x557f122d9f10 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.616+0000 7fddb1602640 1 -- 172.21.15.62:0/1788269975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec0014610 con 0x557f122d9f10 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.616+0000 7fdec9c87800 1 -- 172.21.15.62:0/1788269975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f122db2e0 con 0x557f122d9f10 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.616+0000 7fddb1602640 1 -- 172.21.15.62:0/1788269975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec0014930 con 0x557f122d9f10 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.616+0000 7fdec9c87800 1 -- 172.21.15.62:0/1788269975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f122db7e0 con 0x557f122d9f10 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.616+0000 7fddb1602640 1 -- 172.21.15.62:0/1788269975 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fdec0011040 con 0x557f122d9f10 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fddb1602640 1 --2- 172.21.15.62:0/1788269975 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdda0036eb0 0x7fdda0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fddb1602640 1 -- 172.21.15.62:0/1788269975 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fdec001e070 con 0x557f122d9f10 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec7786640 1 --2- 172.21.15.62:0/1788269975 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdda0036eb0 0x7fdda0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec9c87800 1 Processor -- start 2024-04-26T07:54:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec9c87800 1 -- start start 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec7786640 1 --2- 172.21.15.62:0/1788269975 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdda0036eb0 0x7fdda0039370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x557f122c3130 tx=0x7fdeb805c7d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec9c87800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f1213b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec9c87800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f122b7630 con 0x557f1213ace0 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec7f87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f1213b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec7f87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f1213b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34728/0 (socket says 172.21.15.62:34728) 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec7f87640 1 -- 172.21.15.62:0/687023981 learned_addr learned my addr 172.21.15.62:0/687023981 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.617+0000 7fdec7f87640 1 -- 172.21.15.62:0/687023981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f121394e0 con 0x557f1213ace0 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fdec7f87640 1 --2- 172.21.15.62:0/687023981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f1213b100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdec004d060 tx=0x7fdec0013ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83299afb34578fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fddaaffd640 1 -- 172.21.15.62:0/687023981 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec0046070 con 0x557f1213ace0 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fddaaffd640 1 -- 172.21.15.62:0/687023981 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec0046e50 con 0x557f1213ace0 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fddaaffd640 1 -- 172.21.15.62:0/687023981 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec00168f0 con 0x557f1213ace0 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fdec9c87800 1 -- 172.21.15.62:0/687023981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 msgr2=0x557f1213b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fdec9c87800 1 --2- 172.21.15.62:0/687023981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f1213b100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdec004d060 tx=0x7fdec0013ad0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fdec9c87800 1 -- 172.21.15.62:0/687023981 shutdown_connections 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fdec9c87800 1 --2- 172.21.15.62:0/687023981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f1213b100 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fdec9c87800 1 -- 172.21.15.62:0/687023981 >> 172.21.15.62:0/687023981 conn(0x557f122e3530 msgr2=0x557f122e1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fdec9c87800 1 -- 172.21.15.62:0/687023981 shutdown_connections 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.618+0000 7fdec9c87800 1 -- 172.21.15.62:0/687023981 wait complete. 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec9c87800 1 Processor -- start 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec9c87800 1 -- start start 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec9c87800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f122f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec9c87800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f121399b0 con 0x557f1213ace0 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec7f87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f122f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec7f87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f122f0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34732/0 (socket says 172.21.15.62:34732) 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 learned_addr learned my addr 172.21.15.62:0/542032225 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f122f0ed0 con 0x557f1213ace0 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdec7f87640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f122f0990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdec0013c20 tx=0x7fdec004cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.619+0000 7fdda97fa640 1 -- 172.21.15.62:0/542032225 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec003b070 con 0x557f1213ace0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.620+0000 7fdda97fa640 1 -- 172.21.15.62:0/542032225 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec0013e50 con 0x557f1213ace0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.620+0000 7fdda97fa640 1 -- 172.21.15.62:0/542032225 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec0046040 con 0x557f1213ace0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.620+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f122f1160 con 0x557f1213ace0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.620+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f122f3e10 con 0x557f1213ace0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.620+0000 7fdda97fa640 1 -- 172.21.15.62:0/542032225 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fdec0022c60 con 0x557f1213ace0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.620+0000 7fdda97fa640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd90036e10 0x7fdd900392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.621+0000 7fdda97fa640 1 -- 172.21.15.62:0/542032225 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fdec0033070 con 0x557f1213ace0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.621+0000 7fdec7786640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd90036e10 0x7fdd900392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.621+0000 7fdec7786640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd90036e10 0x7fdd900392d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdeb805cb40 tx=0x7fdeb8082000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.621+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.621+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f122fc4c0 0x557f122fe980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.621+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f122ff0d0 con 0x557f122fc4c0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.621+0000 7fdec6f85640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f122fc4c0 0x557f122fe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec6f85640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f122fc4c0 0x557f122fe980 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdebc009050 con 0x557f122fc4c0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 realm 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f122fb910 con 0x557f122fc4c0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdebc009050 con 0x557f122fc4c0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f122ffbc0 con 0x557f122fc4c0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdebc009050 con 0x557f122fc4c0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12300490 con 0x557f122fc4c0 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdebc009050 con 0x557f122fc4c0 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f12300d80 0x557f123031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.622+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12303960 con 0x557f12300d80 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.623+0000 7fdec7f87640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f12300d80 0x557f123031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.623+0000 7fdec7f87640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f12300d80 0x557f123031d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.623+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.623+0000 7fdec9c87800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.623+0000 7fdec9c87800 20 searching for the correct realm 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.623+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f12305930 0x557f12307df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.624+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.624+0000 7fdec7786640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f12305930 0x557f12307df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.624+0000 7fdec7786640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f12305930 0x557f12307df0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.624+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.624+0000 7fdec7786640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdeb8088070 0x7fdeb808c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.624+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x7fdeb8088070 2024-04-26T07:54:40.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.625+0000 7fdec6f85640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdeb8088070 0x7fdeb808c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.625+0000 7fdec6f85640 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdeb8088070 0x7fdeb808c7d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.625+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc009050 con 0x7fdeb8088070 2024-04-26T07:54:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.625+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.625+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.625+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f122fc4c0 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.626+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc009050 con 0x557f122fc4c0 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.626+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f122fc4c0 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.626+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.626+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.626+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.626+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.626+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.626+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x7fdeb8088070 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.627+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc029040 con 0x7fdeb8088070 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.627+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.627+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.627+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f122fc4c0 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.627+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.627+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f122fc4c0 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x7fdeb8088070 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdebc029040 con 0x7fdeb8088070 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.628+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.629+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.629+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.629+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.629+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.629+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.629+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f122fc4c0 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.629+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.629+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f122fc4c0 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.630+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.630+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.630+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.630+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.630+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.630+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x7fdeb8088070 2024-04-26T07:54:40.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.631+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc029040 con 0x7fdeb8088070 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.631+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f122fc4c0 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.631+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.631+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.631+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.631+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.631+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.631+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.632+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.632+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x7fdeb8088070 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.632+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc029040 con 0x7fdeb8088070 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.632+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12305930 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.633+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.633+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f12300d80 2024-04-26T07:54:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.633+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.633+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x557f122fc4c0 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.633+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.633+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557f123084c0 con 0x7fdeb8088070 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.633+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdebc029040 con 0x7fdeb8088070 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.633+0000 7fdec9c87800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12304320 con 0x557f122fc4c0 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12304bc0 con 0x557f122fc4c0 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12303f60 con 0x557f122fc4c0 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdebc029040 con 0x557f122fc4c0 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 zone default found 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 4 Realm: () 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 zonegroup default 2024-04-26T07:54:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.634+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12308960 con 0x557f12300d80 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f1230ac30 con 0x557f12305930 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f1230afd0 con 0x557f12305930 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 20 started sync module instance, tier type = 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.635+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230a0c0 con 0x7fdeb8088070 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.636+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x7fdeb8088070 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.636+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94004254385632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230a0c0 con 0x7fdeb8088070 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.636+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230ba20 con 0x557f122fc4c0 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.638+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94004254385632] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x7fdeb8088070 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.638+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.638+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94004254389552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230a0c0 con 0x557f122fc4c0 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.638+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230c490 con 0x557f12305930 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.639+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94004254389552] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.639+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.639+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94004254383120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230a030 con 0x557f12305930 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.639+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230d350 con 0x7fdeb8088070 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.640+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94004254383120] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.640+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x7fdeb8088070 2024-04-26T07:54:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.640+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94004254396064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230d770 con 0x7fdeb8088070 2024-04-26T07:54:40.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.640+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230e130 con 0x557f122fc4c0 2024-04-26T07:54:40.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.642+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.642+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94004254399616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230e550 con 0x557f122fc4c0 2024-04-26T07:54:40.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.642+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230f050 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.643+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94004254396064] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x7fdeb8088070 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.643+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94004254399616] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.644+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.644+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94004254403392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230e0a0 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.644+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230f8f0 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.645+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.645+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94004254405696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230fd10 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.645+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f12310560 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.645+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94004254403392] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94004254405696] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94004254406752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f12310130 con 0x557f12300d80 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec9c87800 20 add_watcher() i=0 2024-04-26T07:54:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec9c87800 20 add_watcher() i=1 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec9c87800 20 add_watcher() i=2 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec9c87800 20 add_watcher() i=3 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec9c87800 20 add_watcher() i=4 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec9c87800 20 add_watcher() i=5 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.646+0000 7fdec9c87800 20 add_watcher() i=6 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.647+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94004254406752] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.647+0000 7fdec9c87800 20 add_watcher() i=7 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.647+0000 7fdec9c87800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.647+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12313300 con 0x557f122fc4c0 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.647+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.647+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94004254408176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f123106c0 con 0x557f122fc4c0 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.648+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94004254408176] v27'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.648+0000 7fdd7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.648+0000 7fdec9c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.648+0000 7fdec9c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.648+0000 7fdec9c87800 5 note: GC not initialized 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdd7cfe1640 20 reqs_thread_entry: start 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 20 Filter name: none 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdcf67fc640 20 reqs_thread_entry: start 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12346b40 con 0x557f122fc4c0 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.649+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12346660 con 0x7fdeb8088070 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fdebc039040 con 0x7fdeb8088070 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 20 disabling bucket name=myfoo 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f123475b0 con 0x7fdeb8088070 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fdebc039040 con 0x7fdeb8088070 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12348e90 con 0x557f122fc4c0 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.650+0000 7fdec9c87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.651+0000 7fdec9c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.651+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f12351a50 con 0x557f122fc4c0 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(66 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1, ofs0, ns] 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94004254653296 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f1234c440 con 0x557f12300d80 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== watch-notify(notify (1) cookie 94004254403392 notify 115964117007 ret 0) ==== 794+0+0 (crc 0 0 0) 0x557f122f1160 con 0x557f12300d80 2024-04-26T07:54:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fddaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117007 cookie 94004254403392 notifier 4585 bl.length()=752 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fddaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fddaaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fddaaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(67 notify.5 [notify cookie 94004254653296 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fddaaffd640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdd8c003ea0 con 0x557f12300d80 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== watch-notify(notify_complete (2) cookie 94004254653296 notify 115964117007 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557f122f0ed0 con 0x557f12300d80 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_sources= new_sources= 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential sources added=[] removed=[] 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_dests= new_dests= 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential dests added=[] removed=[] 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.652+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1234aa90 con 0x557f122fc4c0 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.653+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v27'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fdec9c87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fdec9c87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fdec9c87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94004254626112 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557f12345a10 con 0x557f122fc4c0 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== watch-notify(notify (1) cookie 94004254399616 notify 115964117008 ret 0) ==== 609+0+0 (crc 0 0 0) 0x557f12349280 con 0x557f122fc4c0 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fddaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117008 cookie 94004254399616 notifier 4585 bl.length()=567 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fddaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fddaaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(70 notify.4 [notify cookie 94004254626112 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fddaaffd640 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdd8c003ea0 con 0x557f122fc4c0 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.654+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== watch-notify(notify_complete (2) cookie 94004254626112 notify 115964117008 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557f123472a0 con 0x557f122fc4c0 2024-04-26T07:54:40.662 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:40.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.655+0000 7fdd7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.655+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94004254408176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1234f700 con 0x557f122fc4c0 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.656+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94004254408176] v27'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.656+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94004254385632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230fdf0 con 0x7fdeb8088070 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.657+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94004254385632] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x7fdeb8088070 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.657+0000 7fdec9c87800 20 remove_watcher() i=0 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.657+0000 7fdec9c87800 2 removed watcher, disabling cache 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.657+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94004254389552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230fdf0 con 0x557f122fc4c0 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.658+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94004254389552] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.658+0000 7fdec9c87800 20 remove_watcher() i=1 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.658+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94004254383120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230b530 con 0x557f12305930 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.659+0000 7fdec7786640 1 -- 172.21.15.62:0/542032225 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94004254383120] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb8085070 con 0x557f12305930 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.659+0000 7fdec9c87800 20 remove_watcher() i=2 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.659+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94004254396064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230fdf0 con 0x7fdeb8088070 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.660+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94004254396064] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x7fdeb8088070 2024-04-26T07:54:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.660+0000 7fdec9c87800 20 remove_watcher() i=3 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.660+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94004254399616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f12309c10 con 0x557f122fc4c0 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.661+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94004254399616] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdebc039040 con 0x557f122fc4c0 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.661+0000 7fdec9c87800 20 remove_watcher() i=4 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.661+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94004254403392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230cea0 con 0x557f12300d80 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.662+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94004254403392] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.662+0000 7fdec9c87800 20 remove_watcher() i=5 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.662+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94004254405696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f1230fdf0 con 0x557f12300d80 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.663+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94004254405696] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.663+0000 7fdec9c87800 20 remove_watcher() i=6 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.663+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94004254406752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557f12309c10 con 0x557f12300d80 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec7f87640 1 -- 172.21.15.62:0/542032225 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94004254406752] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec004ed70 con 0x557f12300d80 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 20 remove_watcher() i=7 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f12300d80 msgr2=0x557f123031d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f12300d80 0x557f123031d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f122fc4c0 msgr2=0x557f122fe980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f122fc4c0 0x557f122fe980 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdeb8088070 msgr2=0x7fdeb808c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fdeb8088070 0x7fdeb808c7d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f12305930 msgr2=0x557f12307df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f12305930 0x557f12307df0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd90036e10 msgr2=0x7fdd900392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd90036e10 0x7fdd900392d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdeb805cb40 tx=0x7fdeb8082000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 msgr2=0x557f122f0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec6f85640 1 -- 172.21.15.62:0/542032225 reap_dead start 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f122f0990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdec0013c20 tx=0x7fdec004cff0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 shutdown_connections 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 --2- 172.21.15.62:0/542032225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f1213ace0 0x557f122f0990 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.664+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 >> 172.21.15.62:0/542032225 conn(0x557f122e3530 msgr2=0x557f122e0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 shutdown_connections 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/542032225 wait complete. 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/1788269975 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdda0036eb0 msgr2=0x7fdda0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/1788269975 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdda0036eb0 0x7fdda0039370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x557f122c3130 tx=0x7fdeb805c7d0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/1788269975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f122d9f10 msgr2=0x557f122da330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/1788269975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f122d9f10 0x557f122da330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x557f122bfa10 tx=0x7fdec0012fd0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/1788269975 shutdown_connections 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/1788269975 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdda0036eb0 0x7fdda0039370 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/1788269975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f122d9f10 0x557f122da330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/1788269975 >> 172.21.15.62:0/1788269975 conn(0x557f122cdfb0 msgr2=0x557f122ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/1788269975 shutdown_connections 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/1788269975 wait complete. 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f122c8120 msgr2=0x557f122ca5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f122c8120 0x557f122ca5c0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f121c68b0 msgr2=0x557f122c5a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f121c68b0 0x557f122c5a30 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fddac036eb0 msgr2=0x7fddac039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fddac036eb0 0x7fddac039370 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdebc001d90 tx=0x7fdebc0012f0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 msgr2=0x557f122be7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122be7f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800a470 tx=0x7fdeb8002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 shutdown_connections 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f121c68b0 0x557f122c5a30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x557f122c8120 0x557f122ca5c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fddac036eb0 0x7fddac039370 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 --2- 172.21.15.62:0/172829965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f121c5740 0x557f122be7f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.665+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 >> 172.21.15.62:0/172829965 conn(0x557f121c0d20 msgr2=0x557f122b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.666+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 shutdown_connections 2024-04-26T07:54:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.666+0000 7fdec9c87800 1 -- 172.21.15.62:0/172829965 wait complete. 2024-04-26T07:54:40.672 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:40.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-26T07:54:40.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-26T07:54:40.675 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-26T07:54:40.721 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:40.722 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:40.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.724+0000 7f9ee2933800 1 Processor -- start 2024-04-26T07:54:40.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.724+0000 7f9ee2933800 1 -- start start 2024-04-26T07:54:40.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.724+0000 7f9ee2933800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a97fb92130 0x55a97fb906e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.724+0000 7f9ee2933800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a97fb910d0 con 0x55a97fb90c20 2024-04-26T07:54:40.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.724+0000 7f9ee2933800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55a97fabee20 con 0x55a97fb92130 2024-04-26T07:54:40.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.725+0000 7f9ede5fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a97fb92130 0x55a97fb906e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.725+0000 7f9edddfb640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55a97fb90c20 0x55a97fc245f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:44360/0 (socket says 172.21.15.62:44360) 2024-04-26T07:54:40.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.725+0000 7f9edddfb640 1 -- 172.21.15.62:0/297490966 learned_addr learned my addr 172.21.15.62:0/297490966 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:40.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.725+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/297490966 >> v2:172.21.15.1:3300/0 conn(0x55a97fb92130 0x55a97fb906e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34784/0 (socket says 172.21.15.62:34784) 2024-04-26T07:54:40.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.725+0000 7f9ede5fc640 1 -- 172.21.15.62:0/297490966 >> v1:172.21.15.1:6789/0 conn(0x55a97fb90c20 legacy=0x55a97fc245f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.725+0000 7f9ede5fc640 1 -- 172.21.15.62:0/297490966 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97fb912a0 con 0x55a97fb92130 2024-04-26T07:54:40.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.725+0000 7f9edd5fa640 1 -- 172.21.15.62:0/297490966 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051842922 0 0) 0x55a97fb910d0 con 0x55a97fb90c20 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/297490966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb92130 0x55a97fb906e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000a470 tx=0x7f9ed001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da84ebf4af2e0475 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9edd5fa640 1 -- 172.21.15.62:0/297490966 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0057070 con 0x55a97fb92130 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9edd5fa640 1 -- 172.21.15.62:0/297490966 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed004adc0 con 0x55a97fb92130 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9edd5fa640 1 -- 172.21.15.62:0/297490966 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0052590 con 0x55a97fb92130 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9ee2933800 1 -- 172.21.15.62:0/297490966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb92130 msgr2=0x55a97fb906e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9ee2933800 1 --2- 172.21.15.62:0/297490966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb92130 0x55a97fb906e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000a470 tx=0x7f9ed001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9ee2933800 1 -- 172.21.15.62:0/297490966 shutdown_connections 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9ee2933800 1 --2- 172.21.15.62:0/297490966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb92130 0x55a97fb906e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.727+0000 7f9ee2933800 1 -- 172.21.15.62:0/297490966 >> 172.21.15.62:0/297490966 conn(0x55a97fc17d20 msgr2=0x55a97fc1a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.728+0000 7f9ee2933800 1 -- 172.21.15.62:0/297490966 shutdown_connections 2024-04-26T07:54:40.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.728+0000 7f9ee2933800 1 -- 172.21.15.62:0/297490966 wait complete. 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.740+0000 7f9ee2933800 1 Processor -- start 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.740+0000 7f9ee2933800 1 -- start start 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.740+0000 7f9ee2933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd0fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.740+0000 7f9ee2933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a97fb67cd0 con 0x55a97fb90c20 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.740+0000 7f9ede5fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd0fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.740+0000 7f9ede5fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd0fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34800/0 (socket says 172.21.15.62:34800) 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.740+0000 7f9ede5fc640 1 -- 172.21.15.62:0/960056993 learned_addr learned my addr 172.21.15.62:0/960056993 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.741+0000 7f9ede5fc640 1 -- 172.21.15.62:0/960056993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97fd10360 con 0x55a97fb90c20 2024-04-26T07:54:40.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.741+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/960056993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd0fd90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0055040 tx=0x7f9ed004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388006a8586ae376 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.741+0000 7f9dcc608640 1 -- 172.21.15.62:0/960056993 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0057040 con 0x55a97fb90c20 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.741+0000 7f9dcc608640 1 -- 172.21.15.62:0/960056993 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed0063070 con 0x55a97fb90c20 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.741+0000 7f9dcc608640 1 -- 172.21.15.62:0/960056993 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0052780 con 0x55a97fb90c20 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 -- 172.21.15.62:0/960056993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 msgr2=0x55a97fd0fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 --2- 172.21.15.62:0/960056993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd0fd90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0055040 tx=0x7f9ed004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 -- 172.21.15.62:0/960056993 shutdown_connections 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 --2- 172.21.15.62:0/960056993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd0fd90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 -- 172.21.15.62:0/960056993 >> 172.21.15.62:0/960056993 conn(0x55a97fc17d20 msgr2=0x55a97fd0b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 -- 172.21.15.62:0/960056993 shutdown_connections 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 -- 172.21.15.62:0/960056993 wait complete. 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 Processor -- start 2024-04-26T07:54:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 -- start start 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd177a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ee2933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a97fc27f90 con 0x55a97fb90c20 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.742+0000 7f9ede5fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9ede5fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd177a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34802/0 (socket says 172.21.15.62:34802) 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9ede5fc640 1 -- 172.21.15.62:0/21795072 learned_addr learned my addr 172.21.15.62:0/21795072 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9ede5fc640 1 -- 172.21.15.62:0/21795072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97fd17ce0 con 0x55a97fb90c20 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd177a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9dcae05640 1 -- 172.21.15.62:0/21795072 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0057050 con 0x55a97fb90c20 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9dcae05640 1 -- 172.21.15.62:0/21795072 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed0052c00 con 0x55a97fb90c20 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a97fd17f70 con 0x55a97fb90c20 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9dcae05640 1 -- 172.21.15.62:0/21795072 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed005d470 con 0x55a97fb90c20 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.743+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a97fd1ac20 con 0x55a97fb90c20 2024-04-26T07:54:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.744+0000 7f9dcae05640 1 -- 172.21.15.62:0/21795072 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9ed005d610 con 0x55a97fb90c20 2024-04-26T07:54:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.744+0000 7f9dcae05640 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dc4036eb0 0x7f9dc4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.744+0000 7f9dcae05640 1 -- 172.21.15.62:0/21795072 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9ed008e2b0 con 0x55a97fb90c20 2024-04-26T07:54:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.744+0000 7f9edddfb640 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dc4036eb0 0x7f9dc4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.744+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fb92130 0x55a97fd1e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.744+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd1ef60 con 0x55a97fb92130 2024-04-26T07:54:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.744+0000 7f9ededfd640 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fb92130 0x55a97fd1e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.745+0000 7f9edddfb640 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dc4036eb0 0x7f9dc4039370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4000c00 tx=0x7f9ed40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.745+0000 7f9ededfd640 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fb92130 0x55a97fd1e9e0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.745+0000 7f9ededfd640 1 -- 172.21.15.62:0/21795072 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed800a4a0 con 0x55a97fb92130 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.745+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd1bf90 con 0x55a97fb92130 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.745+0000 7f9ededfd640 1 -- 172.21.15.62:0/21795072 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ed800a4a0 con 0x55a97fb92130 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.745+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd21280 0x55a97fd23670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.745+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd23d10 con 0x55a97fd21280 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.746+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd21280 0x55a97fd23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.746+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd21280 0x55a97fd23670 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.746+0000 7f9ede5fc640 1 -- 172.21.15.62:0/21795072 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ed0078070 con 0x55a97fd21280 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.746+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd20230 con 0x55a97fb92130 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.746+0000 7f9ededfd640 1 -- 172.21.15.62:0/21795072 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ed800a4a0 con 0x55a97fb92130 2024-04-26T07:54:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.746+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd20710 con 0x55a97fb92130 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.747+0000 7f9ededfd640 1 -- 172.21.15.62:0/21795072 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ed800a4a0 con 0x55a97fb92130 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.747+0000 7f9ee2933800 1 Processor -- start 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.747+0000 7f9ee2933800 1 -- start start 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.747+0000 7f9ee2933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd32ec0 0x55a97fd332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.747+0000 7f9ee2933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a97fb0f170 con 0x55a97fd32ec0 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9ededfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd32ec0 0x55a97fd332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9ededfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd32ec0 0x55a97fd332e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34812/0 (socket says 172.21.15.62:34812) 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9ededfd640 1 -- 172.21.15.62:0/3388632051 learned_addr learned my addr 172.21.15.62:0/3388632051 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9ededfd640 1 -- 172.21.15.62:0/3388632051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97fd33820 con 0x55a97fd32ec0 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9ededfd640 1 --2- 172.21.15.62:0/3388632051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd32ec0 0x55a97fd332e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55a97fd1f300 tx=0x7f9ed8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9dc3fff640 1 -- 172.21.15.62:0/3388632051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8014450 con 0x55a97fd32ec0 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9dc3fff640 1 -- 172.21.15.62:0/3388632051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed80145f0 con 0x55a97fd32ec0 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9dc3fff640 1 -- 172.21.15.62:0/3388632051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed80148d0 con 0x55a97fd32ec0 2024-04-26T07:54:40.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9ee2933800 1 -- 172.21.15.62:0/3388632051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a97fd34290 con 0x55a97fd32ec0 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.748+0000 7f9ee2933800 1 -- 172.21.15.62:0/3388632051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a97fd34790 con 0x55a97fd32ec0 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.749+0000 7f9dc3fff640 1 -- 172.21.15.62:0/3388632051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9ed8011040 con 0x55a97fd32ec0 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.749+0000 7f9dc3fff640 1 --2- 172.21.15.62:0/3388632051 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9db8036e60 0x7f9db8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.749+0000 7f9dc3fff640 1 -- 172.21.15.62:0/3388632051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9ed801e070 con 0x55a97fd32ec0 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.749+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/3388632051 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9db8036e60 0x7f9db8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.749+0000 7f9ee2933800 1 Processor -- start 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.749+0000 7f9ee2933800 1 -- start start 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/3388632051 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9db8036e60 0x7f9db8039320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55a97fd1f3c0 tx=0x7f9ed005da20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9ee2933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd405c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9ee2933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a97fd10620 con 0x55a97fd401a0 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9ededfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9ededfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34822/0 (socket says 172.21.15.62:34822) 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9ededfd640 1 -- 172.21.15.62:0/2973433189 learned_addr learned my addr 172.21.15.62:0/2973433189 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9ededfd640 1 -- 172.21.15.62:0/2973433189 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97fd40b90 con 0x55a97fd401a0 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9ededfd640 1 --2- 172.21.15.62:0/2973433189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd405c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9ed804d030 tx=0x7f9ed80113f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71d6433f8c85c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9dc1ffb640 1 -- 172.21.15.62:0/2973433189 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8046070 con 0x55a97fd401a0 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9dc1ffb640 1 -- 172.21.15.62:0/2973433189 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed8013c50 con 0x55a97fd401a0 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.750+0000 7f9dc1ffb640 1 -- 172.21.15.62:0/2973433189 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8046210 con 0x55a97fd401a0 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 -- 172.21.15.62:0/2973433189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 msgr2=0x55a97fd405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 --2- 172.21.15.62:0/2973433189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd405c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9ed804d030 tx=0x7f9ed80113f0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 -- 172.21.15.62:0/2973433189 shutdown_connections 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 --2- 172.21.15.62:0/2973433189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd405c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 -- 172.21.15.62:0/2973433189 >> 172.21.15.62:0/2973433189 conn(0x55a97fd3c500 msgr2=0x55a97fd3a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 -- 172.21.15.62:0/2973433189 shutdown_connections 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 -- 172.21.15.62:0/2973433189 wait complete. 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 Processor -- start 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 -- start start 2024-04-26T07:54:40.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd47770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ee2933800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a97fd41300 con 0x55a97fd401a0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ededfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd47770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ededfd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd47770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34824/0 (socket says 172.21.15.62:34824) 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.751+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 learned_addr learned my addr 172.21.15.62:0/523335124 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.752+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97fd47cb0 con 0x55a97fd401a0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.752+0000 7f9ededfd640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd47770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8005a80 tx=0x7f9ed804cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.752+0000 7f9daffff640 1 -- 172.21.15.62:0/523335124 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed803b070 con 0x55a97fd401a0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.752+0000 7f9daffff640 1 -- 172.21.15.62:0/523335124 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed80133b0 con 0x55a97fd401a0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.752+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a97fd47f40 con 0x55a97fd401a0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.752+0000 7f9daffff640 1 -- 172.21.15.62:0/523335124 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8046040 con 0x55a97fd401a0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.752+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a97fd4abf0 con 0x55a97fd401a0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.753+0000 7f9daffff640 1 -- 172.21.15.62:0/523335124 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9ed8013690 con 0x55a97fd401a0 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.753+0000 7f9daffff640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9da8036e60 0x7f9da8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.753+0000 7f9daffff640 1 -- 172.21.15.62:0/523335124 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f9ed8033070 con 0x55a97fd401a0 2024-04-26T07:54:40.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.753+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9da8036e60 0x7f9da8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.753+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9da8036e60 0x7f9da8039320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9ed005d040 tx=0x7f9ed0084000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fd533e0 0x55a97fd558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd55ff0 con 0x55a97fd533e0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9edddfb640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fd533e0 0x55a97fd558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9edddfb640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fd533e0 0x55a97fd558a0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed400f5f0 con 0x55a97fd533e0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 20 realm 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd52830 con 0x55a97fd533e0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed400f5f0 con 0x55a97fd533e0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.754+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd56ae0 con 0x55a97fd533e0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed400f5f0 con 0x55a97fd533e0 2024-04-26T07:54:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9ee2933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd573b0 con 0x55a97fd533e0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ed400f5f0 con 0x55a97fd533e0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9ee2933800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd57dd0 0x55a97fd5a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5a930 con 0x55a97fd57dd0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.755+0000 7f9ededfd640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd57dd0 0x55a97fd5a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.756+0000 7f9ededfd640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd57dd0 0x55a97fd5a1c0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.756+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.756+0000 7f9ee2933800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.756+0000 7f9ee2933800 20 searching for the correct realm 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.756+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a97fd5c8e0 0x55a97fd5eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.756+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.756+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a97fd5c8e0 0x55a97fd5eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.756+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a97fd5c8e0 0x55a97fd5eda0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.757+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.757+0000 7f9ede5fc640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ed0087040 0x7f9ed00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.757+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x7f9ed0087040 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.757+0000 7f9edddfb640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ed0087040 0x7f9ed00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.757+0000 7f9edddfb640 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ed0087040 0x7f9ed00688e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.758+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed400f5f0 con 0x7f9ed0087040 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.758+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.758+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.758+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd533e0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.758+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed400f5f0 con 0x55a97fd533e0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.758+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd533e0 2024-04-26T07:54:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.759+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.759+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.759+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.759+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.759+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.759+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x7f9ed0087040 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.760+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.760+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.760+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.760+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd533e0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.760+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.760+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.760+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.760+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd533e0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.761+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.761+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x7f9ed0087040 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.761+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.761+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.761+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.761+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.761+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.761+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.762+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.762+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.762+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.762+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.762+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.762+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd533e0 2024-04-26T07:54:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.762+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.762+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd533e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.763+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.763+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.763+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.763+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.764+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.764+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x7f9ed0087040 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.764+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.764+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd533e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.764+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.764+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.764+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.765+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.765+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.765+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.765+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.765+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x7f9ed0087040 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.765+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.765+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd5c8e0 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.766+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.766+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd57dd0 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.766+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.766+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x55a97fd533e0 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.766+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.766+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f470 con 0x7f9ed0087040 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5b2f0 con 0x55a97fd533e0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5af30 con 0x55a97fd533e0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5bc90 con 0x55a97fd533e0 2024-04-26T07:54:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 zone default found 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 4 Realm: () 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 zonegroup default 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.767+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd5f8f0 con 0x55a97fd57dd0 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd61b20 con 0x55a97fd5c8e0 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd61ec0 con 0x55a97fd5c8e0 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 20 started sync module instance, tier type = 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.768+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd60fb0 con 0x7f9ed0087040 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.769+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.769+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94186482570448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd60fb0 con 0x7f9ed0087040 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.769+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd628c0 con 0x55a97fd533e0 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.771+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94186482570448] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.771+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.771+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94186482574288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd60fb0 con 0x55a97fd533e0 2024-04-26T07:54:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.771+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd63350 con 0x55a97fd5c8e0 2024-04-26T07:54:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.772+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94186482574288] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.772+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.772+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94186482567936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd60f20 con 0x55a97fd5c8e0 2024-04-26T07:54:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.772+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd64210 con 0x7f9ed0087040 2024-04-26T07:54:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.773+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94186482567936] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.773+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.773+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94186482580832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd64630 con 0x7f9ed0087040 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.773+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd64ff0 con 0x55a97fd533e0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.774+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.774+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94186482584384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd65410 con 0x55a97fd533e0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.774+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd65f10 con 0x55a97fd57dd0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.774+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94186482580832] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.775+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94186482584384] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.775+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.775+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94186482588160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd64f60 con 0x55a97fd57dd0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.775+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd667b0 con 0x55a97fd57dd0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.776+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94186482588160] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.776+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.776+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94186482581888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd64f60 con 0x55a97fd57dd0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.776+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd66e10 con 0x55a97fd57dd0 2024-04-26T07:54:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94186482592032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd67250 con 0x55a97fd57dd0 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ee2933800 20 add_watcher() i=0 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ee2933800 20 add_watcher() i=1 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ee2933800 20 add_watcher() i=2 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ee2933800 20 add_watcher() i=3 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ee2933800 20 add_watcher() i=4 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ee2933800 20 add_watcher() i=5 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94186482581888] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.777+0000 7f9ee2933800 20 add_watcher() i=6 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.778+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94186482592032] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.778+0000 7f9ee2933800 20 add_watcher() i=7 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.778+0000 7f9ee2933800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.778+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd66300 con 0x55a97fd533e0 2024-04-26T07:54:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.778+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.778+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94186482593088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd66300 con 0x55a97fd533e0 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.779+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94186482593088] v27'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.779+0000 7f9d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.779+0000 7f9ee2933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.779+0000 7f9ee2933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.779+0000 7f9ee2933800 5 note: GC not initialized 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.779+0000 7f9d0f7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 20 Filter name: none 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9d0d7fa640 20 reqs_thread_entry: start 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd9da30 con 0x55a97fd533e0 2024-04-26T07:54:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.780+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fda04c0 con 0x7f9ed0087040 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 20 enabling bucket name=myfoo 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd9e4a0 con 0x7f9ed0087040 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-26T07:54:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 : miss 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 20 rados->read ofs=0 len=0 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.781+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fda0d30 con 0x55a97fd533e0 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.782+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.782+0000 7f9ee2933800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.782+0000 7f9ee2933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.782+0000 7f9ee2933800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.782+0000 7f9ee2933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.782+0000 7f9ee2933800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.782+0000 7f9ee2933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.782+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 8.8 8:1537a012:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fda8980 con 0x55a97fd533e0 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(66 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'9 uv9 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9ee2933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9ee2933800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9ee2933800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9ee2933800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1, ofs0, ns] 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94186482832368 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fda4030 con 0x55a97fd57dd0 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== watch-notify(notify (1) cookie 94186482588160 notify 115964117008 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55a97fd4abf0 con 0x55a97fd57dd0 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9dc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117008 cookie 94186482588160 notifier 4592 bl.length()=752 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9dc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 info.flags=0x17 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9dc1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1 to cache LRU end 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.783+0000 7f9dc1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9dc1ffb640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9da4003ea0 con 0x55a97fd57dd0 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(67 notify.5 [notify cookie 94186482832368 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== watch-notify(notify_complete (2) cookie 94186482832368 notify 115964117008 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a97fd47f40 con 0x55a97fd57dd0 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9ee2933800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_sources= new_sources= 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9ee2933800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential sources added=[] removed=[] 2024-04-26T07:54:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9ee2933800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): orig_dests= new_dests= 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9ee2933800 20 handle_bi_update(): bucket=:myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1]): potential dests added=[] removed=[] 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.784+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fda1ce0 con 0x55a97fd533e0 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v27'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9ee2933800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9ee2933800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9ee2933800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94186482836160 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a97fda1ce0 con 0x55a97fd533e0 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== watch-notify(notify (1) cookie 94186482584384 notify 115964117009 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f9ed40422a0 con 0x55a97fd533e0 2024-04-26T07:54:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9dc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117009 cookie 94186482584384 notifier 4592 bl.length()=567 2024-04-26T07:54:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9dc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9dc17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(70 notify.4 [notify cookie 94186482836160 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.785+0000 7f9dc17fa640 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9d14003430 con 0x55a97fd533e0 2024-04-26T07:54:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.786+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== watch-notify(notify_complete (2) cookie 94186482836160 notify 115964117009 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a97fda0250 con 0x55a97fd533e0 2024-04-26T07:54:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.786+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.795 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:40.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.787+0000 7f9d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.787+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94186482593088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fda5db0 con 0x55a97fd533e0 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.788+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94186482593088] v27'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.788+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94186482570448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd66d40 con 0x7f9ed0087040 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.789+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94186482570448] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.789+0000 7f9ee2933800 20 remove_watcher() i=0 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.789+0000 7f9ee2933800 2 removed watcher, disabling cache 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.789+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94186482574288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd66d40 con 0x55a97fd533e0 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.790+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94186482574288] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.790+0000 7f9ee2933800 20 remove_watcher() i=1 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.790+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94186482567936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd623d0 con 0x55a97fd5c8e0 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.791+0000 7f9ede5fc640 1 -- 172.21.15.62:0/523335124 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94186482567936] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed0084070 con 0x55a97fd5c8e0 2024-04-26T07:54:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.791+0000 7f9ee2933800 20 remove_watcher() i=2 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.791+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94186482580832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd60b00 con 0x7f9ed0087040 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.792+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94186482580832] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x7f9ed0087040 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.792+0000 7f9ee2933800 20 remove_watcher() i=3 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.792+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94186482584384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd63d60 con 0x55a97fd533e0 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.793+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94186482584384] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402b040 con 0x55a97fd533e0 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.793+0000 7f9ee2933800 20 remove_watcher() i=4 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.793+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94186482588160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd60b00 con 0x55a97fd57dd0 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.794+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94186482588160] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.794+0000 7f9ee2933800 20 remove_watcher() i=5 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.794+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94186482581888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd64b40 con 0x55a97fd57dd0 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.795+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94186482581888] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.795+0000 7f9ee2933800 20 remove_watcher() i=6 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.795+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94186482592032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a97fd65a00 con 0x55a97fd57dd0 2024-04-26T07:54:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.796+0000 7f9ededfd640 1 -- 172.21.15.62:0/523335124 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94186482592032] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed802a070 con 0x55a97fd57dd0 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.796+0000 7f9ee2933800 20 remove_watcher() i=7 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd57dd0 msgr2=0x55a97fd5a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd57dd0 0x55a97fd5a1c0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fd533e0 msgr2=0x55a97fd558a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fd533e0 0x55a97fd558a0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ed0087040 msgr2=0x7f9ed00688e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9ed0087040 0x7f9ed00688e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a97fd5c8e0 msgr2=0x55a97fd5eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a97fd5c8e0 0x55a97fd5eda0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9da8036e60 msgr2=0x7f9da8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9da8036e60 0x7f9da8039320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9ed005d040 tx=0x7f9ed0084000 comp rx=0 tx=0).stop 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 msgr2=0x55a97fd47770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/523335124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd401a0 0x55a97fd47770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8005a80 tx=0x7f9ed804cf90 comp rx=0 tx=0).stop 2024-04-26T07:54:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 reap_dead start 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9edddfb640 1 -- 172.21.15.62:0/523335124 reap_dead start 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 shutdown_connections 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 >> 172.21.15.62:0/523335124 conn(0x55a97fd3c500 msgr2=0x55a97fd39b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 shutdown_connections 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/523335124 wait complete. 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/3388632051 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9db8036e60 msgr2=0x7f9db8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/3388632051 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9db8036e60 0x7f9db8039320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55a97fd1f3c0 tx=0x7f9ed005da20 comp rx=0 tx=0).stop 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/3388632051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd32ec0 msgr2=0x55a97fd332e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/3388632051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd32ec0 0x55a97fd332e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55a97fd1f300 tx=0x7f9ed8018830 comp rx=0 tx=0).stop 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/3388632051 shutdown_connections 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/3388632051 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9db8036e60 0x7f9db8039320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 --2- 172.21.15.62:0/3388632051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fd32ec0 0x55a97fd332e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/3388632051 >> 172.21.15.62:0/3388632051 conn(0x55a97fd26f60 msgr2=0x55a97fd27360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/3388632051 shutdown_connections 2024-04-26T07:54:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.797+0000 7f9ee2933800 1 -- 172.21.15.62:0/3388632051 wait complete. 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd21280 msgr2=0x55a97fd23670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd21280 0x55a97fd23670 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fb92130 msgr2=0x55a97fd1e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fb92130 0x55a97fd1e9e0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dc4036eb0 msgr2=0x7f9dc4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dc4036eb0 0x7f9dc4039370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4000c00 tx=0x7f9ed40013b0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 msgr2=0x55a97fd177a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd177a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed0002fb0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 shutdown_connections 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a97fb92130 0x55a97fd1e9e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55a97fd21280 0x55a97fd23670 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9dc4036eb0 0x7f9dc4039370 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 --2- 172.21.15.62:0/21795072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a97fb90c20 0x55a97fd177a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 >> 172.21.15.62:0/21795072 conn(0x55a97fc17d20 msgr2=0x55a97fd09eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:40.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 shutdown_connections 2024-04-26T07:54:40.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:40.798+0000 7f9ee2933800 1 -- 172.21.15.62:0/21795072 wait complete. 2024-04-26T07:54:40.806 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:40.814 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T07:54:41.079 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-04-26T07:54:41.085 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:56.086 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-26T07:54:56.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-26T07:54:56.087 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-26T07:54:56.138 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:56.138 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:56.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.141+0000 7f4a6551f800 1 Processor -- start 2024-04-26T07:54:56.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.141+0000 7f4a6551f800 1 -- start start 2024-04-26T07:54:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.141+0000 7f4a6551f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x562da274e1b0 0x562da27505a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.141+0000 7f4a6551f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562da27545f0 con 0x562da2750ae0 2024-04-26T07:54:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.141+0000 7f4a6551f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x562da25efe20 con 0x562da274e1b0 2024-04-26T07:54:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.141+0000 7f4a611c3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x562da274e1b0 0x562da27505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.141+0000 7f4a609c2640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x562da2750ae0 0x562da2752ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:35904/0 (socket says 172.21.15.62:35904) 2024-04-26T07:54:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.141+0000 7f4a609c2640 1 -- 172.21.15.62:0/3836478470 learned_addr learned my addr 172.21.15.62:0/3836478470 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.142+0000 7f4a611c3640 1 -- 172.21.15.62:0/3836478470 >> v1:172.21.15.1:6789/0 conn(0x562da2750ae0 legacy=0x562da2752ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.142+0000 7f4a611c3640 1 -- 172.21.15.62:0/3836478470 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da27557d0 con 0x562da274e1b0 2024-04-26T07:54:56.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.144+0000 7f4a611c3640 1 --2- 172.21.15.62:0/3836478470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da27505a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400a470 tx=0x7f4a5401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88d96a5ad07fd04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.144+0000 7f4a53fff640 1 -- 172.21.15.62:0/3836478470 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54057070 con 0x562da274e1b0 2024-04-26T07:54:56.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.144+0000 7f4a53fff640 1 -- 172.21.15.62:0/3836478470 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a54052570 con 0x562da274e1b0 2024-04-26T07:54:56.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.144+0000 7f4a53fff640 1 -- 172.21.15.62:0/3836478470 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54052870 con 0x562da274e1b0 2024-04-26T07:54:56.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.145+0000 7f4a6551f800 1 -- 172.21.15.62:0/3836478470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 msgr2=0x562da27505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.145+0000 7f4a6551f800 1 --2- 172.21.15.62:0/3836478470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da27505a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400a470 tx=0x7f4a5401ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:56.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.145+0000 7f4a6551f800 1 -- 172.21.15.62:0/3836478470 shutdown_connections 2024-04-26T07:54:56.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.145+0000 7f4a6551f800 1 --2- 172.21.15.62:0/3836478470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da27505a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.145+0000 7f4a6551f800 1 -- 172.21.15.62:0/3836478470 >> 172.21.15.62:0/3836478470 conn(0x562da2747ba0 msgr2=0x562da2749fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.145+0000 7f4a6551f800 1 -- 172.21.15.62:0/3836478470 shutdown_connections 2024-04-26T07:54:56.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.145+0000 7f4a6551f800 1 -- 172.21.15.62:0/3836478470 wait complete. 2024-04-26T07:54:56.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.160+0000 7f4a6551f800 1 Processor -- start 2024-04-26T07:54:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.160+0000 7f4a6551f800 1 -- start start 2024-04-26T07:54:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.160+0000 7f4a6551f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da283ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.160+0000 7f4a6551f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562da2698cd0 con 0x562da274e1b0 2024-04-26T07:54:56.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.160+0000 7f4a611c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da283ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.160+0000 7f4a611c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da283ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56898/0 (socket says 172.21.15.62:56898) 2024-04-26T07:54:56.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.160+0000 7f4a611c3640 1 -- 172.21.15.62:0/706285752 learned_addr learned my addr 172.21.15.62:0/706285752 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.161+0000 7f4a611c3640 1 -- 172.21.15.62:0/706285752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da283f1e0 con 0x562da274e1b0 2024-04-26T07:54:56.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.161+0000 7f4a611c3640 1 --2- 172.21.15.62:0/706285752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da283ec10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4a5401ced0 tx=0x7f4a5404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd8c0aa3f406a1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.161+0000 7f494f606640 1 -- 172.21.15.62:0/706285752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54057040 con 0x562da274e1b0 2024-04-26T07:54:56.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.161+0000 7f494f606640 1 -- 172.21.15.62:0/706285752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a540529a0 con 0x562da274e1b0 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.161+0000 7f494f606640 1 -- 172.21.15.62:0/706285752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54052cc0 con 0x562da274e1b0 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.162+0000 7f4a6551f800 1 -- 172.21.15.62:0/706285752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 msgr2=0x562da283ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.162+0000 7f4a6551f800 1 --2- 172.21.15.62:0/706285752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da283ec10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4a5401ced0 tx=0x7f4a5404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.162+0000 7f4a6551f800 1 -- 172.21.15.62:0/706285752 shutdown_connections 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.162+0000 7f4a6551f800 1 --2- 172.21.15.62:0/706285752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da283ec10 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.162+0000 7f4a6551f800 1 -- 172.21.15.62:0/706285752 >> 172.21.15.62:0/706285752 conn(0x562da2747ba0 msgr2=0x562da283a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.162+0000 7f4a6551f800 1 -- 172.21.15.62:0/706285752 shutdown_connections 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.162+0000 7f4a6551f800 1 -- 172.21.15.62:0/706285752 wait complete. 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.163+0000 7f4a6551f800 1 Processor -- start 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.163+0000 7f4a6551f800 1 -- start start 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.163+0000 7f4a6551f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da2846690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.163+0000 7f4a6551f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562da2754a60 con 0x562da274e1b0 2024-04-26T07:54:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.163+0000 7f4a611c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da2846690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.163+0000 7f4a611c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da2846690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56906/0 (socket says 172.21.15.62:56906) 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.163+0000 7f4a611c3640 1 -- 172.21.15.62:0/958026841 learned_addr learned my addr 172.21.15.62:0/958026841 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.164+0000 7f4a611c3640 1 -- 172.21.15.62:0/958026841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da2846bd0 con 0x562da274e1b0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.164+0000 7f4a611c3640 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da2846690 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a54003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.164+0000 7f494de03640 1 -- 172.21.15.62:0/958026841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54073070 con 0x562da274e1b0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.164+0000 7f494de03640 1 -- 172.21.15.62:0/958026841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5405d780 con 0x562da274e1b0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.164+0000 7f494de03640 1 -- 172.21.15.62:0/958026841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54057070 con 0x562da274e1b0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.164+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562da2846e60 con 0x562da274e1b0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.164+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da2849b10 con 0x562da274e1b0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.165+0000 7f494de03640 1 -- 172.21.15.62:0/958026841 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a54076070 con 0x562da274e1b0 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.165+0000 7f494de03640 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4948036e60 0x7f4948039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.165+0000 7f494de03640 1 -- 172.21.15.62:0/958026841 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f4a5408e7f0 con 0x562da274e1b0 2024-04-26T07:54:56.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.165+0000 7f4a609c2640 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4948036e60 0x7f4948039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.165+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da2750ae0 0x562da284d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.165+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da284def0 con 0x562da2750ae0 2024-04-26T07:54:56.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.166+0000 7f4a619c4640 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da2750ae0 0x562da284d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.166+0000 7f4a609c2640 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4948036e60 0x7f4948039320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a58000f60 tx=0x7f4a580012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.166+0000 7f4a619c4640 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da2750ae0 0x562da284d8d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.166+0000 7f4a619c4640 1 -- 172.21.15.62:0/958026841 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a5c00a4a0 con 0x562da2750ae0 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.166+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da284ae80 con 0x562da2750ae0 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.167+0000 7f4a619c4640 1 -- 172.21.15.62:0/958026841 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a5c00a4a0 con 0x562da2750ae0 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.167+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2850200 0x562da28525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.167+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da2852c90 con 0x562da2850200 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.167+0000 7f4a611c3640 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2850200 0x562da28525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.167+0000 7f4a611c3640 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2850200 0x562da28525f0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.168+0000 7f4a611c3640 1 -- 172.21.15.62:0/958026841 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a54075030 con 0x562da2850200 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.168+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da284f1b0 con 0x562da2750ae0 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.168+0000 7f4a619c4640 1 -- 172.21.15.62:0/958026841 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a5c00a4a0 con 0x562da2750ae0 2024-04-26T07:54:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.168+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da284f690 con 0x562da2750ae0 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.169+0000 7f4a619c4640 1 -- 172.21.15.62:0/958026841 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a5c00a4a0 con 0x562da2750ae0 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.169+0000 7f4a6551f800 1 Processor -- start 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.169+0000 7f4a6551f800 1 -- start start 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.169+0000 7f4a6551f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274dd50 0x562da274c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.169+0000 7f4a6551f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562da2640170 con 0x562da274dd50 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.169+0000 7f4a619c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274dd50 0x562da274c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.169+0000 7f4a619c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274dd50 0x562da274c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56910/0 (socket says 172.21.15.62:56910) 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.169+0000 7f4a619c4640 1 -- 172.21.15.62:0/760390083 learned_addr learned my addr 172.21.15.62:0/760390083 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.170+0000 7f4a619c4640 1 -- 172.21.15.62:0/760390083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da274c700 con 0x562da274dd50 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.170+0000 7f4a619c4640 1 --2- 172.21.15.62:0/760390083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274dd50 0x562da274c1c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x562da2847560 tx=0x7f4a5c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.170+0000 7f4946ffd640 1 -- 172.21.15.62:0/760390083 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c014450 con 0x562da274dd50 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.170+0000 7f4946ffd640 1 -- 172.21.15.62:0/760390083 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c0145f0 con 0x562da274dd50 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.170+0000 7f4a6551f800 1 -- 172.21.15.62:0/760390083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562da274c990 con 0x562da274dd50 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.170+0000 7f4946ffd640 1 -- 172.21.15.62:0/760390083 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c0148d0 con 0x562da274dd50 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.170+0000 7f4a6551f800 1 -- 172.21.15.62:0/760390083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da274ce90 con 0x562da274dd50 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.171+0000 7f4946ffd640 1 -- 172.21.15.62:0/760390083 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a5c011040 con 0x562da274dd50 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.171+0000 7f4946ffd640 1 --2- 172.21.15.62:0/760390083 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f493c036e60 0x7f493c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.171+0000 7f4946ffd640 1 -- 172.21.15.62:0/760390083 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f4a5c01e070 con 0x562da274dd50 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.171+0000 7f4a611c3640 1 --2- 172.21.15.62:0/760390083 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f493c036e60 0x7f493c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a6551f800 1 Processor -- start 2024-04-26T07:54:56.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a6551f800 1 -- start start 2024-04-26T07:54:56.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a611c3640 1 --2- 172.21.15.62:0/760390083 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f493c036e60 0x7f493c039320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x562da284e340 tx=0x7f4a54052f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a6551f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2871770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a6551f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562da283f4a0 con 0x562da2871350 2024-04-26T07:54:56.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a619c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2871770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a619c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2871770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56922/0 (socket says 172.21.15.62:56922) 2024-04-26T07:54:56.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a619c4640 1 -- 172.21.15.62:0/317639504 learned_addr learned my addr 172.21.15.62:0/317639504 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.172+0000 7f4a619c4640 1 -- 172.21.15.62:0/317639504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da2871d40 con 0x562da2871350 2024-04-26T07:54:56.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4a619c4640 1 --2- 172.21.15.62:0/317639504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2871770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c04cf30 tx=0x7f4a5c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00f4bd7584053e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4944ff9640 1 -- 172.21.15.62:0/317639504 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c013c90 con 0x562da2871350 2024-04-26T07:54:56.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4944ff9640 1 -- 172.21.15.62:0/317639504 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c03d050 con 0x562da2871350 2024-04-26T07:54:56.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4944ff9640 1 -- 172.21.15.62:0/317639504 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c02ba60 con 0x562da2871350 2024-04-26T07:54:56.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4a6551f800 1 -- 172.21.15.62:0/317639504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 msgr2=0x562da2871770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4a6551f800 1 --2- 172.21.15.62:0/317639504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2871770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c04cf30 tx=0x7f4a5c011970 comp rx=0 tx=0).stop 2024-04-26T07:54:56.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4a6551f800 1 -- 172.21.15.62:0/317639504 shutdown_connections 2024-04-26T07:54:56.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4a6551f800 1 --2- 172.21.15.62:0/317639504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2871770 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4a6551f800 1 -- 172.21.15.62:0/317639504 >> 172.21.15.62:0/317639504 conn(0x562da286d6b0 msgr2=0x562da286b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4a6551f800 1 -- 172.21.15.62:0/317639504 shutdown_connections 2024-04-26T07:54:56.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.173+0000 7f4a6551f800 1 -- 172.21.15.62:0/317639504 wait complete. 2024-04-26T07:54:56.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.174+0000 7f4a6551f800 1 Processor -- start 2024-04-26T07:54:56.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.174+0000 7f4a6551f800 1 -- start start 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.174+0000 7f4a6551f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2878940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.174+0000 7f4a6551f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562da28724b0 con 0x562da2871350 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.174+0000 7f4a619c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2878940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.174+0000 7f4a619c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2878940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56934/0 (socket says 172.21.15.62:56934) 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.174+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 learned_addr learned my addr 172.21.15.62:0/492800499 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.175+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da2878e80 con 0x562da2871350 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.175+0000 7f4a619c4640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2878940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c03f040 tx=0x7f4a5c04cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.175+0000 7f4932ffd640 1 -- 172.21.15.62:0/492800499 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c03a070 con 0x562da2871350 2024-04-26T07:54:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.175+0000 7f4932ffd640 1 -- 172.21.15.62:0/492800499 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c042040 con 0x562da2871350 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.175+0000 7f4932ffd640 1 -- 172.21.15.62:0/492800499 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c046040 con 0x562da2871350 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.175+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562da2879110 con 0x562da2871350 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.175+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da287bdc0 con 0x562da2871350 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.176+0000 7f4932ffd640 1 -- 172.21.15.62:0/492800499 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a5c02b630 con 0x562da2871350 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.176+0000 7f4932ffd640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f492c036eb0 0x7f492c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.176+0000 7f4932ffd640 1 -- 172.21.15.62:0/492800499 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f4a5c00e040 con 0x562da2871350 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.176+0000 7f4a611c3640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f492c036eb0 0x7f492c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.176+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.176+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da28845c0 0x562da2886a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.176+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28871d0 con 0x562da28845c0 2024-04-26T07:54:56.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.176+0000 7f4a609c2640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da28845c0 0x562da2886a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a611c3640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f492c036eb0 0x7f492c039370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4a540803f0 tx=0x7f4a5408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a609c2640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da28845c0 0x562da2886a80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a58009050 con 0x562da28845c0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a6551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a6551f800 20 realm 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da2883a10 con 0x562da28845c0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a58009050 con 0x562da28845c0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a6551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a6551f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.177+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da2887cb0 con 0x562da28845c0 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a58009050 con 0x562da28845c0 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a6551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da2888580 con 0x562da28845c0 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a58009050 con 0x562da28845c0 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a6551f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2888e30 0x562da288b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da288b960 con 0x562da2888e30 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.178+0000 7f4a619c4640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2888e30 0x562da288b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.179+0000 7f4a619c4640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2888e30 0x562da288b220 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.179+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.179+0000 7f4a6551f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:56.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.179+0000 7f4a6551f800 20 searching for the correct realm 2024-04-26T07:54:56.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.179+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562da288da00 0x562da288fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.179+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da288da00 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.179+0000 7f4a611c3640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562da288da00 0x562da288fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.180+0000 7f4a611c3640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562da288da00 0x562da288fec0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.180+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.180+0000 7f4a611c3640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4a54078060 0x7f4a5408e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.180+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x7f4a54078060 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.180+0000 7f4a609c2640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4a54078060 0x7f4a5408e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.181+0000 7f4a609c2640 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4a54078060 0x7f4a5408e050 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.181+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58009050 con 0x7f4a54078060 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.181+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da2888e30 2024-04-26T07:54:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.182+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.182+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da28845c0 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.182+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58009050 con 0x562da28845c0 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.182+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da28845c0 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.182+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.182+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da2888e30 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.182+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.183+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da2888e30 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.183+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.183+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x7f4a54078060 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.183+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.183+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da288da00 2024-04-26T07:54:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.183+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.183+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da28845c0 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.184+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.184+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da2888e30 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.184+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.184+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da28845c0 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.184+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.184+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x7f4a54078060 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.185+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.185+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562da2890590 con 0x562da288da00 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.185+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.185+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da288da00 2024-04-26T07:54:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.185+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.185+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da2888e30 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.186+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.186+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da288da00 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.186+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.186+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da288da00 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.186+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.186+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da28845c0 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.186+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.186+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da28845c0 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.187+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.187+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da2888e30 2024-04-26T07:54:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.187+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.187+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da288da00 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.187+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.187+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x7f4a54078060 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.188+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.188+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da28845c0 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.188+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.188+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da2888e30 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.188+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.188+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da288da00 2024-04-26T07:54:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.188+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.189+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da2888e30 2024-04-26T07:54:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.189+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.189+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x7f4a54078060 2024-04-26T07:54:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.189+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.189+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da288da00 2024-04-26T07:54:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.189+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.189+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da2888e30 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x562da28845c0 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4a540a8040 con 0x7f4a54078060 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a6551f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a6551f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a6551f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a6551f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a6551f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a6551f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.190+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da288c400 con 0x562da28845c0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da288c010 con 0x562da28845c0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da288ccf0 con 0x562da28845c0 2024-04-26T07:54:56.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 20 zone default found 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 4 Realm: () 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 20 zonegroup default 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.191+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da2890a10 con 0x562da2888e30 2024-04-26T07:54:56.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da2892c40 con 0x562da288da00 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da2892fe0 con 0x562da288da00 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 20 started sync module instance, tier type = 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.192+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2892080 con 0x7f4a54078060 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.194+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.194+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94754000413808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2892080 con 0x7f4a54078060 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.194+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28939a0 con 0x562da28845c0 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.195+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94754000413808] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.195+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.195+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94754000412080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28939a0 con 0x562da28845c0 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.195+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28943a0 con 0x562da288da00 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.196+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94754000412080] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.197+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.197+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94754000418032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2893910 con 0x562da288da00 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.197+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2895260 con 0x7f4a54078060 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.198+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.198+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94754000424848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2895a00 con 0x7f4a54078060 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.198+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2896520 con 0x562da28845c0 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.198+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94754000418032] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.199+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.199+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94754000429040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28964e0 con 0x562da28845c0 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.199+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2896f30 con 0x562da2888e30 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.199+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94754000424848] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.200+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94754000429040] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.200+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.200+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94754000422800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2895450 con 0x562da2888e30 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.200+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28977d0 con 0x562da2888e30 2024-04-26T07:54:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.201+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.202+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94754000422800] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.202+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94754000433952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2897c30 con 0x562da2888e30 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.202+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2896a80 con 0x562da2888e30 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94754000433952] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94754000431744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2898220 con 0x562da2888e30 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a6551f800 20 add_watcher() i=0 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a6551f800 20 add_watcher() i=1 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a6551f800 20 add_watcher() i=2 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a6551f800 20 add_watcher() i=3 2024-04-26T07:54:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a6551f800 20 add_watcher() i=4 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a6551f800 20 add_watcher() i=5 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.203+0000 7f4a6551f800 20 add_watcher() i=6 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.204+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94754000431744] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.204+0000 7f4a6551f800 20 add_watcher() i=7 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.204+0000 7f4a6551f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.204+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da289b620 con 0x562da28845c0 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.204+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.204+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94754000435008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da2898ae0 con 0x562da28845c0 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.205+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94754000435008] v27'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.205+0000 7f49177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.206+0000 7f4a6551f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.206+0000 7f4a6551f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.206+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a3f20 con 0x562da28845c0 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.207+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.207+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a44b0 con 0x562da2888e30 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.208+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.208+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a44b0 con 0x562da288da00 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.209+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.209+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a4d60 con 0x562da28845c0 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.210+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'153 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.210+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da289fe10 con 0x7f4a54078060 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.211+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.212+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da289fd80 con 0x562da288da00 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.212+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.213+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da289fd80 con 0x562da28845c0 2024-04-26T07:54:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.214+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.214+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da289fd80 con 0x562da2888e30 2024-04-26T07:54:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.215+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.215+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x7f4a54078060 2024-04-26T07:54:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.216+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.216+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x562da288da00 2024-04-26T07:54:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.217+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.217+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x7f4a54078060 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.218+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.218+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x562da2888e30 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.219+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.219+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x7f4a54078060 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.220+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.220+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x562da2888e30 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.222+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.222+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x562da28845c0 2024-04-26T07:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.223+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.223+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x562da288da00 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.224+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.224+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5a70 con 0x7f4a54078060 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.225+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.225+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da288da00 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.226+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.226+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da28845c0 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.227+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'27 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.227+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da28845c0 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.228+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.228+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da288da00 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.229+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.230+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x7f4a54078060 2024-04-26T07:54:56.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.230+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.230+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da288da00 2024-04-26T07:54:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.231+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.231+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da288da00 2024-04-26T07:54:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.232+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.233+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da288da00 2024-04-26T07:54:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.234+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.234+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da288da00 2024-04-26T07:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.234+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.235+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da2888e30 2024-04-26T07:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.236+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.236+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da288da00 2024-04-26T07:54:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.237+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.237+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da2888e30 2024-04-26T07:54:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.238+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.238+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da288da00 2024-04-26T07:54:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.239+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.239+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x562da2888e30 2024-04-26T07:54:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.241+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.241+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28a5b20 con 0x7f4a54078060 2024-04-26T07:54:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.242+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.242+0000 7f49167e4640 20 reqs_thread_entry: start 2024-04-26T07:54:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.242+0000 7f4a6551f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.242+0000 7f4a6551f800 20 Filter name: none 2024-04-26T07:54:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.242+0000 7f4887fff640 20 reqs_thread_entry: start 2024-04-26T07:54:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.242+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.242+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.243+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da28845c0 2024-04-26T07:54:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.243+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.243+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.243+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.243+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da2888e30 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.243+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.243+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da2888e30 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.244+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.244+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da2888e30 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.244+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.244+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.244+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.245+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da288da00 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.245+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.245+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.245+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.245+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.245+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.245+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da28845c0 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.246+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.246+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.246+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.246+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.246+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.246+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x7f4a54078060 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.246+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.246+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.247+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.247+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.247+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.247+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da288da00 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.247+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.247+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.247+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.247+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.248+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.248+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da28845c0 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.248+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.248+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.248+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.248+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da2888e30 2024-04-26T07:54:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.249+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.249+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da2888e30 2024-04-26T07:54:56.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.249+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.249+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da2888e30 2024-04-26T07:54:56.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.250+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.250+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.250+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.250+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x7f4a54078060 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.250+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.250+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.251+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.251+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.251+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.251+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da288da00 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.251+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.251+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.251+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.251+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.252+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.252+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x7f4a54078060 2024-04-26T07:54:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.252+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.252+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.252+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.252+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da2888e30 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.253+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.253+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da2888e30 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.253+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.253+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da2888e30 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.253+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.253+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.253+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.253+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x7f4a54078060 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.254+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.254+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.254+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.254+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da2888e30 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.254+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.254+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da2888e30 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.255+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.255+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da2888e30 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.255+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.255+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.256+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.256+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da28845c0 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.256+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.256+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.256+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.256+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.256+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.256+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da288da00 2024-04-26T07:54:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.257+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.257+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.257+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.257+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.257+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.257+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x7f4a54078060 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.258+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.258+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x7f4a54078060 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.258+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.258+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.258+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.258+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da288da00 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.258+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.258+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da288da00 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.259+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.259+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.259+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.259+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d0730 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.259+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.259+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1740 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.260+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 42 ==== osd_op_reply(150 gc.18 [call out=1702b] v0'0 uv26 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.260+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.260+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.260+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.260+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.260+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da28845c0 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.260+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.260+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.261+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.261+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da288da00 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.261+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.261+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.261+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.261+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x7f4a54078060 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.261+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.261+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x7f4a54078060 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.262+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.262+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x7f4a54078060 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.262+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.262+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.262+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.262+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.263+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.263+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.263+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.263+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.263+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.263+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.263+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.263+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.264+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.264+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.264+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.264+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.264+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.264+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.264+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.264+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.265+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.265+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da288da00 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.265+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.265+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.265+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.265+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da2888e30 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.266+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.266+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da2888e30 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.266+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.266+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da2888e30 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.266+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.266+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.267+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.267+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da288da00 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.267+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.267+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.267+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.267+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da2888e30 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.268+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.268+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da2888e30 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.268+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.268+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da2888e30 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.268+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.268+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.269+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.269+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da288da00 2024-04-26T07:54:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.269+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.269+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da288da00 2024-04-26T07:54:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.269+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.269+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da2888e30 2024-04-26T07:54:56.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.270+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.270+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x562da2888e30 2024-04-26T07:54:56.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.270+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.270+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x562da2888e30 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.270+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.270+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x7f4a54078060 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.271+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.271+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d1070 con 0x7f4a54078060 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.271+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.271+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562da28d2080 con 0x7f4a54078060 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.271+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.272+0000 7f49177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.272+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94754000435008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da289ed40 con 0x562da28845c0 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.273+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94754000435008] v27'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.273+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94754000413808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28cf720 con 0x7f4a54078060 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.274+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94754000413808] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.274+0000 7f4a6551f800 20 remove_watcher() i=0 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.274+0000 7f4a6551f800 2 removed watcher, disabling cache 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.274+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94754000412080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28cf720 con 0x562da28845c0 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.275+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94754000412080] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.275+0000 7f4a6551f800 20 remove_watcher() i=1 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.275+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94754000418032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28cf720 con 0x562da288da00 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.277+0000 7f4a611c3640 1 -- 172.21.15.62:0/492800499 <== osd.3 v2:172.21.15.62:6816/1472283839 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94754000418032] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a54099070 con 0x562da288da00 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.277+0000 7f4a6551f800 20 remove_watcher() i=2 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.277+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94754000424848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28cf720 con 0x7f4a54078060 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.278+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.2 v2:172.21.15.62:6808/1138534927 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94754000424848] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x7f4a54078060 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.278+0000 7f4a6551f800 20 remove_watcher() i=3 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.278+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94754000429040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28cf720 con 0x562da28845c0 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.279+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 <== osd.1 v2:172.21.15.62:6800/1888558046 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94754000429040] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a58029040 con 0x562da28845c0 2024-04-26T07:54:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.279+0000 7f4a6551f800 20 remove_watcher() i=4 2024-04-26T07:54:56.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.279+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94754000422800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28cf720 con 0x562da2888e30 2024-04-26T07:54:56.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.280+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94754000422800] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.280+0000 7f4a6551f800 20 remove_watcher() i=5 2024-04-26T07:54:56.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.280+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94754000433952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28cf720 con 0x562da2888e30 2024-04-26T07:54:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.281+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94754000433952] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.281+0000 7f4a6551f800 20 remove_watcher() i=6 2024-04-26T07:54:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.281+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94754000431744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562da28cf720 con 0x562da2888e30 2024-04-26T07:54:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a619c4640 1 -- 172.21.15.62:0/492800499 <== osd.0 v2:172.21.15.1:6800/3827982423 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94754000431744] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c02a070 con 0x562da2888e30 2024-04-26T07:54:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 20 remove_watcher() i=7 2024-04-26T07:54:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2888e30 msgr2=0x562da288b220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2888e30 0x562da288b220 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da28845c0 msgr2=0x562da2886a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da28845c0 0x562da2886a80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4a54078060 msgr2=0x7f4a5408e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4a54078060 0x7f4a5408e050 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562da288da00 msgr2=0x562da288fec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562da288da00 0x562da288fec0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f492c036eb0 msgr2=0x7f492c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f492c036eb0 0x7f492c039370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4a540803f0 tx=0x7f4a5408a000 comp rx=0 tx=0).stop 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 msgr2=0x562da2878940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 --2- 172.21.15.62:0/492800499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da2871350 0x562da2878940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c03f040 tx=0x7f4a5c04cec0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 reap_dead start 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a609c2640 1 -- 172.21.15.62:0/492800499 reap_dead start 2024-04-26T07:54:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 shutdown_connections 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 >> 172.21.15.62:0/492800499 conn(0x562da286d6b0 msgr2=0x562da286ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 shutdown_connections 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.282+0000 7f4a6551f800 1 -- 172.21.15.62:0/492800499 wait complete. 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/760390083 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f493c036e60 msgr2=0x7f493c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/760390083 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f493c036e60 0x7f493c039320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x562da284e340 tx=0x7f4a54052f90 comp rx=0 tx=0).stop 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/760390083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274dd50 msgr2=0x562da274c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/760390083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274dd50 0x562da274c1c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x562da2847560 tx=0x7f4a5c0188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/760390083 shutdown_connections 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/760390083 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f493c036e60 0x7f493c039320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/760390083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274dd50 0x562da274c1c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/760390083 >> 172.21.15.62:0/760390083 conn(0x562da2855ee0 msgr2=0x562da28562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/760390083 shutdown_connections 2024-04-26T07:54:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/760390083 wait complete. 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2850200 msgr2=0x562da28525f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2850200 0x562da28525f0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da2750ae0 msgr2=0x562da284d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da2750ae0 0x562da284d8d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4948036e60 msgr2=0x7f4948039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4948036e60 0x7f4948039320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a58000f60 tx=0x7f4a580012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 msgr2=0x562da2846690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da2846690 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a54003020 comp rx=0 tx=0).stop 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 shutdown_connections 2024-04-26T07:54:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562da2750ae0 0x562da284d8d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x562da2850200 0x562da28525f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4948036e60 0x7f4948039320 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 --2- 172.21.15.62:0/958026841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562da274e1b0 0x562da2846690 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 >> 172.21.15.62:0/958026841 conn(0x562da2747ba0 msgr2=0x562da2838d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 shutdown_connections 2024-04-26T07:54:56.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.283+0000 7f4a6551f800 1 -- 172.21.15.62:0/958026841 wait complete. 2024-04-26T07:54:56.290 INFO:teuthology.orchestra.run.smithi062.stdout:[{"tag":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11683759700354449071\u0000","time":"2024-04-26T07:54:56.087190+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_7","key":"","instance":""}]}] 2024-04-26T07:54:56.290 DEBUG:tasks.util.rgw: json result: [{'tag': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11683759700354449071\x00', 'time': '2024-04-26T07:54:56.087190+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_7', 'key': '', 'instance': ''}]}] 2024-04-26T07:54:56.290 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-04-26T07:54:56.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-04-26T07:54:56.290 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-04-26T07:54:56.333 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:56.333 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.336+0000 7f62e6b33800 1 Processor -- start 2024-04-26T07:54:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.336+0000 7f62e6b33800 1 -- start start 2024-04-26T07:54:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.336+0000 7f62e6b33800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55be932ecf90 0x55be932ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.336+0000 7f62e6b33800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be93262270 con 0x55be932ed8f0 2024-04-26T07:54:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.336+0000 7f62e6b33800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55be93190e20 con 0x55be932ecf90 2024-04-26T07:54:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.336+0000 7f62e27d1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55be932ecf90 0x55be932ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.336+0000 7f62e1fd0640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55be932ed8f0 0x55be932edda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:35916/0 (socket says 172.21.15.62:35916) 2024-04-26T07:54:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.336+0000 7f62e1fd0640 1 -- 172.21.15.62:0/616655998 learned_addr learned my addr 172.21.15.62:0/616655998 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.337+0000 7f62e17cf640 1 -- 172.21.15.62:0/616655998 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002483476 0 0) 0x55be93262270 con 0x55be932ed8f0 2024-04-26T07:54:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.337+0000 7f62e17cf640 1 -- 172.21.15.62:0/616655998 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62cc001e10 con 0x55be932ed8f0 2024-04-26T07:54:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.337+0000 7f62e27d1640 1 -- 172.21.15.62:0/616655998 >> v1:172.21.15.1:6789/0 conn(0x55be932ed8f0 legacy=0x55be932edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.337+0000 7f62e27d1640 1 -- 172.21.15.62:0/616655998 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be932ee4b0 con 0x55be932ecf90 2024-04-26T07:54:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.338+0000 7f62e27d1640 1 --2- 172.21.15.62:0/616655998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be932ed3b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f62d400a470 tx=0x7f62d401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af15bab2bae53e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e17cf640 1 -- 172.21.15.62:0/616655998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4057070 con 0x55be932ecf90 2024-04-26T07:54:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e17cf640 1 -- 172.21.15.62:0/616655998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4052570 con 0x55be932ecf90 2024-04-26T07:54:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e17cf640 1 -- 172.21.15.62:0/616655998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4052850 con 0x55be932ecf90 2024-04-26T07:54:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e6b33800 1 -- 172.21.15.62:0/616655998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 msgr2=0x55be932ed3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e6b33800 1 --2- 172.21.15.62:0/616655998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be932ed3b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f62d400a470 tx=0x7f62d401cdb0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e6b33800 1 -- 172.21.15.62:0/616655998 shutdown_connections 2024-04-26T07:54:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e6b33800 1 --2- 172.21.15.62:0/616655998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be932ed3b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e6b33800 1 -- 172.21.15.62:0/616655998 >> 172.21.15.62:0/616655998 conn(0x55be932e8b70 msgr2=0x55be932eaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e6b33800 1 -- 172.21.15.62:0/616655998 shutdown_connections 2024-04-26T07:54:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.339+0000 7f62e6b33800 1 -- 172.21.15.62:0/616655998 wait complete. 2024-04-26T07:54:56.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.352+0000 7f62e6b33800 1 Processor -- start 2024-04-26T07:54:56.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.352+0000 7f62e6b33800 1 -- start start 2024-04-26T07:54:56.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.352+0000 7f62e6b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.352+0000 7f62e6b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55be93239cc0 con 0x55be932ecf90 2024-04-26T07:54:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.352+0000 7f62e27d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.352+0000 7f62e27d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56962/0 (socket says 172.21.15.62:56962) 2024-04-26T07:54:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.352+0000 7f62e27d1640 1 -- 172.21.15.62:0/1017510520 learned_addr learned my addr 172.21.15.62:0/1017510520 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.353+0000 7f62e27d1640 1 -- 172.21.15.62:0/1017510520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be933e2400 con 0x55be932ecf90 2024-04-26T07:54:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.353+0000 7f62e27d1640 1 --2- 172.21.15.62:0/1017510520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e1e30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f62d4055040 tx=0x7f62d404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be7b204e112c531 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.353+0000 7f61d0608640 1 -- 172.21.15.62:0/1017510520 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4057040 con 0x55be932ecf90 2024-04-26T07:54:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.353+0000 7f61d0608640 1 -- 172.21.15.62:0/1017510520 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4052950 con 0x55be932ecf90 2024-04-26T07:54:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.353+0000 7f61d0608640 1 -- 172.21.15.62:0/1017510520 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4052c70 con 0x55be932ecf90 2024-04-26T07:54:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 -- 172.21.15.62:0/1017510520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 msgr2=0x55be933e1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1017510520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e1e30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f62d4055040 tx=0x7f62d404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 -- 172.21.15.62:0/1017510520 shutdown_connections 2024-04-26T07:54:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1017510520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e1e30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 -- 172.21.15.62:0/1017510520 >> 172.21.15.62:0/1017510520 conn(0x55be932e8b70 msgr2=0x55be933dd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 -- 172.21.15.62:0/1017510520 shutdown_connections 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 -- 172.21.15.62:0/1017510520 wait complete. 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 Processor -- start 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 -- start start 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.354+0000 7f62e6b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55be932ee9e0 con 0x55be932ecf90 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f62e27d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f62e27d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56970/0 (socket says 172.21.15.62:56970) 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f62e27d1640 1 -- 172.21.15.62:0/1075863338 learned_addr learned my addr 172.21.15.62:0/1075863338 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f62e27d1640 1 -- 172.21.15.62:0/1075863338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be933e9e00 con 0x55be932ecf90 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f62e27d1640 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e98c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f62d401baa0 tx=0x7f62d4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f61cee05640 1 -- 172.21.15.62:0/1075863338 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4073070 con 0x55be932ecf90 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be933ea090 con 0x55be932ecf90 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f61cee05640 1 -- 172.21.15.62:0/1075863338 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d405d780 con 0x55be932ecf90 2024-04-26T07:54:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f61cee05640 1 -- 172.21.15.62:0/1075863338 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4057070 con 0x55be932ecf90 2024-04-26T07:54:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.355+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be933eccf0 con 0x55be932ecf90 2024-04-26T07:54:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.356+0000 7f61cee05640 1 -- 172.21.15.62:0/1075863338 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f62d4076070 con 0x55be932ecf90 2024-04-26T07:54:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.356+0000 7f61cee05640 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61c8036e60 0x7f61c8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.356+0000 7f61cee05640 1 -- 172.21.15.62:0/1075863338 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f62d408e5f0 con 0x55be932ecf90 2024-04-26T07:54:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.356+0000 7f62e1fd0640 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61c8036e60 0x7f61c8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.357+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be932ed8f0 0x55be933f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.357+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be933f0ff0 con 0x55be932ed8f0 2024-04-26T07:54:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.357+0000 7f62e2fd2640 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be932ed8f0 0x55be933f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.357+0000 7f62e1fd0640 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61c8036e60 0x7f61c8039320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f62d8000f60 tx=0x7f62d80010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.357+0000 7f62e2fd2640 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be932ed8f0 0x55be933f0ab0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.357+0000 7f62e2fd2640 1 -- 172.21.15.62:0/1075863338 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x55be932ed8f0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.357+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be933ee060 con 0x55be932ed8f0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.357+0000 7f62e2fd2640 1 -- 172.21.15.62:0/1075863338 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62dc00a4a0 con 0x55be932ed8f0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.358+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be933f3300 0x55be933f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.358+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be933f5d90 con 0x55be933f3300 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.358+0000 7f62e27d1640 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be933f3300 0x55be933f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.358+0000 7f62e27d1640 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be933f3300 0x55be933f56f0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.358+0000 7f62e27d1640 1 -- 172.21.15.62:0/1075863338 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f62d4075030 con 0x55be933f3300 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.358+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be933f22b0 con 0x55be932ed8f0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.359+0000 7f62e2fd2640 1 -- 172.21.15.62:0/1075863338 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62dc00a4a0 con 0x55be932ed8f0 2024-04-26T07:54:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.359+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be933f2790 con 0x55be932ed8f0 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.359+0000 7f62e2fd2640 1 -- 172.21.15.62:0/1075863338 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f62dc00a4a0 con 0x55be932ed8f0 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.359+0000 7f62e6b33800 1 Processor -- start 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.359+0000 7f62e6b33800 1 -- start start 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.359+0000 7f62e6b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93404f40 0x55be93405360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.360+0000 7f62e6b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55be931e1170 con 0x55be93404f40 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.360+0000 7f62e2fd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93404f40 0x55be93405360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.360+0000 7f62e2fd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93404f40 0x55be93405360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56976/0 (socket says 172.21.15.62:56976) 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.360+0000 7f62e2fd2640 1 -- 172.21.15.62:0/3369057023 learned_addr learned my addr 172.21.15.62:0/3369057023 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.360+0000 7f62e2fd2640 1 -- 172.21.15.62:0/3369057023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be934058a0 con 0x55be93404f40 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.360+0000 7f62e2fd2640 1 --2- 172.21.15.62:0/3369057023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93404f40 0x55be93405360 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55be933eaa90 tx=0x7f62dc0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.361+0000 7f61c7fff640 1 -- 172.21.15.62:0/3369057023 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc014450 con 0x55be93404f40 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.361+0000 7f61c7fff640 1 -- 172.21.15.62:0/3369057023 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc0145f0 con 0x55be93404f40 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.361+0000 7f62e6b33800 1 -- 172.21.15.62:0/3369057023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be93406310 con 0x55be93404f40 2024-04-26T07:54:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.361+0000 7f61c7fff640 1 -- 172.21.15.62:0/3369057023 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc0148d0 con 0x55be93404f40 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.361+0000 7f62e6b33800 1 -- 172.21.15.62:0/3369057023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be93406810 con 0x55be93404f40 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f61c7fff640 1 -- 172.21.15.62:0/3369057023 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f62dc011040 con 0x55be93404f40 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f61c7fff640 1 --2- 172.21.15.62:0/3369057023 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61bc036eb0 0x7f61bc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f61c7fff640 1 -- 172.21.15.62:0/3369057023 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f62dc01e070 con 0x55be93404f40 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f62e27d1640 1 --2- 172.21.15.62:0/3369057023 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61bc036eb0 0x7f61bc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f62e6b33800 1 Processor -- start 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f62e27d1640 1 --2- 172.21.15.62:0/3369057023 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61bc036eb0 0x7f61bc039370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f62d405b4b0 tx=0x7f62d40528e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f62e6b33800 1 -- start start 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f62e6b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93412620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.362+0000 7f62e6b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55be933e26c0 con 0x55be93412200 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f62e2fd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93412620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f62e2fd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93412620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56980/0 (socket says 172.21.15.62:56980) 2024-04-26T07:54:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2197465556 learned_addr learned my addr 172.21.15.62:0/2197465556 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2197465556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be93412bf0 con 0x55be93412200 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f62e2fd2640 1 --2- 172.21.15.62:0/2197465556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93412620 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f62dc04cf00 tx=0x7f62dc016a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dc6901877588bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f61c5ffb640 1 -- 172.21.15.62:0/2197465556 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc013c90 con 0x55be93412200 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f61c5ffb640 1 -- 172.21.15.62:0/2197465556 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc013e30 con 0x55be93412200 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f61c5ffb640 1 -- 172.21.15.62:0/2197465556 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc02bb90 con 0x55be93412200 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f62e6b33800 1 -- 172.21.15.62:0/2197465556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 msgr2=0x55be93412620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.363+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2197465556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93412620 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f62dc04cf00 tx=0x7f62dc016a90 comp rx=0 tx=0).stop 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 -- 172.21.15.62:0/2197465556 shutdown_connections 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2197465556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93412620 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 -- 172.21.15.62:0/2197465556 >> 172.21.15.62:0/2197465556 conn(0x55be9340e560 msgr2=0x55be9340c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 -- 172.21.15.62:0/2197465556 shutdown_connections 2024-04-26T07:54:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 -- 172.21.15.62:0/2197465556 wait complete. 2024-04-26T07:54:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 Processor -- start 2024-04-26T07:54:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 -- start start 2024-04-26T07:54:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93419790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e6b33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55be93413360 con 0x55be93412200 2024-04-26T07:54:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e2fd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93419790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e2fd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93419790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:56994/0 (socket says 172.21.15.62:56994) 2024-04-26T07:54:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 learned_addr learned my addr 172.21.15.62:0/2501025130 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.364+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be93419cd0 con 0x55be93412200 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.365+0000 7f62e2fd2640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93419790 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f62dc048010 tx=0x7f62dc04ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.365+0000 7f61b3fff640 1 -- 172.21.15.62:0/2501025130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc02b560 con 0x55be93412200 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.365+0000 7f61b3fff640 1 -- 172.21.15.62:0/2501025130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc02b700 con 0x55be93412200 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.365+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be93419f60 con 0x55be93412200 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.365+0000 7f61b3fff640 1 -- 172.21.15.62:0/2501025130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc0133b0 con 0x55be93412200 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.365+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9341cc10 con 0x55be93412200 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f61b3fff640 1 -- 172.21.15.62:0/2501025130 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f62dc04ebe0 con 0x55be93412200 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f61b3fff640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61ac036eb0 0x7f61ac039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f61b3fff640 1 -- 172.21.15.62:0/2501025130 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f62dc00e040 con 0x55be93412200 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f62e27d1640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61ac036eb0 0x7f61ac039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f62e27d1640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61ac036eb0 0x7f61ac039370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55be933f1440 tx=0x7f62d4089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be934254c0 0x55be93427980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934280d0 con 0x55be934254c0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.366+0000 7f62e1fd0640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be934254c0 0x55be93427980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e1fd0640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be934254c0 0x55be93427980 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62d8009050 con 0x55be934254c0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e6b33800 20 realm 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93424910 con 0x55be934254c0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62d8009050 con 0x55be934254c0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e6b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.367+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93428bc0 con 0x55be934254c0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62d8009050 con 0x55be934254c0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93429490 con 0x55be934254c0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62d8009050 con 0x55be934254c0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e6b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be93429eb0 0x55be9342c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be9342c990 con 0x55be93429eb0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.368+0000 7f62e2fd2640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be93429eb0 0x55be9342c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.369+0000 7f62e2fd2640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be93429eb0 0x55be9342c2a0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.369+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.369+0000 7f62e6b33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:56.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.369+0000 7f62e6b33800 20 searching for the correct realm 2024-04-26T07:54:56.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.369+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55be9342e960 0x55be93430e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.369+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.369+0000 7f62e27d1640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55be9342e960 0x55be93430e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.369+0000 7f62e27d1640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55be9342e960 0x55be93430e20 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.370+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.370+0000 7f62e27d1640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f62d409c040 0x7f62d408e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.370+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x7f62d409c040 2024-04-26T07:54:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.370+0000 7f62e1fd0640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f62d409c040 0x7f62d408e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.370+0000 7f62e1fd0640 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f62d409c040 0x7f62d408e9d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.370+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8009050 con 0x7f62d409c040 2024-04-26T07:54:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.371+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.371+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.371+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be934254c0 2024-04-26T07:54:56.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.371+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8009050 con 0x55be934254c0 2024-04-26T07:54:56.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.371+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be934254c0 2024-04-26T07:54:56.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.371+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.371+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.372+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.372+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.372+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.372+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x7f62d409c040 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.372+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8029040 con 0x7f62d409c040 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.372+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.372+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.372+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be934254c0 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.373+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.373+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.373+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.373+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be934254c0 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.373+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.373+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x7f62d409c040 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.373+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f62d8029040 con 0x7f62d409c040 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.374+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.374+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.374+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.374+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.374+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.374+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.374+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.375+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.375+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.375+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.375+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be934254c0 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.375+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.375+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be934254c0 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.375+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.375+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.376+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.376+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.376+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.376+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x7f62d409c040 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.376+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8029040 con 0x7f62d409c040 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.376+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be934254c0 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.376+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.376+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.377+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.377+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.377+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.377+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.377+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.377+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x7f62d409c040 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.377+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8029040 con 0x7f62d409c040 2024-04-26T07:54:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.377+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be9342e960 2024-04-26T07:54:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.378+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.378+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be93429eb0 2024-04-26T07:54:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.378+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.378+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x55be934254c0 2024-04-26T07:54:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.378+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.378+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55be934314f0 con 0x7f62d409c040 2024-04-26T07:54:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d8029040 con 0x7f62d409c040 2024-04-26T07:54:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be9342d350 con 0x55be934254c0 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be9342cf90 con 0x55be934254c0 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be9342dcf0 con 0x55be934254c0 2024-04-26T07:54:56.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f62d8029040 con 0x55be934254c0 2024-04-26T07:54:56.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:56.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.379+0000 7f62e6b33800 20 zone default found 2024-04-26T07:54:56.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 4 Realm: () 2024-04-26T07:54:56.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:56.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 zonegroup default 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93431970 con 0x55be93429eb0 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93433c20 con 0x55be9342e960 2024-04-26T07:54:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93433fc0 con 0x55be9342e960 2024-04-26T07:54:56.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 started sync module instance, tier type = 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.380+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934330b0 con 0x7f62d409c040 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.381+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.382+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94277002802608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934330b0 con 0x7f62d409c040 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.382+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93434a30 con 0x55be934254c0 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.383+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94277002802608] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.383+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.383+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94277002806528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934330b0 con 0x55be934254c0 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.383+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934354a0 con 0x55be9342e960 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.384+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94277002806528] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.384+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.384+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94277002800128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93433020 con 0x55be9342e960 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.384+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93436360 con 0x7f62d409c040 2024-04-26T07:54:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.385+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94277002800128] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.385+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.385+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94277002813104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934362d0 con 0x7f62d409c040 2024-04-26T07:54:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.385+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93437120 con 0x55be934254c0 2024-04-26T07:54:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.386+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.386+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94277002816512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93437120 con 0x55be934254c0 2024-04-26T07:54:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.386+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93438060 con 0x55be93429eb0 2024-04-26T07:54:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.386+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94277002813104] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.387+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94277002816512] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.387+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.387+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94277002818832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93436720 con 0x55be93429eb0 2024-04-26T07:54:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.387+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93438900 con 0x55be93429eb0 2024-04-26T07:54:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.389+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94277002818832] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.389+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.389+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94277002820400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93438900 con 0x55be93429eb0 2024-04-26T07:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.389+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93439300 con 0x55be93429eb0 2024-04-26T07:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94277002820400] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94277002825232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93439270 con 0x55be93429eb0 2024-04-26T07:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e6b33800 20 add_watcher() i=0 2024-04-26T07:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e6b33800 20 add_watcher() i=1 2024-04-26T07:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e6b33800 20 add_watcher() i=2 2024-04-26T07:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e6b33800 20 add_watcher() i=3 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e6b33800 20 add_watcher() i=4 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e6b33800 20 add_watcher() i=5 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.390+0000 7f62e6b33800 20 add_watcher() i=6 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.391+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94277002825232] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.391+0000 7f62e6b33800 20 add_watcher() i=7 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.391+0000 7f62e6b33800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.391+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93438450 con 0x55be934254c0 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.392+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.392+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94277002827504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93438450 con 0x55be934254c0 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.393+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94277002827504] v27'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.393+0000 7f6198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.393+0000 7f62e6b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.393+0000 7f62e6b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.393+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93445410 con 0x55be934254c0 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.394+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.394+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93445a60 con 0x55be93429eb0 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.396+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.396+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93445a60 con 0x55be9342e960 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.397+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.397+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93446330 con 0x55be934254c0 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.398+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'158 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.398+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93441020 con 0x7f62d409c040 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.399+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.399+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93441020 con 0x55be9342e960 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.400+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.400+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93446e70 con 0x55be934254c0 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.401+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.401+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93446e70 con 0x55be93429eb0 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.402+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.402+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93446f70 con 0x7f62d409c040 2024-04-26T07:54:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.403+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.403+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93446f70 con 0x55be9342e960 2024-04-26T07:54:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.404+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.404+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93446f70 con 0x7f62d409c040 2024-04-26T07:54:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.405+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.405+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93446f70 con 0x55be93429eb0 2024-04-26T07:54:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.406+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.406+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93446f70 con 0x7f62d409c040 2024-04-26T07:54:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.407+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.407+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be93429eb0 2024-04-26T07:54:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.409+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'39 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.409+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be934254c0 2024-04-26T07:54:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.410+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.410+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.411+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.411+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x7f62d409c040 2024-04-26T07:54:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.412+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.412+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.413+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.413+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be934254c0 2024-04-26T07:54:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.414+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'28 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.414+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be934254c0 2024-04-26T07:54:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.415+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.415+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.416+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.417+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x7f62d409c040 2024-04-26T07:54:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.417+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.417+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.418+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.418+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.419+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.419+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.420+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.420+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.421+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.421+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be93429eb0 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.423+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.423+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.424+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.424+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be93429eb0 2024-04-26T07:54:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.425+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.425+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be9342e960 2024-04-26T07:54:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.426+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.426+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x55be93429eb0 2024-04-26T07:54:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.427+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'40 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.427+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93447850 con 0x7f62d409c040 2024-04-26T07:54:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.428+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.429+0000 7f61137fe640 20 reqs_thread_entry: start 2024-04-26T07:54:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.429+0000 7f62e6b33800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.429+0000 7f62e6b33800 20 Filter name: none 2024-04-26T07:54:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.429+0000 7f61117fa640 20 reqs_thread_entry: start 2024-04-26T07:54:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.429+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-04-26T07:54:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.429+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:94 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.430+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(94 gc.1 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.430+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:95 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.430+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(95 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.430+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.430+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:96 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.431+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(96 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.431+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.431+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.431+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.431+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.431+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(98 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.431+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.431+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.432+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(99 gc.1 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.432+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-04-26T07:54:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.432+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.433+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(100 gc.2 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.433+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(101 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(102 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:103 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(103 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:104 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(104 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.434+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:105 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.435+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 31 ==== osd_op_reply(105 gc.2 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.435+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-04-26T07:54:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.435+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:106 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.436+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(106 gc.3 [call] v27'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.436+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:107 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.436+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(107 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:108 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(108 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:109 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(109 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:110 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(110 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.437+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:111 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.438+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(111 gc.3 [call] v27'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.438+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-04-26T07:54:56.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.438+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:112 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.439+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(112 gc.4 [call] v27'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.439+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:113 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(113 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:114 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(114 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:115 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(115 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:116 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(116 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.440+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:117 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.441+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(117 gc.4 [call] v27'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.441+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.441+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:118 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.442+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 32 ==== osd_op_reply(118 gc.5 [call] v27'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.442+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:119 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 33 ==== osd_op_reply(119 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:120 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 34 ==== osd_op_reply(120 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:121 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 35 ==== osd_op_reply(121 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:122 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 36 ==== osd_op_reply(122 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.443+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:123 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.444+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 37 ==== osd_op_reply(123 gc.5 [call] v27'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.444+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-04-26T07:54:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.444+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:124 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.445+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(124 gc.6 [call] v27'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.445+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:125 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(125 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:126 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(126 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:127 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(127 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:128 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 38 ==== osd_op_reply(128 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.446+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:129 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.447+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 39 ==== osd_op_reply(129 gc.6 [call] v27'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.447+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-04-26T07:54:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.448+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:130 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.448+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(130 gc.7 [call] v27'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.448+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:131 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.449+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== osd_op_reply(131 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.449+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.449+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:132 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.449+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== osd_op_reply(132 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.449+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:133 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.449+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(133 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.449+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.449+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:134 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.450+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(134 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.450+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.450+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:135 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.450+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== osd_op_reply(135 gc.7 [call] v27'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.450+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.450+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:136 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.451+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(136 gc.8 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.451+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:137 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.452+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(137 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.452+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.452+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:138 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.452+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(138 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.452+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:139 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.452+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(139 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.452+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.452+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:140 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.453+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(140 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.453+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.453+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:141 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.453+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(141 gc.8 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.453+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-04-26T07:54:56.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.453+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:142 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.454+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 38 ==== osd_op_reply(142 gc.9 [call] v27'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.454+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:143 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.455+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 39 ==== osd_op_reply(143 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.455+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.455+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:144 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.455+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 40 ==== osd_op_reply(144 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.455+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:145 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.455+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 41 ==== osd_op_reply(145 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.455+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.455+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:146 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.456+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 42 ==== osd_op_reply(146 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.456+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.456+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:147 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.457+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 43 ==== osd_op_reply(147 gc.9 [call] v27'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.457+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.457+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:148 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(148 gc.10 [call] v27'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:149 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(149 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:150 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 32 ==== osd_op_reply(150 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:151 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 33 ==== osd_op_reply(151 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.458+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:152 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.459+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 34 ==== osd_op_reply(152 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.459+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.459+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:153 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.460+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 35 ==== osd_op_reply(153 gc.10 [call] v27'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.460+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.460+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:154 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.461+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(154 gc.11 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.461+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:155 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.461+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== osd_op_reply(155 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.461+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.461+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:156 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.461+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== osd_op_reply(156 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.461+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:157 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.462+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(157 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.462+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.462+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:158 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.462+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 41 ==== osd_op_reply(158 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.462+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.462+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:159 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.463+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 42 ==== osd_op_reply(159 gc.11 [call] v27'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.463+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.463+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:160 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.464+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 36 ==== osd_op_reply(160 gc.12 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.464+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:161 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.464+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 37 ==== osd_op_reply(161 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.464+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.464+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:162 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.464+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 38 ==== osd_op_reply(162 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.464+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:163 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.465+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 39 ==== osd_op_reply(163 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.465+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.465+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:164 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.465+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 40 ==== osd_op_reply(164 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.465+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.465+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:165 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.466+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 41 ==== osd_op_reply(165 gc.12 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.466+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.466+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:166 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.467+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 43 ==== osd_op_reply(166 gc.13 [call] v27'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.467+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:167 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.468+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 44 ==== osd_op_reply(167 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.468+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.468+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:168 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.468+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 45 ==== osd_op_reply(168 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.468+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:169 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.468+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 46 ==== osd_op_reply(169 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.468+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.468+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:170 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.469+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 47 ==== osd_op_reply(170 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.469+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.469+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:171 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be93429eb0 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.470+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 48 ==== osd_op_reply(171 gc.13 [call] v27'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.470+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-04-26T07:54:56.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.470+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:172 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.471+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 40 ==== osd_op_reply(172 gc.14 [call] v27'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.471+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:173 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.471+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 41 ==== osd_op_reply(173 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.471+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.471+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:174 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.472+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 42 ==== osd_op_reply(174 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.472+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:175 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.472+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 43 ==== osd_op_reply(175 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.472+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.472+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:176 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.472+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 44 ==== osd_op_reply(176 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.472+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.472+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:177 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.473+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 45 ==== osd_op_reply(177 gc.14 [call] v27'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.473+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-04-26T07:54:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.473+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:178 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 44 ==== osd_op_reply(178 gc.15 [call] v27'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:179 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 45 ==== osd_op_reply(179 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:180 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 46 ==== osd_op_reply(180 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:181 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 47 ==== osd_op_reply(181 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.475+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:182 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.476+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 48 ==== osd_op_reply(182 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.476+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.476+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:183 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.477+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 49 ==== osd_op_reply(183 gc.15 [call] v27'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.477+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-04-26T07:54:56.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.477+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:184 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 42 ==== osd_op_reply(184 gc.16 [call] v27'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:185 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 43 ==== osd_op_reply(185 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:186 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 44 ==== osd_op_reply(186 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:187 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 45 ==== osd_op_reply(187 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.478+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:188 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.479+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 46 ==== osd_op_reply(188 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.479+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.479+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:189 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x7f62d409c040 2024-04-26T07:54:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.480+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 47 ==== osd_op_reply(189 gc.16 [call] v27'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.480+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-04-26T07:54:56.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.480+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:190 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 50 ==== osd_op_reply(190 gc.17 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:191 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 51 ==== osd_op_reply(191 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:192 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 52 ==== osd_op_reply(192 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:193 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 53 ==== osd_op_reply(193 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.481+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:194 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.482+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 54 ==== osd_op_reply(194 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.482+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.482+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:195 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be9342e960 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.483+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 55 ==== osd_op_reply(195 gc.17 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.483+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.483+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:196 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.484+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 46 ==== osd_op_reply(196 gc.18 [call] v27'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.484+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:197 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.484+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 47 ==== osd_op_reply(197 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.484+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.484+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:198 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.484+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 48 ==== osd_op_reply(198 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.484+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:199 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 49 ==== osd_op_reply(199 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:200 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be934405b0 con 0x55be934254c0 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 50 ==== osd_op_reply(200 gc.18 [call out=1702b] v0'0 uv29 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 20 garbage collection: RGWGC::process iterating over entry tag='8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11683759700354449071', time=2024-04-26T07:54:56.087190+0000, chain.objs.size()=7 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_1 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:201 3.2cs0 3:36e4497e:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93471df0 con 0x55be9342e960 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_2 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:202 3.7s0 3:e29eebc4:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93476c50 con 0x55be9342e960 2024-04-26T07:54:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_3 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:203 3.1es0 3:7a25b737:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_4 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:204 3.1cs0 3:385de848:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be9347c180 con 0x55be934254c0 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_5 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:205 3.34s0 3:2ecf468b:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_6 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:206 3.31s0 3:8f5e45ac:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93480f20 con 0x55be93429eb0 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_7 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.485+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:207 3.3fs0 3:ff44adea:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x7f62d409c040 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.487+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 48 ==== osd_op_reply(207 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_7 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.487+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 51 ==== osd_op_reply(204 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_4 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.488+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 56 ==== osd_op_reply(201 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_1 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.488+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 49 ==== osd_op_reply(203 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_3 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.490+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 57 ==== osd_op_reply(202 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_2 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.490+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 50 ==== osd_op_reply(206 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_6 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.490+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 52 ==== osd_op_reply(205 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1__shadow_.0WPmpOrVUlNlVPb7CKJUAEagJoRzGNx_5 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.490+0000 7f62e6b33800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.490+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:208 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.493+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 53 ==== osd_op_reply(208 gc.18 [call] v27'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.493+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:209 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.496+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 54 ==== osd_op_reply(209 gc.18 [call] v27'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.496+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.496+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:210 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 55 ==== osd_op_reply(210 gc.19 [call] v27'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:211 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 56 ==== osd_op_reply(211 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:212 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 57 ==== osd_op_reply(212 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:213 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 58 ==== osd_op_reply(213 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.497+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:214 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.498+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 59 ==== osd_op_reply(214 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.498+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.498+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:215 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.499+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 60 ==== osd_op_reply(215 gc.19 [call] v27'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.499+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.499+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:216 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.500+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 58 ==== osd_op_reply(216 gc.20 [call] v27'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.500+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:217 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.500+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 59 ==== osd_op_reply(217 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.500+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.500+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:218 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.500+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 60 ==== osd_op_reply(218 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.500+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:219 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.501+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 61 ==== osd_op_reply(219 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.501+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.501+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:220 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.501+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 62 ==== osd_op_reply(220 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.501+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.501+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:221 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.502+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 63 ==== osd_op_reply(221 gc.20 [call] v27'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.502+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.502+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:222 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.503+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 49 ==== osd_op_reply(222 gc.21 [call] v27'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.503+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:223 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.503+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 50 ==== osd_op_reply(223 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.503+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.503+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:224 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.503+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 51 ==== osd_op_reply(224 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.503+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:225 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.504+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 52 ==== osd_op_reply(225 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.504+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.504+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:226 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x7f62d409c040 2024-04-26T07:54:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.504+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 53 ==== osd_op_reply(226 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.504+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.504+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:227 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x7f62d409c040 2024-04-26T07:54:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.505+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 54 ==== osd_op_reply(227 gc.21 [call] v27'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.505+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-04-26T07:54:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.505+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:228 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.506+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 64 ==== osd_op_reply(228 gc.22 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.506+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:229 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.506+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 65 ==== osd_op_reply(229 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.506+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.506+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:230 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.506+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 66 ==== osd_op_reply(230 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.506+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:231 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.507+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 67 ==== osd_op_reply(231 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.507+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.507+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:232 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.507+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 68 ==== osd_op_reply(232 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.507+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.507+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:233 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.508+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 69 ==== osd_op_reply(233 gc.22 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.508+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.508+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:234 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 70 ==== osd_op_reply(234 gc.23 [call] v27'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:235 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 71 ==== osd_op_reply(235 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:236 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 72 ==== osd_op_reply(236 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:237 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 73 ==== osd_op_reply(237 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.509+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:238 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.510+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 74 ==== osd_op_reply(238 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.510+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.510+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:239 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.511+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 75 ==== osd_op_reply(239 gc.23 [call] v27'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.511+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.511+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:240 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.511+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 76 ==== osd_op_reply(240 gc.24 [call] v27'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.511+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:241 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 77 ==== osd_op_reply(241 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:242 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 78 ==== osd_op_reply(242 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:243 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 79 ==== osd_op_reply(243 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:244 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 80 ==== osd_op_reply(244 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.512+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:245 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.513+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 81 ==== osd_op_reply(245 gc.24 [call] v27'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.513+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.513+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:246 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.514+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 82 ==== osd_op_reply(246 gc.25 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.514+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:247 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.514+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 83 ==== osd_op_reply(247 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.514+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.514+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:248 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.515+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 84 ==== osd_op_reply(248 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.515+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:249 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.515+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 85 ==== osd_op_reply(249 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.515+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.515+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:250 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.515+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 86 ==== osd_op_reply(250 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.515+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.515+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:251 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.516+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 87 ==== osd_op_reply(251 gc.25 [call] v27'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.516+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.516+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:252 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.517+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 51 ==== osd_op_reply(252 gc.26 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.517+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:253 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.517+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 52 ==== osd_op_reply(253 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:254 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 53 ==== osd_op_reply(254 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:255 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 54 ==== osd_op_reply(255 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:256 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 55 ==== osd_op_reply(256 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.518+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:257 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.519+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 56 ==== osd_op_reply(257 gc.26 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.519+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.519+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:258 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.520+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 88 ==== osd_op_reply(258 gc.27 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.520+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:259 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 89 ==== osd_op_reply(259 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:260 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 90 ==== osd_op_reply(260 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:261 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 91 ==== osd_op_reply(261 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:262 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 92 ==== osd_op_reply(262 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.521+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:263 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be9342e960 2024-04-26T07:54:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.522+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 93 ==== osd_op_reply(263 gc.27 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.522+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-04-26T07:54:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.522+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:264 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.524+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 57 ==== osd_op_reply(264 gc.28 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.524+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:265 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.524+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 58 ==== osd_op_reply(265 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.524+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.524+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:266 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93479780 con 0x55be93429eb0 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.524+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 59 ==== osd_op_reply(266 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.524+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:267 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be93429eb0 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.525+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 60 ==== osd_op_reply(267 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.525+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.525+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:268 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be93429eb0 2024-04-26T07:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.525+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 61 ==== osd_op_reply(268 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.525+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.526+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:269 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be93429eb0 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.527+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 62 ==== osd_op_reply(269 gc.28 [call] v27'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.527+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.527+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:270 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be9342e960 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.528+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 94 ==== osd_op_reply(270 gc.29 [call] v27'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.528+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:271 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be9342e960 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.528+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 95 ==== osd_op_reply(271 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.528+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.528+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:272 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93477fa0 con 0x55be9342e960 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.528+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 96 ==== osd_op_reply(272 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.528+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:273 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be9342e960 2024-04-26T07:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.529+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 97 ==== osd_op_reply(273 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.529+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.529+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:274 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be9342e960 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.529+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 98 ==== osd_op_reply(274 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.529+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.529+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:275 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be9342e960 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.530+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 99 ==== osd_op_reply(275 gc.29 [call] v27'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.530+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.530+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:276 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be93429eb0 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.531+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 63 ==== osd_op_reply(276 gc.30 [call] v27'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.531+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:277 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be93429eb0 2024-04-26T07:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.531+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 64 ==== osd_op_reply(277 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.531+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.531+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:278 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93477fa0 con 0x55be93429eb0 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.532+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 65 ==== osd_op_reply(278 gc.30 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.532+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:279 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be93429eb0 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.532+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 66 ==== osd_op_reply(279 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.532+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.532+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:280 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be93429eb0 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.532+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 67 ==== osd_op_reply(280 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.532+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.532+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:281 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be93429eb0 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.533+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 68 ==== osd_op_reply(281 gc.30 [call] v27'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.533+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.533+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:282 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x7f62d409c040 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.534+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 55 ==== osd_op_reply(282 gc.31 [call] v27'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.534+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:283 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x7f62d409c040 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.534+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 56 ==== osd_op_reply(283 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.534+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.534+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:284 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93477fa0 con 0x7f62d409c040 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.535+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 57 ==== osd_op_reply(284 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.535+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:285 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93477fa0 con 0x7f62d409c040 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.535+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 58 ==== osd_op_reply(285 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.535+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.535+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:286 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93477fa0 con 0x7f62d409c040 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.535+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 59 ==== osd_op_reply(286 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.535+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.535+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:287 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x7f62d409c040 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.536+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 60 ==== osd_op_reply(287 gc.31 [call] v27'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.536+0000 7f62e6b33800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.536+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:288 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be934254c0 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 61 ==== osd_op_reply(288 gc.0 [call] v27'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:289 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be934254c0 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 62 ==== osd_op_reply(289 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:290 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93477fa0 con 0x55be934254c0 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 63 ==== osd_op_reply(290 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:291 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be934254c0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 64 ==== osd_op_reply(291 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.538+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:292 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be934254c0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.539+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 65 ==== osd_op_reply(292 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.539+0000 7f62e6b33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.539+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:293 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93478fb0 con 0x55be934254c0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.540+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 66 ==== osd_op_reply(293 gc.0 [call] v27'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.540+0000 7f6198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.540+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94277002827504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934710a0 con 0x55be934254c0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.541+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 67 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94277002827504] v27'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.541+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94277002802608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934396f0 con 0x7f62d409c040 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.542+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94277002802608] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.542+0000 7f62e6b33800 20 remove_watcher() i=0 2024-04-26T07:54:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.542+0000 7f62e6b33800 2 removed watcher, disabling cache 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.542+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94277002806528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934335b0 con 0x55be934254c0 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.543+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 68 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94277002806528] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.543+0000 7f62e6b33800 20 remove_watcher() i=1 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.543+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94277002800128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934335b0 con 0x55be9342e960 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.544+0000 7f62e27d1640 1 -- 172.21.15.62:0/2501025130 <== osd.3 v2:172.21.15.62:6816/1472283839 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94277002800128] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4075030 con 0x55be9342e960 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.544+0000 7f62e6b33800 20 remove_watcher() i=2 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.544+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94277002813104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934335b0 con 0x7f62d409c040 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.545+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.2 v2:172.21.15.62:6808/1138534927 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94277002813104] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x7f62d409c040 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.545+0000 7f62e6b33800 20 remove_watcher() i=3 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.545+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94277002816512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93435eb0 con 0x55be934254c0 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.546+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 <== osd.1 v2:172.21.15.62:6800/1888558046 69 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94277002816512] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d8039040 con 0x55be934254c0 2024-04-26T07:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.546+0000 7f62e6b33800 20 remove_watcher() i=4 2024-04-26T07:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.546+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94277002818832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be934335b0 con 0x55be93429eb0 2024-04-26T07:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.547+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94277002818832] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.547+0000 7f62e6b33800 20 remove_watcher() i=5 2024-04-26T07:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.547+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94277002820400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93436c00 con 0x55be93429eb0 2024-04-26T07:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.548+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94277002820400] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.549+0000 7f62e6b33800 20 remove_watcher() i=6 2024-04-26T07:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.549+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94277002825232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55be93436c00 con 0x55be93429eb0 2024-04-26T07:54:56.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e2fd2640 1 -- 172.21.15.62:0/2501025130 <== osd.0 v2:172.21.15.1:6800/3827982423 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94277002825232] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x55be93429eb0 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 20 remove_watcher() i=7 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be93429eb0 msgr2=0x55be9342c2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be93429eb0 0x55be9342c2a0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be934254c0 msgr2=0x55be93427980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be934254c0 0x55be93427980 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f62d409c040 msgr2=0x7f62d408e9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f62d409c040 0x7f62d408e9d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55be9342e960 msgr2=0x55be93430e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55be9342e960 0x55be93430e20 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61ac036eb0 msgr2=0x7f61ac039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61ac036eb0 0x7f61ac039370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55be933f1440 tx=0x7f62d4089000 comp rx=0 tx=0).stop 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e1fd0640 1 -- 172.21.15.62:0/2501025130 reap_dead start 2024-04-26T07:54:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 msgr2=0x55be93419790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93419790 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f62dc048010 tx=0x7f62dc04ce60 comp rx=0 tx=0).stop 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 shutdown_connections 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/2501025130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93412200 0x55be93419790 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 >> 172.21.15.62:0/2501025130 conn(0x55be9340e560 msgr2=0x55be9340bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 shutdown_connections 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/2501025130 wait complete. 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/3369057023 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61bc036eb0 msgr2=0x7f61bc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/3369057023 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61bc036eb0 0x7f61bc039370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f62d405b4b0 tx=0x7f62d40528e0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/3369057023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93404f40 msgr2=0x55be93405360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/3369057023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93404f40 0x55be93405360 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55be933eaa90 tx=0x7f62dc0188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/3369057023 shutdown_connections 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/3369057023 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61bc036eb0 0x7f61bc039370 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 --2- 172.21.15.62:0/3369057023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be93404f40 0x55be93405360 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/3369057023 >> 172.21.15.62:0/3369057023 conn(0x55be933f8fe0 msgr2=0x55be933f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/3369057023 shutdown_connections 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.550+0000 7f62e6b33800 1 -- 172.21.15.62:0/3369057023 wait complete. 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be933f3300 msgr2=0x55be933f56f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be933f3300 0x55be933f56f0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be932ed8f0 msgr2=0x55be933f0ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be932ed8f0 0x55be933f0ab0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61c8036e60 msgr2=0x7f61c8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61c8036e60 0x7f61c8039320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f62d8000f60 tx=0x7f62d80010a0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 msgr2=0x55be933e98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e98c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f62d401baa0 tx=0x7f62d4003020 comp rx=0 tx=0).stop 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 shutdown_connections 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55be932ed8f0 0x55be933f0ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55be933f3300 0x55be933f56f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f61c8036e60 0x7f61c8039320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 --2- 172.21.15.62:0/1075863338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55be932ecf90 0x55be933e98c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 >> 172.21.15.62:0/1075863338 conn(0x55be932e8b70 msgr2=0x55be933dbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 shutdown_connections 2024-04-26T07:54:56.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.551+0000 7f62e6b33800 1 -- 172.21.15.62:0/1075863338 wait complete. 2024-04-26T07:54:56.562 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-26T07:54:56.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-26T07:54:56.563 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-26T07:54:56.641 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:56.641 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.644+0000 7f2989333800 1 Processor -- start 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.644+0000 7f2989333800 1 -- start start 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.644+0000 7f2989333800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f3999a3ae0 0x55f3999a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.644+0000 7f2989333800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3999a64a0 con 0x55f39999f740 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.644+0000 7f2989333800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55f399841e20 con 0x55f3999a3ae0 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.645+0000 7f29847d0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f3999a3ae0 0x55f3999a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.645+0000 7f29847d0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f3999a3ae0 0x55f3999a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57000/0 (socket says 172.21.15.62:57000) 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.645+0000 7f29847d0640 1 -- 172.21.15.62:0/4029797157 learned_addr learned my addr 172.21.15.62:0/4029797157 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.645+0000 7f2984fd1640 1 --1- 172.21.15.62:0/4029797157 >> v1:172.21.15.1:6789/0 conn(0x55f39999f740 0x55f39999fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:35928/0 (socket says 172.21.15.62:35928) 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.645+0000 7f29847d0640 1 -- 172.21.15.62:0/4029797157 >> v1:172.21.15.1:6789/0 conn(0x55f39999f740 legacy=0x55f39999fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.645+0000 7f29847d0640 1 -- 172.21.15.62:0/4029797157 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3999a76d0 con 0x55f3999a3ae0 2024-04-26T07:54:56.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f29847d0640 1 --2- 172.21.15.62:0/4029797157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f3999a3ae0 0x55f3999a5ed0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f297800a520 tx=0x7f297801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9622f51949bd187 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2983fcf640 1 -- 172.21.15.62:0/4029797157 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2978057070 con 0x55f3999a3ae0 2024-04-26T07:54:56.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2983fcf640 1 -- 172.21.15.62:0/4029797157 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2978052570 con 0x55f3999a3ae0 2024-04-26T07:54:56.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2983fcf640 1 -- 172.21.15.62:0/4029797157 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297804ae60 con 0x55f3999a3ae0 2024-04-26T07:54:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2989333800 1 -- 172.21.15.62:0/4029797157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f3999a3ae0 msgr2=0x55f3999a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2989333800 1 --2- 172.21.15.62:0/4029797157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f3999a3ae0 0x55f3999a5ed0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f297800a520 tx=0x7f297801d010 comp rx=0 tx=0).stop 2024-04-26T07:54:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2989333800 1 -- 172.21.15.62:0/4029797157 shutdown_connections 2024-04-26T07:54:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2989333800 1 --2- 172.21.15.62:0/4029797157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f3999a3ae0 0x55f3999a5ed0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2989333800 1 -- 172.21.15.62:0/4029797157 >> 172.21.15.62:0/4029797157 conn(0x55f39999ad20 msgr2=0x55f39999d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2989333800 1 -- 172.21.15.62:0/4029797157 shutdown_connections 2024-04-26T07:54:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.647+0000 7f2989333800 1 -- 172.21.15.62:0/4029797157 wait complete. 2024-04-26T07:54:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.660+0000 7f2989333800 1 Processor -- start 2024-04-26T07:54:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.660+0000 7f2989333800 1 -- start start 2024-04-26T07:54:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.660+0000 7f2989333800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a90c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.660+0000 7f2989333800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f3998eacd0 con 0x55f39999f740 2024-04-26T07:54:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.661+0000 7f2984fd1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a90c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.661+0000 7f2984fd1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a90c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57008/0 (socket says 172.21.15.62:57008) 2024-04-26T07:54:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.661+0000 7f2984fd1640 1 -- 172.21.15.62:0/3997613968 learned_addr learned my addr 172.21.15.62:0/3997613968 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.661+0000 7f2984fd1640 1 -- 172.21.15.62:0/3997613968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f399a911d0 con 0x55f39999f740 2024-04-26T07:54:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.661+0000 7f2984fd1640 1 --2- 172.21.15.62:0/3997613968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a90c00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2974001e40 tx=0x7f2974001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9277d1e7270e438e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.661+0000 7f2872e0d640 1 -- 172.21.15.62:0/3997613968 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297400e5c0 con 0x55f39999f740 2024-04-26T07:54:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.661+0000 7f2872e0d640 1 -- 172.21.15.62:0/3997613968 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2974006070 con 0x55f39999f740 2024-04-26T07:54:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.661+0000 7f2872e0d640 1 -- 172.21.15.62:0/3997613968 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297400e910 con 0x55f39999f740 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 -- 172.21.15.62:0/3997613968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 msgr2=0x55f399a90c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 --2- 172.21.15.62:0/3997613968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a90c00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2974001e40 tx=0x7f2974001e70 comp rx=0 tx=0).stop 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 -- 172.21.15.62:0/3997613968 shutdown_connections 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 --2- 172.21.15.62:0/3997613968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a90c00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 -- 172.21.15.62:0/3997613968 >> 172.21.15.62:0/3997613968 conn(0x55f39999ad20 msgr2=0x55f399a8c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 -- 172.21.15.62:0/3997613968 shutdown_connections 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 -- 172.21.15.62:0/3997613968 wait complete. 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 Processor -- start 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 -- start start 2024-04-26T07:54:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a98810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.662+0000 7f2989333800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f3999a6970 con 0x55f39999f740 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f2984fd1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a98810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f2984fd1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a98810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57012/0 (socket says 172.21.15.62:57012) 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f2984fd1640 1 -- 172.21.15.62:0/600401988 learned_addr learned my addr 172.21.15.62:0/600401988 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f2984fd1640 1 -- 172.21.15.62:0/600401988 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f399a98d50 con 0x55f39999f740 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f2984fd1640 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a98810 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2974004000 tx=0x7f2974000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f287160a640 1 -- 172.21.15.62:0/600401988 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297401a7c0 con 0x55f39999f740 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f287160a640 1 -- 172.21.15.62:0/600401988 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297401a960 con 0x55f39999f740 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f287160a640 1 -- 172.21.15.62:0/600401988 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297401acc0 con 0x55f39999f740 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f399a98fe0 con 0x55f39999f740 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.663+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f399a9bc40 con 0x55f39999f740 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.664+0000 7f287160a640 1 -- 172.21.15.62:0/600401988 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2974017070 con 0x55f39999f740 2024-04-26T07:54:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.664+0000 7f287160a640 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f286c036e60 0x7f286c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.664+0000 7f287160a640 1 -- 172.21.15.62:0/600401988 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2974015020 con 0x55f39999f740 2024-04-26T07:54:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.664+0000 7f29847d0640 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f286c036e60 0x7f286c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.665+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f3999a3ae0 0x55f399a9fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.665+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399a9ff90 con 0x55f3999a3ae0 2024-04-26T07:54:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.665+0000 7f29857d2640 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f3999a3ae0 0x55f399a9fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.665+0000 7f29847d0640 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f286c036e60 0x7f286c039320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2978054000 tx=0x7f297804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.665+0000 7f29857d2640 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f3999a3ae0 0x55f399a9fa00 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.665+0000 7f29857d2640 1 -- 172.21.15.62:0/600401988 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297c00a4a0 con 0x55f3999a3ae0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.665+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399a9cfd0 con 0x55f3999a3ae0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.666+0000 7f29857d2640 1 -- 172.21.15.62:0/600401988 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f297c00a4a0 con 0x55f3999a3ae0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.666+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399aa22e0 0x55f399aa46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.666+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399aa4dc0 con 0x55f399aa22e0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.666+0000 7f2984fd1640 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399aa22e0 0x55f399aa46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.666+0000 7f2984fd1640 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399aa22e0 0x55f399aa46d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.667+0000 7f2984fd1640 1 -- 172.21.15.62:0/600401988 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f297402e070 con 0x55f399aa22e0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.667+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399aa1290 con 0x55f3999a3ae0 2024-04-26T07:54:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.667+0000 7f29857d2640 1 -- 172.21.15.62:0/600401988 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f297c00a4a0 con 0x55f3999a3ae0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.667+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399aa1770 con 0x55f3999a3ae0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.667+0000 7f29857d2640 1 -- 172.21.15.62:0/600401988 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f297c00a4a0 con 0x55f3999a3ae0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.667+0000 7f2989333800 1 Processor -- start 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f2989333800 1 -- start start 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f2989333800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ab3ec0 0x55f399ab42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f2989333800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f399892170 con 0x55f399ab3ec0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f29857d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ab3ec0 0x55f399ab42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f29857d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ab3ec0 0x55f399ab42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57014/0 (socket says 172.21.15.62:57014) 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f29857d2640 1 -- 172.21.15.62:0/3889633770 learned_addr learned my addr 172.21.15.62:0/3889633770 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f29857d2640 1 -- 172.21.15.62:0/3889633770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f399ab4820 con 0x55f399ab3ec0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f29857d2640 1 --2- 172.21.15.62:0/3889633770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ab3ec0 0x55f399ab42e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55f399aa0390 tx=0x7f297c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f286a7fc640 1 -- 172.21.15.62:0/3889633770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c014450 con 0x55f399ab3ec0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f286a7fc640 1 -- 172.21.15.62:0/3889633770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c014610 con 0x55f399ab3ec0 2024-04-26T07:54:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f286a7fc640 1 -- 172.21.15.62:0/3889633770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c014930 con 0x55f399ab3ec0 2024-04-26T07:54:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.668+0000 7f2989333800 1 -- 172.21.15.62:0/3889633770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f399ab5290 con 0x55f399ab3ec0 2024-04-26T07:54:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.669+0000 7f2989333800 1 -- 172.21.15.62:0/3889633770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f399ab5790 con 0x55f399ab3ec0 2024-04-26T07:54:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.669+0000 7f286a7fc640 1 -- 172.21.15.62:0/3889633770 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f297c011040 con 0x55f399ab3ec0 2024-04-26T07:54:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.669+0000 7f286a7fc640 1 --2- 172.21.15.62:0/3889633770 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f285c036eb0 0x7f285c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.669+0000 7f286a7fc640 1 -- 172.21.15.62:0/3889633770 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f297c01e070 con 0x55f399ab3ec0 2024-04-26T07:54:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.669+0000 7f2984fd1640 1 --2- 172.21.15.62:0/3889633770 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f285c036eb0 0x7f285c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f2989333800 1 Processor -- start 2024-04-26T07:54:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f2984fd1640 1 --2- 172.21.15.62:0/3889633770 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f285c036eb0 0x7f285c039370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55f399aa0430 tx=0x7f2974041040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f2989333800 1 -- start start 2024-04-26T07:54:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f2989333800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f2989333800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f399a91550 con 0x55f399ac1140 2024-04-26T07:54:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f29857d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f29857d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57026/0 (socket says 172.21.15.62:57026) 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f29857d2640 1 -- 172.21.15.62:0/3580825775 learned_addr learned my addr 172.21.15.62:0/3580825775 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f29857d2640 1 -- 172.21.15.62:0/3580825775 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f399ac1b30 con 0x55f399ac1140 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.670+0000 7f29857d2640 1 --2- 172.21.15.62:0/3580825775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac1560 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f297c04cf20 tx=0x7f297c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd9253c34d37ab4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f285bfff640 1 -- 172.21.15.62:0/3580825775 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c03d050 con 0x55f399ac1140 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f285bfff640 1 -- 172.21.15.62:0/3580825775 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c00dd90 con 0x55f399ac1140 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f285bfff640 1 -- 172.21.15.62:0/3580825775 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c016910 con 0x55f399ac1140 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 -- 172.21.15.62:0/3580825775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 msgr2=0x55f399ac1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 --2- 172.21.15.62:0/3580825775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac1560 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f297c04cf20 tx=0x7f297c011ef0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 -- 172.21.15.62:0/3580825775 shutdown_connections 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 --2- 172.21.15.62:0/3580825775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac1560 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 -- 172.21.15.62:0/3580825775 >> 172.21.15.62:0/3580825775 conn(0x55f399abd4a0 msgr2=0x55f399abb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 -- 172.21.15.62:0/3580825775 shutdown_connections 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 -- 172.21.15.62:0/3580825775 wait complete. 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 Processor -- start 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.671+0000 7f2989333800 1 -- start start 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f2989333800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f2989333800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f399ac22a0 con 0x55f399ac1140 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f29857d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f29857d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57034/0 (socket says 172.21.15.62:57034) 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 learned_addr learned my addr 172.21.15.62:0/2381719848 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f399ac8c60 con 0x55f399ac1140 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f29857d2640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac8720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f297c048010 tx=0x7f297c04ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f285a7fc640 1 -- 172.21.15.62:0/2381719848 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c03b070 con 0x55f399ac1140 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f285a7fc640 1 -- 172.21.15.62:0/2381719848 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c0135c0 con 0x55f399ac1140 2024-04-26T07:54:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f399ac8ef0 con 0x55f399ac1140 2024-04-26T07:54:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f285a7fc640 1 -- 172.21.15.62:0/2381719848 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c04e390 con 0x55f399ac1140 2024-04-26T07:54:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.672+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f399acbba0 con 0x55f399ac1140 2024-04-26T07:54:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.673+0000 7f285a7fc640 1 -- 172.21.15.62:0/2381719848 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f297c046d10 con 0x55f399ac1140 2024-04-26T07:54:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.673+0000 7f285a7fc640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2850036eb0 0x7f2850039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.673+0000 7f285a7fc640 1 -- 172.21.15.62:0/2381719848 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f297c033070 con 0x55f399ac1140 2024-04-26T07:54:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2984fd1640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2850036eb0 0x7f2850039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f399ad4380 0x55f399ad6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399ad6f90 con 0x55f399ad4380 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f29847d0640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f399ad4380 0x55f399ad6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2984fd1640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2850036eb0 0x7f2850039370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f297401be30 tx=0x7f2974031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f29847d0640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f399ad4380 0x55f399ad6840 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2989333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2989333800 20 realm 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.674+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399ad7360 con 0x55f399ad4380 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:56.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399ad7c30 con 0x55f399ad4380 2024-04-26T07:54:56.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399ad7fd0 con 0x55f399ad4380 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399ad8ac0 0x55f399adaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399adb5f0 con 0x55f399ad8ac0 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.675+0000 7f29857d2640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399ad8ac0 0x55f399adaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.676+0000 7f29857d2640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399ad8ac0 0x55f399adaeb0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.676+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.676+0000 7f2989333800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.676+0000 7f2989333800 20 searching for the correct realm 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.676+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f399add6a0 0x55f399adfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.676+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.676+0000 7f2984fd1640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f399add6a0 0x55f399adfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.676+0000 7f2984fd1640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f399add6a0 0x55f399adfb60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.677+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.677+0000 7f2984fd1640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f297400f070 0x7f2974017770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.677+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x7f297400f070 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.677+0000 7f29847d0640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f297400f070 0x7f2974017770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.677+0000 7f29847d0640 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f297400f070 0x7f2974017770 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.678+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.678+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.678+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.678+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad4380 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.678+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.678+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad4380 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.679+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.679+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.679+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.679+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.679+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.679+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x7f297400f070 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.679+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.679+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.680+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.680+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad4380 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.680+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.680+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.680+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.680+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad4380 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.680+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.680+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x7f297400f070 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.681+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.681+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.681+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.681+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.681+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.681+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.682+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.682+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.682+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.682+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.682+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.682+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad4380 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.683+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.683+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad4380 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.683+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.683+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.683+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.683+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.684+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.684+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x7f297400f070 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.684+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.684+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad4380 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.684+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.684+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.684+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.684+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.685+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.685+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.685+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.685+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x7f297400f070 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.685+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.685+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399add6a0 2024-04-26T07:54:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad8ac0 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x55f399ad4380 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae0230 con 0x7f297400f070 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2989333800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2989333800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2989333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2989333800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2989333800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2989333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.686+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399adc0a0 con 0x55f399ad4380 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399adc4c0 con 0x55f399ad4380 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399adc9a0 con 0x55f399ad4380 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 20 zone default found 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 4 Realm: () 2024-04-26T07:54:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 20 zonegroup default 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.687+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae06b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae28e0 con 0x55f399add6a0 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae2c80 con 0x55f399add6a0 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 20 started sync module instance, tier type = 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.688+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae1d20 con 0x7f297400f070 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.689+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.689+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504743739664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae1d20 con 0x7f297400f070 2024-04-26T07:54:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.689+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae3510 con 0x55f399ad4380 2024-04-26T07:54:56.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.690+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504743739664] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.691+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.691+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504743737456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae34d0 con 0x55f399ad4380 2024-04-26T07:54:56.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.691+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae3f70 con 0x55f399add6a0 2024-04-26T07:54:56.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.692+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504743737456] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.693+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.693+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504743743520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae3440 con 0x55f399add6a0 2024-04-26T07:54:56.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.693+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae4d30 con 0x7f297400f070 2024-04-26T07:54:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.694+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504743743520] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.694+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.694+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504743748448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae5120 con 0x7f297400f070 2024-04-26T07:54:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.694+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae5b20 con 0x55f399ad4380 2024-04-26T07:54:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.695+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.695+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504743753264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae5a90 con 0x55f399ad4380 2024-04-26T07:54:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.695+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae6af0 con 0x55f399ad8ac0 2024-04-26T07:54:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.695+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504743748448] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.696+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504743753264] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.696+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.696+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504743755536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae6ab0 con 0x55f399ad8ac0 2024-04-26T07:54:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.696+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7390 con 0x55f399ad8ac0 2024-04-26T07:54:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.697+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(56 notify.6 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.697+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504743759504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7760 con 0x55f399ad8ac0 2024-04-26T07:54:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.697+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7fb0 con 0x55f399ad8ac0 2024-04-26T07:54:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.697+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504743755536] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504743759504] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504743760560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7b80 con 0x55f399ad8ac0 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f2989333800 20 add_watcher() i=0 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f2989333800 20 add_watcher() i=1 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f2989333800 20 add_watcher() i=2 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f2989333800 20 add_watcher() i=3 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f2989333800 20 add_watcher() i=4 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f2989333800 20 add_watcher() i=5 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.698+0000 7f2989333800 20 add_watcher() i=6 2024-04-26T07:54:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.699+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504743760560] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.699+0000 7f2989333800 20 add_watcher() i=7 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.699+0000 7f2989333800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.699+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399aeadd0 con 0x55f399ad4380 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.700+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.700+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504743761984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae8110 con 0x55f399ad4380 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.701+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504743761984] v27'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.701+0000 7f283afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.701+0000 7f2989333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.701+0000 7f2989333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.701+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af3660 con 0x55f399ad4380 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.702+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.702+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af3cf0 con 0x55f399ad8ac0 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.703+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.703+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af3cf0 con 0x55f399add6a0 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.704+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.704+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af4750 con 0x55f399ad4380 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.705+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.705+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af1640 con 0x7f297400f070 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.706+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.706+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af1640 con 0x55f399add6a0 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.707+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.707+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af50a0 con 0x55f399ad4380 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.709+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.709+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af50a0 con 0x55f399ad8ac0 2024-04-26T07:54:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.710+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.710+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af50a0 con 0x7f297400f070 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.711+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.711+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.712+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.712+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x7f297400f070 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.713+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.713+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399ad8ac0 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.714+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.715+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x7f297400f070 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.715+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.715+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399ad8ac0 2024-04-26T07:54:56.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.717+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.717+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399ad4380 2024-04-26T07:54:56.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.718+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.718+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.719+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.719+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x7f297400f070 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.720+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.720+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.721+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.721+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399ad4380 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.722+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.722+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399ad4380 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.723+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.723+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.724+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.724+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x7f297400f070 2024-04-26T07:54:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.725+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.725+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.726+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.726+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.727+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.727+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.728+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.728+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.729+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.729+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399ad8ac0 2024-04-26T07:54:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.730+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.730+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.731+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.731+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399ad8ac0 2024-04-26T07:54:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.732+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.732+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399add6a0 2024-04-26T07:54:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.733+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.733+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x55f399ad8ac0 2024-04-26T07:54:56.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.734+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'46 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.734+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af5670 con 0x7f297400f070 2024-04-26T07:54:56.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.735+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.736+0000 7f2839fe3640 20 reqs_thread_entry: start 2024-04-26T07:54:56.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.736+0000 7f2989333800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:56.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.736+0000 7f2989333800 20 Filter name: none 2024-04-26T07:54:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.736+0000 7f27ab7fe640 20 reqs_thread_entry: start 2024-04-26T07:54:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.736+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.736+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.736+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad4380 2024-04-26T07:54:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.737+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.737+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.737+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.737+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.737+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.737+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad8ac0 2024-04-26T07:54:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.738+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.738+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.738+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.738+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.738+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.738+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.739+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.739+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.739+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.739+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.739+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.739+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad4380 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.739+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.739+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.740+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.740+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.740+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.740+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x7f297400f070 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.740+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.740+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.740+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.740+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.741+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.741+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.741+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.741+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.741+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.741+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.742+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.742+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad4380 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.742+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.742+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.742+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.742+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.743+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.743+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad8ac0 2024-04-26T07:54:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.743+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.743+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.743+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.743+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.743+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.744+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x7f297400f070 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.744+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.744+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.744+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.744+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.744+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.744+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.745+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.745+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.745+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.745+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.745+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.745+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x7f297400f070 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.745+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.745+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.746+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.746+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.746+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.746+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad8ac0 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.747+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.747+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.747+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.747+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.747+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.747+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x7f297400f070 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.748+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.748+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.748+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.748+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.748+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.748+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad8ac0 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.749+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.749+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.749+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.749+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.750+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.750+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad4380 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.750+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.750+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.750+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.750+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.750+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.750+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.751+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.751+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.751+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.751+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.751+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.751+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x7f297400f070 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.751+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.752+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.752+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.752+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.752+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.752+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.752+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.752+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.753+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.753+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.753+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.753+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.753+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.753+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.753+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.753+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.754+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.754+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.754+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.754+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.754+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.754+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.754+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.754+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.755+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.755+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.755+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.755+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.755+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.755+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x7f297400f070 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.755+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.755+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.756+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.756+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.756+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.756+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.756+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.756+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.756+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.756+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.757+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.757+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.757+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.757+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.757+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.757+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.758+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.758+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.758+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.758+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.758+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.758+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.758+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.758+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.759+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.759+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.759+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.759+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.759+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.759+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad8ac0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.760+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.760+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.760+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.760+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.760+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.760+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.760+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.760+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.761+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.761+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.761+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.761+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad8ac0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.761+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.761+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.762+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.762+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.762+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.762+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399add6a0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.762+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.762+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399add6a0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.762+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.762+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.763+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.763+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x55f399ad8ac0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.763+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.763+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x55f399ad8ac0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.763+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.763+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.763+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.763+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b201a0 con 0x7f297400f070 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.764+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.764+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f399b211b0 con 0x7f297400f070 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.764+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.765+0000 7f283afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.765+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504743761984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399af4090 con 0x55f399ad4380 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.766+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94504743761984] v27'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.766+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504743739664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7840 con 0x7f297400f070 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.767+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94504743739664] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.767+0000 7f2989333800 20 remove_watcher() i=0 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.767+0000 7f2989333800 2 removed watcher, disabling cache 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.767+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504743737456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7840 con 0x55f399ad4380 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.768+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94504743737456] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.768+0000 7f2989333800 20 remove_watcher() i=1 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.768+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504743743520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7840 con 0x55f399add6a0 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.769+0000 7f2984fd1640 1 -- 172.21.15.62:0/2381719848 <== osd.3 v2:172.21.15.62:6816/1472283839 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94504743743520] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297402e070 con 0x55f399add6a0 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.769+0000 7f2989333800 20 remove_watcher() i=2 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.769+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504743748448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae3020 con 0x7f297400f070 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.770+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.2 v2:172.21.15.62:6808/1138534927 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94504743748448] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x7f297400f070 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.770+0000 7f2989333800 20 remove_watcher() i=3 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.770+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504743753264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7840 con 0x55f399ad4380 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.771+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 <== osd.1 v2:172.21.15.62:6800/1888558046 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94504743753264] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297805a040 con 0x55f399ad4380 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.771+0000 7f2989333800 20 remove_watcher() i=4 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.771+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504743755536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae4360 con 0x55f399ad8ac0 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.772+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94504743755536] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.772+0000 7f2989333800 20 remove_watcher() i=5 2024-04-26T07:54:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.772+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504743759504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae3020 con 0x55f399ad8ac0 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.773+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94504743759504] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.773+0000 7f2989333800 20 remove_watcher() i=6 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.773+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504743760560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f399ae7840 con 0x55f399ad8ac0 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f29857d2640 1 -- 172.21.15.62:0/2381719848 <== osd.0 v2:172.21.15.1:6800/3827982423 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94504743760560] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02a070 con 0x55f399ad8ac0 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 20 remove_watcher() i=7 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399ad8ac0 msgr2=0x55f399adaeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399ad8ac0 0x55f399adaeb0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f399ad4380 msgr2=0x55f399ad6840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f399ad4380 0x55f399ad6840 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f297400f070 msgr2=0x7f2974017770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f297400f070 0x7f2974017770 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f399add6a0 msgr2=0x55f399adfb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.774+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f399add6a0 0x55f399adfb60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2850036eb0 msgr2=0x7f2850039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2850036eb0 0x7f2850039370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f297401be30 tx=0x7f2974031000 comp rx=0 tx=0).stop 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 msgr2=0x55f399ac8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 --2- 172.21.15.62:0/2381719848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ac1140 0x55f399ac8720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f297c048010 tx=0x7f297c04ceb0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 reap_dead start 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f29847d0640 1 -- 172.21.15.62:0/2381719848 reap_dead start 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 shutdown_connections 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 >> 172.21.15.62:0/2381719848 conn(0x55f399abd4a0 msgr2=0x55f399abab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 shutdown_connections 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/2381719848 wait complete. 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/3889633770 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f285c036eb0 msgr2=0x7f285c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 --2- 172.21.15.62:0/3889633770 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f285c036eb0 0x7f285c039370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55f399aa0430 tx=0x7f2974041040 comp rx=0 tx=0).stop 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/3889633770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ab3ec0 msgr2=0x55f399ab42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 --2- 172.21.15.62:0/3889633770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ab3ec0 0x55f399ab42e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55f399aa0390 tx=0x7f297c018830 comp rx=0 tx=0).stop 2024-04-26T07:54:56.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/3889633770 shutdown_connections 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 --2- 172.21.15.62:0/3889633770 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f285c036eb0 0x7f285c039370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 --2- 172.21.15.62:0/3889633770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f399ab3ec0 0x55f399ab42e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/3889633770 >> 172.21.15.62:0/3889633770 conn(0x55f399aa7f60 msgr2=0x55f399aa8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/3889633770 shutdown_connections 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.775+0000 7f2989333800 1 -- 172.21.15.62:0/3889633770 wait complete. 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399aa22e0 msgr2=0x55f399aa46d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399aa22e0 0x55f399aa46d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f3999a3ae0 msgr2=0x55f399a9fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f3999a3ae0 0x55f399a9fa00 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f286c036e60 msgr2=0x7f286c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f286c036e60 0x7f286c039320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2978054000 tx=0x7f297804e000 comp rx=0 tx=0).stop 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 msgr2=0x55f399a98810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a98810 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2974004000 tx=0x7f2974000bc0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 shutdown_connections 2024-04-26T07:54:56.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f3999a3ae0 0x55f399a9fa00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55f399aa22e0 0x55f399aa46d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f286c036e60 0x7f286c039320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 --2- 172.21.15.62:0/600401988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f39999f740 0x55f399a98810 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 >> 172.21.15.62:0/600401988 conn(0x55f39999ad20 msgr2=0x55f399a8ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 shutdown_connections 2024-04-26T07:54:56.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.776+0000 7f2989333800 1 -- 172.21.15.62:0/600401988 wait complete. 2024-04-26T07:54:56.786 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-04-26T07:54:56.786 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T07:54:56.786 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T07:54:56.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T07:54:56.787 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T07:54:56.871 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:56.872 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:56.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.874+0000 7f5da8615800 1 Processor -- start 2024-04-26T07:54:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.874+0000 7f5da8615800 1 -- start start 2024-04-26T07:54:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.874+0000 7f5da8615800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ab92dcecc0 0x55ab92dcf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.874+0000 7f5da8615800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab92dcbf70 con 0x55ab92dcf620 2024-04-26T07:54:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.874+0000 7f5da8615800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55ab92c6fe20 con 0x55ab92dcecc0 2024-04-26T07:54:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.875+0000 7f5da3bdc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ab92dcecc0 0x55ab92dcf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.875+0000 7f5da3bdc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ab92dcecc0 0x55ab92dcf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57042/0 (socket says 172.21.15.62:57042) 2024-04-26T07:54:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.875+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1335229950 learned_addr learned my addr 172.21.15.62:0/1335229950 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.875+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1335229950 >> v1:172.21.15.1:6789/0 conn(0x55ab92dcf620 legacy=0x55ab92dcb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.875+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1335229950 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab92dcc190 con 0x55ab92dcecc0 2024-04-26T07:54:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.877+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/1335229950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dcf0e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400a520 tx=0x7f5d9401cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49846de004bd2ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.877+0000 7f5da2bda640 1 -- 172.21.15.62:0/1335229950 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94057070 con 0x55ab92dcecc0 2024-04-26T07:54:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.877+0000 7f5da2bda640 1 -- 172.21.15.62:0/1335229950 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d94052570 con 0x55ab92dcecc0 2024-04-26T07:54:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.877+0000 7f5da2bda640 1 -- 172.21.15.62:0/1335229950 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94052870 con 0x55ab92dcecc0 2024-04-26T07:54:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.878+0000 7f5da8615800 1 -- 172.21.15.62:0/1335229950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 msgr2=0x55ab92dcf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.878+0000 7f5da8615800 1 --2- 172.21.15.62:0/1335229950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dcf0e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400a520 tx=0x7f5d9401cf30 comp rx=0 tx=0).stop 2024-04-26T07:54:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.878+0000 7f5da8615800 1 -- 172.21.15.62:0/1335229950 shutdown_connections 2024-04-26T07:54:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.878+0000 7f5da8615800 1 --2- 172.21.15.62:0/1335229950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dcf0e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.878+0000 7f5da8615800 1 -- 172.21.15.62:0/1335229950 >> 172.21.15.62:0/1335229950 conn(0x55ab92dc7320 msgr2=0x55ab92dc9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.878+0000 7f5da8615800 1 -- 172.21.15.62:0/1335229950 shutdown_connections 2024-04-26T07:54:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.878+0000 7f5da8615800 1 -- 172.21.15.62:0/1335229950 wait complete. 2024-04-26T07:54:56.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.890+0000 7f5da8615800 1 Processor -- start 2024-04-26T07:54:56.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.890+0000 7f5da8615800 1 -- start start 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.891+0000 7f5da8615800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.891+0000 7f5da8615800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab92d18cd0 con 0x55ab92dcecc0 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.891+0000 7f5da3bdc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.891+0000 7f5da3bdc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57050/0 (socket says 172.21.15.62:57050) 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.891+0000 7f5da3bdc640 1 -- 172.21.15.62:0/38987318 learned_addr learned my addr 172.21.15.62:0/38987318 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.891+0000 7f5da3bdc640 1 -- 172.21.15.62:0/38987318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab92dcc920 con 0x55ab92dcecc0 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.891+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/38987318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dce360 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d9401cf70 tx=0x7f5d9404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b7aa13b1227a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5c91e0b640 1 -- 172.21.15.62:0/38987318 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94057040 con 0x55ab92dcecc0 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5c91e0b640 1 -- 172.21.15.62:0/38987318 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d94052850 con 0x55ab92dcecc0 2024-04-26T07:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5c91e0b640 1 -- 172.21.15.62:0/38987318 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94052b70 con 0x55ab92dcecc0 2024-04-26T07:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5da8615800 1 -- 172.21.15.62:0/38987318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 msgr2=0x55ab92dce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5da8615800 1 --2- 172.21.15.62:0/38987318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dce360 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d9401cf70 tx=0x7f5d9404c000 comp rx=0 tx=0).stop 2024-04-26T07:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5da8615800 1 -- 172.21.15.62:0/38987318 shutdown_connections 2024-04-26T07:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5da8615800 1 --2- 172.21.15.62:0/38987318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92dce360 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5da8615800 1 -- 172.21.15.62:0/38987318 >> 172.21.15.62:0/38987318 conn(0x55ab92dc7320 msgr2=0x55ab92eba810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5da8615800 1 -- 172.21.15.62:0/38987318 shutdown_connections 2024-04-26T07:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.892+0000 7f5da8615800 1 -- 172.21.15.62:0/38987318 wait complete. 2024-04-26T07:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da8615800 1 Processor -- start 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da8615800 1 -- start start 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da8615800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92ec8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da8615800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab92dd6f80 con 0x55ab92dcecc0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da3bdc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92ec8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da3bdc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92ec8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57060/0 (socket says 172.21.15.62:57060) 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da3bdc640 1 -- 172.21.15.62:0/479543615 learned_addr learned my addr 172.21.15.62:0/479543615 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da3bdc640 1 -- 172.21.15.62:0/479543615 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab92ec90b0 con 0x55ab92dcecc0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.893+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92ec8b70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5d94052820 tx=0x7f5d94003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.894+0000 7f5c8bfff640 1 -- 172.21.15.62:0/479543615 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94073070 con 0x55ab92dcecc0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.894+0000 7f5c8bfff640 1 -- 172.21.15.62:0/479543615 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9405d440 con 0x55ab92dcecc0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.894+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab92ec9340 con 0x55ab92dcecc0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.894+0000 7f5c8bfff640 1 -- 172.21.15.62:0/479543615 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94057070 con 0x55ab92dcecc0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.894+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab92ecbff0 con 0x55ab92dcecc0 2024-04-26T07:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.894+0000 7f5c8bfff640 1 -- 172.21.15.62:0/479543615 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5d94076070 con 0x55ab92dcecc0 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.895+0000 7f5c8bfff640 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c8c036e60 0x7f5c8c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.895+0000 7f5c8bfff640 1 -- 172.21.15.62:0/479543615 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5d9408e3a0 con 0x55ab92dcecc0 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.895+0000 7f5da33db640 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c8c036e60 0x7f5c8c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.895+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92dcf620 0x55ab92ecfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.895+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92ed0390 con 0x55ab92dcf620 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.895+0000 7f5da43dd640 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92dcf620 0x55ab92ecfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.895+0000 7f5da33db640 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c8c036e60 0x7f5c8c039320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d98000f60 tx=0x7f5d98001410 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.895+0000 7f5da43dd640 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92dcf620 0x55ab92ecfdb0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.896+0000 7f5da43dd640 1 -- 172.21.15.62:0/479543615 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9c00a4a0 con 0x55ab92dcf620 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.896+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92ecd380 con 0x55ab92dcf620 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.896+0000 7f5da43dd640 1 -- 172.21.15.62:0/479543615 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d9c00a4a0 con 0x55ab92dcf620 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.896+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92ed26e0 0x55ab92ed4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.896+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92ed5170 con 0x55ab92ed26e0 2024-04-26T07:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.896+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92ed26e0 0x55ab92ed4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.896+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92ed26e0 0x55ab92ed4ad0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.897+0000 7f5da3bdc640 1 -- 172.21.15.62:0/479543615 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d94075030 con 0x55ab92ed26e0 2024-04-26T07:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.897+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92ed1690 con 0x55ab92dcf620 2024-04-26T07:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.897+0000 7f5da43dd640 1 -- 172.21.15.62:0/479543615 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d9c00a4a0 con 0x55ab92dcf620 2024-04-26T07:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.897+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92ed1b70 con 0x55ab92dcf620 2024-04-26T07:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.897+0000 7f5da43dd640 1 -- 172.21.15.62:0/479543615 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d9c00a4a0 con 0x55ab92dcf620 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da8615800 1 Processor -- start 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da8615800 1 -- start start 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da8615800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ee4320 0x55ab92ee4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da8615800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab92cc0170 con 0x55ab92ee4320 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da43dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ee4320 0x55ab92ee4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da43dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ee4320 0x55ab92ee4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57076/0 (socket says 172.21.15.62:57076) 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da43dd640 1 -- 172.21.15.62:0/2592947624 learned_addr learned my addr 172.21.15.62:0/2592947624 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da43dd640 1 -- 172.21.15.62:0/2592947624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab92ee4c80 con 0x55ab92ee4320 2024-04-26T07:54:56.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.898+0000 7f5da43dd640 1 --2- 172.21.15.62:0/2592947624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ee4320 0x55ab92ee4740 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55ab92ec9a40 tx=0x7f5d9c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.899+0000 7f5c897fa640 1 -- 172.21.15.62:0/2592947624 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d9c014450 con 0x55ab92ee4320 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.899+0000 7f5c897fa640 1 -- 172.21.15.62:0/2592947624 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c0145f0 con 0x55ab92ee4320 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.899+0000 7f5da8615800 1 -- 172.21.15.62:0/2592947624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab92ee56f0 con 0x55ab92ee4320 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.899+0000 7f5c897fa640 1 -- 172.21.15.62:0/2592947624 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d9c0148d0 con 0x55ab92ee4320 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.899+0000 7f5da8615800 1 -- 172.21.15.62:0/2592947624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab92ee5bf0 con 0x55ab92ee4320 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.899+0000 7f5c897fa640 1 -- 172.21.15.62:0/2592947624 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5d9c011040 con 0x55ab92ee4320 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5c897fa640 1 --2- 172.21.15.62:0/2592947624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c7c036eb0 0x7f5c7c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5c897fa640 1 -- 172.21.15.62:0/2592947624 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5d9c01e070 con 0x55ab92ee4320 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/2592947624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c7c036eb0 0x7f5c7c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da8615800 1 Processor -- start 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/2592947624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c7c036eb0 0x7f5c7c039370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55ab92ed0800 tx=0x7f5d9408c740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da8615800 1 -- start start 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da8615800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da8615800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab92dccbe0 con 0x55ab92ef15e0 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da43dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da43dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57088/0 (socket says 172.21.15.62:57088) 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.900+0000 7f5da43dd640 1 -- 172.21.15.62:0/2816022485 learned_addr learned my addr 172.21.15.62:0/2816022485 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da43dd640 1 -- 172.21.15.62:0/2816022485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab92ef1fd0 con 0x55ab92ef15e0 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da43dd640 1 --2- 172.21.15.62:0/2816022485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef1a00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c04cf00 tx=0x7f5d9c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cf10f1598785d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5c82ffd640 1 -- 172.21.15.62:0/2816022485 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d9c0411b0 con 0x55ab92ef15e0 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5c82ffd640 1 -- 172.21.15.62:0/2816022485 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c013c90 con 0x55ab92ef15e0 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5c82ffd640 1 -- 172.21.15.62:0/2816022485 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d9c02ba60 con 0x55ab92ef15e0 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da8615800 1 -- 172.21.15.62:0/2816022485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 msgr2=0x55ab92ef1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da8615800 1 --2- 172.21.15.62:0/2816022485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef1a00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c04cf00 tx=0x7f5d9c011700 comp rx=0 tx=0).stop 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da8615800 1 -- 172.21.15.62:0/2816022485 shutdown_connections 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da8615800 1 --2- 172.21.15.62:0/2816022485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef1a00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da8615800 1 -- 172.21.15.62:0/2816022485 >> 172.21.15.62:0/2816022485 conn(0x55ab92eed940 msgr2=0x55ab92eeb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da8615800 1 -- 172.21.15.62:0/2816022485 shutdown_connections 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.901+0000 7f5da8615800 1 -- 172.21.15.62:0/2816022485 wait complete. 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da8615800 1 Processor -- start 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da8615800 1 -- start start 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da8615800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da8615800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ab92ef2740 con 0x55ab92ef15e0 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da43dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da43dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57102/0 (socket says 172.21.15.62:57102) 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 learned_addr learned my addr 172.21.15.62:0/1787765493 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab92ef9100 con 0x55ab92ef15e0 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.902+0000 7f5da43dd640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef8bc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c048010 tx=0x7f5d9c04ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.903+0000 7f5c817fa640 1 -- 172.21.15.62:0/1787765493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d9c013e40 con 0x55ab92ef15e0 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.903+0000 7f5c817fa640 1 -- 172.21.15.62:0/1787765493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c02b560 con 0x55ab92ef15e0 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.903+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab92ef9390 con 0x55ab92ef15e0 2024-04-26T07:54:56.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.903+0000 7f5c817fa640 1 -- 172.21.15.62:0/1787765493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d9c02b880 con 0x55ab92ef15e0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.903+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab92efc040 con 0x55ab92ef15e0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5c817fa640 1 -- 172.21.15.62:0/1787765493 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5d9c04e380 con 0x55ab92ef15e0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5c817fa640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c6c036e10 0x7f5c6c0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5c817fa640 1 -- 172.21.15.62:0/1787765493 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f5d9c00e040 con 0x55ab92ef15e0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c6c036e10 0x7f5c6c0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92f048d0 0x55ab92f06d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f074e0 con 0x55ab92f048d0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c6c036e10 0x7f5c6c0392d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5d94066fd0 tx=0x7f5d94088000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.904+0000 7f5da33db640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92f048d0 0x55ab92f06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da33db640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92f048d0 0x55ab92f06d90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9800bd90 con 0x55ab92f048d0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 20 realm 2024-04-26T07:54:56.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f03d20 con 0x55ab92f048d0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9800bd90 con 0x55ab92f048d0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f07fd0 con 0x55ab92f048d0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9800bd90 con 0x55ab92f048d0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.905+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f088a0 con 0x55ab92f048d0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.906+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d9800bd90 con 0x55ab92f048d0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.906+0000 7f5da8615800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.906+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.906+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92f092c0 0x55ab92f0b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.906+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f0bdf0 con 0x55ab92f092c0 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.906+0000 7f5da43dd640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92f092c0 0x55ab92f0b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.906+0000 7f5da43dd640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92f092c0 0x55ab92f0b6b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.907+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.907+0000 7f5da8615800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.907+0000 7f5da8615800 20 searching for the correct realm 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.907+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab92f0ddc0 0x55ab92f10280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.907+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.907+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab92f0ddc0 0x55ab92f10280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.907+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab92f0ddc0 0x55ab92f10280 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.908+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.908+0000 7f5da3bdc640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d94078060 0x7f5d9408e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.908+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x7f5d94078060 2024-04-26T07:54:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.908+0000 7f5da33db640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d94078060 0x7f5d9408e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.908+0000 7f5da33db640 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d94078060 0x7f5d9408e780 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.908+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9800bd90 con 0x7f5d94078060 2024-04-26T07:54:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.908+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.909+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.909+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f048d0 2024-04-26T07:54:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.909+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9800bd90 con 0x55ab92f048d0 2024-04-26T07:54:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.909+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f048d0 2024-04-26T07:54:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.909+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.909+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.909+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.909+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.910+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.910+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x7f5d94078060 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.910+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.910+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.910+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.910+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f048d0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.910+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.910+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.911+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.911+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f048d0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.911+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.911+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x7f5d94078060 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.911+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.911+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.911+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.911+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.912+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.912+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.912+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.912+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.912+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.912+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.912+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.912+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f048d0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.913+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.913+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f048d0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.913+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.913+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.913+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.913+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.914+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.914+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x7f5d94078060 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.914+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.914+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f048d0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.914+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.914+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.915+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.915+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.915+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.915+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.915+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.915+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x7f5d94078060 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.915+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.915+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f0ddc0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.916+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.916+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f092c0 2024-04-26T07:54:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.916+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.916+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x55ab92f048d0 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f10950 con 0x7f5d94078060 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f0c7b0 con 0x55ab92f048d0 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f0c3f0 con 0x55ab92f048d0 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.917+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f0d190 con 0x55ab92f048d0 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 20 zone default found 2024-04-26T07:54:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 4 Realm: () 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 20 zonegroup default 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f0cc50 con 0x55ab92f092c0 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f13160 con 0x55ab92f0ddc0 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f13500 con 0x55ab92f0ddc0 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.918+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.919+0000 7f5da8615800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.919+0000 7f5da8615800 20 started sync module instance, tier type = 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.919+0000 7f5da8615800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.919+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f125f0 con 0x7f5d94078060 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.920+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.920+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94195393047280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f125f0 con 0x7f5d94078060 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.920+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f13ec0 con 0x55ab92f048d0 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.921+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94195393047280] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.921+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.921+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94195393051632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f125f0 con 0x55ab92f048d0 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.921+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f14930 con 0x55ab92f0ddc0 2024-04-26T07:54:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.922+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94195393051632] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.922+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.922+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94195393044800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f12560 con 0x55ab92f0ddc0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.922+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f157f0 con 0x7f5d94078060 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.923+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.923+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94195393058080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f15f30 con 0x7f5d94078060 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.923+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f16a50 con 0x55ab92f048d0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.923+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94195393044800] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.924+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.924+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94195393062176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f16a10 con 0x55ab92f048d0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.924+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f17460 con 0x55ab92f092c0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.924+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94195393058080] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.925+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94195393062176] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.925+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.925+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94195393056032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f15980 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.925+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f17d00 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.926+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94195393056032] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.926+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.926+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94195393064880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f17cb0 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.926+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f18750 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94195393069664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f18b70 con 0x55ab92f092c0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da8615800 20 add_watcher() i=0 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da8615800 20 add_watcher() i=1 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da8615800 20 add_watcher() i=2 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da8615800 20 add_watcher() i=3 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da8615800 20 add_watcher() i=4 2024-04-26T07:54:56.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da8615800 20 add_watcher() i=5 2024-04-26T07:54:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94195393064880] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.927+0000 7f5da8615800 20 add_watcher() i=6 2024-04-26T07:54:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.928+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94195393069664] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.928+0000 7f5da8615800 20 add_watcher() i=7 2024-04-26T07:54:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.928+0000 7f5da8615800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.928+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f17800 con 0x55ab92f048d0 2024-04-26T07:54:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.929+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.929+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94195393070720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f17800 con 0x55ab92f048d0 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.930+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94195393070720] v27'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.930+0000 7f5c59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.930+0000 7f5da8615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.930+0000 7f5da8615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.930+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f247c0 con 0x55ab92f048d0 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.931+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.931+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f24e90 con 0x55ab92f092c0 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.932+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.932+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f24e90 con 0x55ab92f0ddc0 2024-04-26T07:54:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.933+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.933+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f258f0 con 0x55ab92f048d0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.934+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.934+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f20490 con 0x7f5d94078060 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.935+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.935+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f20490 con 0x55ab92f0ddc0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.936+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.936+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x55ab92f048d0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.937+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.937+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x55ab92f092c0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.938+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.938+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x7f5d94078060 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.939+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.939+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x55ab92f0ddc0 2024-04-26T07:54:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.940+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.940+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x7f5d94078060 2024-04-26T07:54:56.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.941+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.941+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x55ab92f092c0 2024-04-26T07:54:56.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.942+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.942+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267f0 con 0x7f5d94078060 2024-04-26T07:54:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.943+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.943+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267f0 con 0x55ab92f092c0 2024-04-26T07:54:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.944+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.944+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f048d0 2024-04-26T07:54:56.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.945+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.945+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f0ddc0 2024-04-26T07:54:56.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.946+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.946+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x7f5d94078060 2024-04-26T07:54:56.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.947+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.947+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f0ddc0 2024-04-26T07:54:56.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.948+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.948+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f048d0 2024-04-26T07:54:56.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.949+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.949+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f048d0 2024-04-26T07:54:56.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.950+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.950+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f0ddc0 2024-04-26T07:54:56.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.951+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.951+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x7f5d94078060 2024-04-26T07:54:56.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.952+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.952+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f0ddc0 2024-04-26T07:54:56.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.953+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.953+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f0ddc0 2024-04-26T07:54:56.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.954+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.954+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f0ddc0 2024-04-26T07:54:56.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.955+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.955+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f0ddc0 2024-04-26T07:54:56.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.956+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.956+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f267c0 con 0x55ab92f092c0 2024-04-26T07:54:56.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.958+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.958+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x55ab92f0ddc0 2024-04-26T07:54:56.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.959+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.959+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x55ab92f092c0 2024-04-26T07:54:56.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.960+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.960+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x55ab92f0ddc0 2024-04-26T07:54:56.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.961+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.961+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x55ab92f092c0 2024-04-26T07:54:56.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.962+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'48 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.962+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f26730 con 0x7f5d94078060 2024-04-26T07:54:56.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.963+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5c58fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:56.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 20 Filter name: none 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5bd27fc640 20 reqs_thread_entry: start 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 20 rados->read ofs=0 len=0 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f51b40 con 0x55ab92f048d0 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.964+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f545d0 con 0x7f5d94078060 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.965+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.963 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T07:54:56.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.966+0000 7f5c59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:56.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.966+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94195393070720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f21430 con 0x55ab92f048d0 2024-04-26T07:54:56.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.967+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94195393070720] v27'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.967+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94195393047280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f18680 con 0x7f5d94078060 2024-04-26T07:54:56.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.968+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94195393047280] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.968+0000 7f5da8615800 20 remove_watcher() i=0 2024-04-26T07:54:56.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.968+0000 7f5da8615800 2 removed watcher, disabling cache 2024-04-26T07:54:56.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.968+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94195393051632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f12af0 con 0x55ab92f048d0 2024-04-26T07:54:56.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.969+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94195393051632] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.969+0000 7f5da8615800 20 remove_watcher() i=1 2024-04-26T07:54:56.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.969+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94195393044800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f12af0 con 0x55ab92f0ddc0 2024-04-26T07:54:56.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.970+0000 7f5da3bdc640 1 -- 172.21.15.62:0/1787765493 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94195393044800] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d94097070 con 0x55ab92f0ddc0 2024-04-26T07:54:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.970+0000 7f5da8615800 20 remove_watcher() i=2 2024-04-26T07:54:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.970+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94195393058080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f12af0 con 0x7f5d94078060 2024-04-26T07:54:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.971+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94195393058080] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x7f5d94078060 2024-04-26T07:54:56.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.971+0000 7f5da8615800 20 remove_watcher() i=3 2024-04-26T07:54:56.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.971+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94195393062176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f15520 con 0x55ab92f048d0 2024-04-26T07:54:56.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.972+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94195393062176] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9802a040 con 0x55ab92f048d0 2024-04-26T07:54:56.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.972+0000 7f5da8615800 20 remove_watcher() i=4 2024-04-26T07:54:56.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.972+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94195393056032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f12af0 con 0x55ab92f092c0 2024-04-26T07:54:56.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.973+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94195393056032] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.973+0000 7f5da8615800 20 remove_watcher() i=5 2024-04-26T07:54:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.973+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94195393064880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f14d20 con 0x55ab92f092c0 2024-04-26T07:54:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.974+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94195393064880] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.974+0000 7f5da8615800 20 remove_watcher() i=6 2024-04-26T07:54:56.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.974+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94195393069664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ab92f12af0 con 0x55ab92f092c0 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.974+0000 7f5da43dd640 1 -- 172.21.15.62:0/1787765493 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94195393069664] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9c056040 con 0x55ab92f092c0 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.974+0000 7f5da8615800 20 remove_watcher() i=7 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92f092c0 msgr2=0x55ab92f0b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92f092c0 0x55ab92f0b6b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92f048d0 msgr2=0x55ab92f06d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92f048d0 0x55ab92f06d90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d94078060 msgr2=0x7f5d9408e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5d94078060 0x7f5d9408e780 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab92f0ddc0 msgr2=0x55ab92f10280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ab92f0ddc0 0x55ab92f10280 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c6c036e10 msgr2=0x7f5c6c0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c6c036e10 0x7f5c6c0392d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5d94066fd0 tx=0x7f5d94088000 comp rx=0 tx=0).stop 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 msgr2=0x55ab92ef8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef8bc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c048010 tx=0x7f5d9c04ce60 comp rx=0 tx=0).stop 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da33db640 1 -- 172.21.15.62:0/1787765493 reap_dead start 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 shutdown_connections 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/1787765493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ef15e0 0x55ab92ef8bc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 >> 172.21.15.62:0/1787765493 conn(0x55ab92eed940 msgr2=0x55ab92eeafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 shutdown_connections 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/1787765493 wait complete. 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/2592947624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c7c036eb0 msgr2=0x7f5c7c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/2592947624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c7c036eb0 0x7f5c7c039370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55ab92ed0800 tx=0x7f5d9408c740 comp rx=0 tx=0).stop 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/2592947624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ee4320 msgr2=0x55ab92ee4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/2592947624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ee4320 0x55ab92ee4740 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55ab92ec9a40 tx=0x7f5d9c0188f0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/2592947624 shutdown_connections 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/2592947624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c7c036eb0 0x7f5c7c039370 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 --2- 172.21.15.62:0/2592947624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92ee4320 0x55ab92ee4740 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/2592947624 >> 172.21.15.62:0/2592947624 conn(0x55ab92ed83c0 msgr2=0x55ab92ed87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/2592947624 shutdown_connections 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.975+0000 7f5da8615800 1 -- 172.21.15.62:0/2592947624 wait complete. 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92ed26e0 msgr2=0x55ab92ed4ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92ed26e0 0x55ab92ed4ad0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92dcf620 msgr2=0x55ab92ecfdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92dcf620 0x55ab92ecfdb0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c8c036e60 msgr2=0x7f5c8c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c8c036e60 0x7f5c8c039320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d98000f60 tx=0x7f5d98001410 comp rx=0 tx=0).stop 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 msgr2=0x55ab92ec8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92ec8b70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5d94052820 tx=0x7f5d94003020 comp rx=0 tx=0).stop 2024-04-26T07:54:56.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 shutdown_connections 2024-04-26T07:54:56.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ab92dcf620 0x55ab92ecfdb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x55ab92ed26e0 0x55ab92ed4ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5c8c036e60 0x7f5c8c039320 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 --2- 172.21.15.62:0/479543615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ab92dcecc0 0x55ab92ec8b70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:56.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 >> 172.21.15.62:0/479543615 conn(0x55ab92dc7320 msgr2=0x55ab92eba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:56.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 shutdown_connections 2024-04-26T07:54:56.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:56.976+0000 7f5da8615800 1 -- 172.21.15.62:0/479543615 wait complete. 2024-04-26T07:54:56.982 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T07:54:56.991 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-04-26T07:54:56.996 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:57.028 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:57.039 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:57.085 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-26T07:54:57.090 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:57.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T07:54:57.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T07:54:57.091 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-26T07:54:57.136 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:57.136 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:57.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.139+0000 7f327b011800 1 Processor -- start 2024-04-26T07:54:57.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.139+0000 7f327b011800 1 -- start start 2024-04-26T07:54:57.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.139+0000 7f327b011800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5571dbe3d1c0 0x5571dbe3f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.139+0000 7f327b011800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5571dbe43600 con 0x5571dbe3faf0 2024-04-26T07:54:57.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.139+0000 7f327b011800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5571dbcdee20 con 0x5571dbe3d1c0 2024-04-26T07:54:57.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.139+0000 7f327666e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5571dbe3d1c0 0x5571dbe3f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.139+0000 7f3275e6d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5571dbe3faf0 0x5571dbe41ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:35954/0 (socket says 172.21.15.62:35954) 2024-04-26T07:54:57.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.139+0000 7f3275e6d640 1 -- 172.21.15.62:0/4119800736 learned_addr learned my addr 172.21.15.62:0/4119800736 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:57.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.140+0000 7f327666e640 1 -- 172.21.15.62:0/4119800736 >> v1:172.21.15.1:6789/0 conn(0x5571dbe3faf0 legacy=0x5571dbe41ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.140+0000 7f327666e640 1 -- 172.21.15.62:0/4119800736 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dbe447e0 con 0x5571dbe3d1c0 2024-04-26T07:54:57.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.141+0000 7f327666e640 1 --2- 172.21.15.62:0/4119800736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3f5b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f326800a470 tx=0x7f326801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3773f24c5caa2ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327566c640 1 -- 172.21.15.62:0/4119800736 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3268057070 con 0x5571dbe3d1c0 2024-04-26T07:54:57.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327566c640 1 -- 172.21.15.62:0/4119800736 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3268052570 con 0x5571dbe3d1c0 2024-04-26T07:54:57.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327566c640 1 -- 172.21.15.62:0/4119800736 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3268052870 con 0x5571dbe3d1c0 2024-04-26T07:54:57.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327b011800 1 -- 172.21.15.62:0/4119800736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 msgr2=0x5571dbe3f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327b011800 1 --2- 172.21.15.62:0/4119800736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3f5b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f326800a470 tx=0x7f326801ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:57.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327b011800 1 -- 172.21.15.62:0/4119800736 shutdown_connections 2024-04-26T07:54:57.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327b011800 1 --2- 172.21.15.62:0/4119800736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3f5b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327b011800 1 -- 172.21.15.62:0/4119800736 >> 172.21.15.62:0/4119800736 conn(0x5571dbe36bb0 msgr2=0x5571dbe38fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327b011800 1 -- 172.21.15.62:0/4119800736 shutdown_connections 2024-04-26T07:54:57.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.142+0000 7f327b011800 1 -- 172.21.15.62:0/4119800736 wait complete. 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.155+0000 7f327b011800 1 Processor -- start 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.155+0000 7f327b011800 1 -- start start 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.155+0000 7f327b011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbf2dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.155+0000 7f327b011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5571dbd87d00 con 0x5571dbe3d1c0 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.155+0000 7f327666e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbf2dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.155+0000 7f327666e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbf2dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57126/0 (socket says 172.21.15.62:57126) 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.155+0000 7f327666e640 1 -- 172.21.15.62:0/1035503176 learned_addr learned my addr 172.21.15.62:0/1035503176 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.156+0000 7f327666e640 1 -- 172.21.15.62:0/1035503176 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dbf2e1e0 con 0x5571dbe3d1c0 2024-04-26T07:54:57.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.156+0000 7f327666e640 1 --2- 172.21.15.62:0/1035503176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbf2dc10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f326801ced0 tx=0x7f326804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdafab6bd98334b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.156+0000 7f3164608640 1 -- 172.21.15.62:0/1035503176 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3268057040 con 0x5571dbe3d1c0 2024-04-26T07:54:57.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.156+0000 7f3164608640 1 -- 172.21.15.62:0/1035503176 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32680529a0 con 0x5571dbe3d1c0 2024-04-26T07:54:57.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.156+0000 7f3164608640 1 -- 172.21.15.62:0/1035503176 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3268052cc0 con 0x5571dbe3d1c0 2024-04-26T07:54:57.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 -- 172.21.15.62:0/1035503176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 msgr2=0x5571dbf2dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 --2- 172.21.15.62:0/1035503176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbf2dc10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f326801ced0 tx=0x7f326804c000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 -- 172.21.15.62:0/1035503176 shutdown_connections 2024-04-26T07:54:57.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 --2- 172.21.15.62:0/1035503176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbf2dc10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 -- 172.21.15.62:0/1035503176 >> 172.21.15.62:0/1035503176 conn(0x5571dbe36bb0 msgr2=0x5571dbf29530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 -- 172.21.15.62:0/1035503176 shutdown_connections 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 -- 172.21.15.62:0/1035503176 wait complete. 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 Processor -- start 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 -- start start 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.157+0000 7f327b011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5571dbe43a70 con 0x5571dbe3d1c0 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f327666e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f327666e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57128/0 (socket says 172.21.15.62:57128) 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f327666e640 1 -- 172.21.15.62:0/2389271010 learned_addr learned my addr 172.21.15.62:0/2389271010 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f327666e640 1 -- 172.21.15.62:0/2389271010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dbe3cfd0 con 0x5571dbe3d1c0 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f327666e640 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3ca90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3268052740 tx=0x7f3268003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f3162e05640 1 -- 172.21.15.62:0/2389271010 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3268073070 con 0x5571dbe3d1c0 2024-04-26T07:54:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f3162e05640 1 -- 172.21.15.62:0/2389271010 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326805d860 con 0x5571dbe3d1c0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571dbe3b1d0 con 0x5571dbe3d1c0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f3162e05640 1 -- 172.21.15.62:0/2389271010 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3268057070 con 0x5571dbe3d1c0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.158+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571dbe3b750 con 0x5571dbe3d1c0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.159+0000 7f3162e05640 1 -- 172.21.15.62:0/2389271010 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3268076070 con 0x5571dbe3d1c0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.159+0000 7f3162e05640 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f315c036e60 0x7f315c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.159+0000 7f3162e05640 1 -- 172.21.15.62:0/2389271010 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f326808e700 con 0x5571dbe3d1c0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.159+0000 7f3275e6d640 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f315c036e60 0x7f315c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.159+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbe3faf0 0x5571dbf3ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.159+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf3f020 con 0x5571dbe3faf0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.159+0000 7f3276e6f640 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbe3faf0 0x5571dbf3ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.160+0000 7f3275e6d640 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f315c036e60 0x7f315c039320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f326c001d90 tx=0x7f326c0012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.160+0000 7f3276e6f640 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbe3faf0 0x5571dbf3ea20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.160+0000 7f3276e6f640 1 -- 172.21.15.62:0/2389271010 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f327000a4a0 con 0x5571dbe3faf0 2024-04-26T07:54:57.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.160+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf3f8a0 con 0x5571dbe3faf0 2024-04-26T07:54:57.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.160+0000 7f3276e6f640 1 -- 172.21.15.62:0/2389271010 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f327000a4a0 con 0x5571dbe3faf0 2024-04-26T07:54:57.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.160+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf411f0 0x5571dbf43680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.160+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf43e10 con 0x5571dbf411f0 2024-04-26T07:54:57.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.161+0000 7f327666e640 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf411f0 0x5571dbf43680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.161+0000 7f327666e640 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf411f0 0x5571dbf43680 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.161+0000 7f327666e640 1 -- 172.21.15.62:0/2389271010 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf411f0 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.161+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf40120 con 0x5571dbe3faf0 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.162+0000 7f3276e6f640 1 -- 172.21.15.62:0/2389271010 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f327000a4a0 con 0x5571dbe3faf0 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.162+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf40600 con 0x5571dbe3faf0 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.162+0000 7f3276e6f640 1 -- 172.21.15.62:0/2389271010 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f327000a4a0 con 0x5571dbe3faf0 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.162+0000 7f327b011800 1 Processor -- start 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.162+0000 7f327b011800 1 -- start start 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f327b011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf52f80 0x5571dbf533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f327b011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5571dbd2f170 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f3276e6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf52f80 0x5571dbf533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f3276e6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf52f80 0x5571dbf533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57132/0 (socket says 172.21.15.62:57132) 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f3276e6f640 1 -- 172.21.15.62:0/3363482804 learned_addr learned my addr 172.21.15.62:0/3363482804 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f3276e6f640 1 -- 172.21.15.62:0/3363482804 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dbf538e0 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f3276e6f640 1 --2- 172.21.15.62:0/3363482804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf52f80 0x5571dbf533a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x5571dbf3f3c0 tx=0x7f3270018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f315bfff640 1 -- 172.21.15.62:0/3363482804 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3270014450 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f315bfff640 1 -- 172.21.15.62:0/3363482804 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3270014610 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f327b011800 1 -- 172.21.15.62:0/3363482804 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571dbf54350 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f315bfff640 1 -- 172.21.15.62:0/3363482804 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3270014930 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.163+0000 7f327b011800 1 -- 172.21.15.62:0/3363482804 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571dbf54850 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.164+0000 7f315bfff640 1 -- 172.21.15.62:0/3363482804 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3270011040 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.164+0000 7f315bfff640 1 --2- 172.21.15.62:0/3363482804 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3150036e60 0x7f3150039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.164+0000 7f315bfff640 1 -- 172.21.15.62:0/3363482804 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f327001e070 con 0x5571dbf52f80 2024-04-26T07:54:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.164+0000 7f327666e640 1 --2- 172.21.15.62:0/3363482804 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3150036e60 0x7f3150039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f327b011800 1 Processor -- start 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f327b011800 1 -- start start 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f327666e640 1 --2- 172.21.15.62:0/3363482804 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3150036e60 0x7f3150039320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5571dbe3bd80 tx=0x7f326808ca80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f327b011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f327b011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5571dbf2e4a0 con 0x5571dbf602a0 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f3276e6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f3276e6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57136/0 (socket says 172.21.15.62:57136) 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f3276e6f640 1 -- 172.21.15.62:0/2701149112 learned_addr learned my addr 172.21.15.62:0/2701149112 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f3276e6f640 1 -- 172.21.15.62:0/2701149112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dbf60c90 con 0x5571dbf602a0 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f3276e6f640 1 --2- 172.21.15.62:0/2701149112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf606c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f327004cf80 tx=0x7f327000df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36258f3ddf28dcc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.165+0000 7f3159ffb640 1 -- 172.21.15.62:0/2701149112 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3270016440 con 0x5571dbf602a0 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f3159ffb640 1 -- 172.21.15.62:0/2701149112 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327002bc50 con 0x5571dbf602a0 2024-04-26T07:54:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f3159ffb640 1 -- 172.21.15.62:0/2701149112 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700165e0 con 0x5571dbf602a0 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 -- 172.21.15.62:0/2701149112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 msgr2=0x5571dbf606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 --2- 172.21.15.62:0/2701149112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf606c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f327004cf80 tx=0x7f327000df90 comp rx=0 tx=0).stop 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 -- 172.21.15.62:0/2701149112 shutdown_connections 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 --2- 172.21.15.62:0/2701149112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf606c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 -- 172.21.15.62:0/2701149112 >> 172.21.15.62:0/2701149112 conn(0x5571dbf5c5c0 msgr2=0x5571dbf5a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 -- 172.21.15.62:0/2701149112 shutdown_connections 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 -- 172.21.15.62:0/2701149112 wait complete. 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 Processor -- start 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.166+0000 7f327b011800 1 -- start start 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f327b011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf67840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f327b011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5571dbf613b0 con 0x5571dbf602a0 2024-04-26T07:54:57.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f3276e6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf67840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f3276e6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf67840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57142/0 (socket says 172.21.15.62:57142) 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 learned_addr learned my addr 172.21.15.62:0/3522458064 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dbf67d80 con 0x5571dbf602a0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f3276e6f640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf67840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f327003f040 tx=0x7f327004cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f3147fff640 1 -- 172.21.15.62:0/3522458064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f327002b350 con 0x5571dbf602a0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f3147fff640 1 -- 172.21.15.62:0/3522458064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327002b4f0 con 0x5571dbf602a0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571dbf68010 con 0x5571dbf602a0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f3147fff640 1 -- 172.21.15.62:0/3522458064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f327002b7d0 con 0x5571dbf602a0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.167+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571dbf6acc0 con 0x5571dbf602a0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.168+0000 7f3147fff640 1 -- 172.21.15.62:0/3522458064 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f327004ed10 con 0x5571dbf602a0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.168+0000 7f3147fff640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3140036e60 0x7f3140039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.168+0000 7f3147fff640 1 -- 172.21.15.62:0/3522458064 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f3270033030 con 0x5571dbf602a0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.168+0000 7f327666e640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3140036e60 0x7f3140039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f327666e640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3140036e60 0x7f3140039320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f326808cd80 tx=0x7f3268088070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbf734a0 0x5571dbf75960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf760b0 con 0x5571dbf734a0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f3275e6d640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbf734a0 0x5571dbf75960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f3275e6d640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbf734a0 0x5571dbf75960 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f326c009050 con 0x5571dbf734a0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f327b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f327b011800 20 realm 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.169+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf728f0 con 0x5571dbf734a0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f326c009050 con 0x5571dbf734a0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf76ba0 con 0x5571dbf734a0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f326c009050 con 0x5571dbf734a0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf77470 con 0x5571dbf734a0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f326c009050 con 0x5571dbf734a0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf77d60 0x5571dbf7a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7a940 con 0x5571dbf77d60 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.170+0000 7f3276e6f640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf77d60 0x5571dbf7a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.171+0000 7f3276e6f640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf77d60 0x5571dbf7a1b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.171+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.171+0000 7f327b011800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.171+0000 7f327b011800 20 searching for the correct realm 2024-04-26T07:54:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.171+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5571dbf7c910 0x5571dbf7edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.171+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.171+0000 7f327666e640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5571dbf7c910 0x5571dbf7edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.171+0000 7f327666e640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5571dbf7c910 0x5571dbf7edd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.172+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.172+0000 7f327666e640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f326809d040 0x7f326808b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.172+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x7f326809d040 2024-04-26T07:54:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.172+0000 7f3275e6d640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f326809d040 0x7f326808b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.172+0000 7f3275e6d640 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f326809d040 0x7f326808b170 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.173+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c009050 con 0x7f326809d040 2024-04-26T07:54:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.173+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.173+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.173+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf734a0 2024-04-26T07:54:57.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.173+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c009050 con 0x5571dbf734a0 2024-04-26T07:54:57.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.173+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf734a0 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.174+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.174+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.174+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.174+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.174+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.174+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x7f326809d040 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.175+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c029040 con 0x7f326809d040 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.175+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.175+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.175+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf734a0 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.175+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.175+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.176+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.176+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf734a0 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.176+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.176+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x7f326809d040 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.176+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f326c029040 con 0x7f326809d040 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.176+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.176+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.176+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.177+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.177+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.177+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.177+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.177+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.177+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.177+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.177+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf734a0 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.178+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.178+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf734a0 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.178+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.178+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.178+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.178+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.178+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.178+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x7f326809d040 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.179+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c029040 con 0x7f326809d040 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.179+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf734a0 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.179+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.179+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.179+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.179+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.179+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.179+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.180+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.180+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x7f326809d040 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.180+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c029040 con 0x7f326809d040 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.180+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf7c910 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.180+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.180+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf77d60 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x5571dbf734a0 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f4a0 con 0x7f326809d040 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326c029040 con 0x7f326809d040 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7b300 con 0x5571dbf734a0 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.181+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7af40 con 0x5571dbf734a0 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7bca0 con 0x5571dbf734a0 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f326c029040 con 0x5571dbf734a0 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 20 zone default found 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 4 Realm: () 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:57.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 20 zonegroup default 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf7f920 con 0x5571dbf77d60 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf81bd0 con 0x5571dbf7c910 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.182+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.183+0000 7f327b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.183+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.183+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf81f70 con 0x5571dbf7c910 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.183+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.183+0000 7f327b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.183+0000 7f327b011800 20 started sync module instance, tier type = 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.183+0000 7f327b011800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.183+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf81060 con 0x7f326809d040 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.184+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x7f326809d040 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.184+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93947510134144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf81060 con 0x7f326809d040 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.184+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf82970 con 0x5571dbf734a0 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.185+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93947510134144] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x7f326809d040 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.185+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.185+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93947510137984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf81060 con 0x5571dbf734a0 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.185+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf83400 con 0x5571dbf7c910 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.186+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93947510137984] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.187+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.187+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93947510131632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf80fd0 con 0x5571dbf7c910 2024-04-26T07:54:57.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.187+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf842c0 con 0x7f326809d040 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.188+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93947510131632] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.188+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x7f326809d040 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.188+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93947510144528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf846e0 con 0x7f326809d040 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.188+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf84fb0 con 0x5571dbf734a0 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.189+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.189+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93947510146784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf84b00 con 0x5571dbf734a0 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.189+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf85f80 con 0x5571dbf77d60 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.189+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93947510144528] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x7f326809d040 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.190+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93947510146784] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.190+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.190+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93947510150048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf85f40 con 0x5571dbf77d60 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.190+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf86820 con 0x5571dbf77d60 2024-04-26T07:54:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.191+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93947510150048] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.191+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.191+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93947510151792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf85f40 con 0x5571dbf77d60 2024-04-26T07:54:57.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.191+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf86e50 con 0x5571dbf77d60 2024-04-26T07:54:57.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93947510151792] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93947510155584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf86e10 con 0x5571dbf77d60 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f327b011800 20 add_watcher() i=0 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f327b011800 20 add_watcher() i=1 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f327b011800 20 add_watcher() i=2 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f327b011800 20 add_watcher() i=3 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f327b011800 20 add_watcher() i=4 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f327b011800 20 add_watcher() i=5 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.192+0000 7f327b011800 20 add_watcher() i=6 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.193+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93947510155584] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.193+0000 7f327b011800 20 add_watcher() i=7 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.193+0000 7f327b011800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.193+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf8a2d0 con 0x5571dbf734a0 2024-04-26T07:54:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.193+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.193+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93947510154016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbf87750 con 0x5571dbf734a0 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93947510154016] v27'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f312cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f327b011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f327b011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f327b011800 5 note: GC not initialized 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f30a77fe640 20 reqs_thread_entry: start 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f327b011800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f327b011800 20 Filter name: none 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f30a57fa640 20 reqs_thread_entry: start 2024-04-26T07:54:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f327b011800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.195+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbdf60 con 0x7f326809d040 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f326c039040 con 0x7f326809d040 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 : miss 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.3 8:c6c1f974:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbfb00 con 0x5571dbf734a0 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(63 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 info.flags=0x17 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 to cache LRU end 2024-04-26T07:54:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 20 get_obj_state: octx=0x7f326c00e5b0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5571dbfc21a8 s->prefetch_data=0 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.196+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 3.21s0 3:85051d9a:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfc32a0 con 0x5571dbf77d60 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.197+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(64 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.197+0000 7f327b011800 10 manifest: total_size = 5 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.197+0000 7f327b011800 20 get_obj_state: setting s->obj_tag to _1876GXyENlVlbze6C9hBaBOtfRotAC- 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.198+0000 7f312cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.198+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93947510154016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbb8b0 con 0x5571dbf734a0 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.199+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93947510154016] v27'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.199+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93947510134144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbb8b0 con 0x7f326809d040 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.200+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93947510134144] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x7f326809d040 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.200+0000 7f327b011800 20 remove_watcher() i=0 2024-04-26T07:54:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.200+0000 7f327b011800 2 removed watcher, disabling cache 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.200+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93947510137984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfc32a0 con 0x5571dbf734a0 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.201+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93947510137984] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.201+0000 7f327b011800 20 remove_watcher() i=1 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.201+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93947510131632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfc32a0 con 0x5571dbf7c910 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.202+0000 7f327666e640 1 -- 172.21.15.62:0/3522458064 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93947510131632] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3268075030 con 0x5571dbf7c910 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.202+0000 7f327b011800 20 remove_watcher() i=2 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.202+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93947510144528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbb8b0 con 0x7f326809d040 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.203+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93947510144528] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x7f326809d040 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.203+0000 7f327b011800 20 remove_watcher() i=3 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.203+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93947510146784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbb8b0 con 0x5571dbf734a0 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.204+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93947510146784] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f326c039040 con 0x5571dbf734a0 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.204+0000 7f327b011800 20 remove_watcher() i=4 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.204+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93947510150048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbb8b0 con 0x5571dbf77d60 2024-04-26T07:54:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.205+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93947510150048] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.205+0000 7f327b011800 20 remove_watcher() i=5 2024-04-26T07:54:57.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.205+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93947510151792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbb8b0 con 0x5571dbf77d60 2024-04-26T07:54:57.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.206+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93947510151792] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.206+0000 7f327b011800 20 remove_watcher() i=6 2024-04-26T07:54:57.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.206+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93947510155584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571dbfbb8b0 con 0x5571dbf77d60 2024-04-26T07:54:57.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f3276e6f640 1 -- 172.21.15.62:0/3522458064 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93947510155584] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270046d70 con 0x5571dbf77d60 2024-04-26T07:54:57.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 20 remove_watcher() i=7 2024-04-26T07:54:57.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf77d60 msgr2=0x5571dbf7a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf77d60 0x5571dbf7a1b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbf734a0 msgr2=0x5571dbf75960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbf734a0 0x5571dbf75960 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f326809d040 msgr2=0x7f326808b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f326809d040 0x7f326808b170 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5571dbf7c910 msgr2=0x5571dbf7edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5571dbf7c910 0x5571dbf7edd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3140036e60 msgr2=0x7f3140039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3140036e60 0x7f3140039320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f326808cd80 tx=0x7f3268088070 comp rx=0 tx=0).stop 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 msgr2=0x5571dbf67840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf67840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f327003f040 tx=0x7f327004cf10 comp rx=0 tx=0).stop 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f3275e6d640 1 -- 172.21.15.62:0/3522458064 reap_dead start 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 shutdown_connections 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 --2- 172.21.15.62:0/3522458064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf602a0 0x5571dbf67840 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.207+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 >> 172.21.15.62:0/3522458064 conn(0x5571dbf5c5c0 msgr2=0x5571dbf59c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 shutdown_connections 2024-04-26T07:54:57.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/3522458064 wait complete. 2024-04-26T07:54:57.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/3363482804 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3150036e60 msgr2=0x7f3150039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/3363482804 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3150036e60 0x7f3150039320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5571dbe3bd80 tx=0x7f326808ca80 comp rx=0 tx=0).stop 2024-04-26T07:54:57.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/3363482804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf52f80 msgr2=0x5571dbf533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/3363482804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf52f80 0x5571dbf533a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x5571dbf3f3c0 tx=0x7f3270018830 comp rx=0 tx=0).stop 2024-04-26T07:54:57.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/3363482804 shutdown_connections 2024-04-26T07:54:57.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/3363482804 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f3150036e60 0x7f3150039320 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/3363482804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbf52f80 0x5571dbf533a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/3363482804 >> 172.21.15.62:0/3363482804 conn(0x5571dbf47020 msgr2=0x5571dbf47420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/3363482804 shutdown_connections 2024-04-26T07:54:57.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/3363482804 wait complete. 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf411f0 msgr2=0x5571dbf43680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf411f0 0x5571dbf43680 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbe3faf0 msgr2=0x5571dbf3ea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbe3faf0 0x5571dbf3ea20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f315c036e60 msgr2=0x7f315c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f315c036e60 0x7f315c039320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f326c001d90 tx=0x7f326c0012f0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 msgr2=0x5571dbe3ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3ca90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3268052740 tx=0x7f3268003020 comp rx=0 tx=0).stop 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 shutdown_connections 2024-04-26T07:54:57.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5571dbe3faf0 0x5571dbf3ea20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5571dbf411f0 0x5571dbf43680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f315c036e60 0x7f315c039320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 --2- 172.21.15.62:0/2389271010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5571dbe3d1c0 0x5571dbe3ca90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.208+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 >> 172.21.15.62:0/2389271010 conn(0x5571dbe36bb0 msgr2=0x5571dbf27d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.209+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 shutdown_connections 2024-04-26T07:54:57.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.209+0000 7f327b011800 1 -- 172.21.15.62:0/2389271010 wait complete. 2024-04-26T07:54:57.224 INFO:teuthology.orchestra.run.smithi062.stdout:fooFoofooFooFULL_CONTROL 2024-04-26T07:54:57.225 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-04-26T07:54:57.228 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-04-26T07:54:57.233 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:57.233 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T07:54:57.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T07:54:57.233 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-26T07:54:57.278 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:57.278 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.281+0000 7fbb40736800 1 Processor -- start 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.281+0000 7fbb40736800 1 -- start start 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.281+0000 7fbb40736800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559150162cb0 0x5591501650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.281+0000 7fbb40736800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591501655e0 con 0x55915015f1a0 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.281+0000 7fbb40736800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x559150000e20 con 0x559150162cb0 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.282+0000 7fbb3bccb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559150162cb0 0x5591501650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.282+0000 7fbb3c4cc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55915015f1a0 0x559150161590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:35962/0 (socket says 172.21.15.62:35962) 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.282+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/3160965826 learned_addr learned my addr 172.21.15.62:0/3160965826 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.282+0000 7fbb3bccb640 1 -- 172.21.15.62:0/3160965826 >> v1:172.21.15.1:6789/0 conn(0x55915015f1a0 legacy=0x559150161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.282+0000 7fbb3bccb640 1 -- 172.21.15.62:0/3160965826 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591501667c0 con 0x559150162cb0 2024-04-26T07:54:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb3bccb640 1 --2- 172.21.15.62:0/3160965826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559150162cb0 0x5591501650a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000a470 tx=0x7fbb3001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892e3982ceccbf7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb3b4ca640 1 -- 172.21.15.62:0/3160965826 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb30057070 con 0x559150162cb0 2024-04-26T07:54:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb3b4ca640 1 -- 172.21.15.62:0/3160965826 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb30052570 con 0x559150162cb0 2024-04-26T07:54:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb3b4ca640 1 -- 172.21.15.62:0/3160965826 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb30052870 con 0x559150162cb0 2024-04-26T07:54:57.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb40736800 1 -- 172.21.15.62:0/3160965826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559150162cb0 msgr2=0x5591501650a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb40736800 1 --2- 172.21.15.62:0/3160965826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559150162cb0 0x5591501650a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000a470 tx=0x7fbb3001ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:57.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb40736800 1 -- 172.21.15.62:0/3160965826 shutdown_connections 2024-04-26T07:54:57.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb40736800 1 --2- 172.21.15.62:0/3160965826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559150162cb0 0x5591501650a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.284+0000 7fbb40736800 1 -- 172.21.15.62:0/3160965826 >> 172.21.15.62:0/3160965826 conn(0x559150158bb0 msgr2=0x55915015afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.285+0000 7fbb40736800 1 -- 172.21.15.62:0/3160965826 shutdown_connections 2024-04-26T07:54:57.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.285+0000 7fbb40736800 1 -- 172.21.15.62:0/3160965826 wait complete. 2024-04-26T07:54:57.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.297+0000 7fbb40736800 1 Processor -- start 2024-04-26T07:54:57.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.297+0000 7fbb40736800 1 -- start start 2024-04-26T07:54:57.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.297+0000 7fbb40736800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x55915024fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.297+0000 7fbb40736800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5591500a9d00 con 0x55915015f1a0 2024-04-26T07:54:57.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.298+0000 7fbb3c4cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x55915024fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.298+0000 7fbb3c4cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x55915024fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57156/0 (socket says 172.21.15.62:57156) 2024-04-26T07:54:57.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.298+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/146328482 learned_addr learned my addr 172.21.15.62:0/146328482 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.298+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/146328482 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559150250270 con 0x55915015f1a0 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.298+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/146328482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x55915024fca0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c001d50 tx=0x7fbb2c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15365518ef44112 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fba2a60c640 1 -- 172.21.15.62:0/146328482 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb2c013030 con 0x55915015f1a0 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fba2a60c640 1 -- 172.21.15.62:0/146328482 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c00e470 con 0x55915015f1a0 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fba2a60c640 1 -- 172.21.15.62:0/146328482 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb2c00e810 con 0x55915015f1a0 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fbb40736800 1 -- 172.21.15.62:0/146328482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 msgr2=0x55915024fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fbb40736800 1 --2- 172.21.15.62:0/146328482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x55915024fca0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c001d50 tx=0x7fbb2c00b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fbb40736800 1 -- 172.21.15.62:0/146328482 shutdown_connections 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fbb40736800 1 --2- 172.21.15.62:0/146328482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x55915024fca0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fbb40736800 1 -- 172.21.15.62:0/146328482 >> 172.21.15.62:0/146328482 conn(0x559150158bb0 msgr2=0x55915024b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fbb40736800 1 -- 172.21.15.62:0/146328482 shutdown_connections 2024-04-26T07:54:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.299+0000 7fbb40736800 1 -- 172.21.15.62:0/146328482 wait complete. 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb40736800 1 Processor -- start 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb40736800 1 -- start start 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb40736800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x5591502577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb40736800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559150165ab0 con 0x55915015f1a0 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb3c4cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x5591502577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb3c4cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x5591502577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57166/0 (socket says 172.21.15.62:57166) 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/2120580459 learned_addr learned my addr 172.21.15.62:0/2120580459 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/2120580459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559150257d30 con 0x55915015f1a0 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.300+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x5591502577f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x559150250a30 tx=0x7fbb2c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.301+0000 7fba28e09640 1 -- 172.21.15.62:0/2120580459 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb2c027070 con 0x55915015f1a0 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.301+0000 7fba28e09640 1 -- 172.21.15.62:0/2120580459 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c019900 con 0x55915015f1a0 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.301+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559150257fc0 con 0x55915015f1a0 2024-04-26T07:54:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.301+0000 7fba28e09640 1 -- 172.21.15.62:0/2120580459 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb2c019c40 con 0x55915015f1a0 2024-04-26T07:54:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.301+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915025ac70 con 0x55915015f1a0 2024-04-26T07:54:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.301+0000 7fba28e09640 1 -- 172.21.15.62:0/2120580459 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbb2c02a070 con 0x55915015f1a0 2024-04-26T07:54:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.302+0000 7fba28e09640 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba24036e60 0x7fba24039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.302+0000 7fba28e09640 1 -- 172.21.15.62:0/2120580459 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbb2c01f070 con 0x55915015f1a0 2024-04-26T07:54:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.302+0000 7fbb3bccb640 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba24036e60 0x7fba24039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.302+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150162cb0 0x55915025ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.302+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55915025f000 con 0x559150162cb0 2024-04-26T07:54:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.302+0000 7fbb3cccd640 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150162cb0 0x55915025ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.302+0000 7fbb3bccb640 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba24036e60 0x7fba24039320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb30054000 tx=0x7fbb3004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.302+0000 7fbb3cccd640 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150162cb0 0x55915025ea30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.303+0000 7fbb3cccd640 1 -- 172.21.15.62:0/2120580459 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3400a4a0 con 0x559150162cb0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.303+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55915025c000 con 0x559150162cb0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.303+0000 7fbb3cccd640 1 -- 172.21.15.62:0/2120580459 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb3400a4a0 con 0x559150162cb0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.303+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150261310 0x559150263700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.303+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559150263da0 con 0x559150261310 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.303+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150261310 0x559150263700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.303+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150261310 0x559150263700 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.304+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/2120580459 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbb2c029030 con 0x559150261310 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.304+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502602c0 con 0x559150162cb0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.304+0000 7fbb3cccd640 1 -- 172.21.15.62:0/2120580459 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb3400a4a0 con 0x559150162cb0 2024-04-26T07:54:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.304+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502607a0 con 0x559150162cb0 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.304+0000 7fbb3cccd640 1 -- 172.21.15.62:0/2120580459 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbb3400a4a0 con 0x559150162cb0 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.305+0000 7fbb40736800 1 Processor -- start 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.305+0000 7fbb40736800 1 -- start start 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.305+0000 7fbb40736800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015ed20 0x55915015d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.305+0000 7fbb40736800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559150051170 con 0x55915015ed20 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.305+0000 7fbb3cccd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015ed20 0x55915015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.305+0000 7fbb3cccd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015ed20 0x55915015d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57168/0 (socket says 172.21.15.62:57168) 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.305+0000 7fbb3cccd640 1 -- 172.21.15.62:0/2973646250 learned_addr learned my addr 172.21.15.62:0/2973646250 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.305+0000 7fbb3cccd640 1 -- 172.21.15.62:0/2973646250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915015d6d0 con 0x55915015ed20 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.306+0000 7fbb3cccd640 1 --2- 172.21.15.62:0/2973646250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015ed20 0x55915015d190 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55915025f3c0 tx=0x7fbb34018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.306+0000 7fba21ffb640 1 -- 172.21.15.62:0/2973646250 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb34014450 con 0x55915015ed20 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.306+0000 7fba21ffb640 1 -- 172.21.15.62:0/2973646250 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb34014610 con 0x55915015ed20 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.306+0000 7fba21ffb640 1 -- 172.21.15.62:0/2973646250 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb34014930 con 0x55915015ed20 2024-04-26T07:54:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.306+0000 7fbb40736800 1 -- 172.21.15.62:0/2973646250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55915015d900 con 0x55915015ed20 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.306+0000 7fbb40736800 1 -- 172.21.15.62:0/2973646250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915015de00 con 0x55915015ed20 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fba21ffb640 1 -- 172.21.15.62:0/2973646250 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbb34011040 con 0x55915015ed20 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fba21ffb640 1 --2- 172.21.15.62:0/2973646250 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba14036e60 0x7fba14039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fba21ffb640 1 -- 172.21.15.62:0/2973646250 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbb3401e070 con 0x55915015ed20 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/2973646250 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba14036e60 0x7fba14039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb40736800 1 Processor -- start 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb40736800 1 -- start start 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/2973646250 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba14036e60 0x7fba14039320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55915025f430 tx=0x7fbb2c00ef30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb40736800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb40736800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5591502505f0 con 0x5591502824b0 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb3cccd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb3cccd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502828d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57174/0 (socket says 172.21.15.62:57174) 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.307+0000 7fbb3cccd640 1 -- 172.21.15.62:0/1676024554 learned_addr learned my addr 172.21.15.62:0/1676024554 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb3cccd640 1 -- 172.21.15.62:0/1676024554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559150282ea0 con 0x5591502824b0 2024-04-26T07:54:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb3cccd640 1 --2- 172.21.15.62:0/1676024554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502828d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbb3404cf50 tx=0x7fbb3400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934acffd5c113a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fba137fe640 1 -- 172.21.15.62:0/1676024554 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb34016960 con 0x5591502824b0 2024-04-26T07:54:57.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fba137fe640 1 -- 172.21.15.62:0/1676024554 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb34016440 con 0x5591502824b0 2024-04-26T07:54:57.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fba137fe640 1 -- 172.21.15.62:0/1676024554 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb34016b00 con 0x5591502824b0 2024-04-26T07:54:57.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb40736800 1 -- 172.21.15.62:0/1676024554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 msgr2=0x5591502828d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb40736800 1 --2- 172.21.15.62:0/1676024554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502828d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbb3404cf50 tx=0x7fbb3400dd90 comp rx=0 tx=0).stop 2024-04-26T07:54:57.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb40736800 1 -- 172.21.15.62:0/1676024554 shutdown_connections 2024-04-26T07:54:57.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb40736800 1 --2- 172.21.15.62:0/1676024554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502828d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb40736800 1 -- 172.21.15.62:0/1676024554 >> 172.21.15.62:0/1676024554 conn(0x55915027e780 msgr2=0x55915027c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb40736800 1 -- 172.21.15.62:0/1676024554 shutdown_connections 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.308+0000 7fbb40736800 1 -- 172.21.15.62:0/1676024554 wait complete. 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb40736800 1 Processor -- start 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb40736800 1 -- start start 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb40736800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502899f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb40736800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559150283630 con 0x5591502824b0 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb3cccd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb3cccd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502899f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57178/0 (socket says 172.21.15.62:57178) 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 learned_addr learned my addr 172.21.15.62:0/304664924 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559150289f30 con 0x5591502824b0 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.309+0000 7fbb3cccd640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502899f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbb34048010 tx=0x7fbb3404cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.310+0000 7fba11ffb640 1 -- 172.21.15.62:0/304664924 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3404e5d0 con 0x5591502824b0 2024-04-26T07:54:57.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.310+0000 7fba11ffb640 1 -- 172.21.15.62:0/304664924 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb34042040 con 0x5591502824b0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.310+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55915028a1c0 con 0x5591502824b0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.310+0000 7fba11ffb640 1 -- 172.21.15.62:0/304664924 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3404e8e0 con 0x5591502824b0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.310+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915028ce70 con 0x5591502824b0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.310+0000 7fba11ffb640 1 -- 172.21.15.62:0/304664924 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbb3402b350 con 0x5591502824b0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.310+0000 7fba11ffb640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba04036e60 0x7fba04039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.310+0000 7fba11ffb640 1 -- 172.21.15.62:0/304664924 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fbb3400e040 con 0x5591502824b0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.311+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba04036e60 0x7fba04039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.311+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba04036e60 0x7fba04039320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c04b4e0 tx=0x7fbb2c041000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.311+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.311+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150295590 0x559150297a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.311+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502981a0 con 0x559150295590 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.311+0000 7fbb3bccb640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150295590 0x559150297a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb3bccb640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150295590 0x559150297a50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 20 realm 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559150298570 con 0x559150295590 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559150298e40 con 0x559150295590 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.312+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502991e0 con 0x559150295590 2024-04-26T07:54:57.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb40736800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150299f40 0x55915029c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55915029c8f0 con 0x559150299f40 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb3cccd640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150299f40 0x55915029c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb3cccd640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150299f40 0x55915029c330 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb40736800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb40736800 20 searching for the correct realm 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55915029e8c0 0x5591502a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.313+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.314+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55915029e8c0 0x5591502a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.314+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55915029e8c0 0x5591502a0d80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.314+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.314+0000 7fbb3c4cc640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbb2c02c060 0x7fbb2c04b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.314+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x7fbb2c02c060 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.314+0000 7fbb3bccb640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbb2c02c060 0x7fbb2c04b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.315+0000 7fbb3bccb640 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbb2c02c060 0x7fbb2c04b590 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.315+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.315+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.315+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.315+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150295590 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.316+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.316+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150295590 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.316+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.316+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.316+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.316+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.316+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.316+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x7fbb2c02c060 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.317+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.317+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.317+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.317+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150295590 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.317+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.317+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.317+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.317+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150295590 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.318+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.318+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x7fbb2c02c060 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.318+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.318+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.318+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.318+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.318+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.318+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.319+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.319+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.319+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.319+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.319+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.319+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150295590 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.319+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.319+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150295590 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.320+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.320+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.320+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.320+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.320+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.320+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x7fbb2c02c060 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.320+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.320+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150295590 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.321+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.321+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.321+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.321+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.321+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.321+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.321+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.321+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x7fbb2c02c060 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.322+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.322+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x55915029e8c0 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.322+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.322+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150299f40 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.322+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.322+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x559150295590 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.322+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5591502a1450 con 0x7fbb2c02c060 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:57.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55915029d2b0 con 0x559150295590 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55915029cec0 con 0x559150295590 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.323+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55915029dc20 con 0x559150295590 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 zone default found 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 4 Realm: () 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 zonegroup default 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502a18d0 con 0x559150299f40 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502a3b70 con 0x55915029e8c0 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502a3f10 con 0x55915029e8c0 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 started sync module instance, tier type = 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.324+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a3000 con 0x7fbb2c02c060 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.325+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.325+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94082603562240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a3000 con 0x7fbb2c02c060 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.326+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a4960 con 0x559150295590 2024-04-26T07:54:57.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.327+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94082603562240] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.327+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.327+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94082603566192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a3000 con 0x559150295590 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.327+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a5410 con 0x55915029e8c0 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.328+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94082603566192] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.328+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.328+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94082603559760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a2f70 con 0x55915029e8c0 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.328+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a62d0 con 0x7fbb2c02c060 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.329+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94082603559760] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.329+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.329+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94082603572768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a6240 con 0x7fbb2c02c060 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.329+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a7190 con 0x559150295590 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.330+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94082603572768] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.331+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.331+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94082603574832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a7190 con 0x559150295590 2024-04-26T07:54:57.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.331+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a7b50 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.332+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94082603574832] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.332+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.332+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94082603576544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a7100 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.332+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a8850 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.333+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94082603576544] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.333+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.333+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94082603581168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a87c0 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.333+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a92a0 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94082603584944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a9750 con 0x559150299f40 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb40736800 20 add_watcher() i=0 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb40736800 20 add_watcher() i=1 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb40736800 20 add_watcher() i=2 2024-04-26T07:54:57.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb40736800 20 add_watcher() i=3 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb40736800 20 add_watcher() i=4 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb40736800 20 add_watcher() i=5 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94082603581168] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.334+0000 7fbb40736800 20 add_watcher() i=6 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.335+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94082603584944] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.335+0000 7fbb40736800 20 add_watcher() i=7 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.335+0000 7fbb40736800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.335+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502a9750 con 0x559150295590 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.335+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.335+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94082603586208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502a9730 con 0x559150295590 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.336+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94082603586208] v27'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fb9f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fbb40736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fbb40736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fbb40736800 5 note: GC not initialized 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fb9f17e2640 20 reqs_thread_entry: start 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fbb40736800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fbb40736800 20 Filter name: none 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fb962ffd640 20 reqs_thread_entry: start 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fbb40736800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.337+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502e0260 con 0x7fbb2c02c060 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 : miss 2024-04-26T07:54:57.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.3 8:c6c1f974:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502e1e20 con 0x559150295590 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(63 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 info.flags=0x17 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 to cache LRU end 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 20 get_obj_state: octx=0x7fbb30052be0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5591502e44e8 s->prefetch_data=0 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.338+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 3.21s0 3:85051d9a:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5591502e5620 con 0x559150299f40 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.339+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(64 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.339+0000 7fbb40736800 10 manifest: total_size = 5 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.339+0000 7fbb40736800 20 get_obj_state: setting s->obj_tag to _UGh3gjz1wDwIGxFVKUCqYE7F1iWnWe7 2024-04-26T07:54:57.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.339+0000 7fb9f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.339+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94082603586208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502ddbb0 con 0x559150295590 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.340+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94082603586208] v27'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.341+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94082603562240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502e5620 con 0x7fbb2c02c060 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.341+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94082603562240] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.341+0000 7fbb40736800 20 remove_watcher() i=0 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.342+0000 7fbb40736800 2 removed watcher, disabling cache 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.342+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94082603566192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502e5620 con 0x559150295590 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.343+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94082603566192] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.343+0000 7fbb40736800 20 remove_watcher() i=1 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.343+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94082603559760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502e5620 con 0x55915029e8c0 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.344+0000 7fbb3c4cc640 1 -- 172.21.15.62:0/304664924 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94082603559760] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c029030 con 0x55915029e8c0 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.344+0000 7fbb40736800 20 remove_watcher() i=2 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.344+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94082603572768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502ddbb0 con 0x7fbb2c02c060 2024-04-26T07:54:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.345+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94082603572768] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x7fbb2c02c060 2024-04-26T07:54:57.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.345+0000 7fbb40736800 20 remove_watcher() i=3 2024-04-26T07:54:57.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.345+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94082603574832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502ddbb0 con 0x559150295590 2024-04-26T07:54:57.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.346+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94082603574832] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3005a040 con 0x559150295590 2024-04-26T07:54:57.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.346+0000 7fbb40736800 20 remove_watcher() i=4 2024-04-26T07:54:57.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.346+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94082603576544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502ddbb0 con 0x559150299f40 2024-04-26T07:54:57.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.347+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94082603576544] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.347+0000 7fbb40736800 20 remove_watcher() i=5 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.347+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94082603581168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502ddbb0 con 0x559150299f40 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.348+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94082603581168] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.348+0000 7fbb40736800 20 remove_watcher() i=6 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.348+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94082603584944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5591502ddbb0 con 0x559150299f40 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.349+0000 7fbb3cccd640 1 -- 172.21.15.62:0/304664924 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94082603584944] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3402a070 con 0x559150299f40 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.349+0000 7fbb40736800 20 remove_watcher() i=7 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150299f40 msgr2=0x55915029c330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150299f40 0x55915029c330 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150295590 msgr2=0x559150297a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150295590 0x559150297a50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbb2c02c060 msgr2=0x7fbb2c04b590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbb2c02c060 0x7fbb2c04b590 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55915029e8c0 msgr2=0x5591502a0d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55915029e8c0 0x5591502a0d80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba04036e60 msgr2=0x7fba04039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba04036e60 0x7fba04039320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c04b4e0 tx=0x7fbb2c041000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 msgr2=0x5591502899f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb3bccb640 1 -- 172.21.15.62:0/304664924 reap_dead start 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502899f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbb34048010 tx=0x7fbb3404cee0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 shutdown_connections 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/304664924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5591502824b0 0x5591502899f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 >> 172.21.15.62:0/304664924 conn(0x55915027e780 msgr2=0x55915027bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 shutdown_connections 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/304664924 wait complete. 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/2973646250 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba14036e60 msgr2=0x7fba14039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/2973646250 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba14036e60 0x7fba14039320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55915025f430 tx=0x7fbb2c00ef30 comp rx=0 tx=0).stop 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/2973646250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015ed20 msgr2=0x55915015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/2973646250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015ed20 0x55915015d190 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55915025f3c0 tx=0x7fbb34018830 comp rx=0 tx=0).stop 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/2973646250 shutdown_connections 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/2973646250 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba14036e60 0x7fba14039320 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 --2- 172.21.15.62:0/2973646250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015ed20 0x55915015d190 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/2973646250 >> 172.21.15.62:0/2973646250 conn(0x559150266fe0 msgr2=0x5591502673e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/2973646250 shutdown_connections 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.350+0000 7fbb40736800 1 -- 172.21.15.62:0/2973646250 wait complete. 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150261310 msgr2=0x559150263700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150261310 0x559150263700 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150162cb0 msgr2=0x55915025ea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150162cb0 0x55915025ea30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba24036e60 msgr2=0x7fba24039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba24036e60 0x7fba24039320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb30054000 tx=0x7fbb3004e000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 msgr2=0x5591502577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x5591502577f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x559150250a30 tx=0x7fbb2c000bc0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 shutdown_connections 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559150162cb0 0x55915025ea30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559150261310 0x559150263700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fba24036e60 0x7fba24039320 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 --2- 172.21.15.62:0/2120580459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55915015f1a0 0x5591502577f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 >> 172.21.15.62:0/2120580459 conn(0x559150158bb0 msgr2=0x559150249e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 shutdown_connections 2024-04-26T07:54:57.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.351+0000 7fbb40736800 1 -- 172.21.15.62:0/2120580459 wait complete. 2024-04-26T07:54:57.358 INFO:teuthology.orchestra.run.smithi062.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-26T07:54:57.358 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-26T07:54:57.360 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-04-26T07:54:57.375 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:57.471 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-26T07:54:57.471 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-26T07:54:57.471 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T07:54:57.472 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-26T07:54:57.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-26T07:54:57.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-26T07:54:57.472 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-04-26T07:54:57.518 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:57.518 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.521+0000 7f97ad72e800 1 Processor -- start 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.521+0000 7f97ad72e800 1 -- start start 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.521+0000 7f97ad72e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x560902510110 0x560902512500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.521+0000 7f97ad72e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560902516550 con 0x560902512a40 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.521+0000 7f97ad72e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5609023b1e20 con 0x560902510110 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.521+0000 7f97a9492640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x560902510110 0x560902512500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.521+0000 7f97a8c91640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x560902512a40 0x560902514e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:35972/0 (socket says 172.21.15.62:35972) 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.521+0000 7f97a8c91640 1 -- 172.21.15.62:0/2524711554 learned_addr learned my addr 172.21.15.62:0/2524711554 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.522+0000 7f97a9492640 1 -- 172.21.15.62:0/2524711554 >> v1:172.21.15.1:6789/0 conn(0x560902512a40 legacy=0x560902514e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.522+0000 7f97a9492640 1 -- 172.21.15.62:0/2524711554 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560902517730 con 0x560902510110 2024-04-26T07:54:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.523+0000 7f97a9492640 1 --2- 172.21.15.62:0/2524711554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902512500 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f979c005fd0 tx=0x7f979c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1407b97bbe544f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97a3fff640 1 -- 172.21.15.62:0/2524711554 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c052560 con 0x560902510110 2024-04-26T07:54:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97a3fff640 1 -- 172.21.15.62:0/2524711554 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979c052700 con 0x560902510110 2024-04-26T07:54:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97a3fff640 1 -- 172.21.15.62:0/2524711554 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c052a60 con 0x560902510110 2024-04-26T07:54:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97ad72e800 1 -- 172.21.15.62:0/2524711554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 msgr2=0x560902512500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2524711554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902512500 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f979c005fd0 tx=0x7f979c01ccc0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97ad72e800 1 -- 172.21.15.62:0/2524711554 shutdown_connections 2024-04-26T07:54:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2524711554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902512500 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97ad72e800 1 -- 172.21.15.62:0/2524711554 >> 172.21.15.62:0/2524711554 conn(0x560902509be0 msgr2=0x56090250c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97ad72e800 1 -- 172.21.15.62:0/2524711554 shutdown_connections 2024-04-26T07:54:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.524+0000 7f97ad72e800 1 -- 172.21.15.62:0/2524711554 wait complete. 2024-04-26T07:54:57.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.537+0000 7f97ad72e800 1 Processor -- start 2024-04-26T07:54:57.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.537+0000 7f97ad72e800 1 -- start start 2024-04-26T07:54:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.537+0000 7f97ad72e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902600c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.537+0000 7f97ad72e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56090245ad00 con 0x560902510110 2024-04-26T07:54:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.537+0000 7f97a9492640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902600c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.537+0000 7f97a9492640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902600c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57190/0 (socket says 172.21.15.62:57190) 2024-04-26T07:54:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.537+0000 7f97a9492640 1 -- 172.21.15.62:0/4172296737 learned_addr learned my addr 172.21.15.62:0/4172296737 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.538+0000 7f97a9492640 1 -- 172.21.15.62:0/4172296737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560902601200 con 0x560902510110 2024-04-26T07:54:57.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.538+0000 7f97a9492640 1 --2- 172.21.15.62:0/4172296737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902600c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f979c007000 tx=0x7f979c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401b02e4da4b0be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.538+0000 7f9697606640 1 -- 172.21.15.62:0/4172296737 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c0529e0 con 0x560902510110 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.538+0000 7f9697606640 1 -- 172.21.15.62:0/4172296737 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979c052b80 con 0x560902510110 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.538+0000 7f9697606640 1 -- 172.21.15.62:0/4172296737 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c05c430 con 0x560902510110 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 -- 172.21.15.62:0/4172296737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 msgr2=0x560902600c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4172296737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902600c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f979c007000 tx=0x7f979c04c000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 -- 172.21.15.62:0/4172296737 shutdown_connections 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4172296737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x560902600c30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 -- 172.21.15.62:0/4172296737 >> 172.21.15.62:0/4172296737 conn(0x560902509be0 msgr2=0x5609025fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 -- 172.21.15.62:0/4172296737 shutdown_connections 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 -- 172.21.15.62:0/4172296737 wait complete. 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 Processor -- start 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 -- start start 2024-04-26T07:54:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x5609026086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.539+0000 7f97ad72e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5609025169c0 con 0x560902510110 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f97a9492640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x5609026086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f97a9492640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x5609026086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57192/0 (socket says 172.21.15.62:57192) 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f97a9492640 1 -- 172.21.15.62:0/4123363984 learned_addr learned my addr 172.21.15.62:0/4123363984 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f97a9492640 1 -- 172.21.15.62:0/4123363984 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560902608be0 con 0x560902510110 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f97a9492640 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x5609026086a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f979c0526d0 tx=0x7f979c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f9695e03640 1 -- 172.21.15.62:0/4123363984 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c075070 con 0x560902510110 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f9695e03640 1 -- 172.21.15.62:0/4123363984 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979c070540 con 0x560902510110 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560902608e70 con 0x560902510110 2024-04-26T07:54:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.540+0000 7f9695e03640 1 -- 172.21.15.62:0/4123363984 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c070820 con 0x560902510110 2024-04-26T07:54:57.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.541+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56090260bb20 con 0x560902510110 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.541+0000 7f9695e03640 1 -- 172.21.15.62:0/4123363984 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f979c078070 con 0x560902510110 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.541+0000 7f9695e03640 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9690036e60 0x7f9690039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.541+0000 7f9695e03640 1 -- 172.21.15.62:0/4123363984 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f979c06d070 con 0x560902510110 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.542+0000 7f97a8c91640 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9690036e60 0x7f9690039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.542+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902512a40 0x56090260f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.542+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090260feb0 con 0x560902512a40 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.542+0000 7f97a9c93640 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902512a40 0x56090260f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.542+0000 7f97a8c91640 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9690036e60 0x7f9690039320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9794000f60 tx=0x7f97940012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.542+0000 7f97a9c93640 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902512a40 0x56090260f8e0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.542+0000 7f97a9c93640 1 -- 172.21.15.62:0/4123363984 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x560902512a40 2024-04-26T07:54:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.542+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090260ce90 con 0x560902512a40 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.543+0000 7f97a9c93640 1 -- 172.21.15.62:0/4123363984 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97a40083e0 con 0x560902512a40 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.543+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5609026121c0 0x5609026145b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.543+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902614ca0 con 0x5609026121c0 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.543+0000 7f97a9492640 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5609026121c0 0x5609026145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.543+0000 7f97a9492640 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5609026121c0 0x5609026145b0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.543+0000 7f97a9492640 1 -- 172.21.15.62:0/4123363984 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f979c077030 con 0x5609026121c0 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.543+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902611170 con 0x560902512a40 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.544+0000 7f97a9c93640 1 -- 172.21.15.62:0/4123363984 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97a40083e0 con 0x560902512a40 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.544+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902611630 con 0x560902512a40 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.544+0000 7f97a9c93640 1 -- 172.21.15.62:0/4123363984 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f97a40083e0 con 0x560902512a40 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.544+0000 7f97ad72e800 1 Processor -- start 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.544+0000 7f97ad72e800 1 -- start start 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.544+0000 7f97ad72e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902623e50 0x560902624270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.544+0000 7f97ad72e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560902402170 con 0x560902623e50 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f97a9c93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902623e50 0x560902624270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f97a9c93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902623e50 0x560902624270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57208/0 (socket says 172.21.15.62:57208) 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f97a9c93640 1 -- 172.21.15.62:0/791301721 learned_addr learned my addr 172.21.15.62:0/791301721 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f97a9c93640 1 -- 172.21.15.62:0/791301721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609026247b0 con 0x560902623e50 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f97a9c93640 1 --2- 172.21.15.62:0/791301721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902623e50 0x560902624270 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x560902609aa0 tx=0x7f97a400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f968effd640 1 -- 172.21.15.62:0/791301721 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a4007d00 con 0x560902623e50 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f968effd640 1 -- 172.21.15.62:0/791301721 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a401e020 con 0x560902623e50 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f97ad72e800 1 -- 172.21.15.62:0/791301721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560902625220 con 0x560902623e50 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f968effd640 1 -- 172.21.15.62:0/791301721 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a4019420 con 0x560902623e50 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.545+0000 7f97ad72e800 1 -- 172.21.15.62:0/791301721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560902625720 con 0x560902623e50 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.546+0000 7f968effd640 1 -- 172.21.15.62:0/791301721 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f97a4016040 con 0x560902623e50 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.546+0000 7f968effd640 1 --2- 172.21.15.62:0/791301721 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9680036eb0 0x7f9680039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.546+0000 7f968effd640 1 -- 172.21.15.62:0/791301721 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f97a401f030 con 0x560902623e50 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.546+0000 7f97a9492640 1 --2- 172.21.15.62:0/791301721 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9680036eb0 0x7f9680039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97ad72e800 1 Processor -- start 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97a9492640 1 --2- 172.21.15.62:0/791301721 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9680036eb0 0x7f9680039370 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x560902610330 tx=0x7f979c06ef10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97ad72e800 1 -- start start 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97ad72e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x560902631600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97ad72e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560902601520 con 0x5609026311e0 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97a9c93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x560902631600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97a9c93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x560902631600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57212/0 (socket says 172.21.15.62:57212) 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97a9c93640 1 -- 172.21.15.62:0/3608240995 learned_addr learned my addr 172.21.15.62:0/3608240995 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97a9c93640 1 -- 172.21.15.62:0/3608240995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560902631bd0 con 0x5609026311e0 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.547+0000 7f97a9c93640 1 --2- 172.21.15.62:0/3608240995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x560902631600 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f97a404cec0 tx=0x7f97a4014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afed0aa9271eae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f968cff9640 1 -- 172.21.15.62:0/3608240995 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a401d070 con 0x5609026311e0 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f968cff9640 1 -- 172.21.15.62:0/3608240995 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a4017570 con 0x5609026311e0 2024-04-26T07:54:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f968cff9640 1 -- 172.21.15.62:0/3608240995 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a4017870 con 0x5609026311e0 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f97ad72e800 1 -- 172.21.15.62:0/3608240995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 msgr2=0x560902631600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f97ad72e800 1 --2- 172.21.15.62:0/3608240995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x560902631600 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f97a404cec0 tx=0x7f97a4014640 comp rx=0 tx=0).stop 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f97ad72e800 1 -- 172.21.15.62:0/3608240995 shutdown_connections 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f97ad72e800 1 --2- 172.21.15.62:0/3608240995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x560902631600 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f97ad72e800 1 -- 172.21.15.62:0/3608240995 >> 172.21.15.62:0/3608240995 conn(0x56090262d4a0 msgr2=0x56090262b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f97ad72e800 1 -- 172.21.15.62:0/3608240995 shutdown_connections 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f97ad72e800 1 -- 172.21.15.62:0/3608240995 wait complete. 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.548+0000 7f97ad72e800 1 Processor -- start 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97ad72e800 1 -- start start 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97ad72e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x56090250fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97ad72e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560902632310 con 0x5609026311e0 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97a9c93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x56090250fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97a9c93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x56090250fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57216/0 (socket says 172.21.15.62:57216) 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 learned_addr learned my addr 172.21.15.62:0/2349596296 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090250e120 con 0x5609026311e0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97a9c93640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x56090250fa30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f97a404cec0 tx=0x7f97a404ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f967effd640 1 -- 172.21.15.62:0/2349596296 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a4019a80 con 0x5609026311e0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f967effd640 1 -- 172.21.15.62:0/2349596296 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a404e330 con 0x5609026311e0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56090250e3b0 con 0x5609026311e0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.549+0000 7f967effd640 1 -- 172.21.15.62:0/2349596296 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a404e650 con 0x5609026311e0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.550+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56090250e850 con 0x5609026311e0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.550+0000 7f967effd640 1 -- 172.21.15.62:0/2349596296 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f97a404ebd0 con 0x5609026311e0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.550+0000 7f967effd640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9674036e60 0x7f9674039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.550+0000 7f967effd640 1 -- 172.21.15.62:0/2349596296 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f97a4038c30 con 0x5609026311e0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.550+0000 7f97a9492640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9674036e60 0x7f9674039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.551+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.551+0000 7f97a9492640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9674036e60 0x7f9674039320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f979c08d130 tx=0x7f979c08c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.551+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902646470 0x560902648930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.551+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902649080 con 0x560902646470 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.551+0000 7f97a8c91640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902646470 0x560902648930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.551+0000 7f97a8c91640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902646470 0x560902648930 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9794009050 con 0x560902646470 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 realm 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026458c0 con 0x560902646470 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9794009050 con 0x560902646470 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902649b70 con 0x560902646470 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9794009050 con 0x560902646470 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090264a440 con 0x560902646470 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9794009050 con 0x560902646470 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56090264ad80 0x56090264d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.552+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090264d920 con 0x56090264ad80 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.553+0000 7f97a9c93640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56090264ad80 0x56090264d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.553+0000 7f97a9c93640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56090264ad80 0x56090264d190 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.553+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.553+0000 7f97ad72e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:57.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.553+0000 7f97ad72e800 20 searching for the correct realm 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.553+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56090264f8d0 0x560902651d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.553+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.553+0000 7f97a9492640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56090264f8d0 0x560902651d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.554+0000 7f97a9492640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56090264f8d0 0x560902651d90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.554+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.554+0000 7f97a9492640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f979c07a060 0x7f979c05b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.554+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x7f979c07a060 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.554+0000 7f97a8c91640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f979c07a060 0x7f979c05b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.555+0000 7f97a8c91640 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f979c07a060 0x7f979c05b390 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.555+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794009050 con 0x7f979c07a060 2024-04-26T07:54:57.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.555+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.555+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.555+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x560902646470 2024-04-26T07:54:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.556+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794009050 con 0x560902646470 2024-04-26T07:54:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.556+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x560902646470 2024-04-26T07:54:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.556+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.556+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.556+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.556+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.557+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.557+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x7f979c07a060 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.557+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794029040 con 0x7f979c07a060 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.557+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.557+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.557+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x560902646470 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.557+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.557+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.558+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.558+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x560902646470 2024-04-26T07:54:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.558+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.558+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x7f979c07a060 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.558+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9794029040 con 0x7f979c07a060 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.558+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.558+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.558+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.559+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.559+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.559+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.559+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.560+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.560+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.560+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.560+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x560902646470 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.560+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.560+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x560902646470 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.560+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.560+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.561+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.561+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.561+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.561+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x7f979c07a060 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.561+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794029040 con 0x7f979c07a060 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.561+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x560902646470 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.561+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.561+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.562+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.562+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.562+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.562+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.562+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.562+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x7f979c07a060 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.562+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794029040 con 0x7f979c07a060 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.562+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264f8d0 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x56090264ad80 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x560902646470 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560902652460 con 0x7f979c07a060 2024-04-26T07:54:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9794029040 con 0x7f979c07a060 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97ad72e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97ad72e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97ad72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97ad72e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97ad72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97ad72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.563+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090264e2e0 con 0x560902646470 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090264eb80 con 0x560902646470 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090264df20 con 0x560902646470 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9794029040 con 0x560902646470 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 zone default found 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 4 Realm: () 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 zonegroup default 2024-04-26T07:54:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090264e7e0 con 0x56090264ad80 2024-04-26T07:54:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.564+0000 7f97ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902654cc0 con 0x56090264f8d0 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902655060 con 0x56090264f8d0 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 20 started sync module instance, tier type = 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.565+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902654150 con 0x7f979c07a060 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.566+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.566+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596694885968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902654150 con 0x7f979c07a060 2024-04-26T07:54:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.566+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902655a60 con 0x560902646470 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.567+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596694885968] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.568+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.568+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596694889840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902654150 con 0x560902646470 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.568+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902656520 con 0x56090264f8d0 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.569+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.569+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596694892528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902656dc0 con 0x56090264f8d0 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.569+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902657880 con 0x7f979c07a060 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.569+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596694889840] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.570+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596694892528] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.570+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.570+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596694894864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902653ca0 con 0x7f979c07a060 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.570+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902658120 con 0x560902646470 2024-04-26T07:54:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.571+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.571+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596694899696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902658550 con 0x560902646470 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.571+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902659050 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.571+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596694894864] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.572+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596694899696] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.572+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.572+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596694900752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902659010 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.572+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609026598f0 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.573+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596694900752] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.573+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.573+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596694903616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902659010 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.573+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902659f70 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596694907488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902659f30 con 0x56090264ad80 2024-04-26T07:54:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97ad72e800 20 add_watcher() i=0 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97ad72e800 20 add_watcher() i=1 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97ad72e800 20 add_watcher() i=2 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97ad72e800 20 add_watcher() i=3 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97ad72e800 20 add_watcher() i=4 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97ad72e800 20 add_watcher() i=5 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596694903616] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.574+0000 7f97ad72e800 20 add_watcher() i=6 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.575+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596694907488] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.575+0000 7f97ad72e800 20 add_watcher() i=7 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.575+0000 7f97ad72e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.575+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902659440 con 0x560902646470 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.576+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.576+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596694909792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902659440 con 0x560902646470 2024-04-26T07:54:57.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.577+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596694909792] v27'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.577+0000 7f965f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.577+0000 7f97ad72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:57.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.577+0000 7f97ad72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:57.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.577+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902666090 con 0x560902646470 2024-04-26T07:54:57.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.578+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.578+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902666760 con 0x56090264ad80 2024-04-26T07:54:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.579+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.579+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902666760 con 0x56090264f8d0 2024-04-26T07:54:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.580+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.580+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667010 con 0x560902646470 2024-04-26T07:54:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.581+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.581+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902661d20 con 0x7f979c07a060 2024-04-26T07:54:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.582+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.582+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902661d20 con 0x56090264f8d0 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.583+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.583+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x560902646470 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.585+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.585+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264ad80 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.586+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.586+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x7f979c07a060 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.587+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.587+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.588+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.588+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x7f979c07a060 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.589+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.589+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264ad80 2024-04-26T07:54:57.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.590+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.590+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x7f979c07a060 2024-04-26T07:54:57.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.591+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.591+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264ad80 2024-04-26T07:54:57.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.592+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.592+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x560902646470 2024-04-26T07:54:57.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.593+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.593+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.595+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.595+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x7f979c07a060 2024-04-26T07:54:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.596+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.596+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.597+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.597+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x560902646470 2024-04-26T07:54:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.598+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.598+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x560902646470 2024-04-26T07:54:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.599+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.599+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.600+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.600+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x7f979c07a060 2024-04-26T07:54:57.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.601+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.601+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.602+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.602+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.603+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.603+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.604+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.604+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.605+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.605+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264ad80 2024-04-26T07:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.606+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.606+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.607+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.607+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264ad80 2024-04-26T07:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.608+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.608+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264f8d0 2024-04-26T07:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.609+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.609+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x56090264ad80 2024-04-26T07:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.611+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'50 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.611+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902667b70 con 0x7f979c07a060 2024-04-26T07:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f965e7e4640 20 reqs_thread_entry: start 2024-04-26T07:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97ad72e800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97ad72e800 20 Filter name: none 2024-04-26T07:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f95cffff640 20 reqs_thread_entry: start 2024-04-26T07:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97ad72e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902693460 con 0x7f979c07a060 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97ad72e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.612+0000 7f97ad72e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 : miss 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 8.3 8:c6c1f974:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026949c0 con 0x560902646470 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(95 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 info.flags=0x17 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 to cache LRU end 2024-04-26T07:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:96 4.14 4:28209c16:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609027120d0 con 0x56090264f8d0 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(96 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.613+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:97 4.1a 4:5886091a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902712110 con 0x7f979c07a060 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.614+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(97 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.614+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 4.14 4:2950b973:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902712110 con 0x56090264f8d0 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.614+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(98 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.614+0000 7f97ad72e800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.614+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:99 4.10 4:0a894fda:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902712630 con 0x56090264f8d0 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.614+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(99 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.614+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:100 4.28 4:164445c1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902712610 con 0x560902646470 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.615+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(100 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.615+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:101 4.2f 4:f5322692:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902712610 con 0x560902646470 2024-04-26T07:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.615+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(101 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.615+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:102 4.1b 4:d99b702b:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609027125c0 con 0x7f979c07a060 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.615+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(102 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.615+0000 7f97ad72e800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.615+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:103 4.e 4:7362730f:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609027125c0 con 0x7f979c07a060 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.616+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(103 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.616+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:104 4.2c 4:36cc0285:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609027125c0 con 0x560902646470 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.616+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(104 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.616+0000 7f97ad72e800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.616+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:105 4.14 4:29dd24af:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609027125c0 con 0x56090264f8d0 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.617+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(105 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.617+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:106 4.3 4:c38d430c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609027125c0 con 0x560902646470 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.617+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(106 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 [call out=696b] v0'0 uv9 ondisk = 0) ==== 195+0+696 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.617+0000 7f97ad72e800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.617+0000 7f97ad72e800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.617+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.617+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:107 3.33s0 3:cf9d4a5f:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090270fc30 con 0x56090264ad80 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.618+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(107 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.618+0000 7f97ad72e800 10 manifest: total_size = 6 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.618+0000 7f97ad72e800 20 get_obj_state: setting s->obj_tag to 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9625466847693598318 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.618+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.618+0000 7f97ad72e800 20 prepare_atomic_modification: state is not atomic. state=0x560902695248 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.618+0000 7f97ad72e800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.618+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:108 4.14 4:2950b973:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269a0b0 con 0x56090264f8d0 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.619+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(108 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2 [stat,call,call] v27'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.619+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:109 3.33s0 3:cf9d4a5f:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560902698090 con 0x56090264ad80 2024-04-26T07:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.620+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(109 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_9c8454ddf7aa50116496bac348d7550d [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.620+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:110 4.14 4:2950b973:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269a0b0 con 0x56090264f8d0 2024-04-26T07:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.620+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.620+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:111 3.36s0 3:6cc133b7:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269a0b0 con 0x7f979c07a060 2024-04-26T07:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(111 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f97ad72e800 10 manifest: total_size = 3 2024-04-26T07:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f97ad72e800 20 get_obj_state: setting s->obj_tag to 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.1254601807573713051 2024-04-26T07:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f97ad72e800 20 prepare_atomic_modification: state is not atomic. state=0x560902695248 2024-04-26T07:54:57.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f97ad72e800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6 2024-04-26T07:54:57.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:112 4.1b 4:d99b702b:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269f140 con 0x7f979c07a060 2024-04-26T07:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 31 ==== osd_op_reply(110 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2 [stat,call,call] v27'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.621+0000 7f968cff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-04-26T07:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.622+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(112 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6 [stat,call,call] v27'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.622+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:113 3.36s0 3:6cc133b7:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269f140 con 0x7f979c07a060 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.623+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(113 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_b1b9a972ccd8c962a473909b97007eb4 [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.623+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:114 4.1b 4:d99b702b:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x7f979c07a060 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.623+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.623+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:115 3.32s0 3:4dff25ad:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x56090264f8d0 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 32 ==== osd_op_reply(115 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f97ad72e800 10 manifest: total_size = 4 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f97ad72e800 20 get_obj_state: setting s->obj_tag to 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.6842237871135692015 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f97ad72e800 20 prepare_atomic_modification: state is not atomic. state=0x560902695248 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f97ad72e800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:116 4.2c 4:36cc0285:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x560902646470 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(114 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6 [stat,call,call] v27'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.624+0000 7f967ffff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.625+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(116 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8 [stat,call,call] v27'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.625+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:117 3.32s0 3:4dff25ad:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x56090264f8d0 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.626+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 33 ==== osd_op_reply(117 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.626+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:118 4.2c 4:36cc0285:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x560902646470 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.626+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.626+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:119 3.37s0 3:efacacd4:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x560902646470 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(119 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f97ad72e800 10 manifest: total_size = 5 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f97ad72e800 20 get_obj_state: setting s->obj_tag to 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.363636576001343159 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f97ad72e800 20 prepare_atomic_modification: state is not atomic. state=0x560902695248 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f97ad72e800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:120 4.3 4:c38d430c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x560902646470 2024-04-26T07:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(118 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8 [stat,call,call] v27'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.627+0000 7f968cff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.628+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(120 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 [stat,call,call] v27'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.628+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:121 3.37s0 3:efacacd4:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.629+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(121 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_24d27c169c2c881eb09a065116f2aa5c [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.629+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:122 4.3 4:c38d430c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x560902646470 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.629+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.629+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:123 3.21s0 3:85051d9a:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x56090264ad80 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.630+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(123 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.630+0000 7f97ad72e800 10 manifest: total_size = 5 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.630+0000 7f97ad72e800 20 get_obj_state: setting s->obj_tag to _UGh3gjz1wDwIGxFVKUCqYE7F1iWnWe7 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.630+0000 7f97ad72e800 20 get_obj_state: octx=0x7f979400e510 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x560902695248 s->prefetch_data=0 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.630+0000 7f97ad72e800 20 prepare_atomic_modification: state is not atomic. state=0x560902695248 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.630+0000 7f97ad72e800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 2024-04-26T07:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.630+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:124 4.3 4:c38d430c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269b0c0 con 0x560902646470 2024-04-26T07:54:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.631+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 38 ==== osd_op_reply(122 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 [stat,call,call] v27'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.631+0000 7f967ffff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.631+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 39 ==== osd_op_reply(124 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 [stat,call,call] v27'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.631+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:125 3.21s0 3:85051d9a:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264ad80 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.632+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(125 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5_bb3aec0fdcdbc2974890f805c585d432 [call] v27'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.632+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:126 4.3 4:c38d430c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.632+0000 7f97ad72e800 20 list_objects_ordered: starting attempt 1 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.632+0000 7f97ad72e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.632+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:127 4.14 4:28209c16:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264f8d0 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.632+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:128 4.1a 4:5886091a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560902699550 con 0x7f979c07a060 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:129 4.14 4:2950b973:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264f8d0 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:130 4.10 4:0a894fda:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026a5d00 con 0x56090264f8d0 2024-04-26T07:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:131 4.28 4:164445c1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026a8960 con 0x560902646470 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:132 4.2f 4:f5322692:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026ab700 con 0x560902646470 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:133 4.1b 4:d99b702b:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026ae4f0 con 0x7f979c07a060 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:134 4.e 4:7362730f:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026b1320 con 0x7f979c07a060 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:135 4.2c 4:36cc0285:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026b41a0 con 0x560902646470 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:136 4.14 4:29dd24af:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026b6fd0 con 0x56090264f8d0 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.633+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:137 4.3 4:c38d430c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026b9e00 con 0x560902646470 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 40 ==== osd_op_reply(131 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 41 ==== osd_op_reply(132 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(128 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(133 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(134 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 42 ==== osd_op_reply(135 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 43 ==== osd_op_reply(126 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 [stat,call,call] v27'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f967ffff640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 34 ==== osd_op_reply(127 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 35 ==== osd_op_reply(129 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 36 ==== osd_op_reply(130 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 37 ==== osd_op_reply(136 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 44 ==== osd_op_reply(137 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5])"; uploads.size()=0; is_truncated=0 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:138 4.14 4:28209c16:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264f8d0 2024-04-26T07:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:139 4.1a 4:5886091a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026a8960 con 0x7f979c07a060 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:140 4.14 4:2950b973:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264f8d0 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:141 4.10 4:0a894fda:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026a8960 con 0x56090264f8d0 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:142 4.28 4:164445c1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:143 4.2f 4:f5322692:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026a8960 con 0x560902646470 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:144 4.1b 4:d99b702b:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026b9e00 con 0x7f979c07a060 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:145 4.e 4:7362730f:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026ae4f0 con 0x7f979c07a060 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:146 4.2c 4:36cc0285:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.634+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:147 4.14 4:29dd24af:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026a8960 con 0x56090264f8d0 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:148 4.3 4:c38d430c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609026b9e00 con 0x560902646470 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 38 ==== osd_op_reply(138 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 39 ==== osd_op_reply(141 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 40 ==== osd_op_reply(140 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 45 ==== osd_op_reply(142 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 46 ==== osd_op_reply(143 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(139 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(144 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(145 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 47 ==== osd_op_reply(146 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 41 ==== osd_op_reply(147 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 48 ==== osd_op_reply(148 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.635+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x7f979c07a060 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.636+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 32 ==== osd_op_reply(149 foo.buckets [call] v27'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.637+0000 7f97ad72e800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.637+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x7f979c07a060 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.637+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 33 ==== osd_op_reply(150 myfoo [call,call,delete] v27'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.637+0000 7f97ad72e800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.637+0000 7f97ad72e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T07:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.638+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94596695654304 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264ad80 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.638+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== watch-notify(notify (1) cookie 94596694903616 notify 115964117015 ret 0) ==== 191+0+0 (crc 0 0 0) 0x560902661e00 con 0x56090264ad80 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.638+0000 7f967ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117015 cookie 94596694903616 notifier 4641 bl.length()=149 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.638+0000 7f967ffff640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f95dc003320 con 0x56090264ad80 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.638+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(151 notify.6 [notify cookie 94596695654304 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.638+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.638+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== watch-notify(notify_complete (2) cookie 94596695654304 notify 115964117015 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56090250e120 con 0x56090264ad80 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.638+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:153 8.3 8:c6c1f974:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.639+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 49 ==== osd_op_reply(153 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 [call,call,delete] v27'3 uv3 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.639+0000 7f97ad72e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 from cache 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.639+0000 7f97ad72e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5, ofs0, ns] 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.639+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 94596695654304 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264ad80 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== watch-notify(notify (1) cookie 94596694900752 notify 115964117016 ret 0) ==== 248+0+0 (crc 0 0 0) 0x56090250e120 con 0x56090264ad80 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f968cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117016 cookie 94596694900752 notifier 4641 bl.length()=206 2024-04-26T07:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(154 notify.5 [notify cookie 94596695654304 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f968cff9640 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f966c003d60 con 0x56090264ad80 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== watch-notify(notify_complete (2) cookie 94596695654304 notify 115964117016 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560902631bd0 con 0x56090264ad80 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:156 4.14 4:28209c16:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264f8d0 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:157 4.1a 4:5886091a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609026b6800 con 0x7f979c07a060 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:158 4.14 4:2950b973:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609026a0c60 con 0x56090264f8d0 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:159 4.10 4:0a894fda:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609026a82c0 con 0x56090264f8d0 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:160 4.28 4:164445c1:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:161 4.2f 4:f5322692:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609026a0c60 con 0x560902646470 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:162 4.1b 4:d99b702b:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609026a82c0 con 0x7f979c07a060 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:163 4.e 4:7362730f:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269f680 con 0x7f979c07a060 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:164 4.2c 4:36cc0285:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ff90 con 0x560902646470 2024-04-26T07:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:165 4.14 4:29dd24af:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609026b5c20 con 0x56090264f8d0 2024-04-26T07:54:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.640+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:166 4.3 4:c38d430c:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609026b41a0 con 0x560902646470 2024-04-26T07:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.641+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 34 ==== osd_op_reply(162 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.6 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 35 ==== osd_op_reply(157 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.1 [delete] v27'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 42 ==== osd_op_reply(156 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.0 [delete] v27'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 43 ==== osd_op_reply(158 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.2 [delete] v27'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 44 ==== osd_op_reply(159 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.3 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 50 ==== osd_op_reply(160 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.4 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 51 ==== osd_op_reply(161 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.5 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 52 ==== osd_op_reply(164 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.8 [delete] v27'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 45 ==== osd_op_reply(165 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.9 [delete] v27'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.642+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 36 ==== osd_op_reply(163 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.7 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 53 ==== osd_op_reply(166 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5.10 [delete] v27'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97ad72e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 : miss 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97ad72e800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:167 6.2 6:41d13965:::pubsub..bucket.myfoo%2f8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264f8d0 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 46 ==== osd_op_reply(167 pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97ad72e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 info.flags=0x0 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97ad72e800 10 adding default.rgw.log++pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 to cache LRU end 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.643+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:168 6.2 6:41d13965:::pubsub..bucket.myfoo%2f8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264f8d0 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.644+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 47 ==== osd_op_reply(168 pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.5 [delete] v27'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.644+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x7f979c07a060 2024-04-26T07:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.645+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 37 ==== osd_op_reply(169 foo.buckets [call] v27'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.646+0000 7f965f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.646+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596694909792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.647+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 54 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94596694909792] v27'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.647+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596694885968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x7f979c07a060 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.648+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 38 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94596694885968] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.648+0000 7f97ad72e800 20 remove_watcher() i=0 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.648+0000 7f97ad72e800 2 removed watcher, disabling cache 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.648+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596694889840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.649+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 55 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94596694889840] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.649+0000 7f97ad72e800 20 remove_watcher() i=1 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.649+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596694892528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264f8d0 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.650+0000 7f97a9492640 1 -- 172.21.15.62:0/2349596296 <== osd.3 v2:172.21.15.62:6816/1472283839 48 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94596694892528] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f979c077030 con 0x56090264f8d0 2024-04-26T07:54:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.650+0000 7f97ad72e800 20 remove_watcher() i=2 2024-04-26T07:54:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.650+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596694894864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x7f979c07a060 2024-04-26T07:54:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.651+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.2 v2:172.21.15.62:6808/1138534927 39 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94596694894864] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x7f979c07a060 2024-04-26T07:54:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.651+0000 7f97ad72e800 20 remove_watcher() i=3 2024-04-26T07:54:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.651+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596694899696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x560902646470 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.652+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 <== osd.1 v2:172.21.15.62:6800/1888558046 56 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94596694899696] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9794039040 con 0x560902646470 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.652+0000 7f97ad72e800 20 remove_watcher() i=4 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.652+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596694900752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264ad80 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.653+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94596694900752] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.653+0000 7f97ad72e800 20 remove_watcher() i=5 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.653+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596694903616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264ad80 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.654+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94596694903616] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.654+0000 7f97ad72e800 20 remove_watcher() i=6 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.654+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596694907488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56090269ac10 con 0x56090264ad80 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97a9c93640 1 -- 172.21.15.62:0/2349596296 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94596694907488] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a40083e0 con 0x56090264ad80 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 20 remove_watcher() i=7 2024-04-26T07:54:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56090264ad80 msgr2=0x56090264d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x56090264ad80 0x56090264d190 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902646470 msgr2=0x560902648930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902646470 0x560902648930 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f979c07a060 msgr2=0x7f979c05b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f979c07a060 0x7f979c05b390 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56090264f8d0 msgr2=0x560902651d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56090264f8d0 0x560902651d90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9674036e60 msgr2=0x7f9674039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9674036e60 0x7f9674039320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f979c08d130 tx=0x7f979c08c000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 msgr2=0x56090250fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97a8c91640 1 -- 172.21.15.62:0/2349596296 reap_dead start 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x56090250fa30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f97a404cec0 tx=0x7f97a404ce50 comp rx=0 tx=0).stop 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 shutdown_connections 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 --2- 172.21.15.62:0/2349596296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5609026311e0 0x56090250fa30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 >> 172.21.15.62:0/2349596296 conn(0x56090262d4a0 msgr2=0x56090262ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 shutdown_connections 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.655+0000 7f97ad72e800 1 -- 172.21.15.62:0/2349596296 wait complete. 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/791301721 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9680036eb0 msgr2=0x7f9680039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/791301721 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9680036eb0 0x7f9680039370 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x560902610330 tx=0x7f979c06ef10 comp rx=0 tx=0).stop 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/791301721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902623e50 msgr2=0x560902624270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/791301721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902623e50 0x560902624270 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x560902609aa0 tx=0x7f97a400aec0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/791301721 shutdown_connections 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/791301721 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9680036eb0 0x7f9680039370 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/791301721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902623e50 0x560902624270 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/791301721 >> 172.21.15.62:0/791301721 conn(0x560902617ef0 msgr2=0x5609026182f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/791301721 shutdown_connections 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/791301721 wait complete. 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5609026121c0 msgr2=0x5609026145b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5609026121c0 0x5609026145b0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902512a40 msgr2=0x56090260f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902512a40 0x56090260f8e0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9690036e60 msgr2=0x7f9690039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9690036e60 0x7f9690039320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9794000f60 tx=0x7f97940012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 msgr2=0x5609026086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x5609026086a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f979c0526d0 tx=0x7f979c003330 comp rx=0 tx=0).stop 2024-04-26T07:54:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 shutdown_connections 2024-04-26T07:54:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560902512a40 0x56090260f8e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x5609026121c0 0x5609026145b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9690036e60 0x7f9690039320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 --2- 172.21.15.62:0/4123363984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560902510110 0x5609026086a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 >> 172.21.15.62:0/4123363984 conn(0x560902509be0 msgr2=0x5609025fad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 shutdown_connections 2024-04-26T07:54:57.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.656+0000 7f97ad72e800 1 -- 172.21.15.62:0/4123363984 wait complete. 2024-04-26T07:54:57.663 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T07:54:57.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T07:54:57.663 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-04-26T07:54:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2883c800 1 Processor -- start 2024-04-26T07:54:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2883c800 1 -- start start 2024-04-26T07:54:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2883c800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x563fbc4a1110 0x563fbc4a3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2883c800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563fbc4a7550 con 0x563fbc4a3a40 2024-04-26T07:54:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2883c800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x563fbc342e20 con 0x563fbc4a1110 2024-04-26T07:54:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2342c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x563fbc4a1110 0x563fbc4a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde22c2b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x563fbc4a3a40 0x563fbc4a5e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:35976/0 (socket says 172.21.15.62:35976) 2024-04-26T07:54:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde22c2b640 1 -- 172.21.15.62:0/3660604837 learned_addr learned my addr 172.21.15.62:0/3660604837 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2342c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x563fbc4a1110 0x563fbc4a3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57228/0 (socket says 172.21.15.62:57228) 2024-04-26T07:54:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2342c640 1 -- 172.21.15.62:0/3660604837 >> v1:172.21.15.1:6789/0 conn(0x563fbc4a3a40 legacy=0x563fbc4a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.712+0000 7fde2342c640 1 -- 172.21.15.62:0/3660604837 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fbc4a8730 con 0x563fbc4a1110 2024-04-26T07:54:57.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.714+0000 7fde2342c640 1 --2- 172.21.15.62:0/3660604837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a3500 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fde1c005fd0 tx=0x7fde1c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54156129bee7f0fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.714+0000 7fde2242a640 1 -- 172.21.15.62:0/3660604837 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c052560 con 0x563fbc4a1110 2024-04-26T07:54:57.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.714+0000 7fde2242a640 1 -- 172.21.15.62:0/3660604837 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c052700 con 0x563fbc4a1110 2024-04-26T07:54:57.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.715+0000 7fde2242a640 1 -- 172.21.15.62:0/3660604837 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c052a60 con 0x563fbc4a1110 2024-04-26T07:54:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.715+0000 7fde2883c800 1 -- 172.21.15.62:0/3660604837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 msgr2=0x563fbc4a3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.715+0000 7fde2883c800 1 --2- 172.21.15.62:0/3660604837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a3500 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fde1c005fd0 tx=0x7fde1c01ccc0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.715+0000 7fde2883c800 1 -- 172.21.15.62:0/3660604837 shutdown_connections 2024-04-26T07:54:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.715+0000 7fde2883c800 1 --2- 172.21.15.62:0/3660604837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a3500 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.715+0000 7fde2883c800 1 -- 172.21.15.62:0/3660604837 >> 172.21.15.62:0/3660604837 conn(0x563fbc49abe0 msgr2=0x563fbc49d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.715+0000 7fde2883c800 1 -- 172.21.15.62:0/3660604837 shutdown_connections 2024-04-26T07:54:57.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.715+0000 7fde2883c800 1 -- 172.21.15.62:0/3660604837 wait complete. 2024-04-26T07:54:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.728+0000 7fde2883c800 1 Processor -- start 2024-04-26T07:54:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.728+0000 7fde2883c800 1 -- start start 2024-04-26T07:54:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.728+0000 7fde2883c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc591c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.728+0000 7fde2883c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563fbc3ebd00 con 0x563fbc4a1110 2024-04-26T07:54:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.728+0000 7fde2342c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc591c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.728+0000 7fde2342c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc591c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57244/0 (socket says 172.21.15.62:57244) 2024-04-26T07:54:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.728+0000 7fde2342c640 1 -- 172.21.15.62:0/831696475 learned_addr learned my addr 172.21.15.62:0/831696475 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.728+0000 7fde2342c640 1 -- 172.21.15.62:0/831696475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fbc592200 con 0x563fbc4a1110 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fde2342c640 1 --2- 172.21.15.62:0/831696475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc591c30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fde1c007000 tx=0x7fde1c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee49053c3efd758 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fdd1160a640 1 -- 172.21.15.62:0/831696475 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c052cd0 con 0x563fbc4a1110 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fdd1160a640 1 -- 172.21.15.62:0/831696475 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c0528b0 con 0x563fbc4a1110 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fdd1160a640 1 -- 172.21.15.62:0/831696475 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c05c430 con 0x563fbc4a1110 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fde2883c800 1 -- 172.21.15.62:0/831696475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 msgr2=0x563fbc591c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fde2883c800 1 --2- 172.21.15.62:0/831696475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc591c30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fde1c007000 tx=0x7fde1c04c000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fde2883c800 1 -- 172.21.15.62:0/831696475 shutdown_connections 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fde2883c800 1 --2- 172.21.15.62:0/831696475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc591c30 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.729+0000 7fde2883c800 1 -- 172.21.15.62:0/831696475 >> 172.21.15.62:0/831696475 conn(0x563fbc49abe0 msgr2=0x563fbc58d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2883c800 1 -- 172.21.15.62:0/831696475 shutdown_connections 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2883c800 1 -- 172.21.15.62:0/831696475 wait complete. 2024-04-26T07:54:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2883c800 1 Processor -- start 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2883c800 1 -- start start 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2883c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2883c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563fbc4a79c0 con 0x563fbc4a1110 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2342c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2342c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57250/0 (socket says 172.21.15.62:57250) 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2342c640 1 -- 172.21.15.62:0/2968625318 learned_addr learned my addr 172.21.15.62:0/2968625318 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.730+0000 7fde2342c640 1 -- 172.21.15.62:0/2968625318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fbc49f140 con 0x563fbc4a1110 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.731+0000 7fde2342c640 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a0a50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fde1c000f80 tx=0x7fde1c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.731+0000 7fdd0fe07640 1 -- 172.21.15.62:0/2968625318 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c073020 con 0x563fbc4a1110 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.731+0000 7fdd0fe07640 1 -- 172.21.15.62:0/2968625318 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c06f520 con 0x563fbc4a1110 2024-04-26T07:54:57.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.731+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fbc49f3d0 con 0x563fbc4a1110 2024-04-26T07:54:57.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.731+0000 7fdd0fe07640 1 -- 172.21.15.62:0/2968625318 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c06f800 con 0x563fbc4a1110 2024-04-26T07:54:57.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.731+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fbc49f950 con 0x563fbc4a1110 2024-04-26T07:54:57.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fdd0fe07640 1 -- 172.21.15.62:0/2968625318 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fde1c06fbb0 con 0x563fbc4a1110 2024-04-26T07:54:57.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fdd0fe07640 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd08036e60 0x7fdd08039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fdd0fe07640 1 -- 172.21.15.62:0/2968625318 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fde1c06c050 con 0x563fbc4a1110 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fde22c2b640 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd08036e60 0x7fdd08039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc4a3a40 0x563fbc5a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5a3100 con 0x563fbc4a3a40 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fde23c2d640 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc4a3a40 0x563fbc5a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fde22c2b640 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd08036e60 0x7fdd08039320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde18000f60 tx=0x7fde180012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.732+0000 7fde23c2d640 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc4a3a40 0x563fbc5a2bc0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.733+0000 7fde23c2d640 1 -- 172.21.15.62:0/2968625318 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc4a3a40 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.733+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5a39d0 con 0x563fbc4a3a40 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.733+0000 7fde23c2d640 1 -- 172.21.15.62:0/2968625318 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc4a3a40 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.733+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5a5400 0x563fbc5a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.733+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5a8030 con 0x563fbc5a5400 2024-04-26T07:54:57.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.733+0000 7fde2342c640 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5a5400 0x563fbc5a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.734+0000 7fde2342c640 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5a5400 0x563fbc5a78a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.734+0000 7fde2342c640 1 -- 172.21.15.62:0/2968625318 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5a5400 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.734+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5a4250 con 0x563fbc4a3a40 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.734+0000 7fde23c2d640 1 -- 172.21.15.62:0/2968625318 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc4a3a40 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.734+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5a4710 con 0x563fbc4a3a40 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde23c2d640 1 -- 172.21.15.62:0/2968625318 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc4a3a40 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde2883c800 1 Processor -- start 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde2883c800 1 -- start start 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde2883c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5b71f0 0x563fbc5b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde2883c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563fbc4a0f90 con 0x563fbc5b71f0 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde23c2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5b71f0 0x563fbc5b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde23c2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5b71f0 0x563fbc5b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57264/0 (socket says 172.21.15.62:57264) 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde23c2d640 1 -- 172.21.15.62:0/799964138 learned_addr learned my addr 172.21.15.62:0/799964138 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.735+0000 7fde23c2d640 1 -- 172.21.15.62:0/799964138 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fbc5b7b50 con 0x563fbc5b71f0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.736+0000 7fde23c2d640 1 --2- 172.21.15.62:0/799964138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5b71f0 0x563fbc5b7610 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x563fbc4a05b0 tx=0x7fde1400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.736+0000 7fdd0d602640 1 -- 172.21.15.62:0/799964138 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde14007d00 con 0x563fbc5b71f0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.736+0000 7fdd0d602640 1 -- 172.21.15.62:0/799964138 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1401e020 con 0x563fbc5b71f0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.736+0000 7fdd0d602640 1 -- 172.21.15.62:0/799964138 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde14019590 con 0x563fbc5b71f0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.736+0000 7fde2883c800 1 -- 172.21.15.62:0/799964138 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fbc5b85c0 con 0x563fbc5b71f0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.736+0000 7fde2883c800 1 -- 172.21.15.62:0/799964138 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fbc5b8ac0 con 0x563fbc5b71f0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fdd0d602640 1 -- 172.21.15.62:0/799964138 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fde14016040 con 0x563fbc5b71f0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fdd0d602640 1 --2- 172.21.15.62:0/799964138 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcfc036e60 0x7fdcfc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fdd0d602640 1 -- 172.21.15.62:0/799964138 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fde1401f030 con 0x563fbc5b71f0 2024-04-26T07:54:57.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fde2342c640 1 --2- 172.21.15.62:0/799964138 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcfc036e60 0x7fdcfc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fde2883c800 1 Processor -- start 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fde2883c800 1 -- start start 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fde2342c640 1 --2- 172.21.15.62:0/799964138 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcfc036e60 0x7fdcfc039320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x563fbc49ff00 tx=0x7fde1c05b7d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fde2883c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.737+0000 7fde2883c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563fbc393170 con 0x563fbc5c45c0 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde23c2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde23c2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57280/0 (socket says 172.21.15.62:57280) 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde23c2d640 1 -- 172.21.15.62:0/3660021002 learned_addr learned my addr 172.21.15.62:0/3660021002 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde23c2d640 1 -- 172.21.15.62:0/3660021002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fbc5c4fb0 con 0x563fbc5c45c0 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde23c2d640 1 --2- 172.21.15.62:0/3660021002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5c49e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fde1404ceb0 tx=0x7fde14014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d1b249f4dccf1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fdd06ffd640 1 -- 172.21.15.62:0/3660021002 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1401d070 con 0x563fbc5c45c0 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fdd06ffd640 1 -- 172.21.15.62:0/3660021002 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde14017d90 con 0x563fbc5c45c0 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fdd06ffd640 1 -- 172.21.15.62:0/3660021002 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde14018520 con 0x563fbc5c45c0 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde2883c800 1 -- 172.21.15.62:0/3660021002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 msgr2=0x563fbc5c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde2883c800 1 --2- 172.21.15.62:0/3660021002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5c49e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fde1404ceb0 tx=0x7fde14014f30 comp rx=0 tx=0).stop 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde2883c800 1 -- 172.21.15.62:0/3660021002 shutdown_connections 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde2883c800 1 --2- 172.21.15.62:0/3660021002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5c49e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.738+0000 7fde2883c800 1 -- 172.21.15.62:0/3660021002 >> 172.21.15.62:0/3660021002 conn(0x563fbc5c08d0 msgr2=0x563fbc5be930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde2883c800 1 -- 172.21.15.62:0/3660021002 shutdown_connections 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde2883c800 1 -- 172.21.15.62:0/3660021002 wait complete. 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde2883c800 1 Processor -- start 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde2883c800 1 -- start start 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde2883c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde2883c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563fbc5c5580 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde23c2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde23c2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57284/0 (socket says 172.21.15.62:57284) 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 learned_addr learned my addr 172.21.15.62:0/3080301290 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.739+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fbc5cbf30 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.740+0000 7fde23c2d640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5cb9f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fde14017f60 tx=0x7fde1404ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.740+0000 7fdd057fa640 1 -- 172.21.15.62:0/3080301290 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde14019860 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.740+0000 7fdd057fa640 1 -- 172.21.15.62:0/3080301290 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde14019a00 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.740+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fbc5cc1c0 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.740+0000 7fdd057fa640 1 -- 172.21.15.62:0/3080301290 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde140173b0 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.740+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fbc5cee70 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.740+0000 7fdd057fa640 1 -- 172.21.15.62:0/3080301290 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fde14017550 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.741+0000 7fdd057fa640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcec036eb0 0x7fdcec039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.741+0000 7fdd057fa640 1 -- 172.21.15.62:0/3080301290 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fde14037c70 con 0x563fbc5c45c0 2024-04-26T07:54:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.741+0000 7fde2342c640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcec036eb0 0x7fdcec039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.741+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.741+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc5d74e0 0x563fbc5d99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.741+0000 7fde2342c640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcec036eb0 0x7fdcec039370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x563fbc5a8430 tx=0x7fde1c087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.741+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5da0f0 con 0x563fbc5d74e0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.741+0000 7fde22c2b640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc5d74e0 0x563fbc5d99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde22c2b640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc5d74e0 0x563fbc5d99a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde18009050 con 0x563fbc5d74e0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 20 realm 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5d6930 con 0x563fbc5d74e0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde18009050 con 0x563fbc5d74e0 2024-04-26T07:54:57.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5dabe0 con 0x563fbc5d74e0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde18009050 con 0x563fbc5d74e0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.742+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5db4b0 con 0x563fbc5d74e0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.743+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde18009050 con 0x563fbc5d74e0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.743+0000 7fde2883c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.743+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.743+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5dbdf0 0x563fbc5de1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.743+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5de970 con 0x563fbc5dbdf0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.743+0000 7fde23c2d640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5dbdf0 0x563fbc5de1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.743+0000 7fde23c2d640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5dbdf0 0x563fbc5de1e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.744+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.744+0000 7fde2883c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.744+0000 7fde2883c800 20 searching for the correct realm 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.744+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563fbc5e0940 0x563fbc5e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.744+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5e0940 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.744+0000 7fde2342c640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563fbc5e0940 0x563fbc5e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.744+0000 7fde2342c640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563fbc5e0940 0x563fbc5e2e00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.745+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.745+0000 7fde2342c640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fde1c078020 0x7fde1c08c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.745+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x7fde1c078020 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.745+0000 7fde22c2b640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fde1c078020 0x7fde1c08c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.745+0000 7fde22c2b640 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fde1c078020 0x7fde1c08c260 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.745+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18009050 con 0x7fde1c078020 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.745+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.746+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.746+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5d74e0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.746+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18009050 con 0x563fbc5d74e0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.746+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5d74e0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.746+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.746+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.747+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.747+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.747+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.747+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x7fde1c078020 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.747+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18029040 con 0x7fde1c078020 2024-04-26T07:54:57.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.747+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5e0940 2024-04-26T07:54:57.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.747+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.747+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5d74e0 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.748+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.748+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.748+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.748+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5d74e0 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.748+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.748+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x7fde1c078020 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.749+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fde18029040 con 0x7fde1c078020 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.749+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e34d0 con 0x563fbc5e0940 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.749+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.749+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5e0940 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.749+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.749+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5dbdf0 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.749+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.749+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5e0940 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.750+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.750+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5e0940 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.750+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.750+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5d74e0 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.750+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.750+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5d74e0 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.750+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.750+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5dbdf0 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.751+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.751+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5e0940 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.751+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.751+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x7fde1c078020 2024-04-26T07:54:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.751+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18029040 con 0x7fde1c078020 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.751+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5d74e0 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.751+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.751+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5dbdf0 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.752+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.752+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5e0940 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.752+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.752+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5dbdf0 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.752+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.752+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x7fde1c078020 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.753+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18029040 con 0x7fde1c078020 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.753+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5e0940 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.753+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.753+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5dbdf0 2024-04-26T07:54:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.753+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.753+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x563fbc5d74e0 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fde1c0a8040 con 0x7fde1c078020 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde18029040 con 0x7fde1c078020 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5df330 con 0x563fbc5d74e0 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.754+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5def70 con 0x563fbc5d74e0 2024-04-26T07:54:57.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5dfcd0 con 0x563fbc5d74e0 2024-04-26T07:54:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde18029040 con 0x563fbc5d74e0 2024-04-26T07:54:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 20 zone default found 2024-04-26T07:54:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 4 Realm: () 2024-04-26T07:54:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 20 zonegroup default 2024-04-26T07:54:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e39b0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e5c80 con 0x563fbc5e0940 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.755+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.756+0000 7fde2883c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.756+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.756+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e6020 con 0x563fbc5e0940 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.756+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.756+0000 7fde2883c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.756+0000 7fde2883c800 20 started sync module instance, tier type = 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.756+0000 7fde2883c800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.756+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e5110 con 0x7fde1c078020 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.757+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x7fde1c078020 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.757+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94831743227456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e5110 con 0x7fde1c078020 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.757+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e6ad0 con 0x563fbc5d74e0 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.758+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94831743227456] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x7fde1c078020 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.758+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.758+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94831743231408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e5110 con 0x563fbc5d74e0 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.758+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e7550 con 0x563fbc5e0940 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.759+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94831743231408] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.759+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.759+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94831743224928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e5080 con 0x563fbc5e0940 2024-04-26T07:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.759+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e8440 con 0x7fde1c078020 2024-04-26T07:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.760+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x7fde1c078020 2024-04-26T07:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.760+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94831743224928] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.760+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94831743238032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e8860 con 0x7fde1c078020 2024-04-26T07:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.760+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e9220 con 0x563fbc5d74e0 2024-04-26T07:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.761+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94831743238032] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x7fde1c078020 2024-04-26T07:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.761+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.761+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94831743239568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e9220 con 0x563fbc5d74e0 2024-04-26T07:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.761+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e9be0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.762+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94831743239568] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.762+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.763+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94831743242064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e9be0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.763+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5ea5a0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.763+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94831743242064] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.764+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.764+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94831743244080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5ea780 con 0x563fbc5dbdf0 2024-04-26T07:54:57.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.764+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5eafd0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94831743244080] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94831743247536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5eae80 con 0x563fbc5dbdf0 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 20 add_watcher() i=0 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 20 add_watcher() i=1 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 20 add_watcher() i=2 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 20 add_watcher() i=3 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 20 add_watcher() i=4 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 20 add_watcher() i=5 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 20 add_watcher() i=6 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94831743247536] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 20 add_watcher() i=7 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.765+0000 7fde2883c800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.766+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5ee3f0 con 0x563fbc5d74e0 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.766+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.766+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94831743248656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5eb8b0 con 0x563fbc5d74e0 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.767+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94831743248656] v27'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.767+0000 7fdcd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.767+0000 7fde2883c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.767+0000 7fde2883c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.767+0000 7fde2883c800 5 note: GC not initialized 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.767+0000 7fdcd8fe1640 20 reqs_thread_entry: start 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.767+0000 7fde2883c800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 20 Filter name: none 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fdc527fc640 20 reqs_thread_entry: start 2024-04-26T07:54:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc621be0 con 0x563fbc5d74e0 2024-04-26T07:54:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.768+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc627da0 con 0x563fbc5d74e0 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.769+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v27'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.769+0000 7fde2883c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.769+0000 7fde2883c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.769+0000 7fde2883c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.769+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94831743498256 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563fbc623660 con 0x563fbc5d74e0 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.770+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94831743239568 notify 115964117010 ret 0) ==== 621+0+0 (crc 0 0 0) 0x563fbc4a7550 con 0x563fbc5d74e0 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.770+0000 7fdd06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117010 cookie 94831743239568 notifier 4648 bl.length()=579 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.770+0000 7fdd06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.770+0000 7fdd06ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.770+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94831743498256 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.770+0000 7fdd06ffd640 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdce8003ea0 con 0x563fbc5d74e0 2024-04-26T07:54:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.770+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.770+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94831743498256 notify 115964117010 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fde1802da10 con 0x563fbc5d74e0 2024-04-26T07:54:57.783 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.771+0000 7fdcd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.771+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94831743248656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc626c10 con 0x563fbc5d74e0 2024-04-26T07:54:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.772+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94831743248656] v27'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.772+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94831743227456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5ea8d0 con 0x7fde1c078020 2024-04-26T07:54:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.773+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94831743227456] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x7fde1c078020 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.773+0000 7fde2883c800 20 remove_watcher() i=0 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.773+0000 7fde2883c800 2 removed watcher, disabling cache 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.773+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94831743231408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e5640 con 0x563fbc5d74e0 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.774+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94831743231408] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.774+0000 7fde2883c800 20 remove_watcher() i=1 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.774+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94831743224928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e5640 con 0x563fbc5e0940 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.775+0000 7fde2342c640 1 -- 172.21.15.62:0/3080301290 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94831743224928] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c075020 con 0x563fbc5e0940 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.775+0000 7fde2883c800 20 remove_watcher() i=2 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.775+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94831743238032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e4c60 con 0x7fde1c078020 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.776+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94831743238032] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x7fde1c078020 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.776+0000 7fde2883c800 20 remove_watcher() i=3 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.776+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94831743239568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e7f90 con 0x563fbc5d74e0 2024-04-26T07:54:57.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.777+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94831743239568] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde18039040 con 0x563fbc5d74e0 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.777+0000 7fde2883c800 20 remove_watcher() i=4 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.777+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94831743242064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e4c60 con 0x563fbc5dbdf0 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.778+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94831743242064] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.778+0000 7fde2883c800 20 remove_watcher() i=5 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.778+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94831743244080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e8590 con 0x563fbc5dbdf0 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.779+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94831743244080] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.779+0000 7fde2883c800 20 remove_watcher() i=6 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.779+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94831743247536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563fbc5e7f90 con 0x563fbc5dbdf0 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.780+0000 7fde23c2d640 1 -- 172.21.15.62:0/3080301290 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94831743247536] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde140083e0 con 0x563fbc5dbdf0 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.780+0000 7fde2883c800 20 remove_watcher() i=7 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.780+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5dbdf0 msgr2=0x563fbc5de1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.780+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5dbdf0 0x563fbc5de1e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.780+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc5d74e0 msgr2=0x563fbc5d99a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc5d74e0 0x563fbc5d99a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fde1c078020 msgr2=0x7fde1c08c260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fde1c078020 0x7fde1c08c260 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563fbc5e0940 msgr2=0x563fbc5e2e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x563fbc5e0940 0x563fbc5e2e00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcec036eb0 msgr2=0x7fdcec039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcec036eb0 0x7fdcec039370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x563fbc5a8430 tx=0x7fde1c087000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 msgr2=0x563fbc5cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5cb9f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fde14017f60 tx=0x7fde1404ce10 comp rx=0 tx=0).stop 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde22c2b640 1 -- 172.21.15.62:0/3080301290 reap_dead start 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 shutdown_connections 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/3080301290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5c45c0 0x563fbc5cb9f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 >> 172.21.15.62:0/3080301290 conn(0x563fbc5c08d0 msgr2=0x563fbc5bdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 shutdown_connections 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/3080301290 wait complete. 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/799964138 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcfc036e60 msgr2=0x7fdcfc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/799964138 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcfc036e60 0x7fdcfc039320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x563fbc49ff00 tx=0x7fde1c05b7d0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/799964138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5b71f0 msgr2=0x563fbc5b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/799964138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5b71f0 0x563fbc5b7610 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x563fbc4a05b0 tx=0x7fde1400aea0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/799964138 shutdown_connections 2024-04-26T07:54:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/799964138 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdcfc036e60 0x7fdcfc039320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 --2- 172.21.15.62:0/799964138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc5b71f0 0x563fbc5b7610 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/799964138 >> 172.21.15.62:0/799964138 conn(0x563fbc5ab290 msgr2=0x563fbc5ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/799964138 shutdown_connections 2024-04-26T07:54:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.781+0000 7fde2883c800 1 -- 172.21.15.62:0/799964138 wait complete. 2024-04-26T07:54:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5a5400 msgr2=0x563fbc5a78a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5a5400 0x563fbc5a78a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc4a3a40 msgr2=0x563fbc5a2bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc4a3a40 0x563fbc5a2bc0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd08036e60 msgr2=0x7fdd08039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd08036e60 0x7fdd08039320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde18000f60 tx=0x7fde180012b0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 msgr2=0x563fbc4a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a0a50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fde1c000f80 tx=0x7fde1c003330 comp rx=0 tx=0).stop 2024-04-26T07:54:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 shutdown_connections 2024-04-26T07:54:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x563fbc4a3a40 0x563fbc5a2bc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x563fbc5a5400 0x563fbc5a78a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fdd08036e60 0x7fdd08039320 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 --2- 172.21.15.62:0/2968625318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563fbc4a1110 0x563fbc4a0a50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 >> 172.21.15.62:0/2968625318 conn(0x563fbc49abe0 msgr2=0x563fbc58bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 shutdown_connections 2024-04-26T07:54:57.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.782+0000 7fde2883c800 1 -- 172.21.15.62:0/2968625318 wait complete. 2024-04-26T07:54:57.798 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:57.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T07:54:57.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T07:54:57.799 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-04-26T07:54:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.848+0000 7fb430462800 1 Processor -- start 2024-04-26T07:54:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.848+0000 7fb430462800 1 -- start start 2024-04-26T07:54:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.848+0000 7fb430462800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564fe49dffb0 0x564fe49e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.848+0000 7fb430462800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564fe4955280 con 0x564fe49e0910 2024-04-26T07:54:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.848+0000 7fb430462800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x564fe4883e20 con 0x564fe49dffb0 2024-04-26T07:54:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.849+0000 7fb42df61640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564fe49dffb0 0x564fe49e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.849+0000 7fb42df61640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564fe49dffb0 0x564fe49e03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57296/0 (socket says 172.21.15.62:57296) 2024-04-26T07:54:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.849+0000 7fb42df61640 1 -- 172.21.15.62:0/3739589817 learned_addr learned my addr 172.21.15.62:0/3739589817 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.849+0000 7fb42df61640 1 -- 172.21.15.62:0/3739589817 >> v1:172.21.15.1:6789/0 conn(0x564fe49e0910 legacy=0x564fe49e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.849+0000 7fb42df61640 1 -- 172.21.15.62:0/3739589817 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe49e14d0 con 0x564fe49dffb0 2024-04-26T07:54:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb42df61640 1 --2- 172.21.15.62:0/3739589817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe49e03d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb420005fd0 tx=0x7fb42001cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3672d39e7fb2a1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb42cf5f640 1 -- 172.21.15.62:0/3739589817 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420052540 con 0x564fe49dffb0 2024-04-26T07:54:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb42cf5f640 1 -- 172.21.15.62:0/3739589817 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42004e070 con 0x564fe49dffb0 2024-04-26T07:54:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb42cf5f640 1 -- 172.21.15.62:0/3739589817 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420052890 con 0x564fe49dffb0 2024-04-26T07:54:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb430462800 1 -- 172.21.15.62:0/3739589817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 msgr2=0x564fe49e03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb430462800 1 --2- 172.21.15.62:0/3739589817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe49e03d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb420005fd0 tx=0x7fb42001cd80 comp rx=0 tx=0).stop 2024-04-26T07:54:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb430462800 1 -- 172.21.15.62:0/3739589817 shutdown_connections 2024-04-26T07:54:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb430462800 1 --2- 172.21.15.62:0/3739589817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe49e03d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb430462800 1 -- 172.21.15.62:0/3739589817 >> 172.21.15.62:0/3739589817 conn(0x564fe49dbbb0 msgr2=0x564fe49ddfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb430462800 1 -- 172.21.15.62:0/3739589817 shutdown_connections 2024-04-26T07:54:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.851+0000 7fb430462800 1 -- 172.21.15.62:0/3739589817 wait complete. 2024-04-26T07:54:57.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.864+0000 7fb430462800 1 Processor -- start 2024-04-26T07:54:57.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.864+0000 7fb430462800 1 -- start start 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.864+0000 7fb430462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4ad5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.864+0000 7fb430462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fe492cd00 con 0x564fe49dffb0 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.865+0000 7fb42df61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4ad5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.865+0000 7fb42df61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4ad5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57308/0 (socket says 172.21.15.62:57308) 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.865+0000 7fb42df61640 1 -- 172.21.15.62:0/478619616 learned_addr learned my addr 172.21.15.62:0/478619616 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.865+0000 7fb42df61640 1 -- 172.21.15.62:0/478619616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe4ad5610 con 0x564fe49dffb0 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.865+0000 7fb42df61640 1 --2- 172.21.15.62:0/478619616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4ad5040 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb42000a190 tx=0x7fb42004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e6e342e50cb95a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.865+0000 7fb31be07640 1 -- 172.21.15.62:0/478619616 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420052410 con 0x564fe49dffb0 2024-04-26T07:54:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.865+0000 7fb31be07640 1 -- 172.21.15.62:0/478619616 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb420062070 con 0x564fe49dffb0 2024-04-26T07:54:57.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.865+0000 7fb31be07640 1 -- 172.21.15.62:0/478619616 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420052700 con 0x564fe49dffb0 2024-04-26T07:54:57.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 -- 172.21.15.62:0/478619616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 msgr2=0x564fe4ad5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 --2- 172.21.15.62:0/478619616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4ad5040 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb42000a190 tx=0x7fb42004c000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 -- 172.21.15.62:0/478619616 shutdown_connections 2024-04-26T07:54:57.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 --2- 172.21.15.62:0/478619616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4ad5040 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 -- 172.21.15.62:0/478619616 >> 172.21.15.62:0/478619616 conn(0x564fe49dbbb0 msgr2=0x564fe4ad0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 -- 172.21.15.62:0/478619616 shutdown_connections 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 -- 172.21.15.62:0/478619616 wait complete. 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 Processor -- start 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.866+0000 7fb430462800 1 -- start start 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.867+0000 7fb430462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4adcb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.867+0000 7fb430462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fe49e1a00 con 0x564fe49dffb0 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.867+0000 7fb42df61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4adcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.867+0000 7fb42df61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4adcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57324/0 (socket says 172.21.15.62:57324) 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.867+0000 7fb42df61640 1 -- 172.21.15.62:0/215607602 learned_addr learned my addr 172.21.15.62:0/215607602 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.867+0000 7fb42df61640 1 -- 172.21.15.62:0/215607602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe4add060 con 0x564fe49dffb0 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.867+0000 7fb42df61640 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4adcb20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb420000f80 tx=0x7fb420003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.868+0000 7fb31a604640 1 -- 172.21.15.62:0/215607602 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42005d630 con 0x564fe49dffb0 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.868+0000 7fb31a604640 1 -- 172.21.15.62:0/215607602 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb420058040 con 0x564fe49dffb0 2024-04-26T07:54:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.868+0000 7fb31a604640 1 -- 172.21.15.62:0/215607602 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42005d920 con 0x564fe49dffb0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.868+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fe4add2f0 con 0x564fe49dffb0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.868+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe4adff50 con 0x564fe49dffb0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.868+0000 7fb31a604640 1 -- 172.21.15.62:0/215607602 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb420050070 con 0x564fe49dffb0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.869+0000 7fb31a604640 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb314036e60 0x7fb314039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.869+0000 7fb31a604640 1 -- 172.21.15.62:0/215607602 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fb42008ed00 con 0x564fe49dffb0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.869+0000 7fb42d760640 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb314036e60 0x7fb314039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.869+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe49e0910 0x564fe4ae3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.869+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4ae4290 con 0x564fe49e0910 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.869+0000 7fb42e762640 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe49e0910 0x564fe4ae3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.869+0000 7fb42d760640 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb314036e60 0x7fb314039320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb418001e10 tx=0x7fb418001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.869+0000 7fb42e762640 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe49e0910 0x564fe4ae3d10 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.870+0000 7fb42e762640 1 -- 172.21.15.62:0/215607602 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4280083e0 con 0x564fe49e0910 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.870+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4ae12c0 con 0x564fe49e0910 2024-04-26T07:54:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.870+0000 7fb42e762640 1 -- 172.21.15.62:0/215607602 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4280083e0 con 0x564fe49e0910 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.870+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4ae65d0 0x564fe4ae89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.870+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4ae90b0 con 0x564fe4ae65d0 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.870+0000 7fb42df61640 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4ae65d0 0x564fe4ae89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.870+0000 7fb42df61640 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4ae65d0 0x564fe4ae89c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.871+0000 7fb42df61640 1 -- 172.21.15.62:0/215607602 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb420077020 con 0x564fe4ae65d0 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.871+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4ae5580 con 0x564fe49e0910 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.871+0000 7fb42e762640 1 -- 172.21.15.62:0/215607602 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4280083e0 con 0x564fe49e0910 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.871+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4ae5a20 con 0x564fe49e0910 2024-04-26T07:54:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.871+0000 7fb42e762640 1 -- 172.21.15.62:0/215607602 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb4280083e0 con 0x564fe49e0910 2024-04-26T07:54:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb430462800 1 Processor -- start 2024-04-26T07:54:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb430462800 1 -- start start 2024-04-26T07:54:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb430462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4af8250 0x564fe4af8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb430462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fe48d4170 con 0x564fe4af8250 2024-04-26T07:54:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb42e762640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4af8250 0x564fe4af8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb42e762640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4af8250 0x564fe4af8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57332/0 (socket says 172.21.15.62:57332) 2024-04-26T07:54:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb42e762640 1 -- 172.21.15.62:0/2144120654 learned_addr learned my addr 172.21.15.62:0/2144120654 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb42e762640 1 -- 172.21.15.62:0/2144120654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe4af8bb0 con 0x564fe4af8250 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.872+0000 7fb42e762640 1 --2- 172.21.15.62:0/2144120654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4af8250 0x564fe4af8670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x564fe4add9a0 tx=0x7fb42800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.873+0000 7fb3137fe640 1 -- 172.21.15.62:0/2144120654 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428007d00 con 0x564fe4af8250 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.873+0000 7fb3137fe640 1 -- 172.21.15.62:0/2144120654 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42801e020 con 0x564fe4af8250 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.873+0000 7fb3137fe640 1 -- 172.21.15.62:0/2144120654 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428019420 con 0x564fe4af8250 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.873+0000 7fb430462800 1 -- 172.21.15.62:0/2144120654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fe4af9620 con 0x564fe4af8250 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.873+0000 7fb430462800 1 -- 172.21.15.62:0/2144120654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe4af9b20 con 0x564fe4af8250 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.873+0000 7fb3137fe640 1 -- 172.21.15.62:0/2144120654 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb428016040 con 0x564fe4af8250 2024-04-26T07:54:57.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb3137fe640 1 --2- 172.21.15.62:0/2144120654 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb308036eb0 0x7fb308039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb3137fe640 1 -- 172.21.15.62:0/2144120654 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fb42801f030 con 0x564fe4af8250 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb42df61640 1 --2- 172.21.15.62:0/2144120654 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb308036eb0 0x7fb308039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb430462800 1 Processor -- start 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb430462800 1 -- start start 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb42df61640 1 --2- 172.21.15.62:0/2144120654 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb308036eb0 0x7fb308039370 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x564fe4ae4740 tx=0x7fb420051ea0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb430462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b05a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb430462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fe4ad58d0 con 0x564fe4b05620 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb42e762640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b05a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb42e762640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b05a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57340/0 (socket says 172.21.15.62:57340) 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.874+0000 7fb42e762640 1 -- 172.21.15.62:0/2221877076 learned_addr learned my addr 172.21.15.62:0/2221877076 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb42e762640 1 -- 172.21.15.62:0/2221877076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe4b05fd0 con 0x564fe4b05620 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb42e762640 1 --2- 172.21.15.62:0/2221877076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b05a00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb42804ce40 tx=0x7fb428017470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4f9f70f79cb272 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb3117fa640 1 -- 172.21.15.62:0/2221877076 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428040030 con 0x564fe4b05620 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb3117fa640 1 -- 172.21.15.62:0/2221877076 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42804a030 con 0x564fe4b05620 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb3117fa640 1 -- 172.21.15.62:0/2221877076 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42801d070 con 0x564fe4b05620 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb430462800 1 -- 172.21.15.62:0/2221877076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 msgr2=0x564fe4b05a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb430462800 1 --2- 172.21.15.62:0/2221877076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b05a00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb42804ce40 tx=0x7fb428017470 comp rx=0 tx=0).stop 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb430462800 1 -- 172.21.15.62:0/2221877076 shutdown_connections 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb430462800 1 --2- 172.21.15.62:0/2221877076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b05a00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb430462800 1 -- 172.21.15.62:0/2221877076 >> 172.21.15.62:0/2221877076 conn(0x564fe4b018f0 msgr2=0x564fe4aff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb430462800 1 -- 172.21.15.62:0/2221877076 shutdown_connections 2024-04-26T07:54:57.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.875+0000 7fb430462800 1 -- 172.21.15.62:0/2221877076 wait complete. 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb430462800 1 Processor -- start 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb430462800 1 -- start start 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb430462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b0cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb430462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564fe4b067d0 con 0x564fe4b05620 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb42e762640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b0cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb42e762640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b0cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57344/0 (socket says 172.21.15.62:57344) 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 learned_addr learned my addr 172.21.15.62:0/3434902406 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe4b0d040 con 0x564fe4b05620 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.876+0000 7fb42e762640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b0cb00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb4280157d0 tx=0x7fb42804cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.877+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3434902406 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428040070 con 0x564fe4b05620 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.877+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3434902406 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb428041040 con 0x564fe4b05620 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.877+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fe4b0d2d0 con 0x564fe4b05620 2024-04-26T07:54:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.877+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3434902406 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4280195c0 con 0x564fe4b05620 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.877+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe4b0ff80 con 0x564fe4b05620 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.877+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3434902406 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb428019890 con 0x564fe4b05620 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.877+0000 7fb2ff7fe640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb2f8036e60 0x7fb2f8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.878+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3434902406 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7fb428038c70 con 0x564fe4b05620 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.878+0000 7fb42df61640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb2f8036e60 0x7fb2f8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.878+0000 7fb42df61640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb2f8036e60 0x7fb2f8039320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb420052770 tx=0x7fb420086000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.878+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.878+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe4b185e0 0x564fe4b1aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.878+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b1b1f0 con 0x564fe4b185e0 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.878+0000 7fb42d760640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe4b185e0 0x564fe4b1aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb42d760640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe4b185e0 0x564fe4b1aaa0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb41800bdb0 con 0x564fe4b185e0 2024-04-26T07:54:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 20 realm 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b17a30 con 0x564fe4b185e0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb41800bdb0 con 0x564fe4b185e0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b1bce0 con 0x564fe4b185e0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb41800bdb0 con 0x564fe4b185e0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b1c5b0 con 0x564fe4b185e0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb41800bdb0 con 0x564fe4b185e0 2024-04-26T07:54:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.879+0000 7fb430462800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.880+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.880+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4b1cef0 0x564fe4b1f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.880+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b1fab0 con 0x564fe4b1cef0 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.880+0000 7fb42e762640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4b1cef0 0x564fe4b1f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.880+0000 7fb42e762640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4b1cef0 0x564fe4b1f320 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.881+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.881+0000 7fb430462800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.881+0000 7fb430462800 20 searching for the correct realm 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.881+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fe4b21a60 0x564fe4b23f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.881+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.881+0000 7fb42df61640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fe4b21a60 0x564fe4b23f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.881+0000 7fb42df61640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fe4b21a60 0x564fe4b23f20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.882+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.882+0000 7fb42df61640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb420089040 0x7fb420066400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.882+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x7fb420089040 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.882+0000 7fb42d760640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb420089040 0x7fb420066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.882+0000 7fb42d760640 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb420089040 0x7fb420066400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.882+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800bdb0 con 0x7fb420089040 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.882+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.883+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.883+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b185e0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.883+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800bdb0 con 0x564fe4b185e0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.883+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b185e0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.883+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.883+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.883+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.883+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.884+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.884+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x7fb420089040 2024-04-26T07:54:57.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.884+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.884+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.884+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.884+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b185e0 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.884+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.884+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.885+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.885+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b185e0 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.885+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.885+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x7fb420089040 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.885+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.885+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.886+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.886+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.886+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.886+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.886+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.886+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.886+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.886+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.887+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.887+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b185e0 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.887+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.887+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b185e0 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.887+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.887+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.887+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.888+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.888+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.888+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x7fb420089040 2024-04-26T07:54:57.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.888+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.888+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b185e0 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.888+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.888+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.889+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.889+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.889+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.889+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.889+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.889+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x7fb420089040 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.889+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.889+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b21a60 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.890+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.890+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b1cef0 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.890+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.890+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x564fe4b185e0 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b245f0 con 0x7fb420089040 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b20470 con 0x564fe4b185e0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b20d10 con 0x564fe4b185e0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.891+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b200b0 con 0x564fe4b185e0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 20 zone default found 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 4 Realm: () 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 20 zonegroup default 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b20940 con 0x564fe4b1cef0 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b26e30 con 0x564fe4b21a60 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.892+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.893+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b271d0 con 0x564fe4b21a60 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.893+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.893+0000 7fb430462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.893+0000 7fb430462800 20 started sync module instance, tier type = 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.893+0000 7fb430462800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.893+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b26270 con 0x7fb420089040 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.894+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.894+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94901139302288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b26270 con 0x7fb420089040 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.894+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b27b90 con 0x564fe4b185e0 2024-04-26T07:54:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.895+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94901139302288] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.895+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.895+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94901139306688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b26270 con 0x564fe4b185e0 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.895+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b285d0 con 0x564fe4b21a60 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.896+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94901139306688] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.896+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.896+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94901139299776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b261e0 con 0x564fe4b21a60 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.896+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b293c0 con 0x7fb420089040 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.897+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94901139299776] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.897+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.897+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94901139311088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b297b0 con 0x7fb420089040 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.897+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2a1b0 con 0x564fe4b185e0 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.898+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.898+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94901139315904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2a0e0 con 0x564fe4b185e0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.898+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2b0e0 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.899+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94901139311088] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.899+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94901139315904] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.900+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.900+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94901139318176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2abf0 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.900+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2b9b0 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.901+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94901139318176] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.901+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.901+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94901139312144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2abf0 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.901+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2c030 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(58 notify.7 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94901139323680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2c4a0 con 0x564fe4b1cef0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb430462800 20 add_watcher() i=0 2024-04-26T07:54:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb430462800 20 add_watcher() i=1 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb430462800 20 add_watcher() i=2 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb430462800 20 add_watcher() i=3 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb430462800 20 add_watcher() i=4 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb430462800 20 add_watcher() i=5 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94901139312144] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.902+0000 7fb430462800 20 add_watcher() i=6 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.903+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94901139323680] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.903+0000 7fb430462800 20 add_watcher() i=7 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.903+0000 7fb430462800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.903+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2c4a0 con 0x564fe4b185e0 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.903+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.903+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94901139324912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2ce60 con 0x564fe4b185e0 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.904+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94901139324912] v27'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.904+0000 7fb2df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.904+0000 7fb430462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.904+0000 7fb430462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.904+0000 7fb430462800 5 note: GC not initialized 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb2de7fc640 20 reqs_thread_entry: start 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 20 Filter name: none 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb24ffff640 20 reqs_thread_entry: start 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 20 rados->read ofs=0 len=0 2024-04-26T07:54:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b62c70 con 0x564fe4b185e0 2024-04-26T07:54:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 20 rados_obj.operate() r=0 bl.length=403 2024-04-26T07:54:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.905+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b68e60 con 0x564fe4b185e0 2024-04-26T07:54:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.906+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb430462800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb430462800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb430462800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94901139572944 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b646f0 con 0x564fe4b185e0 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94901139315904 notify 115964117011 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564fe4955280 con 0x564fe4b185e0 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb3117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117011 cookie 94901139315904 notifier 4655 bl.length()=567 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94901139572944 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb3117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb3117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb3117fa640 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fb2f0003ea0 con 0x564fe4b185e0 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.907+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94901139572944 notify 115964117011 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb41803c8f0 con 0x564fe4b185e0 2024-04-26T07:54:57.964 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T07:54:33.908740Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:54:33.908719Z","tags":[],"group_ids":[]} 2024-04-26T07:54:57.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.908+0000 7fb2df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:57.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.908+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94901139324912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b680c0 con 0x564fe4b185e0 2024-04-26T07:54:57.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.909+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94901139324912] v27'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.909+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94901139302288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2bff0 con 0x7fb420089040 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.910+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94901139302288] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.910+0000 7fb430462800 20 remove_watcher() i=0 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.910+0000 7fb430462800 2 removed watcher, disabling cache 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.910+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94901139306688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2bff0 con 0x564fe4b185e0 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.911+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94901139306688] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.911+0000 7fb430462800 20 remove_watcher() i=1 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.911+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94901139299776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b2bff0 con 0x564fe4b21a60 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.912+0000 7fb42df61640 1 -- 172.21.15.62:0/3434902406 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94901139299776] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb420077020 con 0x564fe4b21a60 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.913+0000 7fb430462800 20 remove_watcher() i=2 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.913+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94901139311088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b25dc0 con 0x7fb420089040 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.913+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94901139311088] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x7fb420089040 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.913+0000 7fb430462800 20 remove_watcher() i=3 2024-04-26T07:54:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.913+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94901139315904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b25dc0 con 0x564fe4b185e0 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.914+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94901139315904] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41802a040 con 0x564fe4b185e0 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.914+0000 7fb430462800 20 remove_watcher() i=4 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.914+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94901139318176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b29cc0 con 0x564fe4b1cef0 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.915+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94901139318176] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.915+0000 7fb430462800 20 remove_watcher() i=5 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.915+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94901139312144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b25dc0 con 0x564fe4b1cef0 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.917+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94901139312144] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.917+0000 7fb430462800 20 remove_watcher() i=6 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.917+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94901139323680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564fe4b25dc0 con 0x564fe4b1cef0 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb42e762640 1 -- 172.21.15.62:0/3434902406 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94901139323680] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42804ed70 con 0x564fe4b1cef0 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 20 remove_watcher() i=7 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4b1cef0 msgr2=0x564fe4b1f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4b1cef0 0x564fe4b1f320 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe4b185e0 msgr2=0x564fe4b1aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe4b185e0 0x564fe4b1aaa0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb420089040 msgr2=0x7fb420066400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb420089040 0x7fb420066400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fe4b21a60 msgr2=0x564fe4b23f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564fe4b21a60 0x564fe4b23f20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb2f8036e60 msgr2=0x7fb2f8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb2f8036e60 0x7fb2f8039320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb420052770 tx=0x7fb420086000 comp rx=0 tx=0).stop 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 msgr2=0x564fe4b0cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b0cb00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb4280157d0 tx=0x7fb42804cdd0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb42d760640 1 -- 172.21.15.62:0/3434902406 reap_dead start 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 shutdown_connections 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/3434902406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4b05620 0x564fe4b0cb00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 >> 172.21.15.62:0/3434902406 conn(0x564fe4b018f0 msgr2=0x564fe4afef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 shutdown_connections 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/3434902406 wait complete. 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/2144120654 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb308036eb0 msgr2=0x7fb308039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/2144120654 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb308036eb0 0x7fb308039370 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x564fe4ae4740 tx=0x7fb420051ea0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/2144120654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4af8250 msgr2=0x564fe4af8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/2144120654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4af8250 0x564fe4af8670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x564fe4add9a0 tx=0x7fb42800aea0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/2144120654 shutdown_connections 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/2144120654 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb308036eb0 0x7fb308039370 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 --2- 172.21.15.62:0/2144120654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe4af8250 0x564fe4af8670 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/2144120654 >> 172.21.15.62:0/2144120654 conn(0x564fe4aec2f0 msgr2=0x564fe4aec6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/2144120654 shutdown_connections 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.918+0000 7fb430462800 1 -- 172.21.15.62:0/2144120654 wait complete. 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4ae65d0 msgr2=0x564fe4ae89c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4ae65d0 0x564fe4ae89c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe49e0910 msgr2=0x564fe4ae3d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe49e0910 0x564fe4ae3d10 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb314036e60 msgr2=0x7fb314039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb314036e60 0x7fb314039320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb418001e10 tx=0x7fb418001390 comp rx=0 tx=0).stop 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 msgr2=0x564fe4adcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4adcb20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb420000f80 tx=0x7fb420003330 comp rx=0 tx=0).stop 2024-04-26T07:54:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 shutdown_connections 2024-04-26T07:54:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564fe49e0910 0x564fe4ae3d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x564fe4ae65d0 0x564fe4ae89c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb314036e60 0x7fb314039320 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 --2- 172.21.15.62:0/215607602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564fe49dffb0 0x564fe4adcb20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 >> 172.21.15.62:0/215607602 conn(0x564fe49dbbb0 msgr2=0x564fe4acf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 shutdown_connections 2024-04-26T07:54:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:57.919+0000 7fb430462800 1 -- 172.21.15.62:0/215607602 wait complete. 2024-04-26T07:54:57.977 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T07:54:33.908740Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:54:33.908719Z', 'tags': [], 'group_ids': []} 2024-04-26T07:54:57.988 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:57.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T07:54:57.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T07:54:57.989 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T07:54:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:54:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:54:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f24d1f800 1 Processor -- start 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f24d1f800 1 -- start start 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f24d1f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559f816ffc80 0x559f81702070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f24d1f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f817025b0 con 0x559f816fc170 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f24d1f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x559f8159de20 con 0x559f816ffc80 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f1bfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559f816ffc80 0x559f81702070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f209c3640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x559f816fc170 0x559f816fe560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:35994/0 (socket says 172.21.15.62:35994) 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f209c3640 1 -- 172.21.15.62:0/2649926036 learned_addr learned my addr 172.21.15.62:0/2649926036 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f1bfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559f816ffc80 0x559f81702070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57358/0 (socket says 172.21.15.62:57358) 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f1bfff640 1 -- 172.21.15.62:0/2649926036 >> v1:172.21.15.1:6789/0 conn(0x559f816fc170 legacy=0x559f816fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.037+0000 7f2f1bfff640 1 -- 172.21.15.62:0/2649926036 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f81703790 con 0x559f816ffc80 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.039+0000 7f2f1bfff640 1 --2- 172.21.15.62:0/2649926036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816ffc80 0x559f81702070 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00a470 tx=0x7f2f0c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d106309796aaf930 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.039+0000 7f2f1b7fe640 1 -- 172.21.15.62:0/2649926036 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0c057070 con 0x559f816ffc80 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.039+0000 7f2f1b7fe640 1 -- 172.21.15.62:0/2649926036 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c052570 con 0x559f816ffc80 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.039+0000 7f2f1b7fe640 1 -- 172.21.15.62:0/2649926036 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0c052870 con 0x559f816ffc80 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.040+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2649926036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816ffc80 msgr2=0x559f81702070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.040+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2649926036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816ffc80 0x559f81702070 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00a470 tx=0x7f2f0c01ce90 comp rx=0 tx=0).stop 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.040+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2649926036 shutdown_connections 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.040+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2649926036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816ffc80 0x559f81702070 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.040+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2649926036 >> 172.21.15.62:0/2649926036 conn(0x559f816f5b80 msgr2=0x559f816f7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:58.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.040+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2649926036 shutdown_connections 2024-04-26T07:54:58.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.040+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2649926036 wait complete. 2024-04-26T07:54:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.053+0000 7f2f24d1f800 1 Processor -- start 2024-04-26T07:54:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.053+0000 7f2f24d1f800 1 -- start start 2024-04-26T07:54:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.053+0000 7f2f24d1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817ecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.053+0000 7f2f24d1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f81646cd0 con 0x559f816fc170 2024-04-26T07:54:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.053+0000 7f2f209c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817ecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.053+0000 7f2f209c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817ecc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57368/0 (socket says 172.21.15.62:57368) 2024-04-26T07:54:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.053+0000 7f2f209c3640 1 -- 172.21.15.62:0/338278836 learned_addr learned my addr 172.21.15.62:0/338278836 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.054+0000 7f2f209c3640 1 -- 172.21.15.62:0/338278836 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f817ed250 con 0x559f816fc170 2024-04-26T07:54:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.054+0000 7f2f209c3640 1 --2- 172.21.15.62:0/338278836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817ecc80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2f14001de0 tx=0x7f2f1400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfcd68b78dfc52f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.054+0000 7f2e0ee05640 1 -- 172.21.15.62:0/338278836 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14012020 con 0x559f816fc170 2024-04-26T07:54:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.054+0000 7f2e0ee05640 1 -- 172.21.15.62:0/338278836 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1400e5a0 con 0x559f816fc170 2024-04-26T07:54:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.054+0000 7f2e0ee05640 1 -- 172.21.15.62:0/338278836 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1400e8c0 con 0x559f816fc170 2024-04-26T07:54:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 -- 172.21.15.62:0/338278836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 msgr2=0x559f817ecc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/338278836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817ecc80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2f14001de0 tx=0x7f2f1400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 -- 172.21.15.62:0/338278836 shutdown_connections 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/338278836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817ecc80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 -- 172.21.15.62:0/338278836 >> 172.21.15.62:0/338278836 conn(0x559f816f5b80 msgr2=0x559f817e85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 -- 172.21.15.62:0/338278836 shutdown_connections 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 -- 172.21.15.62:0/338278836 wait complete. 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 Processor -- start 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.055+0000 7f2f24d1f800 1 -- start start 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.056+0000 7f2f24d1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.056+0000 7f2f24d1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f81702a80 con 0x559f816fc170 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.056+0000 7f2f209c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.056+0000 7f2f209c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817f47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57376/0 (socket says 172.21.15.62:57376) 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.056+0000 7f2f209c3640 1 -- 172.21.15.62:0/2157684573 learned_addr learned my addr 172.21.15.62:0/2157684573 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.056+0000 7f2f209c3640 1 -- 172.21.15.62:0/2157684573 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f817f4d00 con 0x559f816fc170 2024-04-26T07:54:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.056+0000 7f2f209c3640 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817f47c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400c010 tx=0x7f2f14000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.056+0000 7f2e0d602640 1 -- 172.21.15.62:0/2157684573 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14012070 con 0x559f816fc170 2024-04-26T07:54:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.057+0000 7f2e0d602640 1 -- 172.21.15.62:0/2157684573 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1401a7a0 con 0x559f816fc170 2024-04-26T07:54:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.057+0000 7f2e0d602640 1 -- 172.21.15.62:0/2157684573 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1401aa80 con 0x559f816fc170 2024-04-26T07:54:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.057+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f817f4f90 con 0x559f816fc170 2024-04-26T07:54:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.057+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f817f7c40 con 0x559f816fc170 2024-04-26T07:54:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.057+0000 7f2e0d602640 1 -- 172.21.15.62:0/2157684573 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2f14015020 con 0x559f816fc170 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2e0d602640 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2e08036eb0 0x7f2e08039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2e0d602640 1 -- 172.21.15.62:0/2157684573 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2f14020070 con 0x559f816fc170 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2f1bfff640 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2e08036eb0 0x7f2e08039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f816ffc80 0x559f817fba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f817fbf40 con 0x559f816ffc80 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2f211c4640 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f816ffc80 0x559f817fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2f1bfff640 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2e08036eb0 0x7f2e08039370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c054000 tx=0x7f2f0c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2f211c4640 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f816ffc80 0x559f817fba00 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2f211c4640 1 -- 172.21.15.62:0/2157684573 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f1c00a4a0 con 0x559f816ffc80 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.058+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f817f8fd0 con 0x559f816ffc80 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.059+0000 7f2f211c4640 1 -- 172.21.15.62:0/2157684573 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f1c00a4a0 con 0x559f816ffc80 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.059+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f817fe290 0x559f81800680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.059+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f81800d70 con 0x559f817fe290 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.059+0000 7f2f209c3640 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f817fe290 0x559f81800680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.059+0000 7f2f209c3640 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f817fe290 0x559f81800680 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.060+0000 7f2f209c3640 1 -- 172.21.15.62:0/2157684573 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f1402b070 con 0x559f817fe290 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.060+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f817fd240 con 0x559f816ffc80 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.060+0000 7f2f211c4640 1 -- 172.21.15.62:0/2157684573 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f1c00a4a0 con 0x559f816ffc80 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.060+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f817fd6e0 con 0x559f816ffc80 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.060+0000 7f2f211c4640 1 -- 172.21.15.62:0/2157684573 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f1c00a4a0 con 0x559f816ffc80 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.060+0000 7f2f24d1f800 1 Processor -- start 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f24d1f800 1 -- start start 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f24d1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fbd10 0x559f816fa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f24d1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f815ee170 con 0x559f816fbd10 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f211c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fbd10 0x559f816fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f211c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fbd10 0x559f816fa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57392/0 (socket says 172.21.15.62:57392) 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f211c4640 1 -- 172.21.15.62:0/3003133868 learned_addr learned my addr 172.21.15.62:0/3003133868 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f211c4640 1 -- 172.21.15.62:0/3003133868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f816fa6c0 con 0x559f816fbd10 2024-04-26T07:54:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f211c4640 1 --2- 172.21.15.62:0/3003133868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fbd10 0x559f816fa180 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x559f817f5bc0 tx=0x7f2f1c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2e067fc640 1 -- 172.21.15.62:0/3003133868 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c014450 con 0x559f816fbd10 2024-04-26T07:54:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2e067fc640 1 -- 172.21.15.62:0/3003133868 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c0145f0 con 0x559f816fbd10 2024-04-26T07:54:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.061+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3003133868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f816fa950 con 0x559f816fbd10 2024-04-26T07:54:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.062+0000 7f2e067fc640 1 -- 172.21.15.62:0/3003133868 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c014910 con 0x559f816fbd10 2024-04-26T07:54:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.062+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3003133868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f816fae50 con 0x559f816fbd10 2024-04-26T07:54:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.062+0000 7f2e067fc640 1 -- 172.21.15.62:0/3003133868 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2f1c011040 con 0x559f816fbd10 2024-04-26T07:54:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.062+0000 7f2e067fc640 1 --2- 172.21.15.62:0/3003133868 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2df8036eb0 0x7f2df8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.062+0000 7f2e067fc640 1 -- 172.21.15.62:0/3003133868 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2f1c01e070 con 0x559f816fbd10 2024-04-26T07:54:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.062+0000 7f2f209c3640 1 --2- 172.21.15.62:0/3003133868 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2df8036eb0 0x7f2df8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f24d1f800 1 Processor -- start 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f24d1f800 1 -- start start 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f209c3640 1 --2- 172.21.15.62:0/3003133868 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2df8036eb0 0x7f2df8039370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x559f817fc3e0 tx=0x7f2f1404af80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f24d1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f8181f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f24d1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f817ed5d0 con 0x559f8181f3f0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f211c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f8181f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f211c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f8181f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57400/0 (socket says 172.21.15.62:57400) 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f211c4640 1 -- 172.21.15.62:0/2987846512 learned_addr learned my addr 172.21.15.62:0/2987846512 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.063+0000 7f2f211c4640 1 -- 172.21.15.62:0/2987846512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8181fde0 con 0x559f8181f3f0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f211c4640 1 --2- 172.21.15.62:0/2987846512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f8181f810 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c018430 tx=0x7f2f1c011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4f2b320ffebc76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2df7fff640 1 -- 172.21.15.62:0/2987846512 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c046070 con 0x559f8181f3f0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2df7fff640 1 -- 172.21.15.62:0/2987846512 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c013de0 con 0x559f8181f3f0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2df7fff640 1 -- 172.21.15.62:0/2987846512 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c046340 con 0x559f8181f3f0 2024-04-26T07:54:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2987846512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 msgr2=0x559f8181f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2987846512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f8181f810 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c018430 tx=0x7f2f1c011930 comp rx=0 tx=0).stop 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2987846512 shutdown_connections 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2987846512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f8181f810 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2987846512 >> 172.21.15.62:0/2987846512 conn(0x559f8181b6c0 msgr2=0x559f81819720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2987846512 shutdown_connections 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2987846512 wait complete. 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.064+0000 7f2f24d1f800 1 Processor -- start 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.065+0000 7f2f24d1f800 1 -- start start 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.065+0000 7f2f24d1f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f81826950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.065+0000 7f2f24d1f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f81820570 con 0x559f8181f3f0 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.065+0000 7f2f211c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f81826950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.065+0000 7f2f211c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f81826950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:57416/0 (socket says 172.21.15.62:57416) 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.065+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 learned_addr learned my addr 172.21.15.62:0/3989714452 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.065+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f81826e90 con 0x559f8181f3f0 2024-04-26T07:54:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.065+0000 7f2f211c4640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f81826950 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c048010 tx=0x7f2f1c04cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.066+0000 7f2df67fc640 1 -- 172.21.15.62:0/3989714452 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c03b070 con 0x559f8181f3f0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.066+0000 7f2df67fc640 1 -- 172.21.15.62:0/3989714452 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c02bc70 con 0x559f8181f3f0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.066+0000 7f2df67fc640 1 -- 172.21.15.62:0/3989714452 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c046040 con 0x559f8181f3f0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.066+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f81827180 con 0x559f8181f3f0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.066+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f81829dd0 con 0x559f8181f3f0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.066+0000 7f2df67fc640 1 -- 172.21.15.62:0/3989714452 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2f1c03f070 con 0x559f8181f3f0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.066+0000 7f2df67fc640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2dec036e60 0x7f2dec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.067+0000 7f2df67fc640 1 -- 172.21.15.62:0/3989714452 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6110+0+0 (secure 0 0 0) 0x7f2f1c033070 con 0x559f8181f3f0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.067+0000 7f2f209c3640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2dec036e60 0x7f2dec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.067+0000 7f2f209c3640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2dec036e60 0x7f2dec039320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2f14016f50 tx=0x7f2f14040000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.067+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.067+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f818326d0 0x559f81834b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.067+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f818352e0 con 0x559f818326d0 2024-04-26T07:54:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.067+0000 7f2f1bfff640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f818326d0 0x559f81834b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f1bfff640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f818326d0 0x559f81834b90 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 20 realm 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f818356b0 con 0x559f818326d0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f81835f80 con 0x559f818326d0 2024-04-26T07:54:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.068+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f81836320 con 0x559f818326d0 2024-04-26T07:54:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f24d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f81837080 0x559f81839470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f81839a30 con 0x559f81837080 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f211c4640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f81837080 0x559f81839470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f211c4640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f81837080 0x559f81839470 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f24d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f24d1f800 20 searching for the correct realm 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f8183ba00 0x559f8183dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.069+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.070+0000 7f2f209c3640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f8183ba00 0x559f8183dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.070+0000 7f2f209c3640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f8183ba00 0x559f8183dec0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.070+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.070+0000 7f2f209c3640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2f1403b070 0x7f2f14019000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.070+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x7f2f1403b070 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.071+0000 7f2f1bfff640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2f1403b070 0x7f2f14019000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.071+0000 7f2f1bfff640 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2f1403b070 0x7f2f14019000 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.071+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.071+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.072+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.072+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f818326d0 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.072+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.072+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f818326d0 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.072+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.072+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.072+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.072+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.073+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.073+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x7f2f1403b070 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.073+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.073+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.073+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.073+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f818326d0 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.073+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.073+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.074+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.074+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f818326d0 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.074+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.074+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x7f2f1403b070 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.074+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.074+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.074+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.074+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.075+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.075+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.075+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.075+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.075+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.075+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.075+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.076+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f818326d0 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.076+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.076+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f818326d0 2024-04-26T07:54:58.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.076+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.076+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.076+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.076+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.077+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.077+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x7f2f1403b070 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.077+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.077+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f818326d0 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.077+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.077+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.077+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.077+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.078+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.078+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.078+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.078+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x7f2f1403b070 2024-04-26T07:54:58.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.078+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.078+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f8183ba00 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.078+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.078+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f81837080 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x559f818326d0 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x559f8183e590 con 0x7f2f1403b070 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:54:58.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f8183a3f0 con 0x559f818326d0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.079+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f8183ac90 con 0x559f818326d0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f8183a030 con 0x559f818326d0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 20 zone default found 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 4 Realm: () 2024-04-26T07:54:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:54:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:54:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:54:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 20 zonegroup default 2024-04-26T07:54:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f8183eac0 con 0x559f81837080 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.080+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f81840d90 con 0x559f8183ba00 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f24d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f81841130 con 0x559f8183ba00 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f24d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f24d1f800 20 started sync module instance, tier type = 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f24d1f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.081+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81840220 con 0x7f2f1403b070 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.082+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.082+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143561074512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81840220 con 0x7f2f1403b070 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.082+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81841b60 con 0x559f818326d0 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.083+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94143561074512] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.084+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(46 notify.1 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.084+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143561072464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81841b60 con 0x559f818326d0 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.084+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81842560 con 0x559f8183ba00 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.085+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94143561072464] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.085+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.085+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94143561078448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81841ad0 con 0x559f8183ba00 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.085+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81843420 con 0x7f2f1403b070 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.086+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94143561078448] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.086+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.086+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94143561084784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81843840 con 0x7f2f1403b070 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.086+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81844200 con 0x559f818326d0 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.087+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(52 notify.4 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.087+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143561088336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81844170 con 0x559f818326d0 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.087+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81845170 con 0x559f81837080 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.087+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94143561084784] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.088+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94143561088336] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.088+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(54 notify.5 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.088+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94143561090544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81845130 con 0x559f81837080 2024-04-26T07:54:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.088+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81845a10 con 0x559f81837080 2024-04-26T07:54:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.089+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94143561090544] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.089+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(56 notify.6 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.089+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94143561092160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81845130 con 0x559f81837080 2024-04-26T07:54:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.089+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81846060 con 0x559f81837080 2024-04-26T07:54:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.090+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94143561092160] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(58 notify.7 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94143561095984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81846020 con 0x559f81837080 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f24d1f800 20 add_watcher() i=0 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f24d1f800 20 add_watcher() i=1 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f24d1f800 20 add_watcher() i=2 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f24d1f800 20 add_watcher() i=3 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f24d1f800 20 add_watcher() i=4 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f24d1f800 20 add_watcher() i=5 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.091+0000 7f2f24d1f800 20 add_watcher() i=6 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.092+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94143561095984] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.092+0000 7f2f24d1f800 20 add_watcher() i=7 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.092+0000 7f2f24d1f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.092+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f818494e0 con 0x559f818326d0 2024-04-26T07:54:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.092+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.092+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94143561094416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f818469a0 con 0x559f818326d0 2024-04-26T07:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.093+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94143561094416] v27'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.093+0000 7f2dd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.093+0000 7f2f24d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.093+0000 7f2f24d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.093+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81849290 con 0x559f818326d0 2024-04-26T07:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.095+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.095+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81852770 con 0x559f81837080 2024-04-26T07:54:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.096+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.096+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81852770 con 0x559f8183ba00 2024-04-26T07:54:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.097+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.097+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81852fc0 con 0x559f818326d0 2024-04-26T07:54:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.098+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.098+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81851d00 con 0x7f2f1403b070 2024-04-26T07:54:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.099+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.099+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81851d00 con 0x559f8183ba00 2024-04-26T07:54:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.100+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.100+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81851d00 con 0x559f818326d0 2024-04-26T07:54:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.101+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.101+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81851e70 con 0x559f81837080 2024-04-26T07:54:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.102+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.102+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x7f2f1403b070 2024-04-26T07:54:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.103+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.103+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.104+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.104+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x7f2f1403b070 2024-04-26T07:54:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.105+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.105+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f81837080 2024-04-26T07:54:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.106+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.106+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x7f2f1403b070 2024-04-26T07:54:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.107+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.107+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f81837080 2024-04-26T07:54:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.108+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.108+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f818326d0 2024-04-26T07:54:58.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.109+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.109+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.111+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.111+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x7f2f1403b070 2024-04-26T07:54:58.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.112+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.112+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.112+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.113+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f818326d0 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.113+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.113+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f818326d0 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.115+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.115+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.116+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.116+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x7f2f1403b070 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.117+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.117+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.118+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.118+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.119+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.119+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.120+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.120+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.121+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.121+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f81837080 2024-04-26T07:54:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.122+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.122+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.123+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.123+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f81837080 2024-04-26T07:54:58.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.124+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.124+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f8183ba00 2024-04-26T07:54:58.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.125+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.126+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x559f81837080 2024-04-26T07:54:58.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.127+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'52 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.127+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81853d70 con 0x7f2f1403b070 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.128+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.128+0000 7f2dd5fe3640 20 reqs_thread_entry: start 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.128+0000 7f2f24d1f800 20 init_complete bucket index max shards: 11 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.128+0000 7f2f24d1f800 20 Filter name: none 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.128+0000 7f2d477fe640 20 reqs_thread_entry: start 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.128+0000 7f2f24d1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.128+0000 7f2f24d1f800 20 rados->read ofs=0 len=0 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.128+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f8187ed60 con 0x559f818326d0 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.129+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.129+0000 7f2f24d1f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.129+0000 7f2f24d1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.129+0000 7f2f24d1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.129+0000 7f2f24d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:54:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.129+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559f8187ece0 con 0x7f2f1403b070 2024-04-26T07:54:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.129+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T07:54:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.130+0000 7f2dd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:54:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.130+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94143561094416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81852fc0 con 0x559f818326d0 2024-04-26T07:54:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.131+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94143561094416] v27'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.131+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94143561074512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81845510 con 0x7f2f1403b070 2024-04-26T07:54:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.132+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94143561074512] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.132+0000 7f2f24d1f800 20 remove_watcher() i=0 2024-04-26T07:54:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.132+0000 7f2f24d1f800 2 removed watcher, disabling cache 2024-04-26T07:54:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.132+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94143561072464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81845510 con 0x559f818326d0 2024-04-26T07:54:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.133+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94143561072464] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.133+0000 7f2f24d1f800 20 remove_watcher() i=1 2024-04-26T07:54:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.133+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94143561078448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81845510 con 0x559f8183ba00 2024-04-26T07:54:58.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.134+0000 7f2f209c3640 1 -- 172.21.15.62:0/3989714452 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94143561078448] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1402b070 con 0x559f8183ba00 2024-04-26T07:54:58.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.134+0000 7f2f24d1f800 20 remove_watcher() i=2 2024-04-26T07:54:58.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.134+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94143561084784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f818416b0 con 0x7f2f1403b070 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.135+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94143561084784] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x7f2f1403b070 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.135+0000 7f2f24d1f800 20 remove_watcher() i=3 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.135+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94143561088336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81845510 con 0x559f818326d0 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.136+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94143561088336] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c05a040 con 0x559f818326d0 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.136+0000 7f2f24d1f800 20 remove_watcher() i=4 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.136+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94143561090544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81842f70 con 0x559f81837080 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.137+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94143561090544] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.137+0000 7f2f24d1f800 20 remove_watcher() i=5 2024-04-26T07:54:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.137+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94143561092160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f818416b0 con 0x559f81837080 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.138+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94143561092160] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.138+0000 7f2f24d1f800 20 remove_watcher() i=6 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.138+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94143561095984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559f81843d50 con 0x559f81837080 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f211c4640 1 -- 172.21.15.62:0/3989714452 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94143561095984] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c03e030 con 0x559f81837080 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 20 remove_watcher() i=7 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f81837080 msgr2=0x559f81839470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f81837080 0x559f81839470 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f818326d0 msgr2=0x559f81834b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f818326d0 0x559f81834b90 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2f1403b070 msgr2=0x7f2f14019000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f2f1403b070 0x7f2f14019000 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f8183ba00 msgr2=0x559f8183dec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559f8183ba00 0x559f8183dec0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2dec036e60 msgr2=0x7f2dec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2dec036e60 0x7f2dec039320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2f14016f50 tx=0x7f2f14040000 comp rx=0 tx=0).stop 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 msgr2=0x559f81826950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f1bfff640 1 -- 172.21.15.62:0/3989714452 reap_dead start 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f81826950 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c048010 tx=0x7f2f1c04cf20 comp rx=0 tx=0).stop 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 shutdown_connections 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3989714452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f8181f3f0 0x559f81826950 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 >> 172.21.15.62:0/3989714452 conn(0x559f8181b6c0 msgr2=0x559f81818d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 shutdown_connections 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3989714452 wait complete. 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3003133868 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2df8036eb0 msgr2=0x7f2df8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3003133868 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2df8036eb0 0x7f2df8039370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x559f817fc3e0 tx=0x7f2f1404af80 comp rx=0 tx=0).stop 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3003133868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fbd10 msgr2=0x559f816fa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3003133868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fbd10 0x559f816fa180 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x559f817f5bc0 tx=0x7f2f1c018830 comp rx=0 tx=0).stop 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3003133868 shutdown_connections 2024-04-26T07:54:58.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3003133868 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2df8036eb0 0x7f2df8039370 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/3003133868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fbd10 0x559f816fa180 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3003133868 >> 172.21.15.62:0/3003133868 conn(0x559f81803f90 msgr2=0x559f81804390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3003133868 shutdown_connections 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.140+0000 7f2f24d1f800 1 -- 172.21.15.62:0/3003133868 wait complete. 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f817fe290 msgr2=0x559f81800680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f817fe290 0x559f81800680 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f816ffc80 msgr2=0x559f817fba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f816ffc80 0x559f817fba00 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2e08036eb0 msgr2=0x7f2e08039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2e08036eb0 0x7f2e08039370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c054000 tx=0x7f2f0c04e000 comp rx=0 tx=0).stop 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 msgr2=0x559f817f47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817f47c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400c010 tx=0x7f2f14000ed0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 shutdown_connections 2024-04-26T07:54:58.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559f816ffc80 0x559f817fba00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x559f817fe290 0x559f81800680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f2e08036eb0 0x7f2e08039370 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 --2- 172.21.15.62:0/2157684573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f816fc170 0x559f817f47c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:54:58.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 >> 172.21.15.62:0/2157684573 conn(0x559f816f5b80 msgr2=0x559f817e6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:54:58.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 shutdown_connections 2024-04-26T07:54:58.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:54:58.141+0000 7f2f24d1f800 1 -- 172.21.15.62:0/2157684573 wait complete. 2024-04-26T07:54:58.152 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T07:54:58.169 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:54:58.178 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-26T07:55:33.178 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-04-26T07:55:33.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-04-26T07:55:33.179 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-04-26T07:55:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.234+0000 7f51bfa0e800 1 Processor -- start 2024-04-26T07:55:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.234+0000 7f51bfa0e800 1 -- start start 2024-04-26T07:55:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.234+0000 7f51bfa0e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5563e38c6b00 0x5563e38cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.234+0000 7f51bfa0e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563e38398b0 con 0x5563e38c4fc0 2024-04-26T07:55:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.234+0000 7f51bfa0e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5563e3768e20 con 0x5563e38c6b00 2024-04-26T07:55:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.235+0000 7f51bcd0c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5563e38c6b00 0x5563e38cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.235+0000 7f51bcd0c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5563e38c6b00 0x5563e38cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34564/0 (socket says 172.21.15.62:34564) 2024-04-26T07:55:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.235+0000 7f51bcd0c640 1 -- 172.21.15.62:0/1119728067 learned_addr learned my addr 172.21.15.62:0/1119728067 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.235+0000 7f51bd50d640 1 --1- 172.21.15.62:0/1119728067 >> v1:172.21.15.1:6789/0 conn(0x5563e38c4fc0 0x5563e38c53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43468/0 (socket says 172.21.15.62:43468) 2024-04-26T07:55:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.235+0000 7f51bcd0c640 1 -- 172.21.15.62:0/1119728067 >> v1:172.21.15.1:6789/0 conn(0x5563e38c4fc0 legacy=0x5563e38c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.235+0000 7f51bcd0c640 1 -- 172.21.15.62:0/1119728067 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e3839a80 con 0x5563e38c6b00 2024-04-26T07:55:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.237+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/1119728067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e38cf600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f51b400a520 tx=0x7f51b401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ca808e9a52b9a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51affff640 1 -- 172.21.15.62:0/1119728067 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b4057070 con 0x5563e38c6b00 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51affff640 1 -- 172.21.15.62:0/1119728067 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b4052570 con 0x5563e38c6b00 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51affff640 1 -- 172.21.15.62:0/1119728067 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b404ae60 con 0x5563e38c6b00 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1119728067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 msgr2=0x5563e38cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1119728067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e38cf600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f51b400a520 tx=0x7f51b401d010 comp rx=0 tx=0).stop 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1119728067 shutdown_connections 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1119728067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e38cf600 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1119728067 >> 172.21.15.62:0/1119728067 conn(0x5563e38c0ba0 msgr2=0x5563e38c2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1119728067 shutdown_connections 2024-04-26T07:55:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.238+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1119728067 wait complete. 2024-04-26T07:55:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.253+0000 7f51bfa0e800 1 Processor -- start 2024-04-26T07:55:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.253+0000 7f51bfa0e800 1 -- start start 2024-04-26T07:55:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.253+0000 7f51bfa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c4fc0 0x5563e39b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.253+0000 7f51bfa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5563e3811cd0 con 0x5563e38c4fc0 2024-04-26T07:55:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.254+0000 7f51bd50d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c4fc0 0x5563e39b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.254+0000 7f51bd50d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c4fc0 0x5563e39b9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34582/0 (socket says 172.21.15.62:34582) 2024-04-26T07:55:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.254+0000 7f51bd50d640 1 -- 172.21.15.62:0/2051312473 learned_addr learned my addr 172.21.15.62:0/2051312473 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.254+0000 7f51bd50d640 1 -- 172.21.15.62:0/2051312473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e39ba4c0 con 0x5563e38c4fc0 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.254+0000 7f51bd50d640 1 --2- 172.21.15.62:0/2051312473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c4fc0 0x5563e39b9ef0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f51b0001e90 tx=0x7f51b000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77df533eee29106a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.254+0000 7f50ab606640 1 -- 172.21.15.62:0/2051312473 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b000e5c0 con 0x5563e38c4fc0 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.254+0000 7f50ab606640 1 -- 172.21.15.62:0/2051312473 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b0006070 con 0x5563e38c4fc0 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.255+0000 7f50ab606640 1 -- 172.21.15.62:0/2051312473 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b000e890 con 0x5563e38c4fc0 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.255+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2051312473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c4fc0 msgr2=0x5563e39b9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.255+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2051312473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c4fc0 0x5563e39b9ef0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f51b0001e90 tx=0x7f51b000b6c0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.255+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2051312473 shutdown_connections 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.255+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2051312473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c4fc0 0x5563e39b9ef0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.255+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2051312473 >> 172.21.15.62:0/2051312473 conn(0x5563e38c0ba0 msgr2=0x5563e39b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.255+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2051312473 shutdown_connections 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.255+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2051312473 wait complete. 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.256+0000 7f51bfa0e800 1 Processor -- start 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.256+0000 7f51bfa0e800 1 -- start start 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.256+0000 7f51bfa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e39c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.256+0000 7f51bfa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5563e38cfe10 con 0x5563e38c6b00 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.256+0000 7f51bd50d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e39c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.256+0000 7f51bd50d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e39c1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34590/0 (socket says 172.21.15.62:34590) 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.256+0000 7f51bd50d640 1 -- 172.21.15.62:0/1181595902 learned_addr learned my addr 172.21.15.62:0/1181595902 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.256+0000 7f51bd50d640 1 -- 172.21.15.62:0/1181595902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e39c21e0 con 0x5563e38c6b00 2024-04-26T07:55:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.257+0000 7f51bd50d640 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e39c1ca0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c010 tx=0x7f51b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.257+0000 7f50a9e03640 1 -- 172.21.15.62:0/1181595902 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b001a7c0 con 0x5563e38c6b00 2024-04-26T07:55:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.257+0000 7f50a9e03640 1 -- 172.21.15.62:0/1181595902 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b001a980 con 0x5563e38c6b00 2024-04-26T07:55:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.257+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563e39c2470 con 0x5563e38c6b00 2024-04-26T07:55:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.257+0000 7f50a9e03640 1 -- 172.21.15.62:0/1181595902 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b001aca0 con 0x5563e38c6b00 2024-04-26T07:55:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.257+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e39c5120 con 0x5563e38c6b00 2024-04-26T07:55:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.258+0000 7f50a9e03640 1 -- 172.21.15.62:0/1181595902 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f51b0017070 con 0x5563e38c6b00 2024-04-26T07:55:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.258+0000 7f50a9e03640 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f50a4036e60 0x7f50a4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.258+0000 7f50a9e03640 1 -- 172.21.15.62:0/1181595902 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f51b0015020 con 0x5563e38c6b00 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.258+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f50a4036e60 0x7f50a4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.258+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39c6ed0 0x5563e39c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.258+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39c9890 con 0x5563e39c6ed0 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.259+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39c6ed0 0x5563e39c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.259+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f50a4036e60 0x7f50a4039320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51b4054000 tx=0x7f51b404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.259+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39c6ed0 0x5563e39c92c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.259+0000 7f51bdd0e640 1 -- 172.21.15.62:0/1181595902 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51b800a4a0 con 0x5563e39c6ed0 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.259+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39c64b0 con 0x5563e39c6ed0 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.260+0000 7f51bdd0e640 1 -- 172.21.15.62:0/1181595902 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51b800a4a0 con 0x5563e39c6ed0 2024-04-26T07:55:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.260+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39cb690 con 0x5563e39c6ed0 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.260+0000 7f51bdd0e640 1 -- 172.21.15.62:0/1181595902 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51b800a4a0 con 0x5563e39c6ed0 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.260+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39ca9d0 con 0x5563e39c6ed0 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.260+0000 7f51bdd0e640 1 -- 172.21.15.62:0/1181595902 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51b800a4a0 con 0x5563e39c6ed0 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.260+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39cae20 con 0x5563e39c6ed0 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.261+0000 7f51bdd0e640 1 -- 172.21.15.62:0/1181595902 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51b800a4a0 con 0x5563e39c6ed0 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.261+0000 7f51bfa0e800 1 Processor -- start 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.261+0000 7f51bfa0e800 1 -- start start 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.261+0000 7f51bfa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39da460 0x5563e39da880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.261+0000 7f51bfa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5563e37b9170 con 0x5563e39da460 2024-04-26T07:55:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f51bcd0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39da460 0x5563e39da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f51bcd0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39da460 0x5563e39da880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34604/0 (socket says 172.21.15.62:34604) 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f51bcd0c640 1 -- 172.21.15.62:0/254278957 learned_addr learned my addr 172.21.15.62:0/254278957 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f51bcd0c640 1 -- 172.21.15.62:0/254278957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e39dadc0 con 0x5563e39da460 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/254278957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39da460 0x5563e39da880 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f51b4000c00 tx=0x7f51b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f50a2ffd640 1 -- 172.21.15.62:0/254278957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b4057040 con 0x5563e39da460 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f50a2ffd640 1 -- 172.21.15.62:0/254278957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b405d650 con 0x5563e39da460 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f51bfa0e800 1 -- 172.21.15.62:0/254278957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563e39db830 con 0x5563e39da460 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.262+0000 7f50a2ffd640 1 -- 172.21.15.62:0/254278957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b405d930 con 0x5563e39da460 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.263+0000 7f51bfa0e800 1 -- 172.21.15.62:0/254278957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e39dbcd0 con 0x5563e39da460 2024-04-26T07:55:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.263+0000 7f50a2ffd640 1 -- 172.21.15.62:0/254278957 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f51b4067070 con 0x5563e39da460 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f50a2ffd640 1 --2- 172.21.15.62:0/254278957 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5094036eb0 0x7f5094039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f50a2ffd640 1 -- 172.21.15.62:0/254278957 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f51b408ff00 con 0x5563e39da460 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/254278957 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5094036eb0 0x7f5094039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bfa0e800 1 Processor -- start 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bfa0e800 1 -- start start 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/254278957 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5094036eb0 0x7f5094039370 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5563e39ca4f0 tx=0x7f51b8005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bfa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bfa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5563e39ba840 con 0x5563e39e76e0 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bcd0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bcd0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39e7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34608/0 (socket says 172.21.15.62:34608) 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.264+0000 7f51bcd0c640 1 -- 172.21.15.62:0/3597784106 learned_addr learned my addr 172.21.15.62:0/3597784106 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.265+0000 7f51bcd0c640 1 -- 172.21.15.62:0/3597784106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e39e80d0 con 0x5563e39e76e0 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.265+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/3597784106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39e7b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f51b408e180 tx=0x7f51b4067490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6296fcbbc33318c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.265+0000 7f50a0ff9640 1 -- 172.21.15.62:0/3597784106 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b4068e60 con 0x5563e39e76e0 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.265+0000 7f50a0ff9640 1 -- 172.21.15.62:0/3597784106 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b4081070 con 0x5563e39e76e0 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.265+0000 7f50a0ff9640 1 -- 172.21.15.62:0/3597784106 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b4067540 con 0x5563e39e76e0 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 -- 172.21.15.62:0/3597784106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 msgr2=0x5563e39e7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/3597784106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39e7b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f51b408e180 tx=0x7f51b4067490 comp rx=0 tx=0).stop 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 -- 172.21.15.62:0/3597784106 shutdown_connections 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/3597784106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39e7b00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 -- 172.21.15.62:0/3597784106 >> 172.21.15.62:0/3597784106 conn(0x5563e39e3a00 msgr2=0x5563e39e1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 -- 172.21.15.62:0/3597784106 shutdown_connections 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 -- 172.21.15.62:0/3597784106 wait complete. 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 Processor -- start 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 -- start start 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bfa0e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5563e39e87f0 con 0x5563e39e76e0 2024-04-26T07:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bcd0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bcd0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39eec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34616/0 (socket says 172.21.15.62:34616) 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.266+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 learned_addr learned my addr 172.21.15.62:0/2867929216 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.267+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e39ef1c0 con 0x5563e39e76e0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.267+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39eec80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f51b4052e80 tx=0x7f51b408e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.267+0000 7f5092ffd640 1 -- 172.21.15.62:0/2867929216 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b4068e60 con 0x5563e39e76e0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.267+0000 7f5092ffd640 1 -- 172.21.15.62:0/2867929216 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b4071580 con 0x5563e39e76e0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.267+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563e39ef450 con 0x5563e39e76e0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.267+0000 7f5092ffd640 1 -- 172.21.15.62:0/2867929216 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b405c510 con 0x5563e39e76e0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.267+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e39f2100 con 0x5563e39e76e0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.268+0000 7f5092ffd640 1 -- 172.21.15.62:0/2867929216 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f51b409b020 con 0x5563e39e76e0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.268+0000 7f5092ffd640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5088036e60 0x7f5088039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.268+0000 7f5092ffd640 1 -- 172.21.15.62:0/2867929216 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f51b4099020 con 0x5563e39e76e0 2024-04-26T07:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.269+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5088036e60 0x7f5088039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.269+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.269+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39fa780 0x5563e39fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.269+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39fd390 con 0x5563e39fa780 2024-04-26T07:55:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.269+0000 7f51bd50d640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39fa780 0x5563e39fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.269+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5088036e60 0x7f5088039320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5563e39c2ec0 tx=0x7f51b801f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.269+0000 7f51bd50d640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39fa780 0x5563e39fcc40 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.269+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 realm 2024-04-26T07:55:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39fd7a0 con 0x5563e39fa780 2024-04-26T07:55:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39fe070 con 0x5563e39fa780 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39fe410 con 0x5563e39fa780 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.270+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39fe870 con 0x5563e39fa780 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.271+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.271+0000 7f51bfa0e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.271+0000 7f51bfa0e800 20 searching for the correct realm 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.271+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5563e3a008c0 0x5563e3a02cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.271+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e3a008c0 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.271+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5563e3a008c0 0x5563e3a02cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.271+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5563e3a008c0 0x5563e3a02cd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.272+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.272+0000 7f51bcd0c640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f51b4087610 0x7f51b409d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.272+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b4087610 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.272+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f51b4087610 0x7f51b409d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.272+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f51b4087610 0x7f51b409d410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.272+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b801f070 con 0x7f51b4087610 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.272+0000 7f51bdd0e640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f51b8031040 0x7f51b8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.272+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b8031040 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.273+0000 7f51bd50d640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f51b8031040 0x7f51b8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.273+0000 7f51bd50d640 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f51b8031040 0x7f51b8032940 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.273+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.273+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e39fa780 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.274+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.274+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e39fa780 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.274+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.274+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e39fa780 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.274+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.274+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b8031040 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.275+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.275+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b4087610 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.275+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b801f070 con 0x7f51b4087610 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.275+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e3a008c0 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.275+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.275+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e39fa780 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.275+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.275+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b8031040 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.276+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.276+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e39fa780 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.276+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.276+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b4087610 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.276+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f51b801f070 con 0x7f51b4087610 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.276+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e3a008c0 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.277+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.277+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e3a008c0 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.277+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.277+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b8031040 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.277+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.277+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e3a008c0 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.277+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.277+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e3a008c0 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.278+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.278+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e39fa780 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.278+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.278+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e39fa780 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.278+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.278+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b8031040 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.279+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.279+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e3a008c0 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.279+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.279+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b4087610 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.279+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b801f070 con 0x7f51b4087610 2024-04-26T07:55:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.279+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x5563e39fa780 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.279+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.279+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a033a0 con 0x7f51b8031040 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.280+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.280+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f51b005f040 con 0x5563e3a008c0 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.280+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.280+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f51b005f040 con 0x7f51b8031040 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.280+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.280+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f51b005f040 con 0x7f51b4087610 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.281+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b801f070 con 0x7f51b4087610 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.281+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f51b005f040 con 0x5563e3a008c0 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.281+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.281+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f51b005f040 con 0x7f51b8031040 2024-04-26T07:55:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.281+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.281+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f51b005f040 con 0x5563e39fa780 2024-04-26T07:55:33.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f51b005f040 con 0x7f51b4087610 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b801f070 con 0x7f51b4087610 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39ff310 con 0x5563e39fa780 2024-04-26T07:55:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39ffbb0 con 0x5563e39fa780 2024-04-26T07:55:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.282+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39fef50 con 0x5563e39fa780 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 20 zone default found 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 4 Realm: () 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 20 zonegroup default 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e39ffbb0 con 0x7f51b8031040 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a05200 con 0x5563e3a008c0 2024-04-26T07:55:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.283+0000 7f51bfa0e800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.284+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a055a0 con 0x5563e3a008c0 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.284+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.284+0000 7f51bfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.284+0000 7f51bfa0e800 20 started sync module instance, tier type = 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.284+0000 7f51bfa0e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.284+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a046a0 con 0x7f51b4087610 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.285+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.285+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93887509056192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a04300 con 0x7f51b4087610 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.285+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a06410 con 0x5563e39fa780 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.286+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93887509056192] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.287+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.287+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93887509059904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a06410 con 0x5563e39fa780 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.287+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a06e30 con 0x5563e3a008c0 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.288+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 93887509059904] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.288+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.288+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93887509061472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a06380 con 0x5563e3a008c0 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.288+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a07cf0 con 0x7f51b4087610 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.289+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.289+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93887509068320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a08590 con 0x7f51b4087610 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.289+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a09060 con 0x5563e39fa780 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.289+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93887509061472] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.291+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.291+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93887509072720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a09020 con 0x5563e39fa780 2024-04-26T07:55:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.291+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a09b10 con 0x7f51b8031040 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.291+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93887509068320] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.292+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.292+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93887509070048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a09b10 con 0x7f51b8031040 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.292+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a0a520 con 0x7f51b8031040 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.292+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 93887509072720] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.293+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93887509070048] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.293+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.293+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93887509066272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a0a070 con 0x7f51b8031040 2024-04-26T07:55:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.293+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a0a960 con 0x7f51b8031040 2024-04-26T07:55:33.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93887509066272] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93887509075440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a0a520 con 0x7f51b8031040 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bfa0e800 20 add_watcher() i=0 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bfa0e800 20 add_watcher() i=1 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bfa0e800 20 add_watcher() i=2 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bfa0e800 20 add_watcher() i=3 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bfa0e800 20 add_watcher() i=4 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bfa0e800 20 add_watcher() i=5 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.295+0000 7f51bfa0e800 20 add_watcher() i=6 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.296+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93887509075440] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.296+0000 7f51bfa0e800 20 add_watcher() i=7 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.296+0000 7f51bfa0e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.296+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a0ddb0 con 0x5563e39fa780 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.296+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.296+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93887509078592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a0b260 con 0x5563e39fa780 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.297+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93887509078592] v29'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.297+0000 7f50737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.297+0000 7f51bfa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.297+0000 7f51bfa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.297+0000 7f51bfa0e800 5 note: GC not initialized 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.298+0000 7f50727e4640 20 reqs_thread_entry: start 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.298+0000 7f51bfa0e800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.298+0000 7f51bfa0e800 20 Filter name: none 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.298+0000 7f4fe3fff640 20 reqs_thread_entry: start 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.298+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a419b0 con 0x5563e39fa780 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.298+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.298+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a419b0 con 0x7f51b4087610 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.298+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.299+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a419d0 con 0x5563e39fa780 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.299+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.299+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a41990 con 0x5563e3a008c0 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.299+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.299+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a41990 con 0x5563e3a008c0 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.299+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.299+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a41990 con 0x5563e3a008c0 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.300+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.300+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a41990 con 0x5563e39fa780 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.300+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.300+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a41990 con 0x5563e39fa780 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.300+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.300+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a41990 con 0x5563e3a008c0 2024-04-26T07:55:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.300+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.300+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a41990 con 0x5563e3a008c0 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.301+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.301+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a41990 con 0x7f51b8031040 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.301+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.301+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a435b0 con 0x5563e39fa780 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.302+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.302+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a435b0 con 0x7f51b4087610 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.302+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.302+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a435b0 con 0x5563e3a008c0 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.302+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.302+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a435b0 con 0x7f51b8031040 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.303+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.303+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x7f51b8031040 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.303+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.303+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e3a008c0 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.303+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.303+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x7f51b8031040 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.304+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.304+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e39fa780 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.304+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.304+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e3a008c0 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.304+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.304+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x7f51b8031040 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.304+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.304+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x7f51b4087610 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.305+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.305+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x7f51b8031040 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.305+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.305+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e39fa780 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.305+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.305+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e39fa780 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.306+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.306+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e3a008c0 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.306+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.306+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e39fa780 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.306+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.306+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e39fa780 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.306+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.306+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e3a008c0 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.307+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.307+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e3a008c0 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.307+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.307+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x5563e3a008c0 2024-04-26T07:55:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.307+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.307+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43560 con 0x7f51b8031040 2024-04-26T07:55:33.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.308+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.309+0000 7f50737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.309+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93887509078592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a43230 con 0x5563e39fa780 2024-04-26T07:55:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.310+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93887509078592] v29'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.310+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93887509056192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e39f7e40 con 0x7f51b4087610 2024-04-26T07:55:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.311+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93887509056192] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.311+0000 7f51bfa0e800 20 remove_watcher() i=0 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.311+0000 7f51bfa0e800 2 removed watcher, disabling cache 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.311+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93887509059904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a04ac0 con 0x5563e39fa780 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.312+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93887509059904] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.312+0000 7f51bfa0e800 20 remove_watcher() i=1 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.312+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93887509061472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a05940 con 0x5563e3a008c0 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.314+0000 7f51bcd0c640 1 -- 172.21.15.62:0/2867929216 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93887509061472] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b4066030 con 0x5563e3a008c0 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.314+0000 7f51bfa0e800 20 remove_watcher() i=2 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.314+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93887509068320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a05f60 con 0x7f51b4087610 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.315+0000 7f51bdd0e640 1 -- 172.21.15.62:0/2867929216 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93887509068320] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b8040040 con 0x7f51b4087610 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.315+0000 7f51bfa0e800 20 remove_watcher() i=3 2024-04-26T07:55:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.315+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93887509072720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a05f60 con 0x5563e39fa780 2024-04-26T07:55:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.316+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93887509072720] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x5563e39fa780 2024-04-26T07:55:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.316+0000 7f51bfa0e800 20 remove_watcher() i=4 2024-04-26T07:55:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.316+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93887509070048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a05f60 con 0x7f51b8031040 2024-04-26T07:55:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.317+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93887509070048] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.317+0000 7f51bfa0e800 20 remove_watcher() i=5 2024-04-26T07:55:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.317+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93887509066272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a080e0 con 0x7f51b8031040 2024-04-26T07:55:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.318+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93887509066272] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.319+0000 7f51bfa0e800 20 remove_watcher() i=6 2024-04-26T07:55:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.319+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93887509075440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5563e3a07220 con 0x7f51b8031040 2024-04-26T07:55:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93887509075440] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b002e070 con 0x7f51b8031040 2024-04-26T07:55:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 20 remove_watcher() i=7 2024-04-26T07:55:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f51b8031040 msgr2=0x7f51b8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f51b8031040 0x7f51b8032940 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39fa780 msgr2=0x5563e39fcc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39fa780 0x5563e39fcc40 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f51b4087610 msgr2=0x7f51b409d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f51b4087610 0x7f51b409d410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5563e3a008c0 msgr2=0x5563e3a02cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5563e3a008c0 0x5563e3a02cd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5088036e60 msgr2=0x7f5088039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5088036e60 0x7f5088039320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5563e39c2ec0 tx=0x7f51b801f000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 msgr2=0x5563e39eec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39eec80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f51b4052e80 tx=0x7f51b408e110 comp rx=0 tx=0).stop 2024-04-26T07:55:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bd50d640 1 -- 172.21.15.62:0/2867929216 reap_dead start 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 shutdown_connections 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/2867929216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39e76e0 0x5563e39eec80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 >> 172.21.15.62:0/2867929216 conn(0x5563e39e3a00 msgr2=0x5563e39e1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 shutdown_connections 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/2867929216 wait complete. 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/254278957 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5094036eb0 msgr2=0x7f5094039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/254278957 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5094036eb0 0x7f5094039370 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5563e39ca4f0 tx=0x7f51b8005840 comp rx=0 tx=0).stop 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 -- 172.21.15.62:0/254278957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39da460 msgr2=0x5563e39da880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.320+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/254278957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39da460 0x5563e39da880 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f51b4000c00 tx=0x7f51b4002fb0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/254278957 shutdown_connections 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/254278957 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5094036eb0 0x7f5094039370 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/254278957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e39da460 0x5563e39da880 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/254278957 >> 172.21.15.62:0/254278957 conn(0x5563e39ce500 msgr2=0x5563e39ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/254278957 shutdown_connections 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/254278957 wait complete. 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39c6ed0 msgr2=0x5563e39c92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39c6ed0 0x5563e39c92c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f50a4036e60 msgr2=0x7f50a4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f50a4036e60 0x7f50a4039320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51b4054000 tx=0x7f51b404e000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 msgr2=0x5563e39c1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e39c1ca0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c010 tx=0x7f51b0000ed0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 shutdown_connections 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5563e39c6ed0 0x5563e39c92c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f50a4036e60 0x7f50a4039320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 --2- 172.21.15.62:0/1181595902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5563e38c6b00 0x5563e39c1ca0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 >> 172.21.15.62:0/1181595902 conn(0x5563e38c0ba0 msgr2=0x5563e39b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 shutdown_connections 2024-04-26T07:55:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.321+0000 7f51bfa0e800 1 -- 172.21.15.62:0/1181595902 wait complete. 2024-04-26T07:55:33.328 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-26T07:55:33.328 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:55:33.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-26T07:55:33.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-26T07:55:33.329 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-26T07:55:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.374+0000 7fc32b430800 1 Processor -- start 2024-04-26T07:55:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.374+0000 7fc32b430800 1 -- start start 2024-04-26T07:55:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.374+0000 7fc32b430800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5646817ecfb0 0x5646817ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.374+0000 7fc32b430800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564681762250 con 0x5646817ed910 2024-04-26T07:55:33.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.374+0000 7fc32b430800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x564681690e20 con 0x5646817ecfb0 2024-04-26T07:55:33.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.375+0000 7fc32668b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5646817ecfb0 0x5646817ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.375+0000 7fc32668b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5646817ecfb0 0x5646817ed3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34622/0 (socket says 172.21.15.62:34622) 2024-04-26T07:55:33.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.375+0000 7fc32668b640 1 -- 172.21.15.62:0/3609267244 learned_addr learned my addr 172.21.15.62:0/3609267244 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.375+0000 7fc325e8a640 1 --1- 172.21.15.62:0/3609267244 >> v1:172.21.15.1:6789/0 conn(0x5646817ed910 0x5646817eddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43476/0 (socket says 172.21.15.62:43476) 2024-04-26T07:55:33.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.375+0000 7fc32668b640 1 -- 172.21.15.62:0/3609267244 >> v1:172.21.15.1:6789/0 conn(0x5646817ed910 legacy=0x5646817eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.375+0000 7fc32668b640 1 -- 172.21.15.62:0/3609267244 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646817ee4d0 con 0x5646817ecfb0 2024-04-26T07:55:33.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.377+0000 7fc32668b640 1 --2- 172.21.15.62:0/3609267244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646817ed3d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc31800a520 tx=0x7fc31801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f6a09b0b7d7ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.377+0000 7fc325689640 1 -- 172.21.15.62:0/3609267244 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc318057070 con 0x5646817ecfb0 2024-04-26T07:55:33.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.377+0000 7fc325689640 1 -- 172.21.15.62:0/3609267244 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc318052570 con 0x5646817ecfb0 2024-04-26T07:55:33.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.377+0000 7fc325689640 1 -- 172.21.15.62:0/3609267244 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31804ae60 con 0x5646817ecfb0 2024-04-26T07:55:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.377+0000 7fc32b430800 1 -- 172.21.15.62:0/3609267244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 msgr2=0x5646817ed3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.377+0000 7fc32b430800 1 --2- 172.21.15.62:0/3609267244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646817ed3d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc31800a520 tx=0x7fc31801d010 comp rx=0 tx=0).stop 2024-04-26T07:55:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.378+0000 7fc32b430800 1 -- 172.21.15.62:0/3609267244 shutdown_connections 2024-04-26T07:55:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.378+0000 7fc32b430800 1 --2- 172.21.15.62:0/3609267244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646817ed3d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.378+0000 7fc32b430800 1 -- 172.21.15.62:0/3609267244 >> 172.21.15.62:0/3609267244 conn(0x5646817e8b70 msgr2=0x5646817eaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.378+0000 7fc32b430800 1 -- 172.21.15.62:0/3609267244 shutdown_connections 2024-04-26T07:55:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.378+0000 7fc32b430800 1 -- 172.21.15.62:0/3609267244 wait complete. 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.390+0000 7fc32b430800 1 Processor -- start 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.390+0000 7fc32b430800 1 -- start start 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.390+0000 7fc32b430800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.390+0000 7fc32b430800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564681739cc0 con 0x5646817ecfb0 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.391+0000 7fc32668b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.391+0000 7fc32668b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34624/0 (socket says 172.21.15.62:34624) 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.391+0000 7fc32668b640 1 -- 172.21.15.62:0/3652685984 learned_addr learned my addr 172.21.15.62:0/3652685984 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.391+0000 7fc32668b640 1 -- 172.21.15.62:0/3652685984 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646818e2710 con 0x5646817ecfb0 2024-04-26T07:55:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.391+0000 7fc32668b640 1 --2- 172.21.15.62:0/3652685984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e2140 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc318055040 tx=0x7fc31804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491213145efe52fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.391+0000 7fc214608640 1 -- 172.21.15.62:0/3652685984 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc318057040 con 0x5646817ecfb0 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.391+0000 7fc214608640 1 -- 172.21.15.62:0/3652685984 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc318052720 con 0x5646817ecfb0 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.391+0000 7fc214608640 1 -- 172.21.15.62:0/3652685984 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc318052a40 con 0x5646817ecfb0 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.392+0000 7fc32b430800 1 -- 172.21.15.62:0/3652685984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 msgr2=0x5646818e2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.392+0000 7fc32b430800 1 --2- 172.21.15.62:0/3652685984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e2140 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc318055040 tx=0x7fc31804c000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.392+0000 7fc32b430800 1 -- 172.21.15.62:0/3652685984 shutdown_connections 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.392+0000 7fc32b430800 1 --2- 172.21.15.62:0/3652685984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e2140 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.392+0000 7fc32b430800 1 -- 172.21.15.62:0/3652685984 >> 172.21.15.62:0/3652685984 conn(0x5646817e8b70 msgr2=0x5646818dda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.392+0000 7fc32b430800 1 -- 172.21.15.62:0/3652685984 shutdown_connections 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.392+0000 7fc32b430800 1 -- 172.21.15.62:0/3652685984 wait complete. 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.392+0000 7fc32b430800 1 Processor -- start 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.393+0000 7fc32b430800 1 -- start start 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.393+0000 7fc32b430800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.393+0000 7fc32b430800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5646817ee9a0 con 0x5646817ecfb0 2024-04-26T07:55:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.393+0000 7fc32668b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.393+0000 7fc32668b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34632/0 (socket says 172.21.15.62:34632) 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.393+0000 7fc32668b640 1 -- 172.21.15.62:0/3947767265 learned_addr learned my addr 172.21.15.62:0/3947767265 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.393+0000 7fc32668b640 1 -- 172.21.15.62:0/3947767265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646818ea1c0 con 0x5646817ecfb0 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.393+0000 7fc32668b640 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e9c80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc318052540 tx=0x7fc318003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.394+0000 7fc212e05640 1 -- 172.21.15.62:0/3947767265 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc318073070 con 0x5646817ecfb0 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.394+0000 7fc212e05640 1 -- 172.21.15.62:0/3947767265 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31805d440 con 0x5646817ecfb0 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.394+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646818ea450 con 0x5646817ecfb0 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.394+0000 7fc212e05640 1 -- 172.21.15.62:0/3947767265 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc318057070 con 0x5646817ecfb0 2024-04-26T07:55:33.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.394+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646818ed0b0 con 0x5646817ecfb0 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc212e05640 1 -- 172.21.15.62:0/3947767265 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc318076070 con 0x5646817ecfb0 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc212e05640 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc20c036e60 0x7fc20c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc212e05640 1 -- 172.21.15.62:0/3947767265 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc31808e350 con 0x5646817ecfb0 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc325e8a640 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc20c036e60 0x7fc20c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc32b430800 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5646817ed910 0x5646818f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646818f13b0 con 0x5646817ed910 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc326e8c640 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5646817ed910 0x5646818f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc325e8a640 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc20c036e60 0x7fc20c039320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc31c000f60 tx=0x7fc31c001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.395+0000 7fc326e8c640 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5646817ed910 0x5646818f0e70 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.396+0000 7fc326e8c640 1 -- 172.21.15.62:0/3947767265 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc32000a4a0 con 0x5646817ed910 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.396+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646818ee440 con 0x5646817ed910 2024-04-26T07:55:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.396+0000 7fc326e8c640 1 -- 172.21.15.62:0/3947767265 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc32000a4a0 con 0x5646817ed910 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.396+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646818f31f0 con 0x5646817ed910 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.396+0000 7fc326e8c640 1 -- 172.21.15.62:0/3947767265 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc32000a4a0 con 0x5646817ed910 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.396+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646818f2530 con 0x5646817ed910 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.397+0000 7fc326e8c640 1 -- 172.21.15.62:0/3947767265 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc32000a4a0 con 0x5646817ed910 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.397+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646818f28d0 con 0x5646817ed910 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.397+0000 7fc326e8c640 1 -- 172.21.15.62:0/3947767265 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc32000a4a0 con 0x5646817ed910 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.397+0000 7fc32b430800 1 Processor -- start 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.397+0000 7fc32b430800 1 -- start start 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.397+0000 7fc32b430800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564681901fa0 0x5646819023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.397+0000 7fc32b430800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5646816e1170 con 0x564681901fa0 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc325e8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564681901fa0 0x5646819023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc325e8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564681901fa0 0x5646819023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34640/0 (socket says 172.21.15.62:34640) 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc325e8a640 1 -- 172.21.15.62:0/702309009 learned_addr learned my addr 172.21.15.62:0/702309009 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc325e8a640 1 -- 172.21.15.62:0/702309009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564681902900 con 0x564681901fa0 2024-04-26T07:55:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc325e8a640 1 --2- 172.21.15.62:0/702309009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564681901fa0 0x5646819023c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc31c001ed0 tx=0x7fc31c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc20bfff640 1 -- 172.21.15.62:0/702309009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c022070 con 0x564681901fa0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc20bfff640 1 -- 172.21.15.62:0/702309009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c00d520 con 0x564681901fa0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc32b430800 1 -- 172.21.15.62:0/702309009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564681903370 con 0x564681901fa0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc20bfff640 1 -- 172.21.15.62:0/702309009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c00d800 con 0x564681901fa0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.398+0000 7fc32b430800 1 -- 172.21.15.62:0/702309009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564681903870 con 0x564681901fa0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.399+0000 7fc20bfff640 1 -- 172.21.15.62:0/702309009 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc31c025070 con 0x564681901fa0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.399+0000 7fc20bfff640 1 --2- 172.21.15.62:0/702309009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc200036e60 0x7fc200039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.399+0000 7fc20bfff640 1 -- 172.21.15.62:0/702309009 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc31c04e540 con 0x564681901fa0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.399+0000 7fc326e8c640 1 --2- 172.21.15.62:0/702309009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc200036e60 0x7fc200039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc32b430800 1 Processor -- start 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc32b430800 1 -- start start 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc326e8c640 1 --2- 172.21.15.62:0/702309009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc200036e60 0x7fc200039320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5646818f2050 tx=0x7fc320005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc32b430800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x56468190f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc32b430800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5646818e29d0 con 0x56468190f2e0 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc325e8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x56468190f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc325e8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x56468190f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34656/0 (socket says 172.21.15.62:34656) 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc325e8a640 1 -- 172.21.15.62:0/3156513778 learned_addr learned my addr 172.21.15.62:0/3156513778 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.400+0000 7fc325e8a640 1 -- 172.21.15.62:0/3156513778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468190fcd0 con 0x56468190f2e0 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc325e8a640 1 --2- 172.21.15.62:0/3156513778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x56468190f700 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc31c04c7f0 tx=0x7fc31c024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2261155d9e276ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc209ffb640 1 -- 172.21.15.62:0/3156513778 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c025990 con 0x56468190f2e0 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc209ffb640 1 -- 172.21.15.62:0/3156513778 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c026730 con 0x56468190f2e0 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc209ffb640 1 -- 172.21.15.62:0/3156513778 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c025c50 con 0x56468190f2e0 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc32b430800 1 -- 172.21.15.62:0/3156513778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 msgr2=0x56468190f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc32b430800 1 --2- 172.21.15.62:0/3156513778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x56468190f700 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc31c04c7f0 tx=0x7fc31c024740 comp rx=0 tx=0).stop 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc32b430800 1 -- 172.21.15.62:0/3156513778 shutdown_connections 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc32b430800 1 --2- 172.21.15.62:0/3156513778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x56468190f700 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc32b430800 1 -- 172.21.15.62:0/3156513778 >> 172.21.15.62:0/3156513778 conn(0x56468190b640 msgr2=0x5646819096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc32b430800 1 -- 172.21.15.62:0/3156513778 shutdown_connections 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.401+0000 7fc32b430800 1 -- 172.21.15.62:0/3156513778 wait complete. 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc32b430800 1 Processor -- start 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc32b430800 1 -- start start 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc32b430800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x564681916980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc32b430800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564681910440 con 0x56468190f2e0 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc325e8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x564681916980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc325e8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x564681916980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34668/0 (socket says 172.21.15.62:34668) 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 learned_addr learned my addr 172.21.15.62:0/4234699496 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564681916ec0 con 0x56468190f2e0 2024-04-26T07:55:33.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.402+0000 7fc325e8a640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x564681916980 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc31c01e040 tx=0x7fc31c04c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.403+0000 7fc1f7fff640 1 -- 172.21.15.62:0/4234699496 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c02f030 con 0x56468190f2e0 2024-04-26T07:55:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.403+0000 7fc1f7fff640 1 -- 172.21.15.62:0/4234699496 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c025360 con 0x56468190f2e0 2024-04-26T07:55:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.403+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564681916ec0 con 0x56468190f2e0 2024-04-26T07:55:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.403+0000 7fc1f7fff640 1 -- 172.21.15.62:0/4234699496 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c04e070 con 0x56468190f2e0 2024-04-26T07:55:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.403+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564681916ec0 con 0x56468190f2e0 2024-04-26T07:55:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc1f7fff640 1 -- 172.21.15.62:0/4234699496 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc31c01ba30 con 0x56468190f2e0 2024-04-26T07:55:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc1f7fff640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1f0036e60 0x7fc1f0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc1f7fff640 1 -- 172.21.15.62:0/4234699496 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc31c030070 con 0x56468190f2e0 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc326e8c640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1f0036e60 0x7fc1f0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564681922090 0x564681924520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681924c70 con 0x564681922090 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc32668b640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564681922090 0x564681924520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc326e8c640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1f0036e60 0x7fc1f0039320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5646818ee390 tx=0x7fc32001f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.404+0000 7fc32668b640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564681922090 0x564681924520 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 20 realm 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681925080 con 0x564681922090 2024-04-26T07:55:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681925920 con 0x564681922090 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681925cc0 con 0x564681922090 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.405+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc32b430800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681926510 con 0x564681922090 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc32b430800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc32b430800 20 searching for the correct realm 2024-04-26T07:55:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564681928280 0x56468192a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc325e8a640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564681928280 0x56468192a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.406+0000 7fc325e8a640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564681928280 0x56468192a670 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.407+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.407+0000 7fc325e8a640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc31c01ac20 0x7fc31c0355e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.407+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc31c01ac20 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.407+0000 7fc326e8c640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc31c01ac20 0x7fc31c0355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.407+0000 7fc326e8c640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc31c01ac20 0x7fc31c0355e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.407+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc32001f070 con 0x7fc31c01ac20 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.407+0000 7fc326e8c640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc320031040 0x7fc320032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.407+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc320031040 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.408+0000 7fc32668b640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc320031040 0x7fc320032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.408+0000 7fc32668b640 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc320031040 0x7fc320032940 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.408+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.408+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc320031040 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc31c01ac20 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.409+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc32001f070 con 0x7fc31c01ac20 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.410+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.410+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.410+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.410+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.410+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc320031040 2024-04-26T07:55:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.410+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.410+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.411+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.411+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc31c01ac20 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.411+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc32001f070 con 0x7fc31c01ac20 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.411+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.411+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.411+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.411+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.411+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc320031040 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.412+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.412+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.412+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.412+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.412+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.412+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.413+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.413+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.413+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.413+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc320031040 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.413+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.413+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.413+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.413+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc31c01ac20 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.414+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc32001f070 con 0x7fc31c01ac20 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.414+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.414+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.414+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc320031040 2024-04-26T07:55:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.414+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.414+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.415+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.415+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc320031040 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.415+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.415+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc31c01ac20 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.415+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc32001f070 con 0x7fc31c01ac20 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.415+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681928280 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc320031040 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x564681922090 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56468192ac50 con 0x7fc31c01ac20 2024-04-26T07:55:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc32001f070 con 0x7fc31c01ac20 2024-04-26T07:55:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32b430800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32b430800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32b430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32b430800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32b430800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32b430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.416+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681926ec0 con 0x564681922090 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681927760 con 0x564681922090 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681926b00 con 0x564681922090 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 20 zone default found 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 4 Realm: () 2024-04-26T07:55:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 20 zonegroup default 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.417+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468192b0d0 con 0x7fc320031040 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468192cf60 con 0x564681928280 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468192d300 con 0x564681928280 2024-04-26T07:55:33.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 20 started sync module instance, tier type = 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.418+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56468192c3a0 con 0x7fc31c01ac20 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.419+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.419+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860821579712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56468192db50 con 0x7fc31c01ac20 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.419+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56468192e3a0 con 0x564681922090 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.420+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860821579712] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.421+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.421+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860821583520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56468192df70 con 0x564681922090 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.421+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56468192ea70 con 0x564681928280 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.422+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860821583520] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.422+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.422+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860821584576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56468192dee0 con 0x564681928280 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.422+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56468192f930 con 0x7fc31c01ac20 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.423+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.423+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860821591648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646819300b0 con 0x7fc31c01ac20 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.423+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681930bd0 con 0x564681922090 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.423+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860821584576] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.424+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860821591648] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.425+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.425+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860821595808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681930b90 con 0x564681922090 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.425+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681931470 con 0x7fc320031040 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.426+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.426+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860821595808] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.426+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860821597072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681931520 con 0x7fc320031040 2024-04-26T07:55:33.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.426+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56468192eea0 con 0x7fc320031040 2024-04-26T07:55:33.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.427+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860821597072] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.427+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.427+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860821589600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681931b10 con 0x7fc320031040 2024-04-26T07:55:33.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.427+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646819324d0 con 0x7fc320031040 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860821589600] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860821598128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646819324d0 con 0x7fc320031040 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32b430800 20 add_watcher() i=0 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32b430800 20 add_watcher() i=1 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32b430800 20 add_watcher() i=2 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32b430800 20 add_watcher() i=3 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32b430800 20 add_watcher() i=4 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32b430800 20 add_watcher() i=5 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.428+0000 7fc32b430800 20 add_watcher() i=6 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.429+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860821598128] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.429+0000 7fc32b430800 20 add_watcher() i=7 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.429+0000 7fc32b430800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.429+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681935920 con 0x564681922090 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.430+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.430+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860821602800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681932de0 con 0x564681922090 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.431+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860821602800] v29'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.431+0000 7fc1dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.431+0000 7fc32b430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.431+0000 7fc32b430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.431+0000 7fc32b430800 5 note: GC not initialized 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.431+0000 7fc1577fe640 20 reqs_thread_entry: start 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.431+0000 7fc32b430800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.431+0000 7fc32b430800 20 Filter name: none 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.432+0000 7fc1557fa640 20 reqs_thread_entry: start 2024-04-26T07:55:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.432+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969500 con 0x564681922090 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.432+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.432+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969500 con 0x7fc31c01ac20 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.432+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.432+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646819694c0 con 0x564681922090 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.432+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.432+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646819694c0 con 0x564681928280 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.433+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.433+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969a70 con 0x564681928280 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.433+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.433+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969ec0 con 0x564681928280 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.433+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.433+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969ec0 con 0x564681922090 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.433+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.433+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969ec0 con 0x564681922090 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.434+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.434+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969ec0 con 0x564681928280 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.434+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.434+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969e70 con 0x564681928280 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.434+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.434+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564681969e50 con 0x7fc320031040 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.435+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.435+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b810 con 0x564681922090 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.435+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.435+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b810 con 0x7fc31c01ac20 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.435+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.435+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b810 con 0x564681928280 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.436+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.436+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b7c0 con 0x7fc320031040 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.436+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.436+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b7c0 con 0x7fc320031040 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.436+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.436+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b720 con 0x564681928280 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.436+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.436+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6d0 con 0x7fc320031040 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.437+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.437+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6d0 con 0x564681922090 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.437+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.437+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6d0 con 0x564681928280 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.437+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.437+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6d0 con 0x7fc320031040 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.438+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.438+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x7fc31c01ac20 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.438+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.438+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x7fc320031040 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.438+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.438+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x564681922090 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.438+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.438+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x564681922090 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x564681928280 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x564681922090 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x564681922090 2024-04-26T07:55:33.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x564681928280 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.439+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x564681928280 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.440+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.440+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x564681928280 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.440+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.440+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56468196b6b0 con 0x7fc320031040 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.440+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.441+0000 7fc1dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.441+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860821602800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x564681922090 2024-04-26T07:55:33.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.442+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94860821602800] v29'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.442+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860821579712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x7fc31c01ac20 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.443+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94860821579712] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.443+0000 7fc32b430800 20 remove_watcher() i=0 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.443+0000 7fc32b430800 2 removed watcher, disabling cache 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.443+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860821583520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x564681922090 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.445+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94860821583520] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.445+0000 7fc32b430800 20 remove_watcher() i=1 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.445+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860821584576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x564681928280 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.446+0000 7fc325e8a640 1 -- 172.21.15.62:0/4234699496 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94860821584576] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c058040 con 0x564681928280 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.446+0000 7fc32b430800 20 remove_watcher() i=2 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.446+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860821591648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x7fc31c01ac20 2024-04-26T07:55:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.447+0000 7fc326e8c640 1 -- 172.21.15.62:0/4234699496 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94860821591648] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc320040040 con 0x7fc31c01ac20 2024-04-26T07:55:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.447+0000 7fc32b430800 20 remove_watcher() i=3 2024-04-26T07:55:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.447+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860821595808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x564681922090 2024-04-26T07:55:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.448+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94860821595808] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x564681922090 2024-04-26T07:55:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.448+0000 7fc32b430800 20 remove_watcher() i=4 2024-04-26T07:55:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.448+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860821597072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x7fc320031040 2024-04-26T07:55:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.449+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94860821597072] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.449+0000 7fc32b430800 20 remove_watcher() i=5 2024-04-26T07:55:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.449+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860821589600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x7fc320031040 2024-04-26T07:55:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.451+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94860821589600] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.451+0000 7fc32b430800 20 remove_watcher() i=6 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.451+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860821598128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564681967b90 con 0x7fc320031040 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94860821598128] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc318075030 con 0x7fc320031040 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 20 remove_watcher() i=7 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc320031040 msgr2=0x7fc320032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc320031040 0x7fc320032940 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564681922090 msgr2=0x564681924520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564681922090 0x564681924520 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc31c01ac20 msgr2=0x7fc31c0355e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc31c01ac20 0x7fc31c0355e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564681928280 msgr2=0x56468192a670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564681928280 0x56468192a670 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1f0036e60 msgr2=0x7fc1f0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1f0036e60 0x7fc1f0039320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5646818ee390 tx=0x7fc32001f000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 msgr2=0x564681916980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32668b640 1 -- 172.21.15.62:0/4234699496 reap_dead start 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x564681916980 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc31c01e040 tx=0x7fc31c04c750 comp rx=0 tx=0).stop 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 shutdown_connections 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/4234699496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56468190f2e0 0x564681916980 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 >> 172.21.15.62:0/4234699496 conn(0x56468190b640 msgr2=0x564681908ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 shutdown_connections 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/4234699496 wait complete. 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/702309009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc200036e60 msgr2=0x7fc200039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/702309009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc200036e60 0x7fc200039320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5646818f2050 tx=0x7fc320005840 comp rx=0 tx=0).stop 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 -- 172.21.15.62:0/702309009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564681901fa0 msgr2=0x5646819023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.452+0000 7fc32b430800 1 --2- 172.21.15.62:0/702309009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564681901fa0 0x5646819023c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc31c001ed0 tx=0x7fc31c00ea00 comp rx=0 tx=0).stop 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/702309009 shutdown_connections 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 --2- 172.21.15.62:0/702309009 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc200036e60 0x7fc200039320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 --2- 172.21.15.62:0/702309009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564681901fa0 0x5646819023c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/702309009 >> 172.21.15.62:0/702309009 conn(0x5646818f6040 msgr2=0x5646818f6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/702309009 shutdown_connections 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/702309009 wait complete. 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5646817ed910 msgr2=0x5646818f0e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5646817ed910 0x5646818f0e70 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc20c036e60 msgr2=0x7fc20c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc20c036e60 0x7fc20c039320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc31c000f60 tx=0x7fc31c001370 comp rx=0 tx=0).stop 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 msgr2=0x5646818e9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e9c80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc318052540 tx=0x7fc318003020 comp rx=0 tx=0).stop 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 shutdown_connections 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5646817ed910 0x5646818f0e70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc20c036e60 0x7fc20c039320 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 --2- 172.21.15.62:0/3947767265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646817ecfb0 0x5646818e9c80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 >> 172.21.15.62:0/3947767265 conn(0x5646817e8b70 msgr2=0x5646818dc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 shutdown_connections 2024-04-26T07:55:33.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.453+0000 7fc32b430800 1 -- 172.21.15.62:0/3947767265 wait complete. 2024-04-26T07:55:33.463 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-26T07:55:33.464 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:55:33.464 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-26T07:55:33.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-26T07:55:33.464 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-26T07:55:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.552+0000 7fecfa040800 1 Processor -- start 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.552+0000 7fecfa040800 1 -- start start 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.552+0000 7fecfa040800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fc568f9cc0 0x55fc568fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.552+0000 7fecfa040800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc568fc5f0 con 0x55fc568f61b0 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.552+0000 7fecfa040800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55fc56797e20 con 0x55fc568f9cc0 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.553+0000 7fecf44db640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fc568f9cc0 0x55fc568fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.553+0000 7fecf4cdc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55fc568f61b0 0x55fc568f85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43482/0 (socket says 172.21.15.62:43482) 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.553+0000 7fecf4cdc640 1 -- 172.21.15.62:0/4036850757 learned_addr learned my addr 172.21.15.62:0/4036850757 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.553+0000 7fecf44db640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fc568f9cc0 0x55fc568fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34670/0 (socket says 172.21.15.62:34670) 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.553+0000 7fecf44db640 1 -- 172.21.15.62:0/4036850757 >> v1:172.21.15.1:6789/0 conn(0x55fc568f61b0 legacy=0x55fc568f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.553+0000 7fecf44db640 1 -- 172.21.15.62:0/4036850757 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc568fd7d0 con 0x55fc568f9cc0 2024-04-26T07:55:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.555+0000 7fecf44db640 1 --2- 172.21.15.62:0/4036850757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f9cc0 0x55fc568fc0b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fece800a470 tx=0x7fece801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deeb6db669358f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.555+0000 7fecf3cda640 1 -- 172.21.15.62:0/4036850757 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece8057070 con 0x55fc568f9cc0 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.555+0000 7fecf3cda640 1 -- 172.21.15.62:0/4036850757 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece8052570 con 0x55fc568f9cc0 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.555+0000 7fecf3cda640 1 -- 172.21.15.62:0/4036850757 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece8052870 con 0x55fc568f9cc0 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.556+0000 7fecfa040800 1 -- 172.21.15.62:0/4036850757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f9cc0 msgr2=0x55fc568fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.556+0000 7fecfa040800 1 --2- 172.21.15.62:0/4036850757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f9cc0 0x55fc568fc0b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fece800a470 tx=0x7fece801ce90 comp rx=0 tx=0).stop 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.556+0000 7fecfa040800 1 -- 172.21.15.62:0/4036850757 shutdown_connections 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.556+0000 7fecfa040800 1 --2- 172.21.15.62:0/4036850757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f9cc0 0x55fc568fc0b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.556+0000 7fecfa040800 1 -- 172.21.15.62:0/4036850757 >> 172.21.15.62:0/4036850757 conn(0x55fc568efb80 msgr2=0x55fc568f1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.556+0000 7fecfa040800 1 -- 172.21.15.62:0/4036850757 shutdown_connections 2024-04-26T07:55:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.556+0000 7fecfa040800 1 -- 172.21.15.62:0/4036850757 wait complete. 2024-04-26T07:55:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.569+0000 7fecfa040800 1 Processor -- start 2024-04-26T07:55:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.569+0000 7fecfa040800 1 -- start start 2024-04-26T07:55:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.569+0000 7fecfa040800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc568f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.569+0000 7fecfa040800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc56840cd0 con 0x55fc568f61b0 2024-04-26T07:55:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.569+0000 7fecf4cdc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc568f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.569+0000 7fecf4cdc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc568f5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34676/0 (socket says 172.21.15.62:34676) 2024-04-26T07:55:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.569+0000 7fecf4cdc640 1 -- 172.21.15.62:0/1981576327 learned_addr learned my addr 172.21.15.62:0/1981576327 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.569+0000 7fecf4cdc640 1 -- 172.21.15.62:0/1981576327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc568f40b0 con 0x55fc568f61b0 2024-04-26T07:55:33.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.570+0000 7fecf4cdc640 1 --2- 172.21.15.62:0/1981576327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc568f5af0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fece4001de0 tx=0x7fece400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33f6422c093a02c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.570+0000 7febe2e0d640 1 -- 172.21.15.62:0/1981576327 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece4012020 con 0x55fc568f61b0 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.570+0000 7febe2e0d640 1 -- 172.21.15.62:0/1981576327 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece400e5a0 con 0x55fc568f61b0 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.570+0000 7febe2e0d640 1 -- 172.21.15.62:0/1981576327 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece400e8c0 con 0x55fc568f61b0 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 -- 172.21.15.62:0/1981576327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 msgr2=0x55fc568f5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 --2- 172.21.15.62:0/1981576327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc568f5af0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fece4001de0 tx=0x7fece400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 -- 172.21.15.62:0/1981576327 shutdown_connections 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 --2- 172.21.15.62:0/1981576327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc568f5af0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 -- 172.21.15.62:0/1981576327 >> 172.21.15.62:0/1981576327 conn(0x55fc568efb80 msgr2=0x55fc569e25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 -- 172.21.15.62:0/1981576327 shutdown_connections 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 -- 172.21.15.62:0/1981576327 wait complete. 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 Processor -- start 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 -- start start 2024-04-26T07:55:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc569f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecfa040800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc568fcac0 con 0x55fc568f61b0 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecf4cdc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc569f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecf4cdc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc569f0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34680/0 (socket says 172.21.15.62:34680) 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.571+0000 7fecf4cdc640 1 -- 172.21.15.62:0/3088964128 learned_addr learned my addr 172.21.15.62:0/3088964128 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.572+0000 7fecf4cdc640 1 -- 172.21.15.62:0/3088964128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc569f0ed0 con 0x55fc568f61b0 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.572+0000 7fecf4cdc640 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc569f0990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fece4001de0 tx=0x7fece4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.572+0000 7febe160a640 1 -- 172.21.15.62:0/3088964128 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece4012030 con 0x55fc568f61b0 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.572+0000 7febe160a640 1 -- 172.21.15.62:0/3088964128 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece401a7a0 con 0x55fc568f61b0 2024-04-26T07:55:33.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.572+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc569f1160 con 0x55fc568f61b0 2024-04-26T07:55:33.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.572+0000 7febe160a640 1 -- 172.21.15.62:0/3088964128 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece401aac0 con 0x55fc568f61b0 2024-04-26T07:55:33.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.572+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc569f3e10 con 0x55fc568f61b0 2024-04-26T07:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.573+0000 7febe160a640 1 -- 172.21.15.62:0/3088964128 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fece4015020 con 0x55fc568f61b0 2024-04-26T07:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.573+0000 7febe160a640 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febdc036e60 0x7febdc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.573+0000 7febe160a640 1 -- 172.21.15.62:0/3088964128 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fece4020070 con 0x55fc568f61b0 2024-04-26T07:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.573+0000 7fecf44db640 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febdc036e60 0x7febdc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.573+0000 7fecfa040800 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc568f9cc0 0x55fc569f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.573+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc569f8150 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.574+0000 7fecf54dd640 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc568f9cc0 0x55fc569f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.574+0000 7fecf44db640 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febdc036e60 0x7febdc039320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fece8054000 tx=0x7fece804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.574+0000 7fecf54dd640 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc568f9cc0 0x55fc569f7bd0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.574+0000 7fecf54dd640 1 -- 172.21.15.62:0/3088964128 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecec00a4a0 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.574+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc569f5180 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.574+0000 7fecf54dd640 1 -- 172.21.15.62:0/3088964128 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fecec00a4a0 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.574+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc569f9fa0 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.575+0000 7fecf54dd640 1 -- 172.21.15.62:0/3088964128 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fecec00a4a0 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.575+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc569f92e0 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.575+0000 7fecf54dd640 1 -- 172.21.15.62:0/3088964128 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fecec00a4a0 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.575+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc569f9700 con 0x55fc568f9cc0 2024-04-26T07:55:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.575+0000 7fecf54dd640 1 -- 172.21.15.62:0/3088964128 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fecec00a4a0 con 0x55fc568f9cc0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.576+0000 7fecfa040800 1 Processor -- start 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.576+0000 7fecfa040800 1 -- start start 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.576+0000 7fecfa040800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a08db0 0x55fc56a091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.576+0000 7fecfa040800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc567e8170 con 0x55fc56a08db0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.576+0000 7fecf44db640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a08db0 0x55fc56a091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.576+0000 7fecf44db640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a08db0 0x55fc56a091d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34684/0 (socket says 172.21.15.62:34684) 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.576+0000 7fecf44db640 1 -- 172.21.15.62:0/3602859890 learned_addr learned my addr 172.21.15.62:0/3602859890 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.577+0000 7fecf44db640 1 -- 172.21.15.62:0/3602859890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc56a09710 con 0x55fc56a08db0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.577+0000 7fecf44db640 1 --2- 172.21.15.62:0/3602859890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a08db0 0x55fc56a091d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fece8055040 tx=0x7fece8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.577+0000 7febda7fc640 1 -- 172.21.15.62:0/3602859890 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece8057040 con 0x55fc56a08db0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.577+0000 7febda7fc640 1 -- 172.21.15.62:0/3602859890 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece806d070 con 0x55fc56a08db0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.577+0000 7febda7fc640 1 -- 172.21.15.62:0/3602859890 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece805dcb0 con 0x55fc56a08db0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.577+0000 7fecfa040800 1 -- 172.21.15.62:0/3602859890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc56a0a180 con 0x55fc56a08db0 2024-04-26T07:55:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.577+0000 7fecfa040800 1 -- 172.21.15.62:0/3602859890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc56a0a620 con 0x55fc56a08db0 2024-04-26T07:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7febda7fc640 1 -- 172.21.15.62:0/3602859890 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fece8067070 con 0x55fc56a08db0 2024-04-26T07:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7febda7fc640 1 --2- 172.21.15.62:0/3602859890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febcc036e60 0x7febcc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7febda7fc640 1 -- 172.21.15.62:0/3602859890 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fece8090260 con 0x55fc56a08db0 2024-04-26T07:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7fecf54dd640 1 --2- 172.21.15.62:0/3602859890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febcc036e60 0x7febcc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7fecfa040800 1 Processor -- start 2024-04-26T07:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7fecfa040800 1 -- start start 2024-04-26T07:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7fecf54dd640 1 --2- 172.21.15.62:0/3602859890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febcc036e60 0x7febcc039320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55fc569f9680 tx=0x7fecec005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7fecfa040800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a16450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.578+0000 7fecfa040800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc568f4430 con 0x55fc56a16030 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.579+0000 7fecf44db640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a16450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.579+0000 7fecf44db640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a16450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34700/0 (socket says 172.21.15.62:34700) 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.579+0000 7fecf44db640 1 -- 172.21.15.62:0/1589558819 learned_addr learned my addr 172.21.15.62:0/1589558819 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.579+0000 7fecf44db640 1 -- 172.21.15.62:0/1589558819 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc56a16a20 con 0x55fc56a16030 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.579+0000 7fecf44db640 1 --2- 172.21.15.62:0/1589558819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a16450 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fece808e520 tx=0x7fece8006440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2b5788c6558aec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.579+0000 7febcbfff640 1 -- 172.21.15.62:0/1589558819 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece807f070 con 0x55fc56a16030 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.579+0000 7febcbfff640 1 -- 172.21.15.62:0/1589558819 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece8068400 con 0x55fc56a16030 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.579+0000 7febcbfff640 1 -- 172.21.15.62:0/1589558819 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece8067360 con 0x55fc56a16030 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 -- 172.21.15.62:0/1589558819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 msgr2=0x55fc56a16450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 --2- 172.21.15.62:0/1589558819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a16450 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fece808e520 tx=0x7fece8006440 comp rx=0 tx=0).stop 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 -- 172.21.15.62:0/1589558819 shutdown_connections 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 --2- 172.21.15.62:0/1589558819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a16450 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 -- 172.21.15.62:0/1589558819 >> 172.21.15.62:0/1589558819 conn(0x55fc56a12350 msgr2=0x55fc56a103b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 -- 172.21.15.62:0/1589558819 shutdown_connections 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 -- 172.21.15.62:0/1589558819 wait complete. 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 Processor -- start 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 -- start start 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a1d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.580+0000 7fecfa040800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc56a171a0 con 0x55fc56a16030 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7fecf44db640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a1d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7fecf44db640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a1d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34704/0 (socket says 172.21.15.62:34704) 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 learned_addr learned my addr 172.21.15.62:0/669232223 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc56a1db80 con 0x55fc56a16030 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7fecf44db640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a1d640 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fece8067c10 tx=0x7fece808e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7febca7fc640 1 -- 172.21.15.62:0/669232223 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece807f040 con 0x55fc56a16030 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7febca7fc640 1 -- 172.21.15.62:0/669232223 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece808e8b0 con 0x55fc56a16030 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc56a1de10 con 0x55fc56a16030 2024-04-26T07:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7febca7fc640 1 -- 172.21.15.62:0/669232223 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece808eb90 con 0x55fc56a16030 2024-04-26T07:55:33.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.581+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc56a20ac0 con 0x55fc56a16030 2024-04-26T07:55:33.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.582+0000 7febca7fc640 1 -- 172.21.15.62:0/669232223 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fece8098020 con 0x55fc56a16030 2024-04-26T07:55:33.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.582+0000 7febca7fc640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febc0036eb0 0x7febc0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.582+0000 7febca7fc640 1 -- 172.21.15.62:0/669232223 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fece80610d0 con 0x55fc56a16030 2024-04-26T07:55:33.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.582+0000 7fecf54dd640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febc0036eb0 0x7febc0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc56a290f0 0x55fc56a2b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2bd00 con 0x55fc56a290f0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecf4cdc640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc56a290f0 0x55fc56a2b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecf54dd640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febc0036eb0 0x7febc0039370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55fc569f8e00 tx=0x7fecec01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecf4cdc640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc56a290f0 0x55fc56a2b5b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 20 realm 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2c110 con 0x55fc56a290f0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.583+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2c9e0 con 0x55fc56a290f0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2cd80 con 0x55fc56a290f0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2d1e0 con 0x55fc56a290f0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 20 searching for the correct realm 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc56a2f230 0x55fc56a31620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.584+0000 7fecf44db640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc56a2f230 0x55fc56a31620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.585+0000 7fecf44db640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc56a2f230 0x55fc56a31620 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.585+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.585+0000 7fecf44db640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fece8006ba0 0x7fece8072460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.585+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fece8006ba0 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.585+0000 7fecf54dd640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fece8006ba0 0x7fece8072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.586+0000 7fecf54dd640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fece8006ba0 0x7fece8072460 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.586+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecec01f070 con 0x7fece8006ba0 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.586+0000 7fecf54dd640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fecec031040 0x7fecec032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.586+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fecec031040 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.586+0000 7fecf4cdc640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fecec031040 0x7fecec032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.587+0000 7fecf4cdc640 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fecec031040 0x7fecec032430 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.587+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.587+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.587+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.587+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.588+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.588+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.588+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.588+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fecec031040 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.588+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.588+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fece8006ba0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.588+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecec01f070 con 0x7fece8006ba0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.588+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.589+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.589+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.589+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.589+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fecec031040 2024-04-26T07:55:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.589+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.589+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.589+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.589+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fece8006ba0 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.590+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fecec01f070 con 0x7fece8006ba0 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.590+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.590+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.590+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.590+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.590+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fecec031040 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.591+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.591+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.591+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.591+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.591+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.591+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.592+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.592+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.592+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.592+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fecec031040 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.592+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.592+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.593+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.593+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fece8006ba0 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.593+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecec01f070 con 0x7fece8006ba0 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.593+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.593+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.593+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fecec031040 2024-04-26T07:55:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.593+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.593+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.594+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.594+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fecec031040 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.594+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.594+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fece8006ba0 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.595+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecec01f070 con 0x7fece8006ba0 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.595+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a2f230 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.595+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.595+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fecec031040 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.595+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.595+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x55fc56a290f0 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a31cf0 con 0x7fece8006ba0 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecec01f070 con 0x7fece8006ba0 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2dc80 con 0x55fc56a290f0 2024-04-26T07:55:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2e520 con 0x55fc56a290f0 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.596+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2d8c0 con 0x55fc56a290f0 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 20 zone default found 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 4 Realm: () 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 20 zonegroup default 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a2e520 con 0x7fecec031040 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a33b50 con 0x55fc56a2f230 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.597+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a33ef0 con 0x55fc56a2f230 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.598+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.598+0000 7fecfa040800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.598+0000 7fecfa040800 20 started sync module instance, tier type = 2024-04-26T07:55:33.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.598+0000 7fecfa040800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:33.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.598+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a32ff0 con 0x7fece8006ba0 2024-04-26T07:55:33.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.599+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecec040040 con 0x7fece8006ba0 2024-04-26T07:55:33.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.599+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94542273655824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a34740 con 0x7fece8006ba0 2024-04-26T07:55:33.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.599+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a34f90 con 0x55fc56a290f0 2024-04-26T07:55:33.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.600+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94542273655824] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecec040040 con 0x7fece8006ba0 2024-04-26T07:55:33.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.600+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.600+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94542273659808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a34d10 con 0x55fc56a290f0 2024-04-26T07:55:33.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.600+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a35830 con 0x55fc56a2f230 2024-04-26T07:55:33.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.601+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94542273659808] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.602+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.602+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94542273663744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a35c20 con 0x55fc56a2f230 2024-04-26T07:55:33.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.602+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a365e0 con 0x7fece8006ba0 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.603+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecec040040 con 0x7fece8006ba0 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.603+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94542273667888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a36eb0 con 0x7fece8006ba0 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.603+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a379b0 con 0x55fc56a290f0 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.603+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94542273663744] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.604+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94542273667888] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecec040040 con 0x7fece8006ba0 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.604+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.604+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94542273672352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a36a00 con 0x55fc56a290f0 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.604+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a38250 con 0x7fecec031040 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.605+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94542273672352] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.605+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.605+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94542273660864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a36a00 con 0x7fecec031040 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.605+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a38850 con 0x7fecec031040 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.606+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94542273660864] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.606+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.607+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94542273676128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a38850 con 0x7fecec031040 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.607+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a38850 con 0x7fecec031040 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94542273676128] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94542273674336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a39210 con 0x7fecec031040 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecfa040800 20 add_watcher() i=0 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecfa040800 20 add_watcher() i=1 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecfa040800 20 add_watcher() i=2 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecfa040800 20 add_watcher() i=3 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecfa040800 20 add_watcher() i=4 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecfa040800 20 add_watcher() i=5 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.608+0000 7fecfa040800 20 add_watcher() i=6 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.609+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94542273674336] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.609+0000 7fecfa040800 20 add_watcher() i=7 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.609+0000 7fecfa040800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.609+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a3c640 con 0x55fc56a290f0 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.609+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.609+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94542273679152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a39b00 con 0x55fc56a290f0 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.610+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94542273679152] v29'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.610+0000 7febaafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7fecfa040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7fecfa040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7fecfa040800 5 note: GC not initialized 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7feba9fe3640 20 reqs_thread_entry: start 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7fecfa040800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7fecfa040800 20 Filter name: none 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7feb1b7fe640 20 reqs_thread_entry: start 2024-04-26T07:55:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7fecfa040800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.611+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a6f920 con 0x55fc56a290f0 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.612+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.612+0000 7fecfa040800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.612+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a70e70 con 0x7fecec031040 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.612+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.613+0000 7febaafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.613+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94542273679152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a3bd60 con 0x55fc56a290f0 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.614+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94542273679152] v29'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.614+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94542273655824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a38f00 con 0x7fece8006ba0 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.615+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94542273655824] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecec040040 con 0x7fece8006ba0 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.615+0000 7fecfa040800 20 remove_watcher() i=0 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.615+0000 7fecfa040800 2 removed watcher, disabling cache 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.615+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94542273659808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a33410 con 0x55fc56a290f0 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.617+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94542273659808] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.617+0000 7fecfa040800 20 remove_watcher() i=1 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.617+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94542273663744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a33410 con 0x55fc56a2f230 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.618+0000 7fecf44db640 1 -- 172.21.15.62:0/669232223 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94542273663744] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece8081030 con 0x55fc56a2f230 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.618+0000 7fecfa040800 20 remove_watcher() i=2 2024-04-26T07:55:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.618+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94542273667888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a35300 con 0x7fece8006ba0 2024-04-26T07:55:33.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.619+0000 7fecf54dd640 1 -- 172.21.15.62:0/669232223 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94542273667888] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecec040040 con 0x7fece8006ba0 2024-04-26T07:55:33.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.619+0000 7fecfa040800 20 remove_watcher() i=3 2024-04-26T07:55:33.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.619+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94542273672352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a343a0 con 0x55fc56a290f0 2024-04-26T07:55:33.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.620+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94542273672352] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x55fc56a290f0 2024-04-26T07:55:33.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.620+0000 7fecfa040800 20 remove_watcher() i=4 2024-04-26T07:55:33.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.620+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94542273660864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a343a0 con 0x7fecec031040 2024-04-26T07:55:33.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.621+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94542273660864] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.621+0000 7fecfa040800 20 remove_watcher() i=5 2024-04-26T07:55:33.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.621+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94542273676128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a374a0 con 0x7fecec031040 2024-04-26T07:55:33.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.622+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94542273676128] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.622+0000 7fecfa040800 20 remove_watcher() i=6 2024-04-26T07:55:33.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.622+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94542273674336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc56a374a0 con 0x7fecec031040 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94542273674336] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece4024980 con 0x7fecec031040 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 20 remove_watcher() i=7 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fecec031040 msgr2=0x7fecec032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fecec031040 0x7fecec032430 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc56a290f0 msgr2=0x55fc56a2b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc56a290f0 0x55fc56a2b5b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fece8006ba0 msgr2=0x7fece8072460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fece8006ba0 0x7fece8072460 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc56a2f230 msgr2=0x55fc56a31620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.623+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fc56a2f230 0x55fc56a31620 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febc0036eb0 msgr2=0x7febc0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febc0036eb0 0x7febc0039370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55fc569f8e00 tx=0x7fecec01f000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 msgr2=0x55fc56a1d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a1d640 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fece8067c10 tx=0x7fece808e4b0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecf4cdc640 1 -- 172.21.15.62:0/669232223 reap_dead start 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 shutdown_connections 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 --2- 172.21.15.62:0/669232223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a16030 0x55fc56a1d640 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 >> 172.21.15.62:0/669232223 conn(0x55fc56a12350 msgr2=0x55fc56a0f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 shutdown_connections 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/669232223 wait complete. 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/3602859890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febcc036e60 msgr2=0x7febcc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 --2- 172.21.15.62:0/3602859890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febcc036e60 0x7febcc039320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55fc569f9680 tx=0x7fecec005840 comp rx=0 tx=0).stop 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/3602859890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a08db0 msgr2=0x55fc56a091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 --2- 172.21.15.62:0/3602859890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a08db0 0x55fc56a091d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fece8055040 tx=0x7fece8002fb0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/3602859890 shutdown_connections 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 --2- 172.21.15.62:0/3602859890 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febcc036e60 0x7febcc039320 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 --2- 172.21.15.62:0/3602859890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc56a08db0 0x55fc56a091d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/3602859890 >> 172.21.15.62:0/3602859890 conn(0x55fc569fce50 msgr2=0x55fc569fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/3602859890 shutdown_connections 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.624+0000 7fecfa040800 1 -- 172.21.15.62:0/3602859890 wait complete. 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc568f9cc0 msgr2=0x55fc569f7bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc568f9cc0 0x55fc569f7bd0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febdc036e60 msgr2=0x7febdc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febdc036e60 0x7febdc039320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fece8054000 tx=0x7fece804e000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 msgr2=0x55fc569f0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc569f0990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fece4001de0 tx=0x7fece4000ed0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 shutdown_connections 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fc568f9cc0 0x55fc569f7bd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7febdc036e60 0x7febdc039320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 --2- 172.21.15.62:0/3088964128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc568f61b0 0x55fc569f0990 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 >> 172.21.15.62:0/3088964128 conn(0x55fc568efb80 msgr2=0x55fc568f4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 shutdown_connections 2024-04-26T07:55:33.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.625+0000 7fecfa040800 1 -- 172.21.15.62:0/3088964128 wait complete. 2024-04-26T07:55:33.631 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-26T07:55:33.632 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:55:33.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-26T07:55:33.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-26T07:55:33.632 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-04-26T07:55:33.678 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:33.679 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe965b2f800 1 Processor -- start 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe965b2f800 1 -- start start 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe965b2f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5630d89e6990 0x5630d89e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe965b2f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630d89e94b0 con 0x5630d8956100 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe965b2f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5630d8884e20 con 0x5630d89e6990 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe960fad640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5630d89e6990 0x5630d89e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe960fad640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5630d89e6990 0x5630d89e8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34714/0 (socket says 172.21.15.62:34714) 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe9617ae640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5630d8956100 0x5630d89e5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43486/0 (socket says 172.21.15.62:43486) 2024-04-26T07:55:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.682+0000 7fe960fad640 1 -- 172.21.15.62:0/2340507403 learned_addr learned my addr 172.21.15.62:0/2340507403 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.683+0000 7fe960fad640 1 -- 172.21.15.62:0/2340507403 >> v1:172.21.15.1:6789/0 conn(0x5630d8956100 legacy=0x5630d89e5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.683+0000 7fe960fad640 1 -- 172.21.15.62:0/2340507403 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d89ea6e0 con 0x5630d89e6990 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.684+0000 7fe960fad640 1 --2- 172.21.15.62:0/2340507403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d89e6990 0x5630d89e8e30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe95800a520 tx=0x7fe95801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a37b270b46e30b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe953fff640 1 -- 172.21.15.62:0/2340507403 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe958057070 con 0x5630d89e6990 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe953fff640 1 -- 172.21.15.62:0/2340507403 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe958052570 con 0x5630d89e6990 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe953fff640 1 -- 172.21.15.62:0/2340507403 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95804ae60 con 0x5630d89e6990 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe965b2f800 1 -- 172.21.15.62:0/2340507403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d89e6990 msgr2=0x5630d89e8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2340507403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d89e6990 0x5630d89e8e30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe95800a520 tx=0x7fe95801d010 comp rx=0 tx=0).stop 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe965b2f800 1 -- 172.21.15.62:0/2340507403 shutdown_connections 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2340507403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d89e6990 0x5630d89e8e30 secure :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe95800a520 tx=0x7fe95801d010 comp rx=0 tx=0).stop 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe965b2f800 1 -- 172.21.15.62:0/2340507403 >> 172.21.15.62:0/2340507403 conn(0x5630d89dcbb0 msgr2=0x5630d89defd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe965b2f800 1 -- 172.21.15.62:0/2340507403 shutdown_connections 2024-04-26T07:55:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.685+0000 7fe965b2f800 1 -- 172.21.15.62:0/2340507403 wait complete. 2024-04-26T07:55:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.698+0000 7fe965b2f800 1 Processor -- start 2024-04-26T07:55:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.698+0000 7fe965b2f800 1 -- start start 2024-04-26T07:55:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.698+0000 7fe965b2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d8ad3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.698+0000 7fe965b2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630d892dd00 con 0x5630d8956100 2024-04-26T07:55:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.698+0000 7fe9617ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d8ad3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.698+0000 7fe9617ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d8ad3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34726/0 (socket says 172.21.15.62:34726) 2024-04-26T07:55:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.698+0000 7fe9617ae640 1 -- 172.21.15.62:0/1691405926 learned_addr learned my addr 172.21.15.62:0/1691405926 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.699+0000 7fe9617ae640 1 -- 172.21.15.62:0/1691405926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d8ad43f0 con 0x5630d8956100 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.699+0000 7fe9617ae640 1 --2- 172.21.15.62:0/1691405926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d8ad3e20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe954001eb0 tx=0x7fe95400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e149df73eccb725 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.699+0000 7fe84f606640 1 -- 172.21.15.62:0/1691405926 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95400e5c0 con 0x5630d8956100 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.699+0000 7fe84f606640 1 -- 172.21.15.62:0/1691405926 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe954006070 con 0x5630d8956100 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.699+0000 7fe84f606640 1 -- 172.21.15.62:0/1691405926 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95400e8b0 con 0x5630d8956100 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 -- 172.21.15.62:0/1691405926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 msgr2=0x5630d8ad3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 --2- 172.21.15.62:0/1691405926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d8ad3e20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe954001eb0 tx=0x7fe95400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 -- 172.21.15.62:0/1691405926 shutdown_connections 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 --2- 172.21.15.62:0/1691405926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d8ad3e20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 -- 172.21.15.62:0/1691405926 >> 172.21.15.62:0/1691405926 conn(0x5630d89dcbb0 msgr2=0x5630d8acf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 -- 172.21.15.62:0/1691405926 shutdown_connections 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 -- 172.21.15.62:0/1691405926 wait complete. 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 Processor -- start 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 -- start start 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d89e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.700+0000 7fe965b2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630d89e9980 con 0x5630d8956100 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe9617ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d89e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe9617ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d89e2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34738/0 (socket says 172.21.15.62:34738) 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe9617ae640 1 -- 172.21.15.62:0/3601657180 learned_addr learned my addr 172.21.15.62:0/3601657180 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe9617ae640 1 -- 172.21.15.62:0/3601657180 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d89e1230 con 0x5630d8956100 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe9617ae640 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d89e2b40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c010 tx=0x7fe954000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe84de03640 1 -- 172.21.15.62:0/3601657180 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95401a7c0 con 0x5630d8956100 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe84de03640 1 -- 172.21.15.62:0/3601657180 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95401a980 con 0x5630d8956100 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630d89e14c0 con 0x5630d8956100 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe84de03640 1 -- 172.21.15.62:0/3601657180 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95401ace0 con 0x5630d8956100 2024-04-26T07:55:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.701+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d89e19e0 con 0x5630d8956100 2024-04-26T07:55:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.702+0000 7fe84de03640 1 -- 172.21.15.62:0/3601657180 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe954017070 con 0x5630d8956100 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.702+0000 7fe84de03640 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe848036e60 0x7fe848039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.702+0000 7fe84de03640 1 -- 172.21.15.62:0/3601657180 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fe954015020 con 0x5630d8956100 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.703+0000 7fe960fad640 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe848036e60 0x7fe848039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.703+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8ae2d70 0x5630d8ae5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.703+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8ae5740 con 0x5630d8ae2d70 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.703+0000 7fe961faf640 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8ae2d70 0x5630d8ae5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.703+0000 7fe960fad640 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe848036e60 0x7fe848039320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe958054000 tx=0x7fe95804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.703+0000 7fe961faf640 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8ae2d70 0x5630d8ae5160 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.703+0000 7fe961faf640 1 -- 172.21.15.62:0/3601657180 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95c00a4a0 con 0x5630d8ae2d70 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.703+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8ae6020 con 0x5630d8ae2d70 2024-04-26T07:55:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.704+0000 7fe961faf640 1 -- 172.21.15.62:0/3601657180 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe95c00a4a0 con 0x5630d8ae2d70 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.704+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8ae7410 con 0x5630d8ae2d70 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.704+0000 7fe961faf640 1 -- 172.21.15.62:0/3601657180 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe95c00a4a0 con 0x5630d8ae2d70 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.704+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8ae6870 con 0x5630d8ae2d70 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.704+0000 7fe961faf640 1 -- 172.21.15.62:0/3601657180 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe95c00a4a0 con 0x5630d8ae2d70 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.704+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8ae6c50 con 0x5630d8ae2d70 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.705+0000 7fe961faf640 1 -- 172.21.15.62:0/3601657180 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe95c00a4a0 con 0x5630d8ae2d70 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.705+0000 7fe965b2f800 1 Processor -- start 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.705+0000 7fe965b2f800 1 -- start start 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.705+0000 7fe965b2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8af6540 0x5630d8af6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.705+0000 7fe965b2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630d89e3080 con 0x5630d8af6540 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.705+0000 7fe960fad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8af6540 0x5630d8af6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.705+0000 7fe960fad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8af6540 0x5630d8af6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34752/0 (socket says 172.21.15.62:34752) 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.705+0000 7fe960fad640 1 -- 172.21.15.62:0/3427115373 learned_addr learned my addr 172.21.15.62:0/3427115373 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.706+0000 7fe960fad640 1 -- 172.21.15.62:0/3427115373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d8af6ea0 con 0x5630d8af6540 2024-04-26T07:55:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.706+0000 7fe960fad640 1 --2- 172.21.15.62:0/3427115373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8af6540 0x5630d8af6960 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe958055040 tx=0x7fe958002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.706+0000 7fe846ffd640 1 -- 172.21.15.62:0/3427115373 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe958057040 con 0x5630d8af6540 2024-04-26T07:55:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.706+0000 7fe846ffd640 1 -- 172.21.15.62:0/3427115373 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95805d840 con 0x5630d8af6540 2024-04-26T07:55:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.706+0000 7fe965b2f800 1 -- 172.21.15.62:0/3427115373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630d8af7910 con 0x5630d8af6540 2024-04-26T07:55:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.706+0000 7fe846ffd640 1 -- 172.21.15.62:0/3427115373 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95805db20 con 0x5630d8af6540 2024-04-26T07:55:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.706+0000 7fe965b2f800 1 -- 172.21.15.62:0/3427115373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d8af7db0 con 0x5630d8af6540 2024-04-26T07:55:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.707+0000 7fe846ffd640 1 -- 172.21.15.62:0/3427115373 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe958067070 con 0x5630d8af6540 2024-04-26T07:55:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.707+0000 7fe846ffd640 1 --2- 172.21.15.62:0/3427115373 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe83c036e60 0x7fe83c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.707+0000 7fe846ffd640 1 -- 172.21.15.62:0/3427115373 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fe95808fd80 con 0x5630d8af6540 2024-04-26T07:55:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.707+0000 7fe961faf640 1 --2- 172.21.15.62:0/3427115373 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe83c036e60 0x7fe83c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.707+0000 7fe965b2f800 1 Processor -- start 2024-04-26T07:55:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe961faf640 1 --2- 172.21.15.62:0/3427115373 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe83c036e60 0x7fe83c039320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5630d89e2020 tx=0x7fe95c005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe965b2f800 1 -- start start 2024-04-26T07:55:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe965b2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b03be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe965b2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630d88d5170 con 0x5630d8b037c0 2024-04-26T07:55:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe960fad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b03be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe960fad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b03be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34754/0 (socket says 172.21.15.62:34754) 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe960fad640 1 -- 172.21.15.62:0/2751220005 learned_addr learned my addr 172.21.15.62:0/2751220005 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe960fad640 1 -- 172.21.15.62:0/2751220005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d8b041b0 con 0x5630d8b037c0 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe960fad640 1 --2- 172.21.15.62:0/2751220005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b03be0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe95808e0c0 tx=0x7fe958067480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e6900ce45eb21d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.708+0000 7fe844ff9640 1 -- 172.21.15.62:0/2751220005 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe958071c50 con 0x5630d8b037c0 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe844ff9640 1 -- 172.21.15.62:0/2751220005 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe958080070 con 0x5630d8b037c0 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe844ff9640 1 -- 172.21.15.62:0/2751220005 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe958067520 con 0x5630d8b037c0 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 -- 172.21.15.62:0/2751220005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 msgr2=0x5630d8b03be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2751220005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b03be0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe95808e0c0 tx=0x7fe958067480 comp rx=0 tx=0).stop 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 -- 172.21.15.62:0/2751220005 shutdown_connections 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2751220005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b03be0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 -- 172.21.15.62:0/2751220005 >> 172.21.15.62:0/2751220005 conn(0x5630d8affb20 msgr2=0x5630d8afdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 -- 172.21.15.62:0/2751220005 shutdown_connections 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 -- 172.21.15.62:0/2751220005 wait complete. 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 Processor -- start 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.709+0000 7fe965b2f800 1 -- start start 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.710+0000 7fe965b2f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b0ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.710+0000 7fe965b2f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630d8b04740 con 0x5630d8b037c0 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.710+0000 7fe960fad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b0ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.710+0000 7fe960fad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b0ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34766/0 (socket says 172.21.15.62:34766) 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.710+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 learned_addr learned my addr 172.21.15.62:0/2663270696 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.710+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d8b0b1c0 con 0x5630d8b037c0 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.710+0000 7fe960fad640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b0ac80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe958070750 tx=0x7fe95808e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.711+0000 7fe832ffd640 1 -- 172.21.15.62:0/2663270696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95809b070 con 0x5630d8b037c0 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.711+0000 7fe832ffd640 1 -- 172.21.15.62:0/2663270696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9580716b0 con 0x5630d8b037c0 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.711+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630d8b0b450 con 0x5630d8b037c0 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.711+0000 7fe832ffd640 1 -- 172.21.15.62:0/2663270696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95805ddd0 con 0x5630d8b037c0 2024-04-26T07:55:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.711+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d8b0e100 con 0x5630d8b037c0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.711+0000 7fe832ffd640 1 -- 172.21.15.62:0/2663270696 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe95809e070 con 0x5630d8b037c0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe832ffd640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe82c036eb0 0x7fe82c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe832ffd640 1 -- 172.21.15.62:0/2663270696 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fe9580a1d50 con 0x5630d8b037c0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe961faf640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe82c036eb0 0x7fe82c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8b166c0 0x5630d8b18b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b192d0 con 0x5630d8b166c0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe9617ae640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8b166c0 0x5630d8b18b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe961faf640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe82c036eb0 0x7fe82c039370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5630d89e1ff0 tx=0x7fe95c01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.712+0000 7fe9617ae640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8b166c0 0x5630d8b18b80 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 realm 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b196e0 con 0x5630d8b166c0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b19fb0 con 0x5630d8b166c0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1a350 con 0x5630d8b166c0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.713+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1a7b0 con 0x5630d8b166c0 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe965b2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe965b2f800 20 searching for the correct realm 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5630d8b1c800 0x5630d8b1ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b1c800 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe960fad640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5630d8b1c800 0x5630d8b1ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe960fad640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5630d8b1c800 0x5630d8b1ebf0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe960fad640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe9580a0060 0x7fe958084870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.714+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x7fe9580a0060 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.715+0000 7fe961faf640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe9580a0060 0x7fe958084870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.715+0000 7fe961faf640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe9580a0060 0x7fe958084870 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.715+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c01f070 con 0x7fe9580a0060 2024-04-26T07:55:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.715+0000 7fe961faf640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fe95c031040 0x7fe95c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.715+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x7fe95c031040 2024-04-26T07:55:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.716+0000 7fe9617ae640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fe95c031040 0x7fe95c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.716+0000 7fe9617ae640 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fe95c031040 0x7fe95c032940 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.716+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.716+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b166c0 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.717+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.717+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b166c0 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.717+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.717+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b166c0 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.717+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.717+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x7fe95c031040 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.717+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.717+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x7fe9580a0060 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.718+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c01f070 con 0x7fe9580a0060 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.718+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b1c800 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.718+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.718+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b166c0 2024-04-26T07:55:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.718+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.718+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x7fe95c031040 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.719+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.719+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b166c0 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.719+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.719+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x7fe9580a0060 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.719+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe95c01f070 con 0x7fe9580a0060 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.719+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b1c800 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.719+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.719+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b1c800 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.720+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.720+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x7fe95c031040 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.720+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.720+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b1c800 2024-04-26T07:55:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.720+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.720+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b1c800 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.720+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.720+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b166c0 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.721+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.721+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x5630d8b166c0 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.721+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.721+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1f2a0 con 0x7fe95c031040 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.721+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.721+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x5630d8b1c800 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.721+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.722+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x7fe9580a0060 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.722+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c01f070 con 0x7fe9580a0060 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.722+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x5630d8b166c0 2024-04-26T07:55:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.722+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.722+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x7fe95c031040 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.722+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.722+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x5630d8b1c800 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.723+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.723+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x7fe95c031040 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.723+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.723+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x7fe9580a0060 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.723+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c01f070 con 0x7fe9580a0060 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.723+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x5630d8b1c800 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x7fe95c031040 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x5630d8b166c0 2024-04-26T07:55:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe954059040 con 0x7fe9580a0060 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c01f070 con 0x7fe9580a0060 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe965b2f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.724+0000 7fe965b2f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1b250 con 0x5630d8b166c0 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1baf0 con 0x5630d8b166c0 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1ae90 con 0x5630d8b166c0 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 zone default found 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 4 Realm: () 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 zonegroup default 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.725+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b1baf0 con 0x7fe95c031040 2024-04-26T07:55:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b21100 con 0x5630d8b1c800 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b214a0 con 0x5630d8b1c800 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 20 started sync module instance, tier type = 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.726+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b205a0 con 0x7fe9580a0060 2024-04-26T07:55:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.727+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c040040 con 0x7fe9580a0060 2024-04-26T07:55:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.728+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94767793965504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b20200 con 0x7fe9580a0060 2024-04-26T07:55:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.728+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b22310 con 0x5630d8b166c0 2024-04-26T07:55:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.729+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94767793965504] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c040040 con 0x7fe9580a0060 2024-04-26T07:55:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.729+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.729+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94767793969216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b22310 con 0x5630d8b166c0 2024-04-26T07:55:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.729+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b22d90 con 0x5630d8b1c800 2024-04-26T07:55:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.730+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94767793969216] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.730+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.730+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94767793973408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b23130 con 0x5630d8b1c800 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.730+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b23ba0 con 0x7fe9580a0060 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.731+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c040040 con 0x7fe9580a0060 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.731+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94767793976944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b24440 con 0x7fe9580a0060 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.731+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b24f20 con 0x5630d8b166c0 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.732+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94767793973408] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.732+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.733+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94767793982000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b24f20 con 0x5630d8b166c0 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.733+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b25970 con 0x7fe95c031040 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.733+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94767793976944] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c040040 con 0x7fe9580a0060 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.734+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.734+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94767793982000] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.734+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94767793979280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b25480 con 0x7fe95c031040 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.734+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b26210 con 0x7fe95c031040 2024-04-26T07:55:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.735+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94767793979280] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.735+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.735+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94767793970784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b25ec0 con 0x7fe95c031040 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.735+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b26770 con 0x7fe95c031040 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94767793970784] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94767793986544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b26730 con 0x7fe95c031040 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe965b2f800 20 add_watcher() i=0 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe965b2f800 20 add_watcher() i=1 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe965b2f800 20 add_watcher() i=2 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe965b2f800 20 add_watcher() i=3 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe965b2f800 20 add_watcher() i=4 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe965b2f800 20 add_watcher() i=5 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.736+0000 7fe965b2f800 20 add_watcher() i=6 2024-04-26T07:55:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.737+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94767793986544] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.737+0000 7fe965b2f800 20 add_watcher() i=7 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.737+0000 7fe965b2f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.737+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b29bc0 con 0x5630d8b166c0 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.738+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.738+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94767793987760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b27040 con 0x5630d8b166c0 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94767793987760] v29'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe8177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe965b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe965b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe965b2f800 5 note: GC not initialized 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe8167e4640 20 reqs_thread_entry: start 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe965b2f800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe965b2f800 20 Filter name: none 2024-04-26T07:55:33.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe787fff640 20 reqs_thread_entry: start 2024-04-26T07:55:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe965b2f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.739+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b5cea0 con 0x5630d8b166c0 2024-04-26T07:55:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.740+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.740+0000 7fe965b2f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:55:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.740+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b5e3f0 con 0x7fe95c031040 2024-04-26T07:55:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.741+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.741+0000 7fe8177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.741+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94767793987760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b28e20 con 0x5630d8b166c0 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.742+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94767793987760] v29'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.742+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94767793965504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b26070 con 0x7fe9580a0060 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.744+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94767793965504] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c040040 con 0x7fe9580a0060 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.744+0000 7fe965b2f800 20 remove_watcher() i=0 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.744+0000 7fe965b2f800 2 removed watcher, disabling cache 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.744+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94767793969216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b209c0 con 0x5630d8b166c0 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.745+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94767793969216] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.745+0000 7fe965b2f800 20 remove_watcher() i=1 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.745+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94767793973408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b209c0 con 0x5630d8b1c800 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.746+0000 7fe960fad640 1 -- 172.21.15.62:0/2663270696 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94767793973408] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95809d030 con 0x5630d8b1c800 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.746+0000 7fe965b2f800 20 remove_watcher() i=2 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.746+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94767793976944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b228a0 con 0x7fe9580a0060 2024-04-26T07:55:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.747+0000 7fe961faf640 1 -- 172.21.15.62:0/2663270696 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94767793976944] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c040040 con 0x7fe9580a0060 2024-04-26T07:55:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.747+0000 7fe965b2f800 20 remove_watcher() i=3 2024-04-26T07:55:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.747+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94767793982000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b228a0 con 0x5630d8b166c0 2024-04-26T07:55:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.748+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94767793982000] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x5630d8b166c0 2024-04-26T07:55:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.748+0000 7fe965b2f800 20 remove_watcher() i=4 2024-04-26T07:55:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.748+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94767793979280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b24a30 con 0x7fe95c031040 2024-04-26T07:55:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.749+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94767793979280] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.749+0000 7fe965b2f800 20 remove_watcher() i=5 2024-04-26T07:55:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.749+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94767793970784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b228a0 con 0x7fe95c031040 2024-04-26T07:55:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.750+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94767793970784] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.750+0000 7fe965b2f800 20 remove_watcher() i=6 2024-04-26T07:55:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.750+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94767793986544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630d8b21e60 con 0x7fe95c031040 2024-04-26T07:55:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.751+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94767793986544] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95402e070 con 0x7fe95c031040 2024-04-26T07:55:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.751+0000 7fe965b2f800 20 remove_watcher() i=7 2024-04-26T07:55:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fe95c031040 msgr2=0x7fe95c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fe95c031040 0x7fe95c032940 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8b166c0 msgr2=0x5630d8b18b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8b166c0 0x5630d8b18b80 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe9580a0060 msgr2=0x7fe958084870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fe9580a0060 0x7fe958084870 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5630d8b1c800 msgr2=0x5630d8b1ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5630d8b1c800 0x5630d8b1ebf0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe82c036eb0 msgr2=0x7fe82c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe82c036eb0 0x7fe82c039370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5630d89e1ff0 tx=0x7fe95c01f000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 msgr2=0x5630d8b0ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b0ac80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe958070750 tx=0x7fe95808e050 comp rx=0 tx=0).stop 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe9617ae640 1 -- 172.21.15.62:0/2663270696 reap_dead start 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 shutdown_connections 2024-04-26T07:55:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/2663270696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8b037c0 0x5630d8b0ac80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 >> 172.21.15.62:0/2663270696 conn(0x5630d8affb20 msgr2=0x5630d8afd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 shutdown_connections 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/2663270696 wait complete. 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/3427115373 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe83c036e60 msgr2=0x7fe83c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3427115373 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe83c036e60 0x7fe83c039320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5630d89e2020 tx=0x7fe95c005840 comp rx=0 tx=0).stop 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/3427115373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8af6540 msgr2=0x5630d8af6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3427115373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8af6540 0x5630d8af6960 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe958055040 tx=0x7fe958002fb0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/3427115373 shutdown_connections 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3427115373 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe83c036e60 0x7fe83c039320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3427115373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8af6540 0x5630d8af6960 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/3427115373 >> 172.21.15.62:0/3427115373 conn(0x5630d8aea5e0 msgr2=0x5630d8aea9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/3427115373 shutdown_connections 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.752+0000 7fe965b2f800 1 -- 172.21.15.62:0/3427115373 wait complete. 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8ae2d70 msgr2=0x5630d8ae5160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8ae2d70 0x5630d8ae5160 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe848036e60 msgr2=0x7fe848039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe848036e60 0x7fe848039320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe958054000 tx=0x7fe95804e000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 msgr2=0x5630d89e2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d89e2b40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c010 tx=0x7fe954000ed0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 shutdown_connections 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5630d8ae2d70 0x5630d8ae5160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe848036e60 0x7fe848039320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 --2- 172.21.15.62:0/3601657180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630d8956100 0x5630d89e2b40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 >> 172.21.15.62:0/3601657180 conn(0x5630d89dcbb0 msgr2=0x5630d8acdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 shutdown_connections 2024-04-26T07:55:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.753+0000 7fe965b2f800 1 -- 172.21.15.62:0/3601657180 wait complete. 2024-04-26T07:55:33.759 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-26T07:55:33.759 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:55:33.760 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-26T07:55:33.760 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-26T07:55:33.760 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-04-26T07:55:33.806 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:33.806 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:33.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.809+0000 7fc2fcf19800 1 Processor -- start 2024-04-26T07:55:33.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.809+0000 7fc2fcf19800 1 -- start start 2024-04-26T07:55:33.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.809+0000 7fc2fcf19800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557c20046bd0 0x557c20048fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.809+0000 7fc2fcf19800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557c20049500 con 0x557c20040960 2024-04-26T07:55:33.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.809+0000 7fc2fcf19800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x557c1fee4e20 con 0x557c20046bd0 2024-04-26T07:55:33.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.810+0000 7fc2fa217640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557c20046bd0 0x557c20048fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.810+0000 7fc2fa217640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557c20046bd0 0x557c20048fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34778/0 (socket says 172.21.15.62:34778) 2024-04-26T07:55:33.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.810+0000 7fc2fa217640 1 -- 172.21.15.62:0/2362745118 learned_addr learned my addr 172.21.15.62:0/2362745118 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.810+0000 7fc2fa217640 1 -- 172.21.15.62:0/2362745118 >> v1:172.21.15.1:6789/0 conn(0x557c20040960 legacy=0x557c20040d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.810+0000 7fc2fa217640 1 -- 172.21.15.62:0/2362745118 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2004a710 con 0x557c20046bd0 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.812+0000 7fc2fa217640 1 --2- 172.21.15.62:0/2362745118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20046bd0 0x557c20048fc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000a520 tx=0x7fc2f001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedfbd61aa99bbe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.812+0000 7fc2f9a16640 1 -- 172.21.15.62:0/2362745118 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f0057070 con 0x557c20046bd0 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.812+0000 7fc2f9a16640 1 -- 172.21.15.62:0/2362745118 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f0052570 con 0x557c20046bd0 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.812+0000 7fc2f9a16640 1 -- 172.21.15.62:0/2362745118 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f004ae60 con 0x557c20046bd0 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.812+0000 7fc2fcf19800 1 -- 172.21.15.62:0/2362745118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20046bd0 msgr2=0x557c20048fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.812+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/2362745118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20046bd0 0x557c20048fc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000a520 tx=0x7fc2f001d010 comp rx=0 tx=0).stop 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.813+0000 7fc2fcf19800 1 -- 172.21.15.62:0/2362745118 shutdown_connections 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.813+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/2362745118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20046bd0 0x557c20048fc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.813+0000 7fc2fcf19800 1 -- 172.21.15.62:0/2362745118 >> 172.21.15.62:0/2362745118 conn(0x557c2003c360 msgr2=0x557c2003e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.813+0000 7fc2fcf19800 1 -- 172.21.15.62:0/2362745118 shutdown_connections 2024-04-26T07:55:33.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.813+0000 7fc2fcf19800 1 -- 172.21.15.62:0/2362745118 wait complete. 2024-04-26T07:55:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.825+0000 7fc2fcf19800 1 Processor -- start 2024-04-26T07:55:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.825+0000 7fc2fcf19800 1 -- start start 2024-04-26T07:55:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.825+0000 7fc2fcf19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c200432e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.825+0000 7fc2fcf19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c1ff8dd00 con 0x557c20040960 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.826+0000 7fc2faa18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c200432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.826+0000 7fc2faa18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c200432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34782/0 (socket says 172.21.15.62:34782) 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.826+0000 7fc2faa18640 1 -- 172.21.15.62:0/1850904454 learned_addr learned my addr 172.21.15.62:0/1850904454 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.826+0000 7fc2faa18640 1 -- 172.21.15.62:0/1850904454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c200418a0 con 0x557c20040960 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.826+0000 7fc2faa18640 1 --2- 172.21.15.62:0/1850904454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c200432e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec001d50 tx=0x7fc2ec00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668c4e8f70c3d56a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.826+0000 7fc1e8e09640 1 -- 172.21.15.62:0/1850904454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec00f400 con 0x557c20040960 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.826+0000 7fc1e8e09640 1 -- 172.21.15.62:0/1850904454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec00f5a0 con 0x557c20040960 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.826+0000 7fc1e8e09640 1 -- 172.21.15.62:0/1850904454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec00f7d0 con 0x557c20040960 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.827+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1850904454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 msgr2=0x557c200432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.827+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/1850904454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c200432e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec001d50 tx=0x7fc2ec00b5b0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.827+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1850904454 shutdown_connections 2024-04-26T07:55:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.827+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/1850904454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c200432e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.827+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1850904454 >> 172.21.15.62:0/1850904454 conn(0x557c2003c360 msgr2=0x557c2012f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.827+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1850904454 shutdown_connections 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.827+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1850904454 wait complete. 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.827+0000 7fc2fcf19800 1 Processor -- start 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.828+0000 7fc2fcf19800 1 -- start start 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.828+0000 7fc2fcf19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c2013da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.828+0000 7fc2fcf19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c200499d0 con 0x557c20040960 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.828+0000 7fc2faa18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c2013da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.828+0000 7fc2faa18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c2013da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34786/0 (socket says 172.21.15.62:34786) 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.828+0000 7fc2faa18640 1 -- 172.21.15.62:0/11238897 learned_addr learned my addr 172.21.15.62:0/11238897 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.828+0000 7fc2faa18640 1 -- 172.21.15.62:0/11238897 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2013dfd0 con 0x557c20040960 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.828+0000 7fc2faa18640 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c2013da90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x557c20042910 tx=0x7fc2ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.829+0000 7fc1e7606640 1 -- 172.21.15.62:0/11238897 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec01a7c0 con 0x557c20040960 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.829+0000 7fc1e7606640 1 -- 172.21.15.62:0/11238897 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec01a960 con 0x557c20040960 2024-04-26T07:55:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.829+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c2013e260 con 0x557c20040960 2024-04-26T07:55:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.829+0000 7fc1e7606640 1 -- 172.21.15.62:0/11238897 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec01ac60 con 0x557c20040960 2024-04-26T07:55:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.829+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c20140f10 con 0x557c20040960 2024-04-26T07:55:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.829+0000 7fc1e7606640 1 -- 172.21.15.62:0/11238897 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc2ec017070 con 0x557c20040960 2024-04-26T07:55:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.830+0000 7fc1e7606640 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1e0036eb0 0x7fc1e0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.830+0000 7fc1e7606640 1 -- 172.21.15.62:0/11238897 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc2ec015020 con 0x557c20040960 2024-04-26T07:55:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.830+0000 7fc2fa217640 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1e0036eb0 0x7fc1e0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.830+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20046bd0 0x557c20144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.830+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20145210 con 0x557c20046bd0 2024-04-26T07:55:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.830+0000 7fc2fb219640 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20046bd0 0x557c20144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.830+0000 7fc2fa217640 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1e0036eb0 0x7fc1e0039370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0054000 tx=0x7fc2f004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.830+0000 7fc2fb219640 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20046bd0 0x557c20144cd0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.831+0000 7fc2fb219640 1 -- 172.21.15.62:0/11238897 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f400a4a0 con 0x557c20046bd0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.831+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c201422a0 con 0x557c20046bd0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.831+0000 7fc2fb219640 1 -- 172.21.15.62:0/11238897 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2f400a4a0 con 0x557c20046bd0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.831+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20147050 con 0x557c20046bd0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.831+0000 7fc2fb219640 1 -- 172.21.15.62:0/11238897 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2f400a4a0 con 0x557c20046bd0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.831+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20146390 con 0x557c20046bd0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.831+0000 7fc2fb219640 1 -- 172.21.15.62:0/11238897 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2f400a4a0 con 0x557c20046bd0 2024-04-26T07:55:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.832+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20146730 con 0x557c20046bd0 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.832+0000 7fc2fb219640 1 -- 172.21.15.62:0/11238897 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2f400a4a0 con 0x557c20046bd0 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.832+0000 7fc2fcf19800 1 Processor -- start 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.832+0000 7fc2fcf19800 1 -- start start 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.832+0000 7fc2fcf19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20155e20 0x557c20156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.832+0000 7fc2fcf19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c1ff35170 con 0x557c20155e20 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc2fa217640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20155e20 0x557c20156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc2fa217640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20155e20 0x557c20156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34790/0 (socket says 172.21.15.62:34790) 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc2fa217640 1 -- 172.21.15.62:0/1390514121 learned_addr learned my addr 172.21.15.62:0/1390514121 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc2fa217640 1 -- 172.21.15.62:0/1390514121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c20156780 con 0x557c20155e20 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc2fa217640 1 --2- 172.21.15.62:0/1390514121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20155e20 0x557c20156240 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc2f004b010 tx=0x7fc2f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc1e4e01640 1 -- 172.21.15.62:0/1390514121 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f0057040 con 0x557c20155e20 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc1e4e01640 1 -- 172.21.15.62:0/1390514121 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f005d900 con 0x557c20155e20 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1390514121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c201571f0 con 0x557c20155e20 2024-04-26T07:55:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc1e4e01640 1 -- 172.21.15.62:0/1390514121 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f005dbe0 con 0x557c20155e20 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.833+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1390514121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c20157690 con 0x557c20155e20 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.834+0000 7fc1e4e01640 1 -- 172.21.15.62:0/1390514121 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc2f0067070 con 0x557c20155e20 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.834+0000 7fc1e4e01640 1 --2- 172.21.15.62:0/1390514121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1d4036e60 0x7fc1d4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.834+0000 7fc1e4e01640 1 -- 172.21.15.62:0/1390514121 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc2f008fe60 con 0x557c20155e20 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.834+0000 7fc2fb219640 1 --2- 172.21.15.62:0/1390514121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1d4036e60 0x7fc1d4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fcf19800 1 Processor -- start 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fcf19800 1 -- start start 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fb219640 1 --2- 172.21.15.62:0/1390514121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1d4036e60 0x7fc1d4039320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x557c20145eb0 tx=0x7fc2f4005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fcf19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c20163440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fcf19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c20041c20 con 0x557c20163020 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fa217640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c20163440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fa217640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c20163440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34806/0 (socket says 172.21.15.62:34806) 2024-04-26T07:55:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fa217640 1 -- 172.21.15.62:0/269962668 learned_addr learned my addr 172.21.15.62:0/269962668 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.835+0000 7fc2fa217640 1 -- 172.21.15.62:0/269962668 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c20163a10 con 0x557c20163020 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc2fa217640 1 --2- 172.21.15.62:0/269962668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c20163440 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc2f008e1d0 tx=0x7fc2f005b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b5a0b203bddc19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc1de7fc640 1 -- 172.21.15.62:0/269962668 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f0071ca0 con 0x557c20163020 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc1de7fc640 1 -- 172.21.15.62:0/269962668 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f007f070 con 0x557c20163020 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc1de7fc640 1 -- 172.21.15.62:0/269962668 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f0006380 con 0x557c20163020 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc2fcf19800 1 -- 172.21.15.62:0/269962668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 msgr2=0x557c20163440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/269962668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c20163440 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc2f008e1d0 tx=0x7fc2f005b4b0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc2fcf19800 1 -- 172.21.15.62:0/269962668 shutdown_connections 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/269962668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c20163440 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc2fcf19800 1 -- 172.21.15.62:0/269962668 >> 172.21.15.62:0/269962668 conn(0x557c2015f380 msgr2=0x557c2015d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc2fcf19800 1 -- 172.21.15.62:0/269962668 shutdown_connections 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.836+0000 7fc2fcf19800 1 -- 172.21.15.62:0/269962668 wait complete. 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.837+0000 7fc2fcf19800 1 Processor -- start 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.837+0000 7fc2fcf19800 1 -- start start 2024-04-26T07:55:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.837+0000 7fc2fcf19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c2016a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.837+0000 7fc2fcf19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c20164180 con 0x557c20163020 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.837+0000 7fc2fa217640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c2016a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.837+0000 7fc2fa217640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c2016a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34820/0 (socket says 172.21.15.62:34820) 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.837+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 learned_addr learned my addr 172.21.15.62:0/131542224 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.837+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2016abe0 con 0x557c20163020 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.838+0000 7fc2fa217640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c2016a6a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0070770 tx=0x7fc2f008e130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.838+0000 7fc1dcff9640 1 -- 172.21.15.62:0/131542224 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f0071610 con 0x557c20163020 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.838+0000 7fc1dcff9640 1 -- 172.21.15.62:0/131542224 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f00717b0 con 0x557c20163020 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.838+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c2016ae70 con 0x557c20163020 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.838+0000 7fc1dcff9640 1 -- 172.21.15.62:0/131542224 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00707e0 con 0x557c20163020 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.838+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c2016db20 con 0x557c20163020 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.838+0000 7fc1dcff9640 1 -- 172.21.15.62:0/131542224 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc2f0070980 con 0x557c20163020 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.839+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.839+0000 7fc1dcff9640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1c4036e10 0x7fc1c40392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.839+0000 7fc1dcff9640 1 -- 172.21.15.62:0/131542224 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc2f0002030 con 0x557c20163020 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.839+0000 7fc2fb219640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1c4036e10 0x7fc1c40392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.839+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20176180 0x557c201785f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.839+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20178d40 con 0x557c20176180 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.839+0000 7fc2faa18640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20176180 0x557c201785f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fb219640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1c4036e10 0x7fc1c40392d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x557c201421f0 tx=0x7fc2f401f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2faa18640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20176180 0x557c201785f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 20 realm 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20179150 con 0x557c20176180 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20179a20 con 0x557c20176180 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.840+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20179dc0 con 0x557c20176180 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fcf19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c2017a220 con 0x557c20176180 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fcf19800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fcf19800 20 searching for the correct realm 2024-04-26T07:55:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557c2017c270 0x557c2017e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fa217640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557c2017c270 0x557c2017e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.841+0000 7fc2fa217640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557c2017c270 0x557c2017e660 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.842+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.842+0000 7fc2fa217640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc2f0086040 0x7fc2f0083820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.842+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f0086040 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.842+0000 7fc2fb219640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc2f0086040 0x7fc2f0083820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.842+0000 7fc2fb219640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc2f0086040 0x7fc2f0083820 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.842+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f401f070 con 0x7fc2f0086040 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.842+0000 7fc2fb219640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc2f4031040 0x7fc2f4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.842+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f4031040 2024-04-26T07:55:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.843+0000 7fc2faa18640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc2f4031040 0x7fc2f4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.843+0000 7fc2faa18640 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc2f4031040 0x7fc2f4032940 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.843+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.843+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.844+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.844+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.844+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.844+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.844+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.844+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f4031040 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.844+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.844+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f0086040 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.845+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f401f070 con 0x7fc2f0086040 2024-04-26T07:55:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.845+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.845+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.845+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.845+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.845+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f4031040 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.845+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.845+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.846+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.846+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f0086040 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.846+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2f401f070 con 0x7fc2f0086040 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.846+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.846+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.846+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.846+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.846+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f4031040 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.847+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.847+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.847+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.847+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.847+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.847+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.847+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.847+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.848+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.848+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f4031040 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.848+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.848+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.848+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.848+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f0086040 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.849+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f401f070 con 0x7fc2f0086040 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.849+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.849+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.849+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f4031040 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.849+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.849+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.849+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.849+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f4031040 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.850+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.850+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f0086040 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.850+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f401f070 con 0x7fc2f0086040 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.850+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c2017c270 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.850+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.850+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f4031040 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x557c20176180 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557c2017ed10 con 0x7fc2f0086040 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f401f070 con 0x7fc2f0086040 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fcf19800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fcf19800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fcf19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fcf19800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fcf19800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fcf19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c2017acf0 con 0x557c20176180 2024-04-26T07:55:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.851+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c2017b590 con 0x557c20176180 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c2017a930 con 0x557c20176180 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 zone default found 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 4 Realm: () 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 zonegroup default 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c2017f170 con 0x7fc2f4031040 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.852+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20181000 con 0x557c2017c270 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fcf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c201813a0 con 0x557c2017c270 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fcf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fcf19800 20 started sync module instance, tier type = 2024-04-26T07:55:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fcf19800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.853+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20180440 con 0x7fc2f0086040 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.854+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4040040 con 0x7fc2f0086040 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.854+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93991602751584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c201800a0 con 0x7fc2f0086040 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.854+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20182120 con 0x557c20176180 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.855+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93991602751584] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4040040 con 0x7fc2f0086040 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.855+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.855+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93991602755392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c201820e0 con 0x557c20176180 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.855+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20182bb0 con 0x557c2017c270 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.856+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.857+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93991602759296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20183450 con 0x557c2017c270 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.857+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20183f10 con 0x7fc2f0086040 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.857+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 93991602755392] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.858+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93991602759296] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.858+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4040040 con 0x7fc2f0086040 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.858+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93991602761632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20181b60 con 0x7fc2f0086040 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.858+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c201847f0 con 0x557c20176180 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.859+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.859+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93991602761632] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4040040 con 0x7fc2f0086040 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.859+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93991602766592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20184760 con 0x557c20176180 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.859+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20183a20 con 0x7fc2f4031040 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.860+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 93991602766592] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.860+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.860+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93991602768720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20184720 con 0x7fc2f4031040 2024-04-26T07:55:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.860+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20185d00 con 0x7fc2f4031040 2024-04-26T07:55:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.862+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93991602768720] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.862+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.862+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93991602770480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20185d00 con 0x7fc2f4031040 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.862+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c201865d0 con 0x7fc2f4031040 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93991602770480] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93991602773248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20186c80 con 0x7fc2f4031040 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2fcf19800 20 add_watcher() i=0 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2fcf19800 20 add_watcher() i=1 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2fcf19800 20 add_watcher() i=2 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2fcf19800 20 add_watcher() i=3 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2fcf19800 20 add_watcher() i=4 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2fcf19800 20 add_watcher() i=5 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.863+0000 7fc2fcf19800 20 add_watcher() i=6 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.864+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93991602773248] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.864+0000 7fc2fcf19800 20 add_watcher() i=7 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.864+0000 7fc2fcf19800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.864+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c20189b80 con 0x557c20176180 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.865+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.865+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93991602775712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20187080 con 0x557c20176180 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93991602775712] v29'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc1b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc2fcf19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc2fcf19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc2fcf19800 5 note: GC not initialized 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc12bfff640 20 reqs_thread_entry: start 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc2fcf19800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc2fcf19800 20 Filter name: none 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc129ffb640 20 reqs_thread_entry: start 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc2fcf19800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.866+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c201bcd50 con 0x557c20176180 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.867+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.867+0000 7fc2fcf19800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.867+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557c201be2a0 con 0x7fc2f4031040 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.868+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.868+0000 7fc1b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.868+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93991602775712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20189360 con 0x557c20176180 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.870+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93991602775712] v29'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.870+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93991602751584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c201866a0 con 0x7fc2f0086040 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.871+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93991602751584] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4040040 con 0x7fc2f0086040 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.871+0000 7fc2fcf19800 20 remove_watcher() i=0 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.871+0000 7fc2fcf19800 2 removed watcher, disabling cache 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.871+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93991602755392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c201866a0 con 0x557c20176180 2024-04-26T07:55:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.872+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93991602755392] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.872+0000 7fc2fcf19800 20 remove_watcher() i=1 2024-04-26T07:55:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.872+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93991602759296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20181740 con 0x557c2017c270 2024-04-26T07:55:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.873+0000 7fc2fa217640 1 -- 172.21.15.62:0/131542224 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93991602759296] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f0066030 con 0x557c2017c270 2024-04-26T07:55:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.873+0000 7fc2fcf19800 20 remove_watcher() i=2 2024-04-26T07:55:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.873+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93991602761632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c201866a0 con 0x7fc2f0086040 2024-04-26T07:55:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.874+0000 7fc2fb219640 1 -- 172.21.15.62:0/131542224 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93991602761632] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4040040 con 0x7fc2f0086040 2024-04-26T07:55:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.874+0000 7fc2fcf19800 20 remove_watcher() i=3 2024-04-26T07:55:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.874+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93991602766592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20182680 con 0x557c20176180 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.875+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93991602766592] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x557c20176180 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.875+0000 7fc2fcf19800 20 remove_watcher() i=4 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.875+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93991602768720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c201866a0 con 0x7fc2f4031040 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.876+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93991602768720] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.876+0000 7fc2fcf19800 20 remove_watcher() i=5 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.876+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93991602770480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20184300 con 0x7fc2f4031040 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.877+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93991602770480] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.877+0000 7fc2fcf19800 20 remove_watcher() i=6 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.877+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93991602773248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557c20182680 con 0x7fc2f4031040 2024-04-26T07:55:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.878+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93991602773248] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec02e070 con 0x7fc2f4031040 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.878+0000 7fc2fcf19800 20 remove_watcher() i=7 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc2f4031040 msgr2=0x7fc2f4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc2f4031040 0x7fc2f4032940 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20176180 msgr2=0x557c201785f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20176180 0x557c201785f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc2f0086040 msgr2=0x7fc2f0083820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc2f0086040 0x7fc2f0083820 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557c2017c270 msgr2=0x557c2017e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557c2017c270 0x557c2017e660 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1c4036e10 msgr2=0x7fc1c40392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1c4036e10 0x7fc1c40392d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x557c201421f0 tx=0x7fc2f401f000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 msgr2=0x557c2016a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2faa18640 1 -- 172.21.15.62:0/131542224 reap_dead start 2024-04-26T07:55:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c2016a6a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0070770 tx=0x7fc2f008e130 comp rx=0 tx=0).stop 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 shutdown_connections 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/131542224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20163020 0x557c2016a6a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 >> 172.21.15.62:0/131542224 conn(0x557c2015f380 msgr2=0x557c2015c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 shutdown_connections 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/131542224 wait complete. 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1390514121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1d4036e60 msgr2=0x7fc1d4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/1390514121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1d4036e60 0x7fc1d4039320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x557c20145eb0 tx=0x7fc2f4005840 comp rx=0 tx=0).stop 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1390514121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20155e20 msgr2=0x557c20156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/1390514121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20155e20 0x557c20156240 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc2f004b010 tx=0x7fc2f0002fb0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1390514121 shutdown_connections 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/1390514121 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1d4036e60 0x7fc1d4039320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/1390514121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20155e20 0x557c20156240 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1390514121 >> 172.21.15.62:0/1390514121 conn(0x557c20149ec0 msgr2=0x557c2014a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1390514121 shutdown_connections 2024-04-26T07:55:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.879+0000 7fc2fcf19800 1 -- 172.21.15.62:0/1390514121 wait complete. 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20046bd0 msgr2=0x557c20144cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20046bd0 0x557c20144cd0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1e0036eb0 msgr2=0x7fc1e0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1e0036eb0 0x7fc1e0039370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0054000 tx=0x7fc2f004e000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 msgr2=0x557c2013da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c2013da90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x557c20042910 tx=0x7fc2ec000ed0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 shutdown_connections 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557c20046bd0 0x557c20144cd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc1e0036eb0 0x7fc1e0039370 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 --2- 172.21.15.62:0/11238897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c20040960 0x557c2013da90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 >> 172.21.15.62:0/11238897 conn(0x557c2003c360 msgr2=0x557c20042180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 shutdown_connections 2024-04-26T07:55:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.880+0000 7fc2fcf19800 1 -- 172.21.15.62:0/11238897 wait complete. 2024-04-26T07:55:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-26T07:55:33.886 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:55:33.886 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-26T07:55:33.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-26T07:55:33.886 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-04-26T07:55:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.935+0000 7fd817211800 1 Processor -- start 2024-04-26T07:55:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.935+0000 7fd817211800 1 -- start start 2024-04-26T07:55:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.935+0000 7fd817211800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f8748ad740 0x55f8748adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.935+0000 7fd817211800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8748ae1e0 con 0x55f8748ae8b0 2024-04-26T07:55:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.936+0000 7fd817211800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55f87474fe20 con 0x55f8748ad740 2024-04-26T07:55:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.936+0000 7fd8127dc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f8748ad740 0x55f8748adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.936+0000 7fd8127dc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f8748ad740 0x55f8748adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34836/0 (socket says 172.21.15.62:34836) 2024-04-26T07:55:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.936+0000 7fd8127dc640 1 -- 172.21.15.62:0/293121680 learned_addr learned my addr 172.21.15.62:0/293121680 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.936+0000 7fd8127dc640 1 -- 172.21.15.62:0/293121680 >> v1:172.21.15.1:6789/0 conn(0x55f8748ae8b0 legacy=0x55f8748aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.936+0000 7fd8127dc640 1 -- 172.21.15.62:0/293121680 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8748af470 con 0x55f8748ad740 2024-04-26T07:55:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.938+0000 7fd8127dc640 1 --2- 172.21.15.62:0/293121680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f8748adb60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd80400a520 tx=0x7fd80401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5864d97728a5fce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.938+0000 7fd8117da640 1 -- 172.21.15.62:0/293121680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd804057070 con 0x55f8748ad740 2024-04-26T07:55:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.938+0000 7fd8117da640 1 -- 172.21.15.62:0/293121680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd804052570 con 0x55f8748ad740 2024-04-26T07:55:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.938+0000 7fd8117da640 1 -- 172.21.15.62:0/293121680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd804052870 con 0x55f8748ad740 2024-04-26T07:55:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.939+0000 7fd817211800 1 -- 172.21.15.62:0/293121680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 msgr2=0x55f8748adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.939+0000 7fd817211800 1 --2- 172.21.15.62:0/293121680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f8748adb60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd80400a520 tx=0x7fd80401d010 comp rx=0 tx=0).stop 2024-04-26T07:55:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.939+0000 7fd817211800 1 -- 172.21.15.62:0/293121680 shutdown_connections 2024-04-26T07:55:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.939+0000 7fd817211800 1 --2- 172.21.15.62:0/293121680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f8748adb60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.939+0000 7fd817211800 1 -- 172.21.15.62:0/293121680 >> 172.21.15.62:0/293121680 conn(0x55f8748a8d60 msgr2=0x55f8748ab180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.939+0000 7fd817211800 1 -- 172.21.15.62:0/293121680 shutdown_connections 2024-04-26T07:55:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.939+0000 7fd817211800 1 -- 172.21.15.62:0/293121680 wait complete. 2024-04-26T07:55:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.951+0000 7fd817211800 1 Processor -- start 2024-04-26T07:55:33.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.951+0000 7fd817211800 1 -- start start 2024-04-26T07:55:33.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.952+0000 7fd817211800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f874823030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.952+0000 7fd817211800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f8747f8d00 con 0x55f8748ad740 2024-04-26T07:55:33.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.952+0000 7fd8127dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f874823030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.952+0000 7fd8127dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f874823030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34852/0 (socket says 172.21.15.62:34852) 2024-04-26T07:55:33.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.952+0000 7fd8127dc640 1 -- 172.21.15.62:0/1509990469 learned_addr learned my addr 172.21.15.62:0/1509990469 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.952+0000 7fd8127dc640 1 -- 172.21.15.62:0/1509990469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8748215f0 con 0x55f8748ad740 2024-04-26T07:55:33.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.952+0000 7fd8127dc640 1 --2- 172.21.15.62:0/1509990469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f874823030 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd804055040 tx=0x7fd80404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ee50da2045a362 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd700608640 1 -- 172.21.15.62:0/1509990469 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd804057040 con 0x55f8748ad740 2024-04-26T07:55:33.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd700608640 1 -- 172.21.15.62:0/1509990469 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd804052850 con 0x55f8748ad740 2024-04-26T07:55:33.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd700608640 1 -- 172.21.15.62:0/1509990469 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd804052b50 con 0x55f8748ad740 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd817211800 1 -- 172.21.15.62:0/1509990469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 msgr2=0x55f874823030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd817211800 1 --2- 172.21.15.62:0/1509990469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f874823030 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd804055040 tx=0x7fd80404c000 comp rx=0 tx=0).stop 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd817211800 1 -- 172.21.15.62:0/1509990469 shutdown_connections 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd817211800 1 --2- 172.21.15.62:0/1509990469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ad740 0x55f874823030 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd817211800 1 -- 172.21.15.62:0/1509990469 >> 172.21.15.62:0/1509990469 conn(0x55f8748a8d60 msgr2=0x55f87499a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd817211800 1 -- 172.21.15.62:0/1509990469 shutdown_connections 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.953+0000 7fd817211800 1 -- 172.21.15.62:0/1509990469 wait complete. 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd817211800 1 Processor -- start 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd817211800 1 -- start start 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd817211800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ae8b0 0x55f8749a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd817211800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f8748b6d80 con 0x55f8748ae8b0 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd8127dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ae8b0 0x55f8749a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd8127dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ae8b0 0x55f8749a8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34862/0 (socket says 172.21.15.62:34862) 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd8127dc640 1 -- 172.21.15.62:0/2853927794 learned_addr learned my addr 172.21.15.62:0/2853927794 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd8127dc640 1 -- 172.21.15.62:0/2853927794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8749a9240 con 0x55f8748ae8b0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.954+0000 7fd8127dc640 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ae8b0 0x55f8749a8d00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd80400a520 tx=0x7fd804003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.955+0000 7fd6fee05640 1 -- 172.21.15.62:0/2853927794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd804073070 con 0x55f8748ae8b0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.955+0000 7fd6fee05640 1 -- 172.21.15.62:0/2853927794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80405d570 con 0x55f8748ae8b0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.955+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8749a94d0 con 0x55f8748ae8b0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.955+0000 7fd6fee05640 1 -- 172.21.15.62:0/2853927794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd804057070 con 0x55f8748ae8b0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.955+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8749ac180 con 0x55f8748ae8b0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.956+0000 7fd6fee05640 1 -- 172.21.15.62:0/2853927794 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd804076070 con 0x55f8748ae8b0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.956+0000 7fd6fee05640 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6f8036e60 0x7fd6f8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.956+0000 7fd6fee05640 1 -- 172.21.15.62:0/2853927794 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd80408e340 con 0x55f8748ae8b0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.956+0000 7fd811fdb640 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6f8036e60 0x7fd6f8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.956+0000 7fd817211800 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749adf30 0x55f8749b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.956+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749b0860 con 0x55f8749adf30 2024-04-26T07:55:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.956+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749adf30 0x55f8749b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.956+0000 7fd811fdb640 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6f8036e60 0x7fd6f8039320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd808001e10 tx=0x7fd808001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.957+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749adf30 0x55f8749b0320 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.957+0000 7fd812fdd640 1 -- 172.21.15.62:0/2853927794 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd80c00a4a0 con 0x55f8749adf30 2024-04-26T07:55:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.957+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749b1140 con 0x55f8749adf30 2024-04-26T07:55:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.957+0000 7fd812fdd640 1 -- 172.21.15.62:0/2853927794 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd80c00a4a0 con 0x55f8749adf30 2024-04-26T07:55:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.957+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749b24f0 con 0x55f8749adf30 2024-04-26T07:55:33.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.957+0000 7fd812fdd640 1 -- 172.21.15.62:0/2853927794 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd80c00a4a0 con 0x55f8749adf30 2024-04-26T07:55:33.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.957+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749b1990 con 0x55f8749adf30 2024-04-26T07:55:33.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.958+0000 7fd812fdd640 1 -- 172.21.15.62:0/2853927794 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd80c00a4a0 con 0x55f8749adf30 2024-04-26T07:55:33.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.958+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749b1de0 con 0x55f8749adf30 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.958+0000 7fd812fdd640 1 -- 172.21.15.62:0/2853927794 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd80c00a4a0 con 0x55f8749adf30 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.958+0000 7fd817211800 1 Processor -- start 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.958+0000 7fd817211800 1 -- start start 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.959+0000 7fd817211800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749c1490 0x55f8749c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.959+0000 7fd817211800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f8747a0170 con 0x55f8749c1490 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.959+0000 7fd811fdb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749c1490 0x55f8749c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.959+0000 7fd811fdb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749c1490 0x55f8749c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34866/0 (socket says 172.21.15.62:34866) 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.959+0000 7fd811fdb640 1 -- 172.21.15.62:0/2185049929 learned_addr learned my addr 172.21.15.62:0/2185049929 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.959+0000 7fd811fdb640 1 -- 172.21.15.62:0/2185049929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8749c1df0 con 0x55f8749c1490 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.960+0000 7fd811fdb640 1 --2- 172.21.15.62:0/2185049929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749c1490 0x55f8749c18b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd808001770 tx=0x7fd80800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.960+0000 7fd6f7fff640 1 -- 172.21.15.62:0/2185049929 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd80801c410 con 0x55f8749c1490 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.960+0000 7fd6f7fff640 1 -- 172.21.15.62:0/2185049929 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd808017050 con 0x55f8749c1490 2024-04-26T07:55:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.960+0000 7fd817211800 1 -- 172.21.15.62:0/2185049929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8749c2860 con 0x55f8749c1490 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.960+0000 7fd6f7fff640 1 -- 172.21.15.62:0/2185049929 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd80801c6e0 con 0x55f8749c1490 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.960+0000 7fd817211800 1 -- 172.21.15.62:0/2185049929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8749c2d60 con 0x55f8749c1490 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd6f7fff640 1 -- 172.21.15.62:0/2185049929 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd80800e070 con 0x55f8749c1490 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd6f7fff640 1 --2- 172.21.15.62:0/2185049929 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6ec036e60 0x7fd6ec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd6f7fff640 1 -- 172.21.15.62:0/2185049929 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd80804e780 con 0x55f8749c1490 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2185049929 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6ec036e60 0x7fd6ec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd817211800 1 Processor -- start 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd817211800 1 -- start start 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2185049929 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6ec036e60 0x7fd6ec039320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55f8749ad640 tx=0x7fd80c005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd817211800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd817211800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f8748218b0 con 0x55f8749ce8c0 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.961+0000 7fd811fdb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.962+0000 7fd811fdb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34878/0 (socket says 172.21.15.62:34878) 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.962+0000 7fd811fdb640 1 -- 172.21.15.62:0/2320672943 learned_addr learned my addr 172.21.15.62:0/2320672943 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.962+0000 7fd811fdb640 1 -- 172.21.15.62:0/2320672943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8749cf290 con 0x55f8749ce8c0 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.962+0000 7fd811fdb640 1 --2- 172.21.15.62:0/2320672943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749cecc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd80801afd0 tx=0x7fd80801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd24e3508d10eb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.962+0000 7fd6f5ffb640 1 -- 172.21.15.62:0/2320672943 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808024c10 con 0x55f8749ce8c0 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.962+0000 7fd6f5ffb640 1 -- 172.21.15.62:0/2320672943 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd808002e50 con 0x55f8749ce8c0 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.962+0000 7fd6f5ffb640 1 -- 172.21.15.62:0/2320672943 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808025920 con 0x55f8749ce8c0 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 -- 172.21.15.62:0/2320672943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 msgr2=0x55f8749cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 --2- 172.21.15.62:0/2320672943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749cecc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd80801afd0 tx=0x7fd80801ac60 comp rx=0 tx=0).stop 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 -- 172.21.15.62:0/2320672943 shutdown_connections 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 --2- 172.21.15.62:0/2320672943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749cecc0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 -- 172.21.15.62:0/2320672943 >> 172.21.15.62:0/2320672943 conn(0x55f8749cab90 msgr2=0x55f8749c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 -- 172.21.15.62:0/2320672943 shutdown_connections 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 -- 172.21.15.62:0/2320672943 wait complete. 2024-04-26T07:55:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 Processor -- start 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 -- start start 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd817211800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f8749cfa40 con 0x55f8749ce8c0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd811fdb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd811fdb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749d5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34894/0 (socket says 172.21.15.62:34894) 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.963+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 learned_addr learned my addr 172.21.15.62:0/2633537519 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.964+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8749d63c0 con 0x55f8749ce8c0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.964+0000 7fd811fdb640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749d5e80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd80801afd0 tx=0x7fd80804c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.964+0000 7fd6e3fff640 1 -- 172.21.15.62:0/2633537519 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808034020 con 0x55f8749ce8c0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.964+0000 7fd6e3fff640 1 -- 172.21.15.62:0/2633537519 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd808046040 con 0x55f8749ce8c0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.964+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8749d6650 con 0x55f8749ce8c0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.964+0000 7fd6e3fff640 1 -- 172.21.15.62:0/2633537519 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808025920 con 0x55f8749ce8c0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.964+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8749d6650 con 0x55f8749ce8c0 2024-04-26T07:55:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.965+0000 7fd6e3fff640 1 -- 172.21.15.62:0/2633537519 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd808037020 con 0x55f8749ce8c0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.965+0000 7fd6e3fff640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6dc036e60 0x7fd6dc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.965+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.965+0000 7fd6e3fff640 1 -- 172.21.15.62:0/2633537519 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd80803ad10 con 0x55f8749ce8c0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.965+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6dc036e60 0x7fd6dc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.965+0000 7fd817211800 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749e1790 0x55f8749e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.965+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e4370 con 0x55f8749e1790 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.965+0000 7fd8127dc640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749e1790 0x55f8749e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6dc036e60 0x7fd6dc039320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55f8749ad460 tx=0x7fd80c01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd8127dc640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749e1790 0x55f8749e3c20 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 20 realm 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e4780 con 0x55f8749e1790 2024-04-26T07:55:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e5050 con 0x55f8749e1790 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.966+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e53f0 con 0x55f8749e1790 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd817211800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e5850 con 0x55f8749e1790 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd817211800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd817211800 20 searching for the correct realm 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd817211800 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f8749e78a0 0x55f8749e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd811fdb640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f8749e78a0 0x55f8749e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.967+0000 7fd811fdb640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f8749e78a0 0x55f8749e9cb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.968+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.968+0000 7fd811fdb640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd808039020 0x7fd80800e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.968+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd808039020 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.968+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd808039020 0x7fd80800e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.968+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd808039020 0x7fd80800e580 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.969+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80c01f070 con 0x7fd808039020 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.969+0000 7fd812fdd640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd80c031040 0x7fd80c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.969+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd80c031040 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.969+0000 7fd8127dc640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd80c031040 0x7fd80c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.969+0000 7fd8127dc640 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd80c031040 0x7fd80c032940 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.970+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.970+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.970+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.970+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.970+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.970+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.971+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.971+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd80c031040 2024-04-26T07:55:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.971+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.971+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd808039020 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.971+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80c01f070 con 0x7fd808039020 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.971+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.971+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.971+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.972+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.972+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd80c031040 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.972+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.972+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.972+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.972+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd808039020 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.973+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd80c01f070 con 0x7fd808039020 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.973+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.973+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.973+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.973+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.973+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd80c031040 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.973+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.973+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.974+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.974+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.974+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.974+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.974+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.974+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.975+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.975+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd80c031040 2024-04-26T07:55:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.975+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.975+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.975+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.975+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd808039020 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.975+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80c01f070 con 0x7fd808039020 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.975+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.976+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.976+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd80c031040 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.976+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.976+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.976+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.976+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd80c031040 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.977+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.977+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd808039020 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.977+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80c01f070 con 0x7fd808039020 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.977+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e78a0 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.977+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.977+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd80c031040 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x55f8749e1790 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ea380 con 0x7fd808039020 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80c01f070 con 0x7fd808039020 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e62f0 con 0x55f8749e1790 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.978+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e6b90 con 0x55f8749e1790 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e5f30 con 0x55f8749e1790 2024-04-26T07:55:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 20 zone default found 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 4 Realm: () 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 20 zonegroup default 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749e6b90 con 0x7fd80c031040 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ec1e0 con 0x55f8749e78a0 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.979+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.980+0000 7fd817211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.980+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:33.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.980+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ec580 con 0x55f8749e78a0 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.980+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.980+0000 7fd817211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.980+0000 7fd817211800 20 started sync module instance, tier type = 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.980+0000 7fd817211800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.980+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749eb680 con 0x7fd808039020 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.981+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80c040040 con 0x7fd808039020 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.981+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94525596809888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ecdd0 con 0x7fd808039020 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.981+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ed620 con 0x55f8749e1790 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.982+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94525596809888] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80c040040 con 0x7fd808039020 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.982+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.982+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94525596813600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ed310 con 0x55f8749e1790 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.982+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ede30 con 0x55f8749e78a0 2024-04-26T07:55:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.983+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94525596813600] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.984+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.984+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94525596817664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ee220 con 0x55f8749e78a0 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.984+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749eec20 con 0x7fd808039020 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.985+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80c040040 con 0x7fd808039020 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.985+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94525596817664] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.985+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94525596814720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ef010 con 0x7fd808039020 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.985+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749efa50 con 0x55f8749e1790 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.986+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.986+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94525596824864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749efa10 con 0x55f8749e1790 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.986+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94525596814720] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80c040040 con 0x7fd808039020 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.986+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f09f0 con 0x7fd80c031040 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.987+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94525596824864] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.987+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.987+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94525596821296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f0540 con 0x7fd80c031040 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.987+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f12c0 con 0x7fd80c031040 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.988+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94525596821296] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.989+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.989+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94525596826608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f0540 con 0x7fd80c031040 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.989+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f18e0 con 0x7fd80c031040 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94525596832816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f1d00 con 0x7fd80c031040 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd817211800 20 add_watcher() i=0 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd817211800 20 add_watcher() i=1 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd817211800 20 add_watcher() i=2 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd817211800 20 add_watcher() i=3 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd817211800 20 add_watcher() i=4 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd817211800 20 add_watcher() i=5 2024-04-26T07:55:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94525596826608] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.990+0000 7fd817211800 20 add_watcher() i=6 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.991+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94525596832816] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.991+0000 7fd817211800 20 add_watcher() i=7 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.991+0000 7fd817211800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.991+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f0e10 con 0x55f8749e1790 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.991+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.991+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94525596833872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f0e10 con 0x55f8749e1790 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.992+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94525596833872] v29'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.992+0000 7fd6c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.992+0000 7fd817211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.992+0000 7fd817211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.992+0000 7fd817211800 5 note: GC not initialized 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd6437fe640 20 reqs_thread_entry: start 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd817211800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd817211800 20 Filter name: none 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd6417fa640 20 reqs_thread_entry: start 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd817211800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f874a27fa0 con 0x55f8749e1790 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd817211800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.993+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f874a294f0 con 0x7fd80c031040 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.994+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.995+0000 7fd6c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.995+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94525596833872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f2190 con 0x55f8749e1790 2024-04-26T07:55:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.996+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94525596833872] v29'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.996+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94525596809888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f1850 con 0x7fd808039020 2024-04-26T07:55:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.997+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94525596809888] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80c040040 con 0x7fd808039020 2024-04-26T07:55:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.997+0000 7fd817211800 20 remove_watcher() i=0 2024-04-26T07:55:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.997+0000 7fd817211800 2 removed watcher, disabling cache 2024-04-26T07:55:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.997+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94525596813600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f1850 con 0x55f8749e1790 2024-04-26T07:55:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.998+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94525596813600] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.998+0000 7fd817211800 20 remove_watcher() i=1 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.998+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94525596817664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749f1850 con 0x55f8749e78a0 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:33.999+0000 7fd811fdb640 1 -- 172.21.15.62:0/2633537519 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94525596817664] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80800ec60 con 0x55f8749e78a0 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.000+0000 7fd817211800 20 remove_watcher() i=2 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.000+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94525596814720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ed900 con 0x7fd808039020 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.001+0000 7fd812fdd640 1 -- 172.21.15.62:0/2633537519 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94525596814720] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80c040040 con 0x7fd808039020 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.001+0000 7fd817211800 20 remove_watcher() i=3 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.001+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94525596824864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ed900 con 0x55f8749e1790 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.002+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94525596824864] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x55f8749e1790 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.002+0000 7fd817211800 20 remove_watcher() i=4 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.002+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94525596821296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ed900 con 0x7fd80c031040 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.003+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94525596821296] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.003+0000 7fd817211800 20 remove_watcher() i=5 2024-04-26T07:55:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.003+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94525596826608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ed900 con 0x7fd80c031040 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.004+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94525596826608] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.004+0000 7fd817211800 20 remove_watcher() i=6 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.004+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94525596832816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f8749ed900 con 0x7fd80c031040 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94525596832816] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd804075030 con 0x7fd80c031040 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 20 remove_watcher() i=7 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd80c031040 msgr2=0x7fd80c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd80c031040 0x7fd80c032940 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749e1790 msgr2=0x55f8749e3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749e1790 0x55f8749e3c20 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd808039020 msgr2=0x7fd80800e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd808039020 0x7fd80800e580 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f8749e78a0 msgr2=0x55f8749e9cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f8749e78a0 0x55f8749e9cb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6dc036e60 msgr2=0x7fd6dc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6dc036e60 0x7fd6dc039320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55f8749ad460 tx=0x7fd80c01f000 comp rx=0 tx=0).stop 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 msgr2=0x55f8749d5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 --2- 172.21.15.62:0/2633537519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749ce8c0 0x55f8749d5e80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd80801afd0 tx=0x7fd80804c990 comp rx=0 tx=0).stop 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 reap_dead start 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd8127dc640 1 -- 172.21.15.62:0/2633537519 reap_dead start 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 shutdown_connections 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 >> 172.21.15.62:0/2633537519 conn(0x55f8749cab90 msgr2=0x55f8749c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 shutdown_connections 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.005+0000 7fd817211800 1 -- 172.21.15.62:0/2633537519 wait complete. 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2185049929 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6ec036e60 msgr2=0x7fd6ec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2185049929 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6ec036e60 0x7fd6ec039320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55f8749ad640 tx=0x7fd80c005840 comp rx=0 tx=0).stop 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2185049929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749c1490 msgr2=0x55f8749c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2185049929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749c1490 0x55f8749c18b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd808001770 tx=0x7fd80800f790 comp rx=0 tx=0).stop 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2185049929 shutdown_connections 2024-04-26T07:55:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2185049929 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6ec036e60 0x7fd6ec039320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2185049929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8749c1490 0x55f8749c18b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2185049929 >> 172.21.15.62:0/2185049929 conn(0x55f8749b5530 msgr2=0x55f8749b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2185049929 shutdown_connections 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2185049929 wait complete. 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749adf30 msgr2=0x55f8749b0320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749adf30 0x55f8749b0320 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6f8036e60 msgr2=0x7fd6f8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6f8036e60 0x7fd6f8039320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd808001e10 tx=0x7fd808001390 comp rx=0 tx=0).stop 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ae8b0 msgr2=0x55f8749a8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ae8b0 0x55f8749a8d00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd80400a520 tx=0x7fd804003020 comp rx=0 tx=0).stop 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 shutdown_connections 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f8749adf30 0x55f8749b0320 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd6f8036e60 0x7fd6f8039320 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 --2- 172.21.15.62:0/2853927794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f8748ae8b0 0x55f8749a8d00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 >> 172.21.15.62:0/2853927794 conn(0x55f8748a8d60 msgr2=0x55f874821e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 shutdown_connections 2024-04-26T07:55:34.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.006+0000 7fd817211800 1 -- 172.21.15.62:0/2853927794 wait complete. 2024-04-26T07:55:34.013 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-26T07:55:34.013 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:55:34.013 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-26T07:55:34.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-26T07:55:34.014 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-04-26T07:55:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.063+0000 7f925151f800 1 Processor -- start 2024-04-26T07:55:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.063+0000 7f925151f800 1 -- start start 2024-04-26T07:55:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.064+0000 7f925151f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564f884b0af0 0x564f884b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.064+0000 7f925151f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f88424140 con 0x564f884aefb0 2024-04-26T07:55:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.064+0000 7f925151f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x564f88352e20 con 0x564f884b0af0 2024-04-26T07:55:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.064+0000 7f924c9ed640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564f884b0af0 0x564f884b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.064+0000 7f924c9ed640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564f884b0af0 0x564f884b95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34908/0 (socket says 172.21.15.62:34908) 2024-04-26T07:55:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.064+0000 7f924c9ed640 1 -- 172.21.15.62:0/2697632976 learned_addr learned my addr 172.21.15.62:0/2697632976 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.064+0000 7f924c9ed640 1 -- 172.21.15.62:0/2697632976 >> v1:172.21.15.1:6789/0 conn(0x564f884aefb0 legacy=0x564f884af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.064+0000 7f924c9ed640 1 -- 172.21.15.62:0/2697632976 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f88424310 con 0x564f884b0af0 2024-04-26T07:55:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.066+0000 7f924c9ed640 1 --2- 172.21.15.62:0/2697632976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f884b95f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f924400a520 tx=0x7f924401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb61c459b1bf9d6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.067+0000 7f923ffff640 1 -- 172.21.15.62:0/2697632976 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9244057070 con 0x564f884b0af0 2024-04-26T07:55:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.067+0000 7f923ffff640 1 -- 172.21.15.62:0/2697632976 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9244052570 con 0x564f884b0af0 2024-04-26T07:55:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.067+0000 7f923ffff640 1 -- 172.21.15.62:0/2697632976 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924404ae60 con 0x564f884b0af0 2024-04-26T07:55:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.068+0000 7f925151f800 1 -- 172.21.15.62:0/2697632976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 msgr2=0x564f884b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.068+0000 7f925151f800 1 --2- 172.21.15.62:0/2697632976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f884b95f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f924400a520 tx=0x7f924401d010 comp rx=0 tx=0).stop 2024-04-26T07:55:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.068+0000 7f925151f800 1 -- 172.21.15.62:0/2697632976 shutdown_connections 2024-04-26T07:55:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.068+0000 7f925151f800 1 --2- 172.21.15.62:0/2697632976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f884b95f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.068+0000 7f925151f800 1 -- 172.21.15.62:0/2697632976 >> 172.21.15.62:0/2697632976 conn(0x564f884aabb0 msgr2=0x564f884acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.068+0000 7f925151f800 1 -- 172.21.15.62:0/2697632976 shutdown_connections 2024-04-26T07:55:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.068+0000 7f925151f800 1 -- 172.21.15.62:0/2697632976 wait complete. 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.081+0000 7f925151f800 1 Processor -- start 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.081+0000 7f925151f800 1 -- start start 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.081+0000 7f925151f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884aefb0 0x564f885a3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.081+0000 7f925151f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f883fbd00 con 0x564f884aefb0 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.081+0000 7f924d1ee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884aefb0 0x564f885a3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.082+0000 7f924d1ee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884aefb0 0x564f885a3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34914/0 (socket says 172.21.15.62:34914) 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.082+0000 7f924d1ee640 1 -- 172.21.15.62:0/3710015035 learned_addr learned my addr 172.21.15.62:0/3710015035 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.082+0000 7f924d1ee640 1 -- 172.21.15.62:0/3710015035 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f885a4490 con 0x564f884aefb0 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.082+0000 7f924d1ee640 1 --2- 172.21.15.62:0/3710015035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884aefb0 0x564f885a3ec0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9240001cd0 tx=0x7f924000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d1e6ea43da3976 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.082+0000 7f913b606640 1 -- 172.21.15.62:0/3710015035 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924000be10 con 0x564f884aefb0 2024-04-26T07:55:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.082+0000 7f913b606640 1 -- 172.21.15.62:0/3710015035 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924000f400 con 0x564f884aefb0 2024-04-26T07:55:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.082+0000 7f913b606640 1 -- 172.21.15.62:0/3710015035 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924000f720 con 0x564f884aefb0 2024-04-26T07:55:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.083+0000 7f925151f800 1 -- 172.21.15.62:0/3710015035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884aefb0 msgr2=0x564f885a3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.083+0000 7f925151f800 1 --2- 172.21.15.62:0/3710015035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884aefb0 0x564f885a3ec0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9240001cd0 tx=0x7f924000b5b0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.083+0000 7f925151f800 1 -- 172.21.15.62:0/3710015035 shutdown_connections 2024-04-26T07:55:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.083+0000 7f925151f800 1 --2- 172.21.15.62:0/3710015035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884aefb0 0x564f885a3ec0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.083+0000 7f925151f800 1 -- 172.21.15.62:0/3710015035 >> 172.21.15.62:0/3710015035 conn(0x564f884aabb0 msgr2=0x564f8859f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.083+0000 7f925151f800 1 -- 172.21.15.62:0/3710015035 shutdown_connections 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.083+0000 7f925151f800 1 -- 172.21.15.62:0/3710015035 wait complete. 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.083+0000 7f925151f800 1 Processor -- start 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.084+0000 7f925151f800 1 -- start start 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.084+0000 7f925151f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f885abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.084+0000 7f925151f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f884b9e00 con 0x564f884b0af0 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.084+0000 7f924d1ee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f885abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.084+0000 7f924d1ee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f885abc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34918/0 (socket says 172.21.15.62:34918) 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.084+0000 7f924d1ee640 1 -- 172.21.15.62:0/1674838221 learned_addr learned my addr 172.21.15.62:0/1674838221 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.084+0000 7f924d1ee640 1 -- 172.21.15.62:0/1674838221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f885ac1a0 con 0x564f884b0af0 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.084+0000 7f924d1ee640 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f885abc60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f92400012d0 tx=0x7f9240000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.085+0000 7f9139e03640 1 -- 172.21.15.62:0/1674838221 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924001a5b0 con 0x564f884b0af0 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.085+0000 7f9139e03640 1 -- 172.21.15.62:0/1674838221 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924001a750 con 0x564f884b0af0 2024-04-26T07:55:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.085+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f885ac430 con 0x564f884b0af0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.085+0000 7f9139e03640 1 -- 172.21.15.62:0/1674838221 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924001aa70 con 0x564f884b0af0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.085+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f885af0e0 con 0x564f884b0af0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.086+0000 7f9139e03640 1 -- 172.21.15.62:0/1674838221 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9240017070 con 0x564f884b0af0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.086+0000 7f9139e03640 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9134036e60 0x7f9134039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.086+0000 7f9139e03640 1 -- 172.21.15.62:0/1674838221 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f9240015020 con 0x564f884b0af0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.086+0000 7f924c9ed640 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9134036e60 0x7f9134039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.086+0000 7f925151f800 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885b0ef0 0x564f885b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.086+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885b3820 con 0x564f885b0ef0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.086+0000 7f924d9ef640 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885b0ef0 0x564f885b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.086+0000 7f924c9ed640 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9134036e60 0x7f9134039320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9244054000 tx=0x7f924404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.087+0000 7f924d9ef640 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885b0ef0 0x564f885b32e0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.087+0000 7f924d9ef640 1 -- 172.21.15.62:0/1674838221 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f924800a4a0 con 0x564f885b0ef0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.087+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885b04b0 con 0x564f885b0ef0 2024-04-26T07:55:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.087+0000 7f924d9ef640 1 -- 172.21.15.62:0/1674838221 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f924800a4a0 con 0x564f885b0ef0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.087+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885b55e0 con 0x564f885b0ef0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.087+0000 7f924d9ef640 1 -- 172.21.15.62:0/1674838221 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f924800a4a0 con 0x564f885b0ef0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.087+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885b4920 con 0x564f885b0ef0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.088+0000 7f924d9ef640 1 -- 172.21.15.62:0/1674838221 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f924800a4a0 con 0x564f885b0ef0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.088+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885b4d70 con 0x564f885b0ef0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.088+0000 7f924d9ef640 1 -- 172.21.15.62:0/1674838221 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f924800a4a0 con 0x564f885b0ef0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.088+0000 7f925151f800 1 Processor -- start 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.088+0000 7f925151f800 1 -- start start 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.088+0000 7f925151f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885c43b0 0x564f885c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.088+0000 7f925151f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f883a3170 con 0x564f885c43b0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f924c9ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885c43b0 0x564f885c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f924c9ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885c43b0 0x564f885c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34926/0 (socket says 172.21.15.62:34926) 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f924c9ed640 1 -- 172.21.15.62:0/3919661583 learned_addr learned my addr 172.21.15.62:0/3919661583 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f924c9ed640 1 -- 172.21.15.62:0/3919661583 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f885c4d10 con 0x564f885c43b0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f924c9ed640 1 --2- 172.21.15.62:0/3919661583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885c43b0 0x564f885c47d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9244000c00 tx=0x7f9244002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f9132ffd640 1 -- 172.21.15.62:0/3919661583 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9244061030 con 0x564f885c43b0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f9132ffd640 1 -- 172.21.15.62:0/3919661583 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924405d780 con 0x564f885c43b0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f925151f800 1 -- 172.21.15.62:0/3919661583 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f885c5780 con 0x564f885c43b0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f9132ffd640 1 -- 172.21.15.62:0/3919661583 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9244057040 con 0x564f885c43b0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.089+0000 7f925151f800 1 -- 172.21.15.62:0/3919661583 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f885c5c20 con 0x564f885c43b0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.090+0000 7f9132ffd640 1 -- 172.21.15.62:0/3919661583 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f924405db10 con 0x564f885c43b0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.090+0000 7f9132ffd640 1 --2- 172.21.15.62:0/3919661583 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9124036e60 0x7f9124039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.090+0000 7f9132ffd640 1 -- 172.21.15.62:0/3919661583 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f9244062070 con 0x564f885c43b0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.090+0000 7f924d9ef640 1 --2- 172.21.15.62:0/3919661583 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9124036e60 0x7f9124039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.091+0000 7f925151f800 1 Processor -- start 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.091+0000 7f925151f800 1 -- start start 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.091+0000 7f924d9ef640 1 --2- 172.21.15.62:0/3919661583 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9124036e60 0x7f9124039320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x564f885b4440 tx=0x7f9248005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.091+0000 7f925151f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.091+0000 7f925151f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f885a4810 con 0x564f885d1630 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.091+0000 7f924c9ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.091+0000 7f924c9ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34928/0 (socket says 172.21.15.62:34928) 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.091+0000 7f924c9ed640 1 -- 172.21.15.62:0/14066942 learned_addr learned my addr 172.21.15.62:0/14066942 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f924c9ed640 1 -- 172.21.15.62:0/14066942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f885d2020 con 0x564f885d1630 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f924c9ed640 1 --2- 172.21.15.62:0/14066942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d1a50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f924408ee00 tx=0x7f92440064a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7494e929665d6253 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f9130ff9640 1 -- 172.21.15.62:0/14066942 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9244068e00 con 0x564f885d1630 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f9130ff9640 1 -- 172.21.15.62:0/14066942 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92440703a0 con 0x564f885d1630 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f9130ff9640 1 -- 172.21.15.62:0/14066942 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924405caa0 con 0x564f885d1630 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f925151f800 1 -- 172.21.15.62:0/14066942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 msgr2=0x564f885d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f925151f800 1 --2- 172.21.15.62:0/14066942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d1a50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f924408ee00 tx=0x7f92440064a0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f925151f800 1 -- 172.21.15.62:0/14066942 shutdown_connections 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f925151f800 1 --2- 172.21.15.62:0/14066942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d1a50 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f925151f800 1 -- 172.21.15.62:0/14066942 >> 172.21.15.62:0/14066942 conn(0x564f885cd990 msgr2=0x564f885cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f925151f800 1 -- 172.21.15.62:0/14066942 shutdown_connections 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.092+0000 7f925151f800 1 -- 172.21.15.62:0/14066942 wait complete. 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.093+0000 7f925151f800 1 Processor -- start 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.093+0000 7f925151f800 1 -- start start 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.093+0000 7f925151f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.093+0000 7f925151f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f885d2790 con 0x564f885d1630 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.093+0000 7f924c9ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.093+0000 7f924c9ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34938/0 (socket says 172.21.15.62:34938) 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.093+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 learned_addr learned my addr 172.21.15.62:0/3192456758 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.093+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f885d9210 con 0x564f885d1630 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.094+0000 7f924c9ed640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d8cd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f924408dcf0 tx=0x7f924408ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.094+0000 7f9122ffd640 1 -- 172.21.15.62:0/3192456758 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924405caa0 con 0x564f885d1630 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.094+0000 7f9122ffd640 1 -- 172.21.15.62:0/3192456758 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9244094070 con 0x564f885d1630 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.094+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f885d9210 con 0x564f885d1630 2024-04-26T07:55:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.094+0000 7f9122ffd640 1 -- 172.21.15.62:0/3192456758 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924405c510 con 0x564f885d1630 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.094+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f885d9210 con 0x564f885d1630 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.094+0000 7f9122ffd640 1 -- 172.21.15.62:0/3192456758 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f924405c6b0 con 0x564f885d1630 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f9122ffd640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9118036eb0 0x7f9118039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f9122ffd640 1 -- 172.21.15.62:0/3192456758 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f92440920e0 con 0x564f885d1630 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f924d9ef640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9118036eb0 0x7f9118039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f925151f800 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885e4390 0x564f885e6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e6fa0 con 0x564f885e4390 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f924d1ee640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885e4390 0x564f885e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f924d9ef640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9118036eb0 0x7f9118039370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x564f885b0420 tx=0x7f924801f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.095+0000 7f924d1ee640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885e4390 0x564f885e6850 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 realm 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e73b0 con 0x564f885e4390 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e7c80 con 0x564f885e4390 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e8020 con 0x564f885e4390 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.096+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e8480 con 0x564f885e4390 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.097+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.097+0000 7f925151f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.097+0000 7f925151f800 20 searching for the correct realm 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.097+0000 7f925151f800 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f885ea470 0x564f885ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.097+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x564f885ea470 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.097+0000 7f924c9ed640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f885ea470 0x564f885ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.097+0000 7f924c9ed640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f885ea470 0x564f885ec8c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.098+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.098+0000 7f924c9ed640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9244006ba0 0x7f9244070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.098+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x7f9244006ba0 2024-04-26T07:55:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.098+0000 7f924d9ef640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9244006ba0 0x7f9244070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.098+0000 7f924d9ef640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9244006ba0 0x7f9244070800 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.098+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801f070 con 0x7f9244006ba0 2024-04-26T07:55:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.098+0000 7f924d9ef640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f9248031040 0x7f9248032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.098+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x7f9248031040 2024-04-26T07:55:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.099+0000 7f924d1ee640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f9248031040 0x7f9248032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.099+0000 7f924d1ee640 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f9248031040 0x7f9248032940 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.099+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.099+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x564f885e4390 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.100+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.100+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x564f885e4390 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.100+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.100+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x564f885e4390 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.100+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.100+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x7f9248031040 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.100+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.100+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x7f9244006ba0 2024-04-26T07:55:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.101+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801f070 con 0x7f9244006ba0 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.101+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x564f885ea470 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.101+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.101+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x564f885e4390 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.101+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.101+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x7f9248031040 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.102+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.102+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f885ecf90 con 0x564f885e4390 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.102+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.102+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9244006ba0 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.102+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f924801f070 con 0x7f9244006ba0 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.102+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885ea470 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.102+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.102+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885ea470 2024-04-26T07:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.103+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.103+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9248031040 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.103+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.103+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885ea470 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.103+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.103+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885ea470 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.103+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.103+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885e4390 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.104+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.104+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885e4390 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.104+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.104+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9248031040 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.104+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.104+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885ea470 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.104+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.104+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9244006ba0 2024-04-26T07:55:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.105+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801f070 con 0x7f9244006ba0 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.105+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885e4390 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.105+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.105+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9248031040 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.105+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.105+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885ea470 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.106+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.106+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9248031040 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.106+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.106+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9244006ba0 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.106+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801f070 con 0x7f9244006ba0 2024-04-26T07:55:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.106+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885ea470 2024-04-26T07:55:34.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9248031040 2024-04-26T07:55:34.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x564f885e4390 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f924003d040 con 0x7f9244006ba0 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801f070 con 0x7f9244006ba0 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f925151f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f925151f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f925151f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f925151f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f925151f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.107+0000 7f925151f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e8ec0 con 0x564f885e4390 2024-04-26T07:55:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e9760 con 0x564f885e4390 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e8b00 con 0x564f885e4390 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 zone default found 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 4 Realm: () 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 zonegroup default 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.108+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885e9760 con 0x7f9248031040 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885eedf0 con 0x564f885ea470 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885ef190 con 0x564f885ea470 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 20 started sync module instance, tier type = 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.109+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885ee290 con 0x7f9244006ba0 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.110+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9248040040 con 0x7f9244006ba0 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.110+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94899590325936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885efa30 con 0x7f9244006ba0 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.110+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f0280 con 0x564f885e4390 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.111+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94899590325936] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9248040040 con 0x7f9244006ba0 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.112+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.112+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94899590330000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885effa0 con 0x564f885e4390 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.112+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f0ab0 con 0x564f885ea470 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.113+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94899590330000] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.113+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.113+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94899590333792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f0ea0 con 0x564f885ea470 2024-04-26T07:55:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.113+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f18c0 con 0x7f9244006ba0 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.114+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9248040040 con 0x7f9244006ba0 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.114+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94899590333792] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.114+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94899590331056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f1cb0 con 0x7f9244006ba0 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.114+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f2730 con 0x564f885e4390 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.115+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94899590331056] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9248040040 con 0x7f9244006ba0 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.115+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.115+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94899590341152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f26f0 con 0x564f885e4390 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.115+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f3160 con 0x7f9248031040 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.116+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.116+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94899590343824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f3610 con 0x7f9248031040 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.116+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f4100 con 0x7f9248031040 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.117+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94899590341152] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.117+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94899590343824] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.118+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.118+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94899590347728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f31a0 con 0x7f9248031040 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.118+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f4790 con 0x7f9248031040 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94899590349536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f4bb0 con 0x7f9248031040 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f925151f800 20 add_watcher() i=0 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f925151f800 20 add_watcher() i=1 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f925151f800 20 add_watcher() i=2 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f925151f800 20 add_watcher() i=3 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f925151f800 20 add_watcher() i=4 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f925151f800 20 add_watcher() i=5 2024-04-26T07:55:34.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94899590347728] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.119+0000 7f925151f800 20 add_watcher() i=6 2024-04-26T07:55:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.120+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94899590349536] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.120+0000 7f925151f800 20 add_watcher() i=7 2024-04-26T07:55:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.120+0000 7f925151f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.120+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f885f7be0 con 0x564f885e4390 2024-04-26T07:55:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.120+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.120+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94899590350592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f5040 con 0x564f885e4390 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.121+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94899590350592] v29'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.121+0000 7f91037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.121+0000 7f925151f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.121+0000 7f925151f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.121+0000 7f925151f800 5 note: GC not initialized 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f91027e4640 20 reqs_thread_entry: start 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f925151f800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f925151f800 20 Filter name: none 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f9073fff640 20 reqs_thread_entry: start 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f925151f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f8862ac60 con 0x564f885e4390 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f925151f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:55:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.122+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f8862c1b0 con 0x7f9248031040 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.123+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.124+0000 7f91037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.124+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94899590350592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f88629710 con 0x564f885e4390 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.125+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94899590350592] v29'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.125+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94899590325936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f88629710 con 0x7f9244006ba0 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.126+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94899590325936] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9248040040 con 0x7f9244006ba0 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.126+0000 7f925151f800 20 remove_watcher() i=0 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.126+0000 7f925151f800 2 removed watcher, disabling cache 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.126+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94899590330000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885ee6b0 con 0x564f885e4390 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.127+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94899590330000] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.127+0000 7f925151f800 20 remove_watcher() i=1 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.127+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94899590333792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885ee6b0 con 0x564f885ea470 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.128+0000 7f924c9ed640 1 -- 172.21.15.62:0/3192456758 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94899590333792] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924406e020 con 0x564f885ea470 2024-04-26T07:55:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.128+0000 7f925151f800 20 remove_watcher() i=2 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.128+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94899590331056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f0560 con 0x7f9244006ba0 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.129+0000 7f924d9ef640 1 -- 172.21.15.62:0/3192456758 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94899590331056] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9248040040 con 0x7f9244006ba0 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.129+0000 7f925151f800 20 remove_watcher() i=3 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.129+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94899590341152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885efb40 con 0x564f885e4390 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.130+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94899590341152] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x564f885e4390 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.130+0000 7f925151f800 20 remove_watcher() i=4 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.130+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94899590343824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f2220 con 0x7f9248031040 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.131+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94899590343824] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.131+0000 7f925151f800 20 remove_watcher() i=5 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.131+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94899590347728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f2c90 con 0x7f9248031040 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.133+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94899590347728] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.133+0000 7f925151f800 20 remove_watcher() i=6 2024-04-26T07:55:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.133+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94899590349536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f885f2220 con 0x7f9248031040 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94899590349536] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924002e070 con 0x7f9248031040 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 20 remove_watcher() i=7 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f9248031040 msgr2=0x7f9248032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f9248031040 0x7f9248032940 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885e4390 msgr2=0x564f885e6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885e4390 0x564f885e6850 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9244006ba0 msgr2=0x7f9244070800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f9244006ba0 0x7f9244070800 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f885ea470 msgr2=0x564f885ec8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f885ea470 0x564f885ec8c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9118036eb0 msgr2=0x7f9118039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9118036eb0 0x7f9118039370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x564f885b0420 tx=0x7f924801f000 comp rx=0 tx=0).stop 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 msgr2=0x564f885d8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 --2- 172.21.15.62:0/3192456758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885d1630 0x564f885d8cd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f924408dcf0 tx=0x7f924408ed60 comp rx=0 tx=0).stop 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 reap_dead start 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f924d1ee640 1 -- 172.21.15.62:0/3192456758 reap_dead start 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 shutdown_connections 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 >> 172.21.15.62:0/3192456758 conn(0x564f885cd990 msgr2=0x564f885caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 shutdown_connections 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.134+0000 7f925151f800 1 -- 172.21.15.62:0/3192456758 wait complete. 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/3919661583 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9124036e60 msgr2=0x7f9124039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/3919661583 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9124036e60 0x7f9124039320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x564f885b4440 tx=0x7f9248005840 comp rx=0 tx=0).stop 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/3919661583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885c43b0 msgr2=0x564f885c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/3919661583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885c43b0 0x564f885c47d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9244000c00 tx=0x7f9244002fb0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/3919661583 shutdown_connections 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/3919661583 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9124036e60 0x7f9124039320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/3919661583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f885c43b0 0x564f885c47d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/3919661583 >> 172.21.15.62:0/3919661583 conn(0x564f885b8450 msgr2=0x564f885b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/3919661583 shutdown_connections 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/3919661583 wait complete. 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885b0ef0 msgr2=0x564f885b32e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885b0ef0 0x564f885b32e0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9134036e60 msgr2=0x7f9134039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9134036e60 0x7f9134039320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9244054000 tx=0x7f924404e000 comp rx=0 tx=0).stop 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 msgr2=0x564f885abc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f885abc60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f92400012d0 tx=0x7f9240000bc0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 shutdown_connections 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f885b0ef0 0x564f885b32e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9134036e60 0x7f9134039320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 --2- 172.21.15.62:0/1674838221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f884b0af0 0x564f885abc60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 >> 172.21.15.62:0/1674838221 conn(0x564f884aabb0 msgr2=0x564f8859e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 shutdown_connections 2024-04-26T07:55:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.135+0000 7f925151f800 1 -- 172.21.15.62:0/1674838221 wait complete. 2024-04-26T07:55:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-26T07:00:00.000000Z","epoch":1714114800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-26T07:55:34.152 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:55:34.152 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-26T07:55:34.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-26T07:55:34.152 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-04-26T07:55:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.207+0000 7fd4e8016800 1 Processor -- start 2024-04-26T07:55:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e8016800 1 -- start start 2024-04-26T07:55:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e8016800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x560ab04ba1d0 0x560ab04bc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e8016800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ab04c0610 con 0x560ab04bcb00 2024-04-26T07:55:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e8016800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x560ab035be20 con 0x560ab04ba1d0 2024-04-26T07:55:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e3684640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x560ab04ba1d0 0x560ab04bc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e3684640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x560ab04ba1d0 0x560ab04bc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34950/0 (socket says 172.21.15.62:34950) 2024-04-26T07:55:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e3684640 1 -- 172.21.15.62:0/4265316224 learned_addr learned my addr 172.21.15.62:0/4265316224 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e2e83640 1 --1- 172.21.15.62:0/4265316224 >> v1:172.21.15.1:6789/0 conn(0x560ab04bcb00 0x560ab04beef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43516/0 (socket says 172.21.15.62:43516) 2024-04-26T07:55:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e3684640 1 -- 172.21.15.62:0/4265316224 >> v1:172.21.15.1:6789/0 conn(0x560ab04bcb00 legacy=0x560ab04beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.208+0000 7fd4e3684640 1 -- 172.21.15.62:0/4265316224 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ab04c17f0 con 0x560ab04ba1d0 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.210+0000 7fd4e3684640 1 --2- 172.21.15.62:0/4265316224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab04bc5c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400a520 tx=0x7fd4d401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc24c8d6f56b8573 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e2682640 1 -- 172.21.15.62:0/4265316224 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4057070 con 0x560ab04ba1d0 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e2682640 1 -- 172.21.15.62:0/4265316224 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d4052570 con 0x560ab04ba1d0 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e2682640 1 -- 172.21.15.62:0/4265316224 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d404ae60 con 0x560ab04ba1d0 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e8016800 1 -- 172.21.15.62:0/4265316224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 msgr2=0x560ab04bc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e8016800 1 --2- 172.21.15.62:0/4265316224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab04bc5c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400a520 tx=0x7fd4d401d010 comp rx=0 tx=0).stop 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e8016800 1 -- 172.21.15.62:0/4265316224 shutdown_connections 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e8016800 1 --2- 172.21.15.62:0/4265316224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab04bc5c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e8016800 1 -- 172.21.15.62:0/4265316224 >> 172.21.15.62:0/4265316224 conn(0x560ab04b3be0 msgr2=0x560ab04b6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e8016800 1 -- 172.21.15.62:0/4265316224 shutdown_connections 2024-04-26T07:55:34.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.211+0000 7fd4e8016800 1 -- 172.21.15.62:0/4265316224 wait complete. 2024-04-26T07:55:34.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.224+0000 7fd4e8016800 1 Processor -- start 2024-04-26T07:55:34.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.224+0000 7fd4e8016800 1 -- start start 2024-04-26T07:55:34.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.224+0000 7fd4e8016800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab05aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.224+0000 7fd4e8016800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560ab0404d30 con 0x560ab04ba1d0 2024-04-26T07:55:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.224+0000 7fd4e3684640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab05aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.224+0000 7fd4e3684640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab05aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34962/0 (socket says 172.21.15.62:34962) 2024-04-26T07:55:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.224+0000 7fd4e3684640 1 -- 172.21.15.62:0/1405270231 learned_addr learned my addr 172.21.15.62:0/1405270231 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.225+0000 7fd4e3684640 1 -- 172.21.15.62:0/1405270231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ab05ab300 con 0x560ab04ba1d0 2024-04-26T07:55:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.225+0000 7fd4e3684640 1 --2- 172.21.15.62:0/1405270231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab05aad30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4055040 tx=0x7fd4d404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52419c9f5a52d19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.225+0000 7fd3d160a640 1 -- 172.21.15.62:0/1405270231 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4057040 con 0x560ab04ba1d0 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.225+0000 7fd3d160a640 1 -- 172.21.15.62:0/1405270231 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d4052720 con 0x560ab04ba1d0 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.225+0000 7fd3d160a640 1 -- 172.21.15.62:0/1405270231 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4052a20 con 0x560ab04ba1d0 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 -- 172.21.15.62:0/1405270231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 msgr2=0x560ab05aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1405270231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab05aad30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4055040 tx=0x7fd4d404c000 comp rx=0 tx=0).stop 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 -- 172.21.15.62:0/1405270231 shutdown_connections 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1405270231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04ba1d0 0x560ab05aad30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 -- 172.21.15.62:0/1405270231 >> 172.21.15.62:0/1405270231 conn(0x560ab04b3be0 msgr2=0x560ab05a6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 -- 172.21.15.62:0/1405270231 shutdown_connections 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 -- 172.21.15.62:0/1405270231 wait complete. 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 Processor -- start 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 -- start start 2024-04-26T07:55:34.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04bcb00 0x560ab05b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.226+0000 7fd4e8016800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560ab04c0a80 con 0x560ab04bcb00 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd4e3684640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04bcb00 0x560ab05b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd4e3684640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04bcb00 0x560ab05b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34972/0 (socket says 172.21.15.62:34972) 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd4e3684640 1 -- 172.21.15.62:0/2853339111 learned_addr learned my addr 172.21.15.62:0/2853339111 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd4e3684640 1 -- 172.21.15.62:0/2853339111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ab05b2f90 con 0x560ab04bcb00 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd4e3684640 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04bcb00 0x560ab05b2a50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4052540 tx=0x7fd4d4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd3cfe07640 1 -- 172.21.15.62:0/2853339111 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4073070 con 0x560ab04bcb00 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd3cfe07640 1 -- 172.21.15.62:0/2853339111 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d4052e20 con 0x560ab04bcb00 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ab05b3220 con 0x560ab04bcb00 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd3cfe07640 1 -- 172.21.15.62:0/2853339111 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4057070 con 0x560ab04bcb00 2024-04-26T07:55:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.227+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ab05b5e80 con 0x560ab04bcb00 2024-04-26T07:55:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.228+0000 7fd3cfe07640 1 -- 172.21.15.62:0/2853339111 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd4d4076070 con 0x560ab04bcb00 2024-04-26T07:55:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.228+0000 7fd3cfe07640 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3c8036e60 0x7fd3c8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.228+0000 7fd3cfe07640 1 -- 172.21.15.62:0/2853339111 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd4d408e450 con 0x560ab04bcb00 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.228+0000 7fd4e2e83640 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3c8036e60 0x7fd3c8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.229+0000 7fd4e8016800 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05b7c30 0x560ab05ba020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.229+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05ba560 con 0x560ab05b7c30 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.229+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05b7c30 0x560ab05ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.229+0000 7fd4e2e83640 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3c8036e60 0x7fd3c8039320 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc000f60 tx=0x7fd4cc001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.229+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05b7c30 0x560ab05ba020 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.229+0000 7fd4e3e85640 1 -- 172.21.15.62:0/2853339111 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4dc00a4a0 con 0x560ab05b7c30 2024-04-26T07:55:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.229+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05b7210 con 0x560ab05b7c30 2024-04-26T07:55:34.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.230+0000 7fd4e3e85640 1 -- 172.21.15.62:0/2853339111 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4dc00a4a0 con 0x560ab05b7c30 2024-04-26T07:55:34.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.230+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05bc340 con 0x560ab05b7c30 2024-04-26T07:55:34.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.230+0000 7fd4e3e85640 1 -- 172.21.15.62:0/2853339111 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4dc00a4a0 con 0x560ab05b7c30 2024-04-26T07:55:34.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.230+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05bb680 con 0x560ab05b7c30 2024-04-26T07:55:34.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.230+0000 7fd4e3e85640 1 -- 172.21.15.62:0/2853339111 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4dc00a4a0 con 0x560ab05b7c30 2024-04-26T07:55:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.230+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05bbad0 con 0x560ab05b7c30 2024-04-26T07:55:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.230+0000 7fd4e3e85640 1 -- 172.21.15.62:0/2853339111 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4dc00a4a0 con 0x560ab05b7c30 2024-04-26T07:55:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.231+0000 7fd4e8016800 1 Processor -- start 2024-04-26T07:55:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.231+0000 7fd4e8016800 1 -- start start 2024-04-26T07:55:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.231+0000 7fd4e8016800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05cb110 0x560ab05cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.231+0000 7fd4e8016800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560ab03ac170 con 0x560ab05cb110 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.231+0000 7fd4e2e83640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05cb110 0x560ab05cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.231+0000 7fd4e2e83640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05cb110 0x560ab05cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34982/0 (socket says 172.21.15.62:34982) 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.231+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1518539931 learned_addr learned my addr 172.21.15.62:0/1518539931 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.232+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1518539931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ab05cba70 con 0x560ab05cb110 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.232+0000 7fd4e2e83640 1 --2- 172.21.15.62:0/1518539931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05cb110 0x560ab05cb530 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc001ed0 tx=0x7fd4cc00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.232+0000 7fd3cd602640 1 -- 172.21.15.62:0/1518539931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc022070 con 0x560ab05cb110 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.232+0000 7fd3cd602640 1 -- 172.21.15.62:0/1518539931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00d520 con 0x560ab05cb110 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.232+0000 7fd3cd602640 1 -- 172.21.15.62:0/1518539931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc00d800 con 0x560ab05cb110 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.232+0000 7fd4e8016800 1 -- 172.21.15.62:0/1518539931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ab05cc4e0 con 0x560ab05cb110 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.232+0000 7fd4e8016800 1 -- 172.21.15.62:0/1518539931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ab05cc9e0 con 0x560ab05cb110 2024-04-26T07:55:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.233+0000 7fd3cd602640 1 -- 172.21.15.62:0/1518539931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd4cc025070 con 0x560ab05cb110 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.233+0000 7fd3cd602640 1 --2- 172.21.15.62:0/1518539931 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3bc036e60 0x7fd3bc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.233+0000 7fd3cd602640 1 -- 172.21.15.62:0/1518539931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd4cc04e480 con 0x560ab05cb110 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.233+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/1518539931 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3bc036e60 0x7fd3bc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.233+0000 7fd4e8016800 1 Processor -- start 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.233+0000 7fd4e8016800 1 -- start start 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.233+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/1518539931 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3bc036e60 0x7fd3bc039320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x560ab05bb1a0 tx=0x7fd4dc005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd4e8016800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05d8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd4e8016800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560ab05ab5c0 con 0x560ab05d8450 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd4e2e83640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05d8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd4e2e83640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05d8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:34992/0 (socket says 172.21.15.62:34992) 2024-04-26T07:55:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd4e2e83640 1 -- 172.21.15.62:0/3178694011 learned_addr learned my addr 172.21.15.62:0/3178694011 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd4e2e83640 1 -- 172.21.15.62:0/3178694011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ab05d8e40 con 0x560ab05d8450 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd4e2e83640 1 --2- 172.21.15.62:0/3178694011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05d8870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc04c7f0 tx=0x7fd4cc024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbad0ecc6e9c4e06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd3c6ffd640 1 -- 172.21.15.62:0/3178694011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc026730 con 0x560ab05d8450 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd3c6ffd640 1 -- 172.21.15.62:0/3178694011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4cc025c50 con 0x560ab05d8450 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.234+0000 7fd3c6ffd640 1 -- 172.21.15.62:0/3178694011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc0268d0 con 0x560ab05d8450 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 -- 172.21.15.62:0/3178694011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 msgr2=0x560ab05d8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 --2- 172.21.15.62:0/3178694011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05d8870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc04c7f0 tx=0x7fd4cc024740 comp rx=0 tx=0).stop 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 -- 172.21.15.62:0/3178694011 shutdown_connections 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 --2- 172.21.15.62:0/3178694011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05d8870 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 -- 172.21.15.62:0/3178694011 >> 172.21.15.62:0/3178694011 conn(0x560ab05d47b0 msgr2=0x560ab05d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 -- 172.21.15.62:0/3178694011 shutdown_connections 2024-04-26T07:55:34.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 -- 172.21.15.62:0/3178694011 wait complete. 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 Processor -- start 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 -- start start 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.235+0000 7fd4e8016800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560ab05d95b0 con 0x560ab05d8450 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd4e2e83640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd4e2e83640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05dfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35002/0 (socket says 172.21.15.62:35002) 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 learned_addr learned my addr 172.21.15.62:0/1733976149 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ab05e0110 con 0x560ab05d8450 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd4e2e83640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05dfbd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc01e040 tx=0x7fd4cc04c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd3c57fa640 1 -- 172.21.15.62:0/1733976149 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc02f030 con 0x560ab05d8450 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd3c57fa640 1 -- 172.21.15.62:0/1733976149 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4cc025e00 con 0x560ab05d8450 2024-04-26T07:55:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ab05e0110 con 0x560ab05d8450 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd3c57fa640 1 -- 172.21.15.62:0/1733976149 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc04e070 con 0x560ab05d8450 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.236+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ab05e0110 con 0x560ab05d8450 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.237+0000 7fd3c57fa640 1 -- 172.21.15.62:0/1733976149 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd4cc00d9a0 con 0x560ab05d8450 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.237+0000 7fd3c57fa640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3ac036eb0 0x7fd3ac039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.237+0000 7fd3c57fa640 1 -- 172.21.15.62:0/1733976149 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd4cc030070 con 0x560ab05d8450 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.237+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3ac036eb0 0x7fd3ac039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3ac036eb0 0x7fd3ac039370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x560ab05b3c20 tx=0x7fd4dc01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05eb290 0x560ab05ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05edea0 con 0x560ab05eb290 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e3684640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05eb290 0x560ab05ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e3684640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05eb290 0x560ab05ed750 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e8016800 20 realm 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.238+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05ee2b0 con 0x560ab05eb290 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05eeb80 con 0x560ab05eb290 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05eef20 con 0x560ab05eb290 2024-04-26T07:55:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05ef770 con 0x560ab05eb290 2024-04-26T07:55:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 20 searching for the correct realm 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560ab05f14e0 0x560ab05f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.239+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05f14e0 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.240+0000 7fd4e2e83640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560ab05f14e0 0x560ab05f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.240+0000 7fd4e2e83640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560ab05f14e0 0x560ab05f38d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.240+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.240+0000 7fd4e2e83640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd4cc01ac20 0x7fd4cc03d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.240+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4cc01ac20 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.240+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd4cc01ac20 0x7fd4cc03d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.241+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd4cc01ac20 0x7fd4cc03d350 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.241+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc01f070 con 0x7fd4cc01ac20 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.241+0000 7fd4e3e85640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd4dc031040 0x7fd4dc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.241+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4dc031040 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.241+0000 7fd4e3684640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd4dc031040 0x7fd4dc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.242+0000 7fd4e3684640 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd4dc031040 0x7fd4dc032940 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.242+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.242+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05eb290 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.242+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.242+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05eb290 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.243+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.243+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05eb290 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.243+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.243+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4dc031040 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.243+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.243+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4cc01ac20 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.243+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc01f070 con 0x7fd4cc01ac20 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.243+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05f14e0 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.244+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.244+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05eb290 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.244+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.244+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4dc031040 2024-04-26T07:55:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.244+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.244+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05eb290 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.245+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.245+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4cc01ac20 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.245+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4dc01f070 con 0x7fd4cc01ac20 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.245+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05f14e0 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.245+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.245+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05f14e0 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.245+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.245+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4dc031040 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.246+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.246+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05f14e0 2024-04-26T07:55:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.246+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.246+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05f14e0 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.246+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.246+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05eb290 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.246+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.246+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05eb290 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.247+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.247+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4dc031040 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.247+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.247+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05f14e0 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.247+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.247+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4cc01ac20 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.248+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc01f070 con 0x7fd4cc01ac20 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.248+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x560ab05eb290 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.248+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.248+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f3eb0 con 0x7fd4dc031040 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.248+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.248+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd4d40a2040 con 0x560ab05f14e0 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.248+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.248+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd4d40a2040 con 0x7fd4dc031040 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.249+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.249+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd4d40a2040 con 0x7fd4cc01ac20 2024-04-26T07:55:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.249+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc01f070 con 0x7fd4cc01ac20 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.249+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd4d40a2040 con 0x560ab05f14e0 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.249+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.249+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd4d40a2040 con 0x7fd4dc031040 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd4d40a2040 con 0x560ab05eb290 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd4d40a2040 con 0x7fd4cc01ac20 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc01f070 con 0x7fd4cc01ac20 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05effc0 con 0x560ab05eb290 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.250+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f03b0 con 0x560ab05eb290 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f03b0 con 0x560ab05eb290 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 20 zone default found 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 4 Realm: () 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 20 zonegroup default 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f4330 con 0x7fd4dc031040 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.251+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f5d10 con 0x560ab05f14e0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f60b0 con 0x560ab05f14e0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e8016800 20 started sync module instance, tier type = 2024-04-26T07:55:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e8016800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.252+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f51b0 con 0x7fd4cc01ac20 2024-04-26T07:55:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.253+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc040040 con 0x7fd4cc01ac20 2024-04-26T07:55:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.253+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94603908699600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f4e10 con 0x7fd4cc01ac20 2024-04-26T07:55:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.253+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f6df0 con 0x560ab05eb290 2024-04-26T07:55:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.254+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94603908699600] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc040040 con 0x7fd4cc01ac20 2024-04-26T07:55:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.255+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.255+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94603908703312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f6da0 con 0x560ab05eb290 2024-04-26T07:55:34.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.255+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f78c0 con 0x560ab05f14e0 2024-04-26T07:55:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.256+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.256+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94603908707216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f8160 con 0x560ab05f14e0 2024-04-26T07:55:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.256+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f8c50 con 0x7fd4cc01ac20 2024-04-26T07:55:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.256+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94603908703312] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.257+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94603908707216] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.257+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc040040 con 0x7fd4cc01ac20 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.257+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94603908709552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f6870 con 0x7fd4cc01ac20 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.257+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f9530 con 0x560ab05eb290 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.258+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94603908709552] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc040040 con 0x7fd4cc01ac20 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.258+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.258+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94603908712224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f94f0 con 0x560ab05eb290 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.258+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f9fe0 con 0x7fd4dc031040 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.260+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.260+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94603908717248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f9fe0 con 0x7fd4dc031040 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.260+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05faf00 con 0x7fd4dc031040 2024-04-26T07:55:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.260+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94603908712224] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.261+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94603908717248] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.261+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.261+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94603908721136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05fa240 con 0x7fd4dc031040 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.261+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05fb3b0 con 0x7fd4dc031040 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94603908722368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05fb7d0 con 0x7fd4dc031040 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e8016800 20 add_watcher() i=0 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e8016800 20 add_watcher() i=1 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e8016800 20 add_watcher() i=2 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e8016800 20 add_watcher() i=3 2024-04-26T07:55:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e8016800 20 add_watcher() i=4 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e8016800 20 add_watcher() i=5 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94603908721136] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.262+0000 7fd4e8016800 20 add_watcher() i=6 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.263+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94603908722368] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.263+0000 7fd4e8016800 20 add_watcher() i=7 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.263+0000 7fd4e8016800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.263+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f9040 con 0x560ab05eb290 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.263+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.263+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94603908723424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f9040 con 0x560ab05eb290 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.264+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94603908723424] v29'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:34.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd4e8016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd4e8016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd4e8016800 5 note: GC not initialized 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd398fe1640 20 reqs_thread_entry: start 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd4e8016800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd4e8016800 20 Filter name: none 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd3127fc640 20 reqs_thread_entry: start 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd4e8016800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.265+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab0632080 con 0x7fd4dc031040 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab06306c0 con 0x560ab05eb290 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-26T07:55:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.266+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab0630f60 con 0x7fd4dc031040 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v29'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e8016800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e8016800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e8016800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94603908942512 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab0635b20 con 0x7fd4dc031040 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== watch-notify(notify (1) cookie 94603908722368 notify 124554051613 ret 0) ==== 598+0+0 (crc 0 0 0) 0x560ab0631300 con 0x7fd4dc031040 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd3c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94603908722368 notifier 4717 bl.length()=556 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd3c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd3c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T07:55:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(65 notify.7 [notify cookie 94603908942512 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd3c6ffd640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fd3a8003ea0 con 0x7fd4dc031040 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== watch-notify(notify_complete (2) cookie 94603908942512 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560ab0630850 con 0x7fd4dc031040 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.268+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab0630a60 con 0x560ab05eb290 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.269+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.269+0000 7fd4e8016800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.269+0000 7fd4e8016800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.269+0000 7fd4e8016800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.269+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94603908942432 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560ab0635b20 con 0x7fd4dc031040 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.270+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== watch-notify(notify (1) cookie 94603908717248 notify 124554051614 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560ab0630850 con 0x7fd4dc031040 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.270+0000 7fd3c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 94603908717248 notifier 4717 bl.length()=177 2024-04-26T07:55:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.270+0000 7fd3c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T07:55:34.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.270+0000 7fd3c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T07:55:34.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.270+0000 7fd3c6ffd640 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fd3a8003ea0 con 0x7fd4dc031040 2024-04-26T07:55:34.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.270+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(68 notify.5 [notify cookie 94603908942432 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.270+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.270+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== watch-notify(notify_complete (2) cookie 94603908942432 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560ab05b5e80 con 0x7fd4dc031040 2024-04-26T07:55:34.289 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-26T07:55:34.267621Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:55:34.267607Z","tags":[],"group_ids":[]} 2024-04-26T07:55:34.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.271+0000 7fd399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:34.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.271+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94603908723424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05e4ce0 con 0x560ab05eb290 2024-04-26T07:55:34.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.272+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94603908723424] v29'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.272+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94603908699600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05fb2e0 con 0x7fd4cc01ac20 2024-04-26T07:55:34.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.273+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94603908699600] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc040040 con 0x7fd4cc01ac20 2024-04-26T07:55:34.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.273+0000 7fd4e8016800 20 remove_watcher() i=0 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.273+0000 7fd4e8016800 2 removed watcher, disabling cache 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.273+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94603908703312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05fb2e0 con 0x560ab05eb290 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.274+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94603908703312] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.274+0000 7fd4e8016800 20 remove_watcher() i=1 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.274+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94603908707216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f6450 con 0x560ab05f14e0 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.275+0000 7fd4e2e83640 1 -- 172.21.15.62:0/1733976149 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94603908707216] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc03c070 con 0x560ab05f14e0 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.276+0000 7fd4e8016800 20 remove_watcher() i=2 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.276+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94603908709552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05fb2e0 con 0x7fd4cc01ac20 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.277+0000 7fd4e3e85640 1 -- 172.21.15.62:0/1733976149 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94603908709552] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc040040 con 0x7fd4cc01ac20 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.277+0000 7fd4e8016800 20 remove_watcher() i=3 2024-04-26T07:55:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.277+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94603908712224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05fb2e0 con 0x560ab05eb290 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.278+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94603908712224] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x560ab05eb290 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.278+0000 7fd4e8016800 20 remove_watcher() i=4 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.278+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94603908717248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f8720 con 0x7fd4dc031040 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.279+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94603908717248] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.279+0000 7fd4e8016800 20 remove_watcher() i=5 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.279+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94603908721136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05fb2e0 con 0x7fd4dc031040 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.280+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94603908721136] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.280+0000 7fd4e8016800 20 remove_watcher() i=6 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.280+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94603908722368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560ab05f9ac0 con 0x7fd4dc031040 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94603908722368] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4075030 con 0x7fd4dc031040 2024-04-26T07:55:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 20 remove_watcher() i=7 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd4dc031040 msgr2=0x7fd4dc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd4dc031040 0x7fd4dc032940 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05eb290 msgr2=0x560ab05ed750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05eb290 0x560ab05ed750 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd4cc01ac20 msgr2=0x7fd4cc03d350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd4cc01ac20 0x7fd4cc03d350 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560ab05f14e0 msgr2=0x560ab05f38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x560ab05f14e0 0x560ab05f38d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3ac036eb0 msgr2=0x7fd3ac039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3ac036eb0 0x7fd3ac039370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x560ab05b3c20 tx=0x7fd4dc01f000 comp rx=0 tx=0).stop 2024-04-26T07:55:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 msgr2=0x560ab05dfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1733976149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05d8450 0x560ab05dfbd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc01e040 tx=0x7fd4cc04c750 comp rx=0 tx=0).stop 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 reap_dead start 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e3684640 1 -- 172.21.15.62:0/1733976149 reap_dead start 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 shutdown_connections 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 >> 172.21.15.62:0/1733976149 conn(0x560ab05d47b0 msgr2=0x560ab05d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 shutdown_connections 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.281+0000 7fd4e8016800 1 -- 172.21.15.62:0/1733976149 wait complete. 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/1518539931 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3bc036e60 msgr2=0x7fd3bc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1518539931 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3bc036e60 0x7fd3bc039320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x560ab05bb1a0 tx=0x7fd4dc005840 comp rx=0 tx=0).stop 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/1518539931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05cb110 msgr2=0x560ab05cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1518539931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05cb110 0x560ab05cb530 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc001ed0 tx=0x7fd4cc00ea00 comp rx=0 tx=0).stop 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/1518539931 shutdown_connections 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1518539931 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3bc036e60 0x7fd3bc039320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/1518539931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab05cb110 0x560ab05cb530 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/1518539931 >> 172.21.15.62:0/1518539931 conn(0x560ab05bf1b0 msgr2=0x560ab05bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/1518539931 shutdown_connections 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/1518539931 wait complete. 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05b7c30 msgr2=0x560ab05ba020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05b7c30 0x560ab05ba020 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3c8036e60 msgr2=0x7fd3c8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3c8036e60 0x7fd3c8039320 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc000f60 tx=0x7fd4cc001370 comp rx=0 tx=0).stop 2024-04-26T07:55:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04bcb00 msgr2=0x560ab05b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04bcb00 0x560ab05b2a50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4052540 tx=0x7fd4d4003020 comp rx=0 tx=0).stop 2024-04-26T07:55:34.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 shutdown_connections 2024-04-26T07:55:34.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x560ab05b7c30 0x560ab05ba020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd3c8036e60 0x7fd3c8039320 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 --2- 172.21.15.62:0/2853339111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560ab04bcb00 0x560ab05b2a50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 >> 172.21.15.62:0/2853339111 conn(0x560ab04b3be0 msgr2=0x560ab05a4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 shutdown_connections 2024-04-26T07:55:34.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.282+0000 7fd4e8016800 1 -- 172.21.15.62:0/2853339111 wait complete. 2024-04-26T07:55:34.301 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-26T07:55:34.267621Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:55:34.267607Z', 'tags': [], 'group_ids': []} 2024-04-26T07:55:34.314 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:55:34.320 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-04-26T07:55:34.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-26T07:55:34.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-26T07:55:34.321 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-04-26T07:55:34.367 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:34.367 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.370+0000 7f7d97f35800 1 Processor -- start 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.370+0000 7f7d97f35800 1 -- start start 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.370+0000 7f7d97f35800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x558d0da361a0 0x558d0da38590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.370+0000 7f7d97f35800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d0da3c5e0 con 0x558d0da38ad0 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.371+0000 7f7d97f35800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x558d0d8d7e20 con 0x558d0da361a0 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.371+0000 7f7d93bb5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x558d0da361a0 0x558d0da38590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.371+0000 7f7d933b4640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x558d0da38ad0 0x558d0da3aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43528/0 (socket says 172.21.15.62:43528) 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.371+0000 7f7d933b4640 1 -- 172.21.15.62:0/2105493155 learned_addr learned my addr 172.21.15.62:0/2105493155 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.371+0000 7f7d93bb5640 1 --2- 172.21.15.62:0/2105493155 >> v2:172.21.15.1:3300/0 conn(0x558d0da361a0 0x558d0da38590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35018/0 (socket says 172.21.15.62:35018) 2024-04-26T07:55:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.371+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2105493155 >> v1:172.21.15.1:6789/0 conn(0x558d0da38ad0 legacy=0x558d0da3aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.371+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2105493155 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d0da3d7c0 con 0x558d0da361a0 2024-04-26T07:55:34.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.373+0000 7f7d93bb5640 1 --2- 172.21.15.62:0/2105493155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0da38590 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400a470 tx=0x7f7d8401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a39b68a5d196927 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.373+0000 7f7d92bb3640 1 -- 172.21.15.62:0/2105493155 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d84057070 con 0x558d0da361a0 2024-04-26T07:55:34.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.373+0000 7f7d92bb3640 1 -- 172.21.15.62:0/2105493155 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d84052570 con 0x558d0da361a0 2024-04-26T07:55:34.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.373+0000 7f7d92bb3640 1 -- 172.21.15.62:0/2105493155 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d84052870 con 0x558d0da361a0 2024-04-26T07:55:34.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.374+0000 7f7d97f35800 1 -- 172.21.15.62:0/2105493155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 msgr2=0x558d0da38590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.374+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2105493155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0da38590 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400a470 tx=0x7f7d8401ce90 comp rx=0 tx=0).stop 2024-04-26T07:55:34.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.374+0000 7f7d97f35800 1 -- 172.21.15.62:0/2105493155 shutdown_connections 2024-04-26T07:55:34.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.374+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2105493155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0da38590 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.374+0000 7f7d97f35800 1 -- 172.21.15.62:0/2105493155 >> 172.21.15.62:0/2105493155 conn(0x558d0da2fbb0 msgr2=0x558d0da31fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.374+0000 7f7d97f35800 1 -- 172.21.15.62:0/2105493155 shutdown_connections 2024-04-26T07:55:34.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.374+0000 7f7d97f35800 1 -- 172.21.15.62:0/2105493155 wait complete. 2024-04-26T07:55:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.386+0000 7f7d97f35800 1 Processor -- start 2024-04-26T07:55:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.387+0000 7f7d97f35800 1 -- start start 2024-04-26T07:55:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.387+0000 7f7d97f35800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db26c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.387+0000 7f7d97f35800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d0d980d00 con 0x558d0da361a0 2024-04-26T07:55:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.387+0000 7f7d93bb5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db26c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.387+0000 7f7d93bb5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db26c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35020/0 (socket says 172.21.15.62:35020) 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.387+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2592353825 learned_addr learned my addr 172.21.15.62:0/2592353825 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.387+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2592353825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d0db27210 con 0x558d0da361a0 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.388+0000 7f7d93bb5640 1 --2- 172.21.15.62:0/2592353825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db26c40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7d84055040 tx=0x7f7d8404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c89057f5d70d20 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.388+0000 7f7c81e0b640 1 -- 172.21.15.62:0/2592353825 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d84057040 con 0x558d0da361a0 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.388+0000 7f7c81e0b640 1 -- 172.21.15.62:0/2592353825 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d84052990 con 0x558d0da361a0 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.388+0000 7f7c81e0b640 1 -- 172.21.15.62:0/2592353825 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d84052c70 con 0x558d0da361a0 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 -- 172.21.15.62:0/2592353825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 msgr2=0x558d0db26c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2592353825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db26c40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7d84055040 tx=0x7f7d8404c000 comp rx=0 tx=0).stop 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 -- 172.21.15.62:0/2592353825 shutdown_connections 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2592353825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db26c40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 -- 172.21.15.62:0/2592353825 >> 172.21.15.62:0/2592353825 conn(0x558d0da2fbb0 msgr2=0x558d0db22560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 -- 172.21.15.62:0/2592353825 shutdown_connections 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 -- 172.21.15.62:0/2592353825 wait complete. 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 Processor -- start 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 -- start start 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db2e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d97f35800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d0da3ca50 con 0x558d0da361a0 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d93bb5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db2e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d93bb5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db2e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35034/0 (socket says 172.21.15.62:35034) 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.389+0000 7f7d93bb5640 1 -- 172.21.15.62:0/3969778043 learned_addr learned my addr 172.21.15.62:0/3969778043 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.390+0000 7f7d93bb5640 1 -- 172.21.15.62:0/3969778043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d0db2ebf0 con 0x558d0da361a0 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.390+0000 7f7d93bb5640 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db2e6b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400a470 tx=0x7f7d84003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.390+0000 7f7c7bfff640 1 -- 172.21.15.62:0/3969778043 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d84073070 con 0x558d0da361a0 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.390+0000 7f7c7bfff640 1 -- 172.21.15.62:0/3969778043 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8405d650 con 0x558d0da361a0 2024-04-26T07:55:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.390+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d0db2ee80 con 0x558d0da361a0 2024-04-26T07:55:34.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.390+0000 7f7c7bfff640 1 -- 172.21.15.62:0/3969778043 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d84057070 con 0x558d0da361a0 2024-04-26T07:55:34.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.390+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d0db31b30 con 0x558d0da361a0 2024-04-26T07:55:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.391+0000 7f7c7bfff640 1 -- 172.21.15.62:0/3969778043 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7d84076070 con 0x558d0da361a0 2024-04-26T07:55:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.391+0000 7f7c7bfff640 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c7c036e60 0x7f7c7c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.391+0000 7f7c7bfff640 1 -- 172.21.15.62:0/3969778043 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f7d8408e780 con 0x558d0da361a0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.391+0000 7f7d933b4640 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c7c036e60 0x7f7c7c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.391+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0da38ad0 0x558d0db358f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.391+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db35e80 con 0x558d0da38ad0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.391+0000 7f7d943b6640 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0da38ad0 0x558d0db358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.392+0000 7f7d933b4640 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c7c036e60 0x7f7c7c039320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f60 tx=0x7f7d880012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.392+0000 7f7d943b6640 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0da38ad0 0x558d0db358f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.392+0000 7f7d943b6640 1 -- 172.21.15.62:0/3969778043 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d8c00a4a0 con 0x558d0da38ad0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.392+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db32ec0 con 0x558d0da38ad0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.392+0000 7f7d943b6640 1 -- 172.21.15.62:0/3969778043 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d8c00a4a0 con 0x558d0da38ad0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.392+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db37cc0 con 0x558d0da38ad0 2024-04-26T07:55:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.393+0000 7f7d943b6640 1 -- 172.21.15.62:0/3969778043 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d8c00a4a0 con 0x558d0da38ad0 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.393+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db37000 con 0x558d0da38ad0 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.393+0000 7f7d943b6640 1 -- 172.21.15.62:0/3969778043 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d8c00a4a0 con 0x558d0da38ad0 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.393+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db37450 con 0x558d0da38ad0 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.393+0000 7f7d943b6640 1 -- 172.21.15.62:0/3969778043 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d8c00a4a0 con 0x558d0da38ad0 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.394+0000 7f7d97f35800 1 Processor -- start 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.394+0000 7f7d97f35800 1 -- start start 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.394+0000 7f7d97f35800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da35d20 0x558d0da34190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.394+0000 7f7d97f35800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d0d928170 con 0x558d0da35d20 2024-04-26T07:55:34.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.394+0000 7f7d933b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da35d20 0x558d0da34190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.394+0000 7f7d933b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da35d20 0x558d0da34190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35038/0 (socket says 172.21.15.62:35038) 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.394+0000 7f7d933b4640 1 -- 172.21.15.62:0/4106257019 learned_addr learned my addr 172.21.15.62:0/4106257019 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.394+0000 7f7d933b4640 1 -- 172.21.15.62:0/4106257019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d0da346d0 con 0x558d0da35d20 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.395+0000 7f7d933b4640 1 --2- 172.21.15.62:0/4106257019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da35d20 0x558d0da34190 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7d88001ed0 tx=0x7f7d8800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.395+0000 7f7c797fa640 1 -- 172.21.15.62:0/4106257019 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8801b550 con 0x558d0da35d20 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.395+0000 7f7c797fa640 1 -- 172.21.15.62:0/4106257019 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8801b6f0 con 0x558d0da35d20 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.395+0000 7f7d97f35800 1 -- 172.21.15.62:0/4106257019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d0da34900 con 0x558d0da35d20 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.395+0000 7f7c797fa640 1 -- 172.21.15.62:0/4106257019 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8801b9d0 con 0x558d0da35d20 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.395+0000 7f7d97f35800 1 -- 172.21.15.62:0/4106257019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d0da34e00 con 0x558d0da35d20 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7c797fa640 1 -- 172.21.15.62:0/4106257019 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7d88023020 con 0x558d0da35d20 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7c797fa640 1 --2- 172.21.15.62:0/4106257019 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c6c036e60 0x7f7c6c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7c797fa640 1 -- 172.21.15.62:0/4106257019 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f7d88021020 con 0x558d0da35d20 2024-04-26T07:55:34.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7d943b6640 1 --2- 172.21.15.62:0/4106257019 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c6c036e60 0x7f7c6c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7d97f35800 1 Processor -- start 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7d97f35800 1 -- start start 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7d943b6640 1 --2- 172.21.15.62:0/4106257019 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c6c036e60 0x7f7c6c039320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x558d0db36b20 tx=0x7f7d8c005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7d97f35800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.396+0000 7f7d97f35800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d0db274d0 con 0x558d0db55fc0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.397+0000 7f7d933b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.397+0000 7f7d933b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35044/0 (socket says 172.21.15.62:35044) 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.397+0000 7f7d933b4640 1 -- 172.21.15.62:0/3843668905 learned_addr learned my addr 172.21.15.62:0/3843668905 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.397+0000 7f7d933b4640 1 -- 172.21.15.62:0/3843668905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d0db569b0 con 0x558d0db55fc0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.397+0000 7f7d933b4640 1 --2- 172.21.15.62:0/3843668905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db563e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7d8804d530 tx=0x7f7d8803def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01cf2f238b2d1ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.397+0000 7f7c72ffd640 1 -- 172.21.15.62:0/3843668905 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8800c360 con 0x558d0db55fc0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.397+0000 7f7c72ffd640 1 -- 172.21.15.62:0/3843668905 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88024e10 con 0x558d0db55fc0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.397+0000 7f7c72ffd640 1 -- 172.21.15.62:0/3843668905 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8801ad80 con 0x558d0db55fc0 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 -- 172.21.15.62:0/3843668905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 msgr2=0x558d0db563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3843668905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db563e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7d8804d530 tx=0x7f7d8803def0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 -- 172.21.15.62:0/3843668905 shutdown_connections 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3843668905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db563e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 -- 172.21.15.62:0/3843668905 >> 172.21.15.62:0/3843668905 conn(0x558d0db52320 msgr2=0x558d0db50380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 -- 172.21.15.62:0/3843668905 shutdown_connections 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 -- 172.21.15.62:0/3843668905 wait complete. 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 Processor -- start 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 -- start start 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db5d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d97f35800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d0db57120 con 0x558d0db55fc0 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.398+0000 7f7d933b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db5d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7d933b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db5d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35050/0 (socket says 172.21.15.62:35050) 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 learned_addr learned my addr 172.21.15.62:0/2376705183 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d0db5db90 con 0x558d0db55fc0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7d933b4640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db5d650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800dcc0 tx=0x7f7d8804d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7c717fa640 1 -- 172.21.15.62:0/2376705183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8800c360 con 0x558d0db55fc0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7c717fa640 1 -- 172.21.15.62:0/2376705183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88025980 con 0x558d0db55fc0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d0db5de20 con 0x558d0db55fc0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7c717fa640 1 -- 172.21.15.62:0/2376705183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d88025410 con 0x558d0db55fc0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.399+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d0db5de20 con 0x558d0db55fc0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.400+0000 7f7c717fa640 1 -- 172.21.15.62:0/2376705183 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7d8803c250 con 0x558d0db55fc0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.400+0000 7f7c717fa640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c5c036e60 0x7f7c5c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.400+0000 7f7c717fa640 1 -- 172.21.15.62:0/2376705183 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f7d88046040 con 0x558d0db55fc0 2024-04-26T07:55:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.400+0000 7f7d943b6640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c5c036e60 0x7f7c5c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.400+0000 7f7d943b6640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c5c036e60 0x7f7c5c039320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x558d0db32e10 tx=0x7f7d8c01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0db68f60 0x558d0db6b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db6bb70 con 0x558d0db68f60 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d93bb5640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0db68f60 0x558d0db6b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d93bb5640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0db68f60 0x558d0db6b420 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d97f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d97f35800 20 realm 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db6bf80 con 0x558d0db68f60 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.401+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db6c850 con 0x558d0db68f60 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db6cbf0 con 0x558d0db68f60 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db6d440 con 0x558d0db68f60 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 20 searching for the correct realm 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558d0db6f1b0 0x558d0db715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.402+0000 7f7d933b4640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558d0db6f1b0 0x558d0db715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.403+0000 7f7d933b4640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558d0db6f1b0 0x558d0db715a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.403+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.403+0000 7f7d933b4640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7d88039b70 0x7f7d8803f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.403+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d88039b70 2024-04-26T07:55:34.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.403+0000 7f7d943b6640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7d88039b70 0x7f7d8803f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.404+0000 7f7d943b6640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7d88039b70 0x7f7d8803f9c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.404+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c01f070 con 0x7f7d88039b70 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.404+0000 7f7d943b6640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7d8c031040 0x7f7d8c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.404+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d8c031040 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.404+0000 7f7d93bb5640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7d8c031040 0x7f7d8c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.405+0000 7f7d93bb5640 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7d8c031040 0x7f7d8c032940 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.405+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.405+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.405+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.405+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.406+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.406+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.406+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.406+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d8c031040 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.406+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.406+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d88039b70 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.406+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c01f070 con 0x7f7d88039b70 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.406+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.407+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.407+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.407+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.407+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d8c031040 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.407+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.407+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.407+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.407+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d88039b70 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.408+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d8c01f070 con 0x7f7d88039b70 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.408+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.408+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.408+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.408+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.408+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d8c031040 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.408+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.409+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.409+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.409+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.409+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.409+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.409+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.409+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.410+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.410+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d8c031040 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.410+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.410+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.410+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.410+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d88039b70 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.411+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c01f070 con 0x7f7d88039b70 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.411+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.411+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.411+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d8c031040 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.411+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.411+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.412+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.412+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d8c031040 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.412+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.412+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d88039b70 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.412+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c01f070 con 0x7f7d88039b70 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.412+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db6f1b0 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.413+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.413+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d8c031040 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.413+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.413+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x558d0db68f60 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.413+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.413+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d0db71b80 con 0x7f7d88039b70 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.413+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c01f070 con 0x7f7d88039b70 2024-04-26T07:55:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db6ddf0 con 0x558d0db68f60 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db6e690 con 0x558d0db68f60 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db72000 con 0x558d0db68f60 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 zone default found 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 4 Realm: () 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 zonegroup default 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.414+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db724b0 con 0x7f7d8c031040 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db73e90 con 0x558d0db6f1b0 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db74350 con 0x558d0db6f1b0 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 20 started sync module instance, tier type = 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.415+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db73320 con 0x7f7d88039b70 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.417+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.417+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94064308860688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db74c60 con 0x7f7d88039b70 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.417+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db754b0 con 0x558d0db68f60 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.418+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94064308860688] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.418+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.418+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94064308864944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db75100 con 0x558d0db68f60 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.418+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db75bd0 con 0x558d0db6f1b0 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.419+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.419+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94064308868800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db764a0 con 0x558d0db6f1b0 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.419+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db76f20 con 0x7f7d88039b70 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.419+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94064308864944] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.420+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.420+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94064308873744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db77340 con 0x7f7d88039b70 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.420+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94064308868800] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.420+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db76010 con 0x558d0db68f60 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.421+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94064308873744] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.422+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.422+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94064308866000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db76010 con 0x558d0db68f60 2024-04-26T07:55:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.422+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db78320 con 0x7f7d8c031040 2024-04-26T07:55:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.423+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.423+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94064308878960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db78740 con 0x7f7d8c031040 2024-04-26T07:55:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.423+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94064308866000] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.423+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db77890 con 0x7f7d8c031040 2024-04-26T07:55:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.424+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94064308878960] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.424+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.424+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94064308880016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db786b0 con 0x7f7d8c031040 2024-04-26T07:55:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.424+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db796c0 con 0x7f7d8c031040 2024-04-26T07:55:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94064308883888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db79b30 con 0x7f7d8c031040 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d97f35800 20 add_watcher() i=0 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d97f35800 20 add_watcher() i=1 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d97f35800 20 add_watcher() i=2 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d97f35800 20 add_watcher() i=3 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d97f35800 20 add_watcher() i=4 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d97f35800 20 add_watcher() i=5 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94064308880016] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.425+0000 7f7d97f35800 20 add_watcher() i=6 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.426+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94064308883888] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.426+0000 7f7d97f35800 20 add_watcher() i=7 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.426+0000 7f7d97f35800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.426+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0db79b30 con 0x558d0db68f60 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.426+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.426+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94064308885120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db79ad0 con 0x558d0db68f60 2024-04-26T07:55:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.427+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94064308885120] v29'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.427+0000 7f7c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7d97f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7d97f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7d97f35800 5 note: GC not initialized 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7c48fe1640 20 reqs_thread_entry: start 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7d97f35800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7d97f35800 20 Filter name: none 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7bc27fc640 20 reqs_thread_entry: start 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7d97f35800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.428+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb02b0 con 0x7f7d8c031040 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.429+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.429+0000 7f7d97f35800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:55:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.429+0000 7f7d97f35800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.429+0000 7f7d97f35800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.429+0000 7f7d97f35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.429+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb4620 con 0x7f7d88039b70 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v29'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7d97f35800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7d97f35800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7d97f35800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94064309125088 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb52f0 con 0x7f7d8c031040 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== watch-notify(notify (1) cookie 94064308878960 notify 124554051615 ret 0) ==== 424+0+0 (crc 0 0 0) 0x558d0db31b30 con 0x7f7d8c031040 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7c72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94064308878960 notifier 4724 bl.length()=382 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7c72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7c72ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7c72ffd640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7c58003ea0 con 0x7f7d8c031040 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.430+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(64 notify.5 [notify cookie 94064309125088 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.431+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.431+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== watch-notify(notify_complete (2) cookie 94064309125088 notify 124554051615 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d0db2ee80 con 0x7f7d8c031040 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.431+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb3fe0 con 0x558d0db68f60 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.431+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.431+0000 7f7d97f35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 : miss 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.431+0000 7f7d97f35800 20 rados->read ofs=0 len=0 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.431+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 8.13 8:cdf3e8c0:root::.bucket.meta.myfoo6%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb2450 con 0x7f7d8c031040 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.432+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(67 .bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv9 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.432+0000 7f7d97f35800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.432+0000 7f7d97f35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 info.flags=0x17 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.432+0000 7f7d97f35800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 to cache LRU end 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.432+0000 7f7d97f35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.432+0000 7f7d97f35800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.432+0000 7f7d97f35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 2024-04-26T07:55:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.432+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 8.13 8:cdf3e8c0:root::.bucket.meta.myfoo6%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbc550 con 0x7f7d8c031040 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(68 .bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v29'10 uv10 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d97f35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 info.flags=0x17 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d97f35800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 to cache LRU end 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d97f35800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d97f35800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9, ofs0, ns] 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94064309112720 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbb1a0 con 0x7f7d88039b70 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== watch-notify(notify (1) cookie 94064308860688 notify 124554051606 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f7d8c024a00 con 0x7f7d88039b70 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7c727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94064308860688 notifier 4724 bl.length()=748 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7c727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 info.flags=0x17 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7c727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 to cache LRU end 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7c727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7c727fc640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7bc8003530 con 0x7f7d88039b70 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(69 notify.0 [notify cookie 94064309112720 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.433+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.434+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== watch-notify(notify_complete (2) cookie 94064309112720 notify 124554051606 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7d8c014420 con 0x7f7d88039b70 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.434+0000 7f7d97f35800 20 handle_bi_update(): bucket=:myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]): orig_sources= new_sources= 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.434+0000 7f7d97f35800 20 handle_bi_update(): bucket=:myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]): potential sources added=[] removed=[] 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.434+0000 7f7d97f35800 20 handle_bi_update(): bucket=:myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]): orig_dests= new_dests= 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.434+0000 7f7d97f35800 20 handle_bi_update(): bucket=:myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]): potential dests added=[] removed=[] 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.434+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbacf0 con 0x558d0db68f60 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.435+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(71 bud.buckets [call] v29'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.435+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbacf0 con 0x558d0db68f60 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.436+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(72 bud.buckets [call] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.436+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbbd00 con 0x558d0db68f60 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v29'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7d97f35800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7d97f35800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7d97f35800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-26T07:55:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94064309112720 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb5720 con 0x7f7d88039b70 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== watch-notify(notify (1) cookie 94064308873744 notify 124554051607 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7f7d8c0146c0 con 0x7f7d88039b70 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7c72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94064308873744 notifier 4724 bl.length()=316 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7c72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7c72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7c72ffd640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7c58003ea0 con 0x7f7d88039b70 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.437+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(74 notify.3 [notify cookie 94064309112720 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.438+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== watch-notify(notify_complete (2) cookie 94064309112720 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7d8c014960 con 0x7f7d88039b70 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.438+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.438+0000 7f7d97f35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 : hit (requested=0x17, cached=0x17) 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.438+0000 7f7d97f35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.438+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 8.13 8:cdf3e8c0:root::.bucket.meta.myfoo6%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb8c50 con 0x7f7d8c031040 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(76 .bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v29'11 uv11 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7d97f35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 info.flags=0x17 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7d97f35800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 to cache LRU end 2024-04-26T07:55:34.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7d97f35800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7d97f35800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9, ofs0, ns] 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94064309112720 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb5bd0 con 0x7f7d88039b70 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== watch-notify(notify (1) cookie 94064308860688 notify 124554051608 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f7d8c014960 con 0x7f7d88039b70 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7c727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94064308860688 notifier 4724 bl.length()=748 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7c727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 info.flags=0x17 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7c727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 to cache LRU end 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7c727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7c727fc640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7bc8003510 con 0x7f7d88039b70 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.439+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(77 notify.0 [notify cookie 94064309112720 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== watch-notify(notify_complete (2) cookie 94064309112720 notify 124554051608 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7d8c043420 con 0x7f7d88039b70 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d97f35800 20 handle_bi_update(): bucket=:myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]): orig_sources= new_sources= 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d97f35800 20 handle_bi_update(): bucket=:myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]): potential sources added=[] removed=[] 2024-04-26T07:55:34.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d97f35800 20 handle_bi_update(): bucket=:myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]): orig_dests= new_dests= 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d97f35800 20 handle_bi_update(): bucket=:myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]): potential dests added=[] removed=[] 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:79 4.37 4:ed25d90e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1440 con 0x7f7d8c031040 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(79 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.440+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:80 4.39 4:9f443483:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1440 con 0x558d0db6f1b0 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.441+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(80 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.441+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 4.12 4:4b9c6ce6:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1870 con 0x558d0db68f60 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.441+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(81 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d84075030 con 0x558d0db68f60 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.441+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:82 4.3f 4:ffa10de2:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1870 con 0x7f7d88039b70 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.441+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(82 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.441+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 4.1b 4:db919db8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1870 con 0x7f7d88039b70 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.442+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(83 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.442+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:84 4.13 4:cb192139:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1870 con 0x7f7d88039b70 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.442+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(84 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.442+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:85 4.3e 4:7ef516d8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1870 con 0x7f7d88039b70 2024-04-26T07:55:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.442+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(85 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.442+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:86 4.13 4:c90c768a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1870 con 0x7f7d88039b70 2024-04-26T07:55:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.443+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(86 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.443+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:87 4.37 4:ed7f502d:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb1870 con 0x7f7d8c031040 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.443+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(87 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7d84075030 con 0x7f7d8c031040 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.443+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb17e0 con 0x7f7d8c031040 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.444+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(88 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [call out=378b] v0'0 uv3 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.444+0000 7f7d97f35800 10 cls_bucket_list_unordered: got thirteen 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.444+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 4.30 4:0f0889b7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb17e0 con 0x558d0db6f1b0 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.444+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(89 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.444+0000 7f7d97f35800 20 get_obj_state: octx=0x7f7d84089040 obj=myfoo6:thirteen state=0x558d0dbbaed8 s->prefetch_data=0 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.444+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:90 3.1cs0 3:3b7cb4bb:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb0f90 con 0x558d0db68f60 2024-04-26T07:55:34.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(90 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f7d840a4040 con 0x558d0db68f60 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 10 manifest: total_size = 8 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 get_obj_state: setting s->obj_tag to 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.17399693758932845969 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 Read xattr rgw_rados: user.rgw.acl 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 Read xattr rgw_rados: user.rgw.content_type 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 Read xattr rgw_rados: user.rgw.etag 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 Read xattr rgw_rados: user.rgw.idtag 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 Read xattr rgw_rados: user.rgw.manifest 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 get_obj_state: octx=0x7f7d84089040 obj=myfoo6:thirteen state=0x558d0dbbaed8 s->prefetch_data=0 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 : hit (requested=0x17, cached=0x17) 2024-04-26T07:55:34.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.445+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:91 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbc01b0 con 0x7f7d8c031040 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.446+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(91 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [stat,call,call] v29'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.446+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:92 3.1cs0 3:3b7cb4bb:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbe2f0 con 0x558d0db68f60 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.447+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(92 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v29'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x558d0db68f60 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.448+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:93 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbf7f0 con 0x7f7d8c031040 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:1 objects processed in :myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9]). Next marker thirteen 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.448+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbf950 con 0x7f7d88039b70 2024-04-26T07:55:34.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.450+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(93 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [stat,call,call] v29'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.450+0000 7f7c72ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.450+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v29'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.450+0000 7f7d97f35800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.450+0000 7f7d97f35800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.450+0000 7f7d97f35800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.450+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94064309128896 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbf950 con 0x7f7d8c031040 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== watch-notify(notify (1) cookie 94064308878960 notify 124554051616 ret 0) ==== 598+0+0 (crc 0 0 0) 0x558d0dbb9760 con 0x7f7d8c031040 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7c727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051616 cookie 94064308878960 notifier 4724 bl.length()=556 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7c727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7c727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7c727fc640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7bc8003570 con 0x7f7d8c031040 2024-04-26T07:55:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(95 notify.5 [notify cookie 94064309128896 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== watch-notify(notify_complete (2) cookie 94064309128896 notify 124554051616 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d0dbb2840 con 0x7f7d8c031040 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.451+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb4e90 con 0x558d0db68f60 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.452+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x558d0db68f60 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.452+0000 7f7d97f35800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.452+0000 7f7d97f35800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.452+0000 7f7d97f35800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.452+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94064309128848 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbbf950 con 0x7f7d8c031040 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== watch-notify(notify (1) cookie 94064308878960 notify 124554051617 ret 0) ==== 219+0+0 (crc 0 0 0) 0x558d0dbb2840 con 0x7f7d8c031040 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7c72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051617 cookie 94064308878960 notifier 4724 bl.length()=177 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7c72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T07:55:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7c72ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7c72ffd640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7c58003ea0 con 0x7f7d8c031040 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(98 notify.5 [notify cookie 94064309128848 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== watch-notify(notify_complete (2) cookie 94064309128848 notify 124554051617 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d0dbb4140 con 0x7f7d8c031040 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7d97f35800 10 removing user index: bar 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.453+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb4e90 con 0x7f7d8c031040 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.454+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(100 bar [delete] v29'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.454+0000 7f7d97f35800 10 removing default.rgw.meta+users.uid+bar from cache 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.454+0000 7f7d97f35800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.454+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94064309172560 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d0dbb4e90 con 0x7f7d8c031040 2024-04-26T07:55:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.454+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== watch-notify(notify (1) cookie 94064308883888 notify 124554051618 ret 0) ==== 194+0+0 (crc 0 0 0) 0x558d0dbb4140 con 0x7f7d8c031040 2024-04-26T07:55:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.454+0000 7f7c727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051618 cookie 94064308883888 notifier 4724 bl.length()=152 2024-04-26T07:55:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.454+0000 7f7c727fc640 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7bc8003570 con 0x7f7d8c031040 2024-04-26T07:55:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.454+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== osd_op_reply(101 notify.7 [notify cookie 94064309172560 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.455+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.455+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 41 ==== watch-notify(notify_complete (2) cookie 94064309172560 notify 124554051618 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d0db2ee80 con 0x7f7d8c031040 2024-04-26T07:55:34.462 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-26T07:55:34.267621Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:55:34.267607Z","tags":[],"group_ids":[]} 2024-04-26T07:55:34.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.456+0000 7f7c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:34.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.456+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94064308885120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x558d0db68f60 2024-04-26T07:55:34.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.457+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94064308885120] v29'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x558d0db68f60 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.457+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94064308860688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x7f7d88039b70 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.458+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94064308860688] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.458+0000 7f7d97f35800 20 remove_watcher() i=0 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.458+0000 7f7d97f35800 2 removed watcher, disabling cache 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.458+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94064308864944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x558d0db68f60 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.459+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94064308864944] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x558d0db68f60 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.459+0000 7f7d97f35800 20 remove_watcher() i=1 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.459+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94064308868800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x558d0db6f1b0 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.460+0000 7f7d933b4640 1 -- 172.21.15.62:0/2376705183 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94064308868800] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88034070 con 0x558d0db6f1b0 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.460+0000 7f7d97f35800 20 remove_watcher() i=2 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.460+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94064308873744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x7f7d88039b70 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.461+0000 7f7d943b6640 1 -- 172.21.15.62:0/2376705183 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94064308873744] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c040040 con 0x7f7d88039b70 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.461+0000 7f7d97f35800 20 remove_watcher() i=3 2024-04-26T07:55:34.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.461+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94064308866000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x558d0db68f60 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.463+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94064308866000] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x558d0db68f60 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.463+0000 7f7d97f35800 20 remove_watcher() i=4 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.463+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94064308878960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x7f7d8c031040 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.464+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 42 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94064308878960] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.464+0000 7f7d97f35800 20 remove_watcher() i=5 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.464+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94064308880016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x7f7d8c031040 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.465+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 43 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94064308880016] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.465+0000 7f7d97f35800 20 remove_watcher() i=6 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.465+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94064308883888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d0db98a50 con 0x7f7d8c031040 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 <== osd.0 v2:172.21.15.1:6800/3827982423 44 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94064308883888] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d840a4040 con 0x7f7d8c031040 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 20 remove_watcher() i=7 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7d8c031040 msgr2=0x7f7d8c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7d8c031040 0x7f7d8c032940 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0db68f60 msgr2=0x558d0db6b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0db68f60 0x558d0db6b420 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7d88039b70 msgr2=0x7f7d8803f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7d88039b70 0x7f7d8803f9c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558d0db6f1b0 msgr2=0x558d0db715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558d0db6f1b0 0x558d0db715a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c5c036e60 msgr2=0x7f7c5c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c5c036e60 0x7f7c5c039320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x558d0db32e10 tx=0x7f7d8c01f000 comp rx=0 tx=0).stop 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d93bb5640 1 -- 172.21.15.62:0/2376705183 reap_dead start 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 msgr2=0x558d0db5d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.466+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db5d650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800dcc0 tx=0x7f7d8804d4c0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 shutdown_connections 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 --2- 172.21.15.62:0/2376705183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0db55fc0 0x558d0db5d650 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 >> 172.21.15.62:0/2376705183 conn(0x558d0db52320 msgr2=0x558d0db4f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 shutdown_connections 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/2376705183 wait complete. 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/4106257019 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c6c036e60 msgr2=0x7f7c6c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 --2- 172.21.15.62:0/4106257019 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c6c036e60 0x7f7c6c039320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x558d0db36b20 tx=0x7f7d8c005840 comp rx=0 tx=0).stop 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/4106257019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da35d20 msgr2=0x558d0da34190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 --2- 172.21.15.62:0/4106257019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da35d20 0x558d0da34190 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7d88001ed0 tx=0x7f7d8800d7a0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/4106257019 shutdown_connections 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 --2- 172.21.15.62:0/4106257019 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c6c036e60 0x7f7c6c039320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 --2- 172.21.15.62:0/4106257019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da35d20 0x558d0da34190 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/4106257019 >> 172.21.15.62:0/4106257019 conn(0x558d0db3ab30 msgr2=0x558d0db3af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/4106257019 shutdown_connections 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/4106257019 wait complete. 2024-04-26T07:55:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0da38ad0 msgr2=0x558d0db358f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0da38ad0 0x558d0db358f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c7c036e60 msgr2=0x7f7c7c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c7c036e60 0x7f7c7c039320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f60 tx=0x7f7d880012b0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 msgr2=0x558d0db2e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.467+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db2e6b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400a470 tx=0x7f7d84003020 comp rx=0 tx=0).stop 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.468+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 shutdown_connections 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.468+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x558d0da38ad0 0x558d0db358f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.468+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c7c036e60 0x7f7c7c039320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.468+0000 7f7d97f35800 1 --2- 172.21.15.62:0/3969778043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d0da361a0 0x558d0db2e6b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.468+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 >> 172.21.15.62:0/3969778043 conn(0x558d0da2fbb0 msgr2=0x558d0db20de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.468+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 shutdown_connections 2024-04-26T07:55:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:34.468+0000 7f7d97f35800 1 -- 172.21.15.62:0/3969778043 wait complete. 2024-04-26T07:55:34.474 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-26T07:55:34.267621Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:55:34.267607Z', 'tags': [], 'group_ids': []} 2024-04-26T07:55:39.482 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:55:39.482 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-26T07:55:39.482 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-26T07:55:39.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-26T07:55:39.482 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-04-26T07:55:39.543 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:39.543 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:39.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.546+0000 7f1fbe098800 1 Processor -- start 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.546+0000 7f1fbe098800 1 -- start start 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.546+0000 7f1fbe098800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f67256d9c0 0x55f67256dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.546+0000 7f1fbe098800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f67256e460 con 0x55f67256eae0 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.546+0000 7f1fbe098800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55f67240de20 con 0x55f67256d9c0 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.547+0000 7f1fbbb9e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f67256d9c0 0x55f67256dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.547+0000 7f1fbbb9e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f67256d9c0 0x55f67256dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35056/0 (socket says 172.21.15.62:35056) 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.547+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/2176449163 learned_addr learned my addr 172.21.15.62:0/2176449163 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.547+0000 7f1fbb39d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55f67256eae0 0x55f67256ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43532/0 (socket says 172.21.15.62:43532) 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.547+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/2176449163 >> v1:172.21.15.1:6789/0 conn(0x55f67256eae0 legacy=0x55f67256ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.547+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/2176449163 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f67256f6a0 con 0x55f67256d9c0 2024-04-26T07:55:39.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.549+0000 7f1fbbb9e640 1 --2- 172.21.15.62:0/2176449163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67256dde0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00a520 tx=0x7f1fac01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f38a932a4f673d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.549+0000 7f1fbab9c640 1 -- 172.21.15.62:0/2176449163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fac057070 con 0x55f67256d9c0 2024-04-26T07:55:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.549+0000 7f1fbab9c640 1 -- 172.21.15.62:0/2176449163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac052570 con 0x55f67256d9c0 2024-04-26T07:55:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.549+0000 7f1fbab9c640 1 -- 172.21.15.62:0/2176449163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fac052870 con 0x55f67256d9c0 2024-04-26T07:55:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.550+0000 7f1fbe098800 1 -- 172.21.15.62:0/2176449163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 msgr2=0x55f67256dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.550+0000 7f1fbe098800 1 --2- 172.21.15.62:0/2176449163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67256dde0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00a520 tx=0x7f1fac01d010 comp rx=0 tx=0).stop 2024-04-26T07:55:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.550+0000 7f1fbe098800 1 -- 172.21.15.62:0/2176449163 shutdown_connections 2024-04-26T07:55:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.550+0000 7f1fbe098800 1 --2- 172.21.15.62:0/2176449163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67256dde0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.550+0000 7f1fbe098800 1 -- 172.21.15.62:0/2176449163 >> 172.21.15.62:0/2176449163 conn(0x55f6724e0fd0 msgr2=0x55f67256b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.550+0000 7f1fbe098800 1 -- 172.21.15.62:0/2176449163 shutdown_connections 2024-04-26T07:55:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.550+0000 7f1fbe098800 1 -- 172.21.15.62:0/2176449163 wait complete. 2024-04-26T07:55:39.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.564+0000 7f1fbe098800 1 Processor -- start 2024-04-26T07:55:39.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.564+0000 7f1fbe098800 1 -- start start 2024-04-26T07:55:39.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.565+0000 7f1fbe098800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67265f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.565+0000 7f1fbe098800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f6724b6d30 con 0x55f67256d9c0 2024-04-26T07:55:39.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.565+0000 7f1fbbb9e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67265f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.565+0000 7f1fbbb9e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67265f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35068/0 (socket says 172.21.15.62:35068) 2024-04-26T07:55:39.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.565+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/1584986495 learned_addr learned my addr 172.21.15.62:0/1584986495 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.565+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/1584986495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f67265f650 con 0x55f67256d9c0 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.566+0000 7f1fbbb9e640 1 --2- 172.21.15.62:0/1584986495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67265f080 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1fac055040 tx=0x7f1fac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204ac155168b05fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.566+0000 7f1ea9e0b640 1 -- 172.21.15.62:0/1584986495 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fac057040 con 0x55f67256d9c0 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.566+0000 7f1ea9e0b640 1 -- 172.21.15.62:0/1584986495 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac052850 con 0x55f67256d9c0 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.566+0000 7f1ea9e0b640 1 -- 172.21.15.62:0/1584986495 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fac052b50 con 0x55f67256d9c0 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 -- 172.21.15.62:0/1584986495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 msgr2=0x55f67265f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 --2- 172.21.15.62:0/1584986495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67265f080 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1fac055040 tx=0x7f1fac04c000 comp rx=0 tx=0).stop 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 -- 172.21.15.62:0/1584986495 shutdown_connections 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 --2- 172.21.15.62:0/1584986495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f67265f080 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 -- 172.21.15.62:0/1584986495 >> 172.21.15.62:0/1584986495 conn(0x55f6724e0fd0 msgr2=0x55f67265a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 -- 172.21.15.62:0/1584986495 shutdown_connections 2024-04-26T07:55:39.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 -- 172.21.15.62:0/1584986495 wait complete. 2024-04-26T07:55:39.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 Processor -- start 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 -- start start 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f672666aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.567+0000 7f1fbe098800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f672576fb0 con 0x55f67256d9c0 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1fbbb9e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f672666aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1fbbb9e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f672666aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35084/0 (socket says 172.21.15.62:35084) 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/872699201 learned_addr learned my addr 172.21.15.62:0/872699201 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/872699201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f672666fe0 con 0x55f67256d9c0 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1fbbb9e640 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f672666aa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00a520 tx=0x7f1fac003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1ea3fff640 1 -- 172.21.15.62:0/872699201 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fac073070 con 0x55f67256d9c0 2024-04-26T07:55:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1ea3fff640 1 -- 172.21.15.62:0/872699201 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac05d650 con 0x55f67256d9c0 2024-04-26T07:55:39.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1ea3fff640 1 -- 172.21.15.62:0/872699201 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fac057070 con 0x55f67256d9c0 2024-04-26T07:55:39.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f672667270 con 0x55f67256d9c0 2024-04-26T07:55:39.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.568+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f672669f20 con 0x55f67256d9c0 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.569+0000 7f1ea3fff640 1 -- 172.21.15.62:0/872699201 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1fac076070 con 0x55f67256d9c0 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.569+0000 7f1ea3fff640 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1ea4036e60 0x7f1ea4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.569+0000 7f1ea3fff640 1 -- 172.21.15.62:0/872699201 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f1fac08e5c0 con 0x55f67256d9c0 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.570+0000 7f1fbb39d640 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1ea4036e60 0x7f1ea4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.570+0000 7f1fbe098800 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67256eae0 0x55f67266dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.570+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f67266e270 con 0x55f67256eae0 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.570+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67256eae0 0x55f67266dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.570+0000 7f1fbb39d640 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1ea4036e60 0x7f1ea4039320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0000f60 tx=0x7f1fb0001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.570+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67256eae0 0x55f67266dce0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.571+0000 7f1fbc39f640 1 -- 172.21.15.62:0/872699201 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb400a4a0 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.571+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f67266b2b0 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.571+0000 7f1fbc39f640 1 -- 172.21.15.62:0/872699201 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fb400a4a0 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.571+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726700b0 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.571+0000 7f1fbc39f640 1 -- 172.21.15.62:0/872699201 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1fb400a4a0 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.571+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f67266f3f0 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.572+0000 7f1fbc39f640 1 -- 172.21.15.62:0/872699201 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fb400a4a0 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.572+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f67266f840 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.572+0000 7f1fbc39f640 1 -- 172.21.15.62:0/872699201 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1fb400a4a0 con 0x55f67256eae0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.572+0000 7f1fbe098800 1 Processor -- start 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.572+0000 7f1fbe098800 1 -- start start 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.572+0000 7f1fbe098800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67267ee80 0x55f67267f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.573+0000 7f1fbe098800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f67245e170 con 0x55f67267ee80 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.573+0000 7f1fbb39d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67267ee80 0x55f67267f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.573+0000 7f1fbb39d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67267ee80 0x55f67267f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35088/0 (socket says 172.21.15.62:35088) 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.573+0000 7f1fbb39d640 1 -- 172.21.15.62:0/944339664 learned_addr learned my addr 172.21.15.62:0/944339664 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.573+0000 7f1fbb39d640 1 -- 172.21.15.62:0/944339664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f67267f7e0 con 0x55f67267ee80 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.573+0000 7f1fbb39d640 1 --2- 172.21.15.62:0/944339664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67267ee80 0x55f67267f2a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0001ed0 tx=0x7f1fb000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.573+0000 7f1ea17fa640 1 -- 172.21.15.62:0/944339664 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb0022070 con 0x55f67267ee80 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.573+0000 7f1ea17fa640 1 -- 172.21.15.62:0/944339664 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb000d520 con 0x55f67267ee80 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.574+0000 7f1fbe098800 1 -- 172.21.15.62:0/944339664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f672680250 con 0x55f67267ee80 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.574+0000 7f1ea17fa640 1 -- 172.21.15.62:0/944339664 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb000d800 con 0x55f67267ee80 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.574+0000 7f1fbe098800 1 -- 172.21.15.62:0/944339664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f672680750 con 0x55f67267ee80 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1ea17fa640 1 -- 172.21.15.62:0/944339664 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1fb0025070 con 0x55f67267ee80 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1ea17fa640 1 --2- 172.21.15.62:0/944339664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e94036eb0 0x7f1e94039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1ea17fa640 1 -- 172.21.15.62:0/944339664 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f1fb004e460 con 0x55f67267ee80 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/944339664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e94036eb0 0x7f1e94039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1fbe098800 1 Processor -- start 2024-04-26T07:55:39.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1fbe098800 1 -- start start 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/944339664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e94036eb0 0x7f1e94039370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55f67266ef10 tx=0x7f1fb4005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1fbe098800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f67268c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.575+0000 7f1fbe098800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f67265f910 con 0x55f67268c180 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.576+0000 7f1fbb39d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f67268c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.576+0000 7f1fbb39d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f67268c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35092/0 (socket says 172.21.15.62:35092) 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.576+0000 7f1fbb39d640 1 -- 172.21.15.62:0/1375127715 learned_addr learned my addr 172.21.15.62:0/1375127715 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.576+0000 7f1fbb39d640 1 -- 172.21.15.62:0/1375127715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f67268cb70 con 0x55f67268c180 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.576+0000 7f1fbb39d640 1 --2- 172.21.15.62:0/1375127715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f67268c5a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000eee0 tx=0x7f1fb0024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c1b692fe6e66b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.576+0000 7f1e9affd640 1 -- 172.21.15.62:0/1375127715 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb0026730 con 0x55f67268c180 2024-04-26T07:55:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.576+0000 7f1e9affd640 1 -- 172.21.15.62:0/1375127715 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb004b1d0 con 0x55f67268c180 2024-04-26T07:55:39.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.576+0000 7f1e9affd640 1 -- 172.21.15.62:0/1375127715 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb00268d0 con 0x55f67268c180 2024-04-26T07:55:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 -- 172.21.15.62:0/1375127715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 msgr2=0x55f67268c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 --2- 172.21.15.62:0/1375127715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f67268c5a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000eee0 tx=0x7f1fb0024740 comp rx=0 tx=0).stop 2024-04-26T07:55:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 -- 172.21.15.62:0/1375127715 shutdown_connections 2024-04-26T07:55:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 --2- 172.21.15.62:0/1375127715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f67268c5a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 -- 172.21.15.62:0/1375127715 >> 172.21.15.62:0/1375127715 conn(0x55f6726884e0 msgr2=0x55f672686540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 -- 172.21.15.62:0/1375127715 shutdown_connections 2024-04-26T07:55:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 -- 172.21.15.62:0/1375127715 wait complete. 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 Processor -- start 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 -- start start 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f6726937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.577+0000 7f1fbe098800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f67268d2e0 con 0x55f67268c180 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.578+0000 7f1fbb39d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f6726937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.578+0000 7f1fbb39d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f6726937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35106/0 (socket says 172.21.15.62:35106) 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.578+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 learned_addr learned my addr 172.21.15.62:0/3951877329 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.578+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f672693d20 con 0x55f67268c180 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.578+0000 7f1fbb39d640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f6726937e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0024a50 tx=0x7f1fb004c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.579+0000 7f1e997fa640 1 -- 172.21.15.62:0/3951877329 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb002f070 con 0x55f67268c180 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.579+0000 7f1e997fa640 1 -- 172.21.15.62:0/3951877329 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb004b380 con 0x55f67268c180 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.579+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f672693d20 con 0x55f67268c180 2024-04-26T07:55:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.579+0000 7f1e997fa640 1 -- 172.21.15.62:0/3951877329 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb0025360 con 0x55f67268c180 2024-04-26T07:55:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.579+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f672693d20 con 0x55f67268c180 2024-04-26T07:55:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.579+0000 7f1e997fa640 1 -- 172.21.15.62:0/3951877329 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1fb003cd10 con 0x55f67268c180 2024-04-26T07:55:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.580+0000 7f1e997fa640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e84036e60 0x7f1e84039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.580+0000 7f1e997fa640 1 -- 172.21.15.62:0/3951877329 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f1fb001f080 con 0x55f67268c180 2024-04-26T07:55:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.580+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e84036e60 0x7f1e84039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.580+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e84036e60 0x7f1e84039320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55f672667cc0 tx=0x7f1fb401f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.580+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.580+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67269efa0 0x55f6726a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.580+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a1bb0 con 0x55f67269efa0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.580+0000 7f1fbbb9e640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67269efa0 0x55f6726a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbbb9e640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67269efa0 0x55f6726a1460 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 20 realm 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a1fc0 con 0x55f67269efa0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a2890 con 0x55f67269efa0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.581+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a2c30 con 0x55f67269efa0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbe098800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a3480 con 0x55f67269efa0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbe098800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbe098800 20 searching for the correct realm 2024-04-26T07:55:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f6726a51f0 0x55f6726a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbb39d640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f6726a51f0 0x55f6726a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.582+0000 7f1fbb39d640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f6726a51f0 0x55f6726a75e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.583+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.583+0000 7f1fbb39d640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1fb001ac20 0x7f1fb003b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.583+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb001ac20 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.583+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1fb001ac20 0x7f1fb003b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.583+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1fb001ac20 0x7f1fb003b0d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.584+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb401f070 con 0x7f1fb001ac20 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.584+0000 7f1fbc39f640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f1fb4031040 0x7f1fb4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.584+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb4031040 2024-04-26T07:55:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.584+0000 7f1fbbb9e640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f1fb4031040 0x7f1fb4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.585+0000 7f1fbbb9e640 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f1fb4031040 0x7f1fb4032940 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.585+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.585+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.585+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.585+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.585+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.585+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.586+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.586+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb4031040 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.586+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.586+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb001ac20 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.586+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb401f070 con 0x7f1fb001ac20 2024-04-26T07:55:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.586+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.587+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.587+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.587+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.587+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb4031040 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.587+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.587+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.588+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.588+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb001ac20 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.588+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1fb401f070 con 0x7f1fb001ac20 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.588+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.588+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.588+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.588+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.588+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb4031040 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.589+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.589+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.589+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.589+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.589+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.589+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.589+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.589+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.590+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.590+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb4031040 2024-04-26T07:55:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.590+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.590+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.590+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.590+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb001ac20 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.591+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb401f070 con 0x7f1fb001ac20 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.591+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.591+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.591+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb4031040 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.591+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.591+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.591+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.591+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb4031040 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.592+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.592+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb001ac20 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.592+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb401f070 con 0x7f1fb001ac20 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.592+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f6726a51f0 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.592+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.592+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb4031040 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x55f67269efa0 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a7bc0 con 0x7f1fb001ac20 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb401f070 con 0x7f1fb001ac20 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a3e00 con 0x55f67269efa0 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.593+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a46a0 con 0x55f67269efa0 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a46a0 con 0x55f67269efa0 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 20 zone default found 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 4 Realm: () 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 20 zonegroup default 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a8040 con 0x7f1fb4031040 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.594+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a9a80 con 0x55f6726a51f0 2024-04-26T07:55:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a9f90 con 0x55f6726a51f0 2024-04-26T07:55:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbe098800 20 started sync module instance, tier type = 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbe098800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.595+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a8ec0 con 0x7f1fb001ac20 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.596+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4040040 con 0x7f1fb001ac20 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.596+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94516969902768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aa8a0 con 0x7f1fb001ac20 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.596+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726ab0f0 con 0x55f67269efa0 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.597+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94516969902768] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4040040 con 0x7f1fb001ac20 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.598+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.598+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94516969907184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aad40 con 0x55f67269efa0 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.598+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726ab860 con 0x55f6726a51f0 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.599+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94516969907184] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.599+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.599+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94516969911088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726abc50 con 0x55f6726a51f0 2024-04-26T07:55:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.599+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726ac650 con 0x7f1fb001ac20 2024-04-26T07:55:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.600+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4040040 con 0x7f1fb001ac20 2024-04-26T07:55:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.600+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94516969914720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726acef0 con 0x7f1fb001ac20 2024-04-26T07:55:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.600+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726ad9f0 con 0x55f67269efa0 2024-04-26T07:55:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.600+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94516969911088] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.601+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94516969914720] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4040040 con 0x7f1fb001ac20 2024-04-26T07:55:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.602+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.602+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94516969919712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aca40 con 0x55f67269efa0 2024-04-26T07:55:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.602+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726ae290 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.603+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94516969919712] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.603+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.603+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94516969908240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aca40 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.603+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726ae8a0 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.604+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94516969908240] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.604+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.605+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94516969921760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726ae8a0 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.605+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726af2a0 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94516969921760] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94516969923456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726af260 con 0x7f1fb4031040 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbe098800 20 add_watcher() i=0 2024-04-26T07:55:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbe098800 20 add_watcher() i=1 2024-04-26T07:55:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbe098800 20 add_watcher() i=2 2024-04-26T07:55:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbe098800 20 add_watcher() i=3 2024-04-26T07:55:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbe098800 20 add_watcher() i=4 2024-04-26T07:55:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbe098800 20 add_watcher() i=5 2024-04-26T07:55:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.606+0000 7f1fbe098800 20 add_watcher() i=6 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.607+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94516969923456] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.607+0000 7f1fbe098800 20 add_watcher() i=7 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.607+0000 7f1fbe098800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.607+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726b2690 con 0x55f67269efa0 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.607+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.607+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94516969926528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726afb50 con 0x55f67269efa0 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.608+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94516969926528] v29'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1fbe098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1fbe098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1fbe098800 5 note: GC not initialized 2024-04-26T07:55:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1e70fe1640 20 reqs_thread_entry: start 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1fbe098800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1fbe098800 20 Filter name: none 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1dea7fc640 20 reqs_thread_entry: start 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1fbe098800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.609+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726e5ef0 con 0x7f1fb4031040 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726e4530 con 0x7f1fb4031040 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.610+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726e4dd0 con 0x7f1fb4031040 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.611+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v29'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.611+0000 7f1fbe098800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.611+0000 7f1fbe098800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.611+0000 7f1fbe098800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.611+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94516970146080 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726e9580 con 0x7f1fb4031040 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== watch-notify(notify (1) cookie 94516969908240 notify 124554051619 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55f6726e5940 con 0x7f1fb4031040 2024-04-26T07:55:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1e9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051619 cookie 94516969908240 notifier 4731 bl.length()=556 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1e9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1e9affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1e9affd640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1e80003ea0 con 0x7f1fb4031040 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(65 notify.5 [notify cookie 94516970146080 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== watch-notify(notify_complete (2) cookie 94516970146080 notify 124554051619 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1fac08b040 con 0x7f1fb4031040 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.612+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726e4e20 con 0x7f1fb4031040 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.613+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'12 uv12 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.613+0000 7f1fbe098800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1fbe098800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1fbe098800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94516970147232 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6726e99b0 con 0x55f6726a51f0 2024-04-26T07:55:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== watch-notify(notify (1) cookie 94516969911088 notify 124554051590 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f67268cb70 con 0x55f6726a51f0 2024-04-26T07:55:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1e9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94516969911088 notifier 4731 bl.length()=177 2024-04-26T07:55:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1e9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T07:55:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1e9a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T07:55:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(68 notify.2 [notify cookie 94516970147232 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1e9a7fc640 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1df0003400 con 0x55f6726a51f0 2024-04-26T07:55:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.614+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== watch-notify(notify_complete (2) cookie 94516970147232 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f672680750 con 0x55f6726a51f0 2024-04-26T07:55:39.625 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T07:55:39.611506Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:55:39.611492Z","tags":[],"group_ids":[]} 2024-04-26T07:55:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.615+0000 7f1e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.615+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94516969926528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726b2230 con 0x55f67269efa0 2024-04-26T07:55:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.616+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94516969926528] v29'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.616+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94516969902768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aef50 con 0x7f1fb001ac20 2024-04-26T07:55:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.617+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94516969902768] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4040040 con 0x7f1fb001ac20 2024-04-26T07:55:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.617+0000 7f1fbe098800 20 remove_watcher() i=0 2024-04-26T07:55:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.617+0000 7f1fbe098800 2 removed watcher, disabling cache 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.617+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94516969907184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726a92b0 con 0x55f67269efa0 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.619+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94516969907184] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.619+0000 7f1fbe098800 20 remove_watcher() i=1 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.619+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94516969911088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aa3f0 con 0x55f6726a51f0 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.620+0000 7f1fbb39d640 1 -- 172.21.15.62:0/3951877329 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94516969911088] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb0024030 con 0x55f6726a51f0 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.620+0000 7f1fbe098800 20 remove_watcher() i=2 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.620+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94516969914720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aa3f0 con 0x7f1fb001ac20 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.621+0000 7f1fbc39f640 1 -- 172.21.15.62:0/3951877329 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94516969914720] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4040040 con 0x7f1fb001ac20 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.621+0000 7f1fbe098800 20 remove_watcher() i=3 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.621+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94516969919712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aa3f0 con 0x55f67269efa0 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.622+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94516969919712] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x55f67269efa0 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.622+0000 7f1fbe098800 20 remove_watcher() i=4 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.622+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94516969908240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726aa3f0 con 0x7f1fb4031040 2024-04-26T07:55:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.623+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94516969908240] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.623+0000 7f1fbe098800 20 remove_watcher() i=5 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.623+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94516969921760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726ad4e0 con 0x7f1fb4031040 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.625+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94516969921760] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.625+0000 7f1fbe098800 20 remove_watcher() i=6 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.625+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94516969923456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6726adce0 con 0x7f1fb4031040 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94516969923456] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fac075030 con 0x7f1fb4031040 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 20 remove_watcher() i=7 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f1fb4031040 msgr2=0x7f1fb4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f1fb4031040 0x7f1fb4032940 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67269efa0 msgr2=0x55f6726a1460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67269efa0 0x55f6726a1460 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1fb001ac20 msgr2=0x7f1fb003b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f1fb001ac20 0x7f1fb003b0d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f6726a51f0 msgr2=0x55f6726a75e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f6726a51f0 0x55f6726a75e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e84036e60 msgr2=0x7f1e84039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e84036e60 0x7f1e84039320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55f672667cc0 tx=0x7f1fb401f000 comp rx=0 tx=0).stop 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 msgr2=0x55f6726937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbbb9e640 1 -- 172.21.15.62:0/3951877329 reap_dead start 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f6726937e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0024a50 tx=0x7f1fb004c6b0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 shutdown_connections 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 --2- 172.21.15.62:0/3951877329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67268c180 0x55f6726937e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 >> 172.21.15.62:0/3951877329 conn(0x55f6726884e0 msgr2=0x55f672685b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 shutdown_connections 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.626+0000 7f1fbe098800 1 -- 172.21.15.62:0/3951877329 wait complete. 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/944339664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e94036eb0 msgr2=0x7f1e94039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/944339664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e94036eb0 0x7f1e94039370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55f67266ef10 tx=0x7f1fb4005840 comp rx=0 tx=0).stop 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/944339664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67267ee80 msgr2=0x55f67267f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/944339664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67267ee80 0x55f67267f2a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0001ed0 tx=0x7f1fb000ea00 comp rx=0 tx=0).stop 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/944339664 shutdown_connections 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/944339664 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1e94036eb0 0x7f1e94039370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/944339664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67267ee80 0x55f67267f2a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/944339664 >> 172.21.15.62:0/944339664 conn(0x55f672672f20 msgr2=0x55f672673320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/944339664 shutdown_connections 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/944339664 wait complete. 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67256eae0 msgr2=0x55f67266dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67256eae0 0x55f67266dce0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1ea4036e60 msgr2=0x7f1ea4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1ea4036e60 0x7f1ea4039320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0000f60 tx=0x7f1fb0001370 comp rx=0 tx=0).stop 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 msgr2=0x55f672666aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f672666aa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00a520 tx=0x7f1fac003020 comp rx=0 tx=0).stop 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 shutdown_connections 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f67256eae0 0x55f67266dce0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1ea4036e60 0x7f1ea4039320 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 --2- 172.21.15.62:0/872699201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f67256d9c0 0x55f672666aa0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 >> 172.21.15.62:0/872699201 conn(0x55f6724e0fd0 msgr2=0x55f6726591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 shutdown_connections 2024-04-26T07:55:39.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.627+0000 7f1fbe098800 1 -- 172.21.15.62:0/872699201 wait complete. 2024-04-26T07:55:39.638 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T07:55:39.611506Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:55:39.611492Z', 'tags': [], 'group_ids': []} 2024-04-26T07:55:39.651 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:55:39.657 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-04-26T07:55:39.657 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-26T07:55:39.657 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-26T07:55:39.657 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-04-26T07:55:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.708+0000 7f15b6c3f800 1 Processor -- start 2024-04-26T07:55:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.708+0000 7f15b6c3f800 1 -- start start 2024-04-26T07:55:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.708+0000 7f15b6c3f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x561b91a37a10 0x561b91a39e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.708+0000 7f15b6c3f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561b91a3a3d0 con 0x561b91a33580 2024-04-26T07:55:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.708+0000 7f15b6c3f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x561b918d6e20 con 0x561b91a37a10 2024-04-26T07:55:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.709+0000 7f15b3f3d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x561b91a37a10 0x561b91a39e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.709+0000 7f15b3f3d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x561b91a37a10 0x561b91a39e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35110/0 (socket says 172.21.15.62:35110) 2024-04-26T07:55:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.709+0000 7f15b3f3d640 1 -- 172.21.15.62:0/360361037 learned_addr learned my addr 172.21.15.62:0/360361037 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.709+0000 7f15b473e640 1 --1- 172.21.15.62:0/360361037 >> v1:172.21.15.1:6789/0 conn(0x561b91a33580 0x561b91a339a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43538/0 (socket says 172.21.15.62:43538) 2024-04-26T07:55:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.709+0000 7f15b3f3d640 1 -- 172.21.15.62:0/360361037 >> v1:172.21.15.1:6789/0 conn(0x561b91a33580 legacy=0x561b91a339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.709+0000 7f15b3f3d640 1 -- 172.21.15.62:0/360361037 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b91a3b600 con 0x561b91a37a10 2024-04-26T07:55:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.711+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/360361037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a37a10 0x561b91a39e00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f15a800a520 tx=0x7f15a801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d45e5a9dabc1979 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.711+0000 7f15b373c640 1 -- 172.21.15.62:0/360361037 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8057070 con 0x561b91a37a10 2024-04-26T07:55:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.711+0000 7f15b373c640 1 -- 172.21.15.62:0/360361037 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8052570 con 0x561b91a37a10 2024-04-26T07:55:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.711+0000 7f15b373c640 1 -- 172.21.15.62:0/360361037 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a804ae60 con 0x561b91a37a10 2024-04-26T07:55:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.712+0000 7f15b6c3f800 1 -- 172.21.15.62:0/360361037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a37a10 msgr2=0x561b91a39e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.712+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/360361037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a37a10 0x561b91a39e00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f15a800a520 tx=0x7f15a801d010 comp rx=0 tx=0).stop 2024-04-26T07:55:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.712+0000 7f15b6c3f800 1 -- 172.21.15.62:0/360361037 shutdown_connections 2024-04-26T07:55:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.712+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/360361037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a37a10 0x561b91a39e00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.712+0000 7f15b6c3f800 1 -- 172.21.15.62:0/360361037 >> 172.21.15.62:0/360361037 conn(0x561b91a2ebe0 msgr2=0x561b91a31000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.712+0000 7f15b6c3f800 1 -- 172.21.15.62:0/360361037 shutdown_connections 2024-04-26T07:55:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.712+0000 7f15b6c3f800 1 -- 172.21.15.62:0/360361037 wait complete. 2024-04-26T07:55:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.724+0000 7f15b6c3f800 1 Processor -- start 2024-04-26T07:55:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.724+0000 7f15b6c3f800 1 -- start start 2024-04-26T07:55:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.724+0000 7f15b6c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b27ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.724+0000 7f15b6c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b9197fd00 con 0x561b91a33580 2024-04-26T07:55:39.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.725+0000 7f15b473e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b27ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.725+0000 7f15b473e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b27ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35112/0 (socket says 172.21.15.62:35112) 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.725+0000 7f15b473e640 1 -- 172.21.15.62:0/156206299 learned_addr learned my addr 172.21.15.62:0/156206299 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.725+0000 7f15b473e640 1 -- 172.21.15.62:0/156206299 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b91b28470 con 0x561b91a33580 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.725+0000 7f15b473e640 1 --2- 172.21.15.62:0/156206299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b27ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006e50 tx=0x7f15a4006f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f8073371653bc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f14a260c640 1 -- 172.21.15.62:0/156206299 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a4014440 con 0x561b91a33580 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f14a260c640 1 -- 172.21.15.62:0/156206299 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a40145e0 con 0x561b91a33580 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f14a260c640 1 -- 172.21.15.62:0/156206299 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a4014900 con 0x561b91a33580 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f15b6c3f800 1 -- 172.21.15.62:0/156206299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 msgr2=0x561b91b27ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/156206299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b27ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006e50 tx=0x7f15a4006f40 comp rx=0 tx=0).stop 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f15b6c3f800 1 -- 172.21.15.62:0/156206299 shutdown_connections 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/156206299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b27ea0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f15b6c3f800 1 -- 172.21.15.62:0/156206299 >> 172.21.15.62:0/156206299 conn(0x561b91a2ebe0 msgr2=0x561b91b1f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f15b6c3f800 1 -- 172.21.15.62:0/156206299 shutdown_connections 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.726+0000 7f15b6c3f800 1 -- 172.21.15.62:0/156206299 wait complete. 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.727+0000 7f15b6c3f800 1 Processor -- start 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.727+0000 7f15b6c3f800 1 -- start start 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.727+0000 7f15b6c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b2fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.727+0000 7f15b6c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b91a3a8a0 con 0x561b91a33580 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.727+0000 7f15b473e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b2fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.727+0000 7f15b473e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b2fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35116/0 (socket says 172.21.15.62:35116) 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.727+0000 7f15b473e640 1 -- 172.21.15.62:0/3695332118 learned_addr learned my addr 172.21.15.62:0/3695332118 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.727+0000 7f15b473e640 1 -- 172.21.15.62:0/3695332118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b91b2ff90 con 0x561b91a33580 2024-04-26T07:55:39.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.728+0000 7f15b473e640 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b2fa50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006e50 tx=0x7f15a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.728+0000 7f14a0e09640 1 -- 172.21.15.62:0/3695332118 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a4023020 con 0x561b91a33580 2024-04-26T07:55:39.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.728+0000 7f14a0e09640 1 -- 172.21.15.62:0/3695332118 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a401a040 con 0x561b91a33580 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.728+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b91b30220 con 0x561b91a33580 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.728+0000 7f14a0e09640 1 -- 172.21.15.62:0/3695332118 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a401f420 con 0x561b91a33580 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.728+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b91b32ed0 con 0x561b91a33580 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.729+0000 7f14a0e09640 1 -- 172.21.15.62:0/3695332118 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f15a4026020 con 0x561b91a33580 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.729+0000 7f14a0e09640 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f149c036e60 0x7f149c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.729+0000 7f14a0e09640 1 -- 172.21.15.62:0/3695332118 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f15a404cb40 con 0x561b91a33580 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.729+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f149c036e60 0x7f149c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.729+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91a37a10 0x561b91b36c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.729+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b37210 con 0x561b91a37a10 2024-04-26T07:55:39.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.729+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91a37a10 0x561b91b36c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.729+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f149c036e60 0x7f149c039320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f15a8054000 tx=0x7f15a804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.730+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91a37a10 0x561b91b36c90 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.730+0000 7f15b4f3f640 1 -- 172.21.15.62:0/3695332118 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15ac00a4a0 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.730+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b34260 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.730+0000 7f15b4f3f640 1 -- 172.21.15.62:0/3695332118 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15ac00a4a0 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.730+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b39030 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.730+0000 7f15b4f3f640 1 -- 172.21.15.62:0/3695332118 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f15ac00a4a0 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.730+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b38370 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.731+0000 7f15b4f3f640 1 -- 172.21.15.62:0/3695332118 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15ac00a4a0 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.731+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b387c0 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.731+0000 7f15b4f3f640 1 -- 172.21.15.62:0/3695332118 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f15ac00a4a0 con 0x561b91a37a10 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.731+0000 7f15b6c3f800 1 Processor -- start 2024-04-26T07:55:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.731+0000 7f15b6c3f800 1 -- start start 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.731+0000 7f15b6c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b47da0 0x561b91b481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.731+0000 7f15b6c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b91927170 con 0x561b91b47da0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f15b3f3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b47da0 0x561b91b481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f15b3f3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b47da0 0x561b91b481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35124/0 (socket says 172.21.15.62:35124) 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f15b3f3d640 1 -- 172.21.15.62:0/2798266397 learned_addr learned my addr 172.21.15.62:0/2798266397 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f15b3f3d640 1 -- 172.21.15.62:0/2798266397 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b91b48700 con 0x561b91b47da0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/2798266397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b47da0 0x561b91b481c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f15a804b010 tx=0x7f15a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f1499ffb640 1 -- 172.21.15.62:0/2798266397 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8057040 con 0x561b91b47da0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f1499ffb640 1 -- 172.21.15.62:0/2798266397 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a805d900 con 0x561b91b47da0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f15b6c3f800 1 -- 172.21.15.62:0/2798266397 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b91b49170 con 0x561b91b47da0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f1499ffb640 1 -- 172.21.15.62:0/2798266397 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a805dbe0 con 0x561b91b47da0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.732+0000 7f15b6c3f800 1 -- 172.21.15.62:0/2798266397 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b91b49610 con 0x561b91b47da0 2024-04-26T07:55:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.733+0000 7f1499ffb640 1 -- 172.21.15.62:0/2798266397 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f15a8067070 con 0x561b91b47da0 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.733+0000 7f1499ffb640 1 --2- 172.21.15.62:0/2798266397 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f148c036e60 0x7f148c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.733+0000 7f1499ffb640 1 -- 172.21.15.62:0/2798266397 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f15a808ff20 con 0x561b91b47da0 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.733+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/2798266397 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f148c036e60 0x7f148c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.734+0000 7f15b6c3f800 1 Processor -- start 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.734+0000 7f15b6c3f800 1 -- start start 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.734+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/2798266397 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f148c036e60 0x7f148c039320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x561b91b37e90 tx=0x7f15ac005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.734+0000 7f15b6c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.734+0000 7f15b6c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b91b287f0 con 0x561b91b54fa0 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.734+0000 7f15b3f3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.734+0000 7f15b3f3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35136/0 (socket says 172.21.15.62:35136) 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.734+0000 7f15b3f3d640 1 -- 172.21.15.62:0/340676658 learned_addr learned my addr 172.21.15.62:0/340676658 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b3f3d640 1 -- 172.21.15.62:0/340676658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b91b55990 con 0x561b91b54fa0 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/340676658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b553c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f15a808e1d0 tx=0x7f15a805b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd19d69a024c3963 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f14937fe640 1 -- 172.21.15.62:0/340676658 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8070520 con 0x561b91b54fa0 2024-04-26T07:55:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f14937fe640 1 -- 172.21.15.62:0/340676658 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8071ca0 con 0x561b91b54fa0 2024-04-26T07:55:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f14937fe640 1 -- 172.21.15.62:0/340676658 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8006380 con 0x561b91b54fa0 2024-04-26T07:55:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b6c3f800 1 -- 172.21.15.62:0/340676658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 msgr2=0x561b91b553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/340676658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b553c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f15a808e1d0 tx=0x7f15a805b4b0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b6c3f800 1 -- 172.21.15.62:0/340676658 shutdown_connections 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/340676658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b553c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b6c3f800 1 -- 172.21.15.62:0/340676658 >> 172.21.15.62:0/340676658 conn(0x561b91b51300 msgr2=0x561b91b4f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b6c3f800 1 -- 172.21.15.62:0/340676658 shutdown_connections 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.735+0000 7f15b6c3f800 1 -- 172.21.15.62:0/340676658 wait complete. 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.736+0000 7f15b6c3f800 1 Processor -- start 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.736+0000 7f15b6c3f800 1 -- start start 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.736+0000 7f15b6c3f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b5c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.736+0000 7f15b6c3f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b91b56100 con 0x561b91b54fa0 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.736+0000 7f15b3f3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b5c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.736+0000 7f15b3f3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b5c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35142/0 (socket says 172.21.15.62:35142) 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.736+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 learned_addr learned my addr 172.21.15.62:0/297566597 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.736+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b91b5cb60 con 0x561b91b54fa0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.737+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b5c620 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006910 tx=0x7f15a808e130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.737+0000 7f1491ffb640 1 -- 172.21.15.62:0/297566597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8099070 con 0x561b91b54fa0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.737+0000 7f1491ffb640 1 -- 172.21.15.62:0/297566597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8071400 con 0x561b91b54fa0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.737+0000 7f1491ffb640 1 -- 172.21.15.62:0/297566597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8071720 con 0x561b91b54fa0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.737+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b91b5cdf0 con 0x561b91b54fa0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.737+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b91b5faa0 con 0x561b91b54fa0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.738+0000 7f1491ffb640 1 -- 172.21.15.62:0/297566597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f15a809c070 con 0x561b91b54fa0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.738+0000 7f1491ffb640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1484036e60 0x7f1484039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.738+0000 7f1491ffb640 1 -- 172.21.15.62:0/297566597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f15a809fd50 con 0x561b91b54fa0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.738+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1484036e60 0x7f1484039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.738+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1484036e60 0x7f1484039320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x561b91b341b0 tx=0x7f15ac01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.738+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.738+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91b68110 0x561b91b6a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.738+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b6ad20 con 0x561b91b68110 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b473e640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91b68110 0x561b91b6a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b473e640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91b68110 0x561b91b6a5d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 20 realm 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b6b130 con 0x561b91b68110 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b6ba00 con 0x561b91b68110 2024-04-26T07:55:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.739+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b6bda0 con 0x561b91b68110 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b6c3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b6c5f0 con 0x561b91b68110 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b6c3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b6c3f800 20 searching for the correct realm 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561b91b6e360 0x561b91b70750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561b91b6e360 0x561b91b70750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.740+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561b91b6e360 0x561b91b70750 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.741+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.741+0000 7f15b3f3d640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f15a809e060 0x7f15a8086430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.741+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15a809e060 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.741+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f15a809e060 0x7f15a8086430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.741+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f15a809e060 0x7f15a8086430 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.742+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15ac01f070 con 0x7f15a809e060 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.742+0000 7f15b4f3f640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f15ac031040 0x7f15ac032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.742+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15ac031040 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.742+0000 7f15b473e640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f15ac031040 0x7f15ac032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.742+0000 7f15b473e640 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f15ac031040 0x7f15ac032940 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.743+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.743+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.743+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.743+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.743+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.743+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.743+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.743+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15ac031040 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.744+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.744+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15a809e060 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.744+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15ac01f070 con 0x7f15a809e060 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.744+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.744+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.744+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.744+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.744+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15ac031040 2024-04-26T07:55:39.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.745+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.745+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.745+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.745+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15a809e060 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.745+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f15ac01f070 con 0x7f15a809e060 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.745+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.745+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.745+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.746+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.746+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15ac031040 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.746+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.746+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.746+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.746+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.746+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.746+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.747+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.747+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.747+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.747+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15ac031040 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.747+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.747+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.747+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.748+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15a809e060 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.748+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15ac01f070 con 0x7f15a809e060 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.748+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.748+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.748+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15ac031040 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.748+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.748+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.749+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.749+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15ac031040 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.749+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.749+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15a809e060 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.749+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15ac01f070 con 0x7f15a809e060 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.749+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b6e360 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.750+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.750+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15ac031040 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.750+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.750+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x561b91b68110 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.750+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.750+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561b91b70d80 con 0x7f15a809e060 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15ac01f070 con 0x7f15a809e060 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b6cf70 con 0x561b91b68110 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b6d810 con 0x561b91b68110 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b6d810 con 0x561b91b68110 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 zone default found 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 4 Realm: () 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 zonegroup default 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.751+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b71200 con 0x7f15ac031040 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b72c30 con 0x561b91b6e360 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b730c0 con 0x561b91b6e360 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 20 started sync module instance, tier type = 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.752+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b72080 con 0x7f15a809e060 2024-04-26T07:55:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.753+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15ac040040 con 0x7f15a809e060 2024-04-26T07:55:39.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.753+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94676408804464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b71ce0 con 0x7f15a809e060 2024-04-26T07:55:39.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.753+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b73ff0 con 0x561b91b68110 2024-04-26T07:55:39.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.754+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94676408804464] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15ac040040 con 0x7f15a809e060 2024-04-26T07:55:39.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.755+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.755+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94676408808736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b73ff0 con 0x561b91b68110 2024-04-26T07:55:39.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.755+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b749f0 con 0x561b91b6e360 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.756+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94676408808736] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.756+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.756+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94676408810304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b73f60 con 0x561b91b6e360 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.756+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b758b0 con 0x7f15a809e060 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.757+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15ac040040 con 0x7f15a809e060 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.757+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94676408817120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b760b0 con 0x7f15a809e060 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.757+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b76bd0 con 0x561b91b68110 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.757+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94676408810304] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.758+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.759+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94676408821408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b76b90 con 0x561b91b68110 2024-04-26T07:55:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.759+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b77610 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.759+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94676408817120] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15ac040040 con 0x7f15a809e060 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.760+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.760+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94676408818432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b77610 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.760+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b78050 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.760+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94676408821408] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.761+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94676408818432] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.761+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.761+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94676408824160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b77ba0 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.761+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b78560 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94676408824160] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94676408815072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b78560 con 0x7f15ac031040 2024-04-26T07:55:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b6c3f800 20 add_watcher() i=0 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b6c3f800 20 add_watcher() i=1 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b6c3f800 20 add_watcher() i=2 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b6c3f800 20 add_watcher() i=3 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b6c3f800 20 add_watcher() i=4 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b6c3f800 20 add_watcher() i=5 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.762+0000 7f15b6c3f800 20 add_watcher() i=6 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.763+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94676408815072] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.763+0000 7f15b6c3f800 20 add_watcher() i=7 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.763+0000 7f15b6c3f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.763+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91b7b820 con 0x561b91b68110 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.764+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.764+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94676408828448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b78af0 con 0x561b91b68110 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.765+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94676408828448] v29'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.765+0000 7f146a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.765+0000 7f15b6c3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.765+0000 7f15b6c3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.765+0000 7f15b6c3f800 5 note: GC not initialized 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.765+0000 7f14697e2640 20 reqs_thread_entry: start 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.765+0000 7f15b6c3f800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.765+0000 7f15b6c3f800 20 Filter name: none 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f13daffd640 20 reqs_thread_entry: start 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b6c3f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b6c3f800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561b91baf050 con 0x7f15a809e060 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f15ac040040 con 0x7f15a809e060 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b6c3f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:55:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b6c3f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b6c3f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b6c3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.766+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91bb3450 con 0x7f15ac031040 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.767+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v29'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.768+0000 7f146a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.768+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94676408828448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b7aa80 con 0x561b91b68110 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.769+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94676408828448] v29'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.769+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94676408804464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b78220 con 0x7f15a809e060 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.770+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94676408804464] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15ac040040 con 0x7f15a809e060 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.770+0000 7f15b6c3f800 20 remove_watcher() i=0 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.770+0000 7f15b6c3f800 2 removed watcher, disabling cache 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.770+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94676408808736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b78220 con 0x561b91b68110 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.772+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94676408808736] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.772+0000 7f15b6c3f800 20 remove_watcher() i=1 2024-04-26T07:55:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.772+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94676408810304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b73520 con 0x561b91b6e360 2024-04-26T07:55:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.773+0000 7f15b3f3d640 1 -- 172.21.15.62:0/297566597 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94676408810304] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a809b030 con 0x561b91b6e360 2024-04-26T07:55:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.773+0000 7f15b6c3f800 20 remove_watcher() i=2 2024-04-26T07:55:39.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.773+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94676408817120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b78220 con 0x7f15a809e060 2024-04-26T07:55:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.774+0000 7f15b4f3f640 1 -- 172.21.15.62:0/297566597 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94676408817120] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15ac040040 con 0x7f15a809e060 2024-04-26T07:55:39.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.774+0000 7f15b6c3f800 20 remove_watcher() i=3 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.774+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94676408821408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b73b40 con 0x561b91b68110 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.775+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94676408821408] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x561b91b68110 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.775+0000 7f15b6c3f800 20 remove_watcher() i=4 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.775+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94676408818432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b78220 con 0x7f15ac031040 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.776+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94676408818432] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.776+0000 7f15b6c3f800 20 remove_watcher() i=5 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.776+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94676408824160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b766a0 con 0x7f15ac031040 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.777+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94676408824160] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.777+0000 7f15b6c3f800 20 remove_watcher() i=6 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.777+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94676408815072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561b91b73b40 con 0x7f15ac031040 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94676408815072] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15a4008400 con 0x7f15ac031040 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 20 remove_watcher() i=7 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f15ac031040 msgr2=0x7f15ac032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f15ac031040 0x7f15ac032940 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91b68110 msgr2=0x561b91b6a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91b68110 0x561b91b6a5d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f15a809e060 msgr2=0x7f15a8086430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f15a809e060 0x7f15a8086430 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561b91b6e360 msgr2=0x561b91b70750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x561b91b6e360 0x561b91b70750 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1484036e60 msgr2=0x7f1484039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f1484036e60 0x7f1484039320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x561b91b341b0 tx=0x7f15ac01f000 comp rx=0 tx=0).stop 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 msgr2=0x561b91b5c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b5c620 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006910 tx=0x7f15a808e130 comp rx=0 tx=0).stop 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b473e640 1 -- 172.21.15.62:0/297566597 reap_dead start 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 shutdown_connections 2024-04-26T07:55:39.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/297566597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b54fa0 0x561b91b5c620 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 >> 172.21.15.62:0/297566597 conn(0x561b91b51300 msgr2=0x561b91b4e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 shutdown_connections 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/297566597 wait complete. 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/2798266397 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f148c036e60 msgr2=0x7f148c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/2798266397 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f148c036e60 0x7f148c039320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x561b91b37e90 tx=0x7f15ac005840 comp rx=0 tx=0).stop 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/2798266397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b47da0 msgr2=0x561b91b481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/2798266397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b47da0 0x561b91b481c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f15a804b010 tx=0x7f15a8002fb0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/2798266397 shutdown_connections 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/2798266397 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f148c036e60 0x7f148c039320 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/2798266397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91b47da0 0x561b91b481c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.779+0000 7f15b6c3f800 1 -- 172.21.15.62:0/2798266397 >> 172.21.15.62:0/2798266397 conn(0x561b91b3be40 msgr2=0x561b91b3c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/2798266397 shutdown_connections 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/2798266397 wait complete. 2024-04-26T07:55:39.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91a37a10 msgr2=0x561b91b36c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91a37a10 0x561b91b36c90 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f149c036e60 msgr2=0x7f149c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f149c036e60 0x7f149c039320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f15a8054000 tx=0x7f15a804e000 comp rx=0 tx=0).stop 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 msgr2=0x561b91b2fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b2fa50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006e50 tx=0x7f15a4000ed0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 shutdown_connections 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x561b91a37a10 0x561b91b36c90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f149c036e60 0x7f149c039320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 --2- 172.21.15.62:0/3695332118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b91a33580 0x561b91b2fa50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 >> 172.21.15.62:0/3695332118 conn(0x561b91a2ebe0 msgr2=0x561b91b1dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 shutdown_connections 2024-04-26T07:55:39.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.780+0000 7f15b6c3f800 1 -- 172.21.15.62:0/3695332118 wait complete. 2024-04-26T07:55:39.786 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T07:55:39.791 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:55:39.791 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-26T07:55:39.795 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-26T07:55:39.795 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-04-26T07:55:39.795 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-26T07:55:39.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-26T07:55:39.796 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-04-26T07:55:39.841 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:39.841 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff33d133800 1 Processor -- start 2024-04-26T07:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff33d133800 1 -- start start 2024-04-26T07:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff33d133800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55afbf3a9110 0x55afbf3ab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff33d133800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55afbf3af550 con 0x55afbf3aba40 2024-04-26T07:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff33d133800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55afbf24ae20 con 0x55afbf3a9110 2024-04-26T07:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff338ef2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55afbf3a9110 0x55afbf3ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff333fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55afbf3aba40 0x55afbf3ade30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43548/0 (socket says 172.21.15.62:43548) 2024-04-26T07:55:39.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff338ef2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55afbf3a9110 0x55afbf3ab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35148/0 (socket says 172.21.15.62:35148) 2024-04-26T07:55:39.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.844+0000 7ff333fff640 1 -- 172.21.15.62:0/248677555 learned_addr learned my addr 172.21.15.62:0/248677555 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:55:39.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.845+0000 7ff338ef2640 1 -- 172.21.15.62:0/248677555 >> v1:172.21.15.1:6789/0 conn(0x55afbf3aba40 legacy=0x55afbf3ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.845+0000 7ff338ef2640 1 -- 172.21.15.62:0/248677555 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbf3b0730 con 0x55afbf3a9110 2024-04-26T07:55:39.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff338ef2640 1 --2- 172.21.15.62:0/248677555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf3ab500 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00a470 tx=0x7ff32c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771f6d9d842f0a76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff3337fe640 1 -- 172.21.15.62:0/248677555 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32c057070 con 0x55afbf3a9110 2024-04-26T07:55:39.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff3337fe640 1 -- 172.21.15.62:0/248677555 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c052570 con 0x55afbf3a9110 2024-04-26T07:55:39.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff3337fe640 1 -- 172.21.15.62:0/248677555 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32c052870 con 0x55afbf3a9110 2024-04-26T07:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff33d133800 1 -- 172.21.15.62:0/248677555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 msgr2=0x55afbf3ab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff33d133800 1 --2- 172.21.15.62:0/248677555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf3ab500 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00a470 tx=0x7ff32c01ce90 comp rx=0 tx=0).stop 2024-04-26T07:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff33d133800 1 -- 172.21.15.62:0/248677555 shutdown_connections 2024-04-26T07:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff33d133800 1 --2- 172.21.15.62:0/248677555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf3ab500 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff33d133800 1 -- 172.21.15.62:0/248677555 >> 172.21.15.62:0/248677555 conn(0x55afbf3a2be0 msgr2=0x55afbf3a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff33d133800 1 -- 172.21.15.62:0/248677555 shutdown_connections 2024-04-26T07:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.847+0000 7ff33d133800 1 -- 172.21.15.62:0/248677555 wait complete. 2024-04-26T07:55:39.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.860+0000 7ff33d133800 1 Processor -- start 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.860+0000 7ff33d133800 1 -- start start 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.860+0000 7ff33d133800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf499c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.860+0000 7ff33d133800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55afbf2f3d00 con 0x55afbf3a9110 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.861+0000 7ff338ef2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf499c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.861+0000 7ff338ef2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf499c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35156/0 (socket says 172.21.15.62:35156) 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.861+0000 7ff338ef2640 1 -- 172.21.15.62:0/968505543 learned_addr learned my addr 172.21.15.62:0/968505543 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.861+0000 7ff338ef2640 1 -- 172.21.15.62:0/968505543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbf49a200 con 0x55afbf3a9110 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.861+0000 7ff338ef2640 1 --2- 172.21.15.62:0/968505543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf499c30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff32c01ced0 tx=0x7ff32c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8280b93a9800cbd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.861+0000 7ff226e05640 1 -- 172.21.15.62:0/968505543 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32c057040 con 0x55afbf3a9110 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.861+0000 7ff226e05640 1 -- 172.21.15.62:0/968505543 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c0529a0 con 0x55afbf3a9110 2024-04-26T07:55:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.861+0000 7ff226e05640 1 -- 172.21.15.62:0/968505543 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32c052cc0 con 0x55afbf3a9110 2024-04-26T07:55:39.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 -- 172.21.15.62:0/968505543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 msgr2=0x55afbf499c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 --2- 172.21.15.62:0/968505543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf499c30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff32c01ced0 tx=0x7ff32c04c000 comp rx=0 tx=0).stop 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 -- 172.21.15.62:0/968505543 shutdown_connections 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 --2- 172.21.15.62:0/968505543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf499c30 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 -- 172.21.15.62:0/968505543 >> 172.21.15.62:0/968505543 conn(0x55afbf3a2be0 msgr2=0x55afbf495550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 -- 172.21.15.62:0/968505543 shutdown_connections 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 -- 172.21.15.62:0/968505543 wait complete. 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 Processor -- start 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 -- start start 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf4a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.862+0000 7ff33d133800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55afbf3af9c0 con 0x55afbf3a9110 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff338ef2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf4a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff338ef2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf4a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35172/0 (socket says 172.21.15.62:35172) 2024-04-26T07:55:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff338ef2640 1 -- 172.21.15.62:0/2765349272 learned_addr learned my addr 172.21.15.62:0/2765349272 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff338ef2640 1 -- 172.21.15.62:0/2765349272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbf4a1bf0 con 0x55afbf3a9110 2024-04-26T07:55:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff338ef2640 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf4a16b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff32c000c00 tx=0x7ff32c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff225602640 1 -- 172.21.15.62:0/2765349272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32c073070 con 0x55afbf3a9110 2024-04-26T07:55:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff225602640 1 -- 172.21.15.62:0/2765349272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c05d780 con 0x55afbf3a9110 2024-04-26T07:55:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff225602640 1 -- 172.21.15.62:0/2765349272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32c057070 con 0x55afbf3a9110 2024-04-26T07:55:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.863+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afbf4a1e80 con 0x55afbf3a9110 2024-04-26T07:55:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.864+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbf4a4b30 con 0x55afbf3a9110 2024-04-26T07:55:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.864+0000 7ff225602640 1 -- 172.21.15.62:0/2765349272 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff32c076070 con 0x55afbf3a9110 2024-04-26T07:55:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.864+0000 7ff225602640 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff220036e60 0x7ff220039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff225602640 1 -- 172.21.15.62:0/2765349272 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff32c08e800 con 0x55afbf3a9110 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff333fff640 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff220036e60 0x7ff220039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff33d133800 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf3aba40 0x55afbf4a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4a8f10 con 0x55afbf3aba40 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff3396f3640 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf3aba40 0x55afbf4a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff333fff640 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff220036e60 0x7ff220039320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff324000f60 tx=0x7ff3240012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff3396f3640 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf3aba40 0x55afbf4a88f0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff3396f3640 1 -- 172.21.15.62:0/2765349272 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff33400a4a0 con 0x55afbf3aba40 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.865+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4a5ec0 con 0x55afbf3aba40 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.866+0000 7ff3396f3640 1 -- 172.21.15.62:0/2765349272 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff33400a4a0 con 0x55afbf3aba40 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.866+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4aad00 con 0x55afbf3aba40 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.866+0000 7ff3396f3640 1 -- 172.21.15.62:0/2765349272 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff33400a4a0 con 0x55afbf3aba40 2024-04-26T07:55:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.866+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4aa040 con 0x55afbf3aba40 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.866+0000 7ff3396f3640 1 -- 172.21.15.62:0/2765349272 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff33400a4a0 con 0x55afbf3aba40 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.866+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4aa490 con 0x55afbf3aba40 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.867+0000 7ff3396f3640 1 -- 172.21.15.62:0/2765349272 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff33400a4a0 con 0x55afbf3aba40 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.867+0000 7ff33d133800 1 Processor -- start 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.867+0000 7ff33d133800 1 -- start start 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.867+0000 7ff33d133800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf4b9ad0 0x55afbf4b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.867+0000 7ff33d133800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55afbf29b170 con 0x55afbf4b9ad0 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.867+0000 7ff333fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf4b9ad0 0x55afbf4b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff333fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf4b9ad0 0x55afbf4b9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35186/0 (socket says 172.21.15.62:35186) 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff333fff640 1 -- 172.21.15.62:0/3401821788 learned_addr learned my addr 172.21.15.62:0/3401821788 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff333fff640 1 -- 172.21.15.62:0/3401821788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbf4ba430 con 0x55afbf4b9ad0 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff333fff640 1 --2- 172.21.15.62:0/3401821788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf4b9ad0 0x55afbf4b9ef0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff324001ed0 tx=0x7ff32400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff21e7fc640 1 -- 172.21.15.62:0/3401821788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32401b550 con 0x55afbf4b9ad0 2024-04-26T07:55:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff21e7fc640 1 -- 172.21.15.62:0/3401821788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32401b6f0 con 0x55afbf4b9ad0 2024-04-26T07:55:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff21e7fc640 1 -- 172.21.15.62:0/3401821788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32401b9d0 con 0x55afbf4b9ad0 2024-04-26T07:55:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff33d133800 1 -- 172.21.15.62:0/3401821788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afbf4baea0 con 0x55afbf4b9ad0 2024-04-26T07:55:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.868+0000 7ff33d133800 1 -- 172.21.15.62:0/3401821788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbf4bb3a0 con 0x55afbf4b9ad0 2024-04-26T07:55:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.869+0000 7ff21e7fc640 1 -- 172.21.15.62:0/3401821788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff324023020 con 0x55afbf4b9ad0 2024-04-26T07:55:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.869+0000 7ff21e7fc640 1 --2- 172.21.15.62:0/3401821788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036e60 0x7ff210039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.869+0000 7ff21e7fc640 1 -- 172.21.15.62:0/3401821788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff324021020 con 0x55afbf4b9ad0 2024-04-26T07:55:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.869+0000 7ff3396f3640 1 --2- 172.21.15.62:0/3401821788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036e60 0x7ff210039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.870+0000 7ff33d133800 1 Processor -- start 2024-04-26T07:55:39.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.870+0000 7ff33d133800 1 -- start start 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.870+0000 7ff3396f3640 1 --2- 172.21.15.62:0/3401821788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036e60 0x7ff210039320 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55afbf4a9b60 tx=0x7ff334005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.870+0000 7ff33d133800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf3a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.870+0000 7ff33d133800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55afbf49a4c0 con 0x55afbf3a8700 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.870+0000 7ff333fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf3a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.870+0000 7ff333fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf3a8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35190/0 (socket says 172.21.15.62:35190) 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.870+0000 7ff333fff640 1 -- 172.21.15.62:0/1895340642 learned_addr learned my addr 172.21.15.62:0/1895340642 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff333fff640 1 -- 172.21.15.62:0/1895340642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbf3a6f00 con 0x55afbf3a8700 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff333fff640 1 --2- 172.21.15.62:0/1895340642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf3a8b20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff32404d530 tx=0x7ff32403def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d07ecc93277573e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff20ffff640 1 -- 172.21.15.62:0/1895340642 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32400c360 con 0x55afbf3a8700 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff20ffff640 1 -- 172.21.15.62:0/1895340642 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff324024e10 con 0x55afbf3a8700 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff20ffff640 1 -- 172.21.15.62:0/1895340642 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32401ad80 con 0x55afbf3a8700 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff33d133800 1 -- 172.21.15.62:0/1895340642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 msgr2=0x55afbf3a8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff33d133800 1 --2- 172.21.15.62:0/1895340642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf3a8b20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff32404d530 tx=0x7ff32403def0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff33d133800 1 -- 172.21.15.62:0/1895340642 shutdown_connections 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff33d133800 1 --2- 172.21.15.62:0/1895340642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf3a8b20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff33d133800 1 -- 172.21.15.62:0/1895340642 >> 172.21.15.62:0/1895340642 conn(0x55afbf4c3170 msgr2=0x55afbf4c11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff33d133800 1 -- 172.21.15.62:0/1895340642 shutdown_connections 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.871+0000 7ff33d133800 1 -- 172.21.15.62:0/1895340642 wait complete. 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.872+0000 7ff33d133800 1 Processor -- start 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.872+0000 7ff33d133800 1 -- start start 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.872+0000 7ff33d133800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf4d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.872+0000 7ff33d133800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55afbf3a73d0 con 0x55afbf3a8700 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.872+0000 7ff333fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf4d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.872+0000 7ff333fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf4d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35200/0 (socket says 172.21.15.62:35200) 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.872+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 learned_addr learned my addr 172.21.15.62:0/2578988624 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.872+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbf4d0b70 con 0x55afbf3a8700 2024-04-26T07:55:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.873+0000 7ff333fff640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf4d0630 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff32400dcc0 tx=0x7ff32404d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.873+0000 7ff20e7fc640 1 -- 172.21.15.62:0/2578988624 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff324032020 con 0x55afbf3a8700 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.873+0000 7ff20e7fc640 1 -- 172.21.15.62:0/2578988624 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32400c360 con 0x55afbf3a8700 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.873+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afbf4d0e00 con 0x55afbf3a8700 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.873+0000 7ff20e7fc640 1 -- 172.21.15.62:0/2578988624 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff324025ab0 con 0x55afbf3a8700 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.873+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbf4d0e00 con 0x55afbf3a8700 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.873+0000 7ff20e7fc640 1 -- 172.21.15.62:0/2578988624 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff324035020 con 0x55afbf3a8700 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.874+0000 7ff20e7fc640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036eb0 0x7ff204039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.874+0000 7ff20e7fc640 1 -- 172.21.15.62:0/2578988624 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff324043070 con 0x55afbf3a8700 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.874+0000 7ff3396f3640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036eb0 0x7ff204039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.874+0000 7ff3396f3640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036eb0 0x7ff204039370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55afbf4a5e10 tx=0x7ff33401f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.874+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.874+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf4dbf40 0x55afbf4de400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.874+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4deb50 con 0x55afbf4dbf40 2024-04-26T07:55:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.874+0000 7ff338ef2640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf4dbf40 0x55afbf4de400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff338ef2640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf4dbf40 0x55afbf4de400 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff33d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff33d133800 20 realm 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4def60 con 0x55afbf4dbf40 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff33d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff33d133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4df830 con 0x55afbf4dbf40 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.875+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4dfbd0 con 0x55afbf4dbf40 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e0420 con 0x55afbf4dbf40 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 20 searching for the correct realm 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55afbf4e2190 0x55afbf4e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff333fff640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55afbf4e2190 0x55afbf4e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.876+0000 7ff333fff640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55afbf4e2190 0x55afbf4e4580 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.877+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.877+0000 7ff333fff640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff324037020 0x7ff32403f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.877+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff324037020 2024-04-26T07:55:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.877+0000 7ff3396f3640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff324037020 0x7ff32403f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.877+0000 7ff3396f3640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff324037020 0x7ff32403f9c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.878+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff33401f070 con 0x7ff324037020 2024-04-26T07:55:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.878+0000 7ff3396f3640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff334031040 0x7ff334032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.878+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff334031040 2024-04-26T07:55:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.878+0000 7ff338ef2640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff334031040 0x7ff334032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.878+0000 7ff338ef2640 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff334031040 0x7ff334032940 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.879+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.879+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.879+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.879+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.879+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.879+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.879+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.879+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff334031040 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.880+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.880+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff324037020 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.880+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff33401f070 con 0x7ff324037020 2024-04-26T07:55:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.880+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.880+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.880+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.880+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.880+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff334031040 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.881+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.881+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.881+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.881+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff324037020 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.881+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff33401f070 con 0x7ff324037020 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.881+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.881+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.881+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.882+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.882+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff334031040 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.882+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.882+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.882+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.882+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.882+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.882+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.883+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.883+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.883+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.883+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff334031040 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.883+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.883+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.884+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.884+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff324037020 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.884+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff33401f070 con 0x7ff324037020 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.884+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.884+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.884+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff334031040 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.885+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.885+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.885+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.885+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff334031040 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.885+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.885+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff324037020 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.885+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff33401f070 con 0x7ff324037020 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.885+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4e2190 2024-04-26T07:55:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.886+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.886+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff334031040 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.886+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.886+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x55afbf4dbf40 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.886+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.886+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4b60 con 0x7ff324037020 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff33401f070 con 0x7ff324037020 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e0dd0 con 0x55afbf4dbf40 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e1670 con 0x55afbf4dbf40 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.887+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e1670 con 0x55afbf4dbf40 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 20 zone default found 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 4 Realm: () 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 20 zonegroup default 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e4fe0 con 0x7ff334031040 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e6a20 con 0x55afbf4e2190 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.888+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e6ed0 con 0x55afbf4e2190 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.889+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.889+0000 7ff33d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.889+0000 7ff33d133800 20 started sync module instance, tier type = 2024-04-26T07:55:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.889+0000 7ff33d133800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.889+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e5e60 con 0x7ff324037020 2024-04-26T07:55:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.890+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.890+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94213317222992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e77e0 con 0x7ff324037020 2024-04-26T07:55:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.890+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e8030 con 0x55afbf4dbf40 2024-04-26T07:55:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.891+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94213317222992] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.891+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.892+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94213317227312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e7cc0 con 0x55afbf4dbf40 2024-04-26T07:55:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.892+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e87e0 con 0x55afbf4e2190 2024-04-26T07:55:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.893+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94213317227312] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.893+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.893+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94213317231280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e8bd0 con 0x55afbf4e2190 2024-04-26T07:55:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.893+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e95d0 con 0x7ff324037020 2024-04-26T07:55:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.894+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.894+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94213317234912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e9e70 con 0x7ff324037020 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.894+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4ea940 con 0x55afbf4dbf40 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.894+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94213317231280] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.895+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.895+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94213317228368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4ea940 con 0x55afbf4dbf40 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.895+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4eb3b0 con 0x7ff334031040 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.895+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94213317234912] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.896+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.896+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94213317242528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4eb370 con 0x7ff334031040 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.896+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4ebdc0 con 0x7ff334031040 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.896+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94213317228368] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.898+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94213317242528] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.898+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.898+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94213317237184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4eb910 con 0x7ff334031040 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.898+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4ec660 con 0x7ff334031040 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94213317237184] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94213317239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4eb910 con 0x7ff334031040 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff33d133800 20 add_watcher() i=0 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff33d133800 20 add_watcher() i=1 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff33d133800 20 add_watcher() i=2 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff33d133800 20 add_watcher() i=3 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff33d133800 20 add_watcher() i=4 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff33d133800 20 add_watcher() i=5 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.899+0000 7ff33d133800 20 add_watcher() i=6 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.900+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94213317239808] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.900+0000 7ff33d133800 20 add_watcher() i=7 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.900+0000 7ff33d133800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.900+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4ef5b0 con 0x55afbf4dbf40 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.900+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.900+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94213317247184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4eca10 con 0x55afbf4dbf40 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.901+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94213317247184] v29'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.901+0000 7ff1eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.902+0000 7ff33d133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.902+0000 7ff33d133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.902+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4ef3a0 con 0x55afbf4dbf40 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.903+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.903+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f88a0 con 0x7ff334031040 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.904+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.904+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f88a0 con 0x55afbf4e2190 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.905+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.905+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f90f0 con 0x55afbf4dbf40 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.906+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.906+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f90f0 con 0x7ff324037020 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.907+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.907+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f7e70 con 0x55afbf4e2190 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.908+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.908+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9c50 con 0x55afbf4dbf40 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.909+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.909+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9c50 con 0x7ff334031040 2024-04-26T07:55:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.910+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.911+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9c50 con 0x7ff324037020 2024-04-26T07:55:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.912+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.912+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa100 con 0x55afbf4e2190 2024-04-26T07:55:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.913+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.913+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa100 con 0x7ff324037020 2024-04-26T07:55:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.914+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.914+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa360 con 0x7ff334031040 2024-04-26T07:55:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.915+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.915+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa360 con 0x7ff324037020 2024-04-26T07:55:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.916+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.916+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x7ff334031040 2024-04-26T07:55:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.917+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.917+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x55afbf4dbf40 2024-04-26T07:55:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.918+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.918+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x55afbf4e2190 2024-04-26T07:55:39.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.919+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.919+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x7ff324037020 2024-04-26T07:55:39.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.920+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.920+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x55afbf4e2190 2024-04-26T07:55:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.921+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.921+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x55afbf4dbf40 2024-04-26T07:55:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.923+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.923+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x55afbf4dbf40 2024-04-26T07:55:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.924+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.924+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x55afbf4e2190 2024-04-26T07:55:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.925+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.925+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x7ff324037020 2024-04-26T07:55:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.926+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.926+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4fa8f0 con 0x55afbf4e2190 2024-04-26T07:55:39.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.927+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.927+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9e20 con 0x55afbf4e2190 2024-04-26T07:55:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.928+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.928+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9e20 con 0x55afbf4e2190 2024-04-26T07:55:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.929+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.929+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9e20 con 0x55afbf4e2190 2024-04-26T07:55:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.930+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.930+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9e20 con 0x7ff334031040 2024-04-26T07:55:39.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.931+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.931+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9c50 con 0x55afbf4e2190 2024-04-26T07:55:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.932+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.932+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9c50 con 0x7ff334031040 2024-04-26T07:55:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.933+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.933+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9c50 con 0x55afbf4e2190 2024-04-26T07:55:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.934+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.934+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9c50 con 0x7ff334031040 2024-04-26T07:55:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.936+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'54 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.936+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f9c50 con 0x7ff324037020 2024-04-26T07:55:39.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.937+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.937+0000 7ff1edfe3640 20 reqs_thread_entry: start 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.937+0000 7ff33d133800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 20 Filter name: none 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff15f7fe640 20 reqs_thread_entry: start 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5257d0 con 0x7ff324037020 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-26T07:55:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T07:55:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:55:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf528260 con 0x55afbf4dbf40 2024-04-26T07:55:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 : miss 2024-04-26T07:55:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.938+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:96 8.13 8:cdf3e8c0:root::.bucket.meta.myfoo6%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5280f0 con 0x7ff334031040 2024-04-26T07:55:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.939+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(96 .bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv11 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.939+0000 7ff33d133800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:55:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.939+0000 7ff33d133800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 info.flags=0x17 2024-04-26T07:55:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.939+0000 7ff33d133800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 to cache LRU end 2024-04-26T07:55:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.939+0000 7ff33d133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.939+0000 7ff33d133800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.939+0000 7ff33d133800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.939+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:97 4.37 4:ed25d90e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a5660 con 0x7ff334031040 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.940+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(97 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.940+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:98 4.39 4:9f443483:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a56e0 con 0x55afbf4e2190 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.940+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(98 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.940+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:99 4.12 4:4b9c6ce6:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a56e0 con 0x55afbf4dbf40 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.940+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(99 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.940+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:100 4.3f 4:ffa10de2:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a56e0 con 0x7ff324037020 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.941+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(100 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.941+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:101 4.1b 4:db919db8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a5700 con 0x7ff324037020 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.941+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(101 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.941+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:102 4.13 4:cb192139:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a5d90 con 0x7ff324037020 2024-04-26T07:55:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.941+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(102 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.941+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:103 4.3e 4:7ef516d8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a5d90 con 0x7ff324037020 2024-04-26T07:55:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.942+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(103 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.942+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:104 4.13 4:c90c768a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a5d90 con 0x7ff324037020 2024-04-26T07:55:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.942+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(104 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334040040 con 0x7ff324037020 2024-04-26T07:55:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.942+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:105 4.37 4:ed7f502d:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a5d90 con 0x7ff334031040 2024-04-26T07:55:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.942+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(105 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.942+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:106 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a5d90 con 0x7ff334031040 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.943+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(106 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [call out=289b] v0'0 uv5 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.943+0000 7ff33d133800 10 cls_bucket_list_unordered: got thirteen 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.943+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:107 4.30 4:0f0889b7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a5d90 con 0x55afbf4e2190 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.943+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(107 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.943+0000 7ff33d133800 20 get_obj_state: octx=0x7ff32c088040 obj=myfoo6:thirteen state=0x55afbf5a36e8 s->prefetch_data=0 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.943+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:108 3.1cs0 3:3b7cb4bb:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a4510 con 0x55afbf4dbf40 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.943+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(108 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.944+0000 7ff33d133800 10 manifest: total_size = 8 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.944+0000 7ff33d133800 20 get_obj_state: setting s->obj_tag to _ByemWPaPLc3LOmseS8n70ygHawMyGF9 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.944+0000 7ff33d133800 20 get_obj_state: octx=0x7ff32c088040 obj=myfoo6:thirteen state=0x55afbf5a36e8 s->prefetch_data=0 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.944+0000 7ff33d133800 20 prepare_atomic_modification: state is not atomic. state=0x55afbf5a36e8 2024-04-26T07:55:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.944+0000 7ff33d133800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 2024-04-26T07:55:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.944+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:109 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a4da0 con 0x7ff334031040 2024-04-26T07:55:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.945+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(109 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [stat,call,call] v29'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.945+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:110 3.1cs0 3:3b7cb4bb:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a4da0 con 0x55afbf4dbf40 2024-04-26T07:55:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.946+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(110 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9_thirteen [call] v29'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.946+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:111 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf52c7f0 con 0x7ff334031040 2024-04-26T07:55:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.946+0000 7ff33d133800 20 list_objects_ordered: starting attempt 1 2024-04-26T07:55:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.946+0000 7ff33d133800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T07:55:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.946+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:112 4.37 4:ed25d90e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf52c7f0 con 0x7ff334031040 2024-04-26T07:55:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.946+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:113 4.39 4:9f443483:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf530a80 con 0x55afbf4e2190 2024-04-26T07:55:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.946+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:114 4.12 4:4b9c6ce6:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf52c7f0 con 0x55afbf4dbf40 2024-04-26T07:55:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.946+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:115 4.3f 4:ffa10de2:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf530a80 con 0x7ff324037020 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:116 4.1b 4:db919db8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf538120 con 0x7ff324037020 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:117 4.13 4:cb192139:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53ac20 con 0x7ff324037020 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:118 4.3e 4:7ef516d8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d9e0 con 0x7ff324037020 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:119 4.13 4:c90c768a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf540830 con 0x7ff324037020 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:120 4.37 4:ed7f502d:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x7ff334031040 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:121 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf546490 con 0x7ff334031040 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:122 4.30 4:0f0889b7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf549310 con 0x55afbf4e2190 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(112 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(113 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(114 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(122 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff324009050 con 0x55afbf4e2190 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(115 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff33404d060 con 0x7ff324037020 2024-04-26T07:55:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(116 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff33404d060 con 0x7ff324037020 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(120 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(117 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff33404d060 con 0x7ff324037020 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.947+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(118 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff33404d060 con 0x7ff324037020 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(119 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff33404d060 con 0x7ff324037020 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(111 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [stat,call,call] v29'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff20ffff640 20 handle_completion(): completion ok for obj=thirteen 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(121 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9])"; uploads.size()=0; is_truncated=0 2024-04-26T07:55:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:123 4.37 4:ed25d90e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf540830 con 0x7ff334031040 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:124 4.39 4:9f443483:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d9e0 con 0x55afbf4e2190 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:125 4.12 4:4b9c6ce6:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf540830 con 0x55afbf4dbf40 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:126 4.3f 4:ffa10de2:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf546490 con 0x7ff324037020 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:127 4.1b 4:db919db8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d9e0 con 0x7ff324037020 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:128 4.13 4:cb192139:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf540830 con 0x7ff324037020 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:129 4.3e 4:7ef516d8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf546490 con 0x7ff324037020 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:130 4.13 4:c90c768a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d9e0 con 0x7ff324037020 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:131 4.37 4:ed7f502d:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x7ff334031040 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:132 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf540830 con 0x7ff334031040 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== osd_op_reply(123 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:133 4.30 4:0f0889b7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf546490 con 0x55afbf4e2190 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(125 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== osd_op_reply(131 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.948+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(132 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.949+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(124 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff324069060 con 0x55afbf4e2190 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.949+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(126 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.949+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(127 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.949+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(129 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.949+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 32 ==== osd_op_reply(128 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.949+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 33 ==== osd_op_reply(130 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.949+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 31 ==== osd_op_reply(133 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff324069060 con 0x55afbf4e2190 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.949+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x55afbf4dbf40 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(134 bud.buckets [call] v29'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff33d133800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x55afbf4dbf40 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff33d133800 20 rados_obj.operate() r=0 bl.length=166 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff33d133800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff33d133800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.950+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x55afbf4dbf40 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.951+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 38 ==== osd_op_reply(136 myfoo6 [call,call,delete] v29'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.951+0000 7ff33d133800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.951+0000 7ff33d133800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.951+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94213317616784 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x7ff324037020 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.951+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 34 ==== watch-notify(notify (1) cookie 94213317234912 notify 124554051610 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55afbf4fa8f0 con 0x7ff324037020 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.952+0000 7ff20f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94213317234912 notifier 4745 bl.length()=150 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.952+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 35 ==== osd_op_reply(137 notify.3 [notify cookie 94213317616784 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.952+0000 7ff20f7fe640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff16c0032c0 con 0x7ff324037020 2024-04-26T07:55:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.952+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 36 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.952+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 37 ==== watch-notify(notify_complete (2) cookie 94213317616784 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55afbf4f7b90 con 0x7ff324037020 2024-04-26T07:55:39.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.952+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:139 8.13 8:cdf3e8c0:root::.bucket.meta.myfoo6%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x7ff334031040 2024-04-26T07:55:39.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.953+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(139 .bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 [call,call,delete] v29'13 uv13 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.953+0000 7ff33d133800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 from cache 2024-04-26T07:55:39.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.953+0000 7ff33d133800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9, ofs0, ns] 2024-04-26T07:55:39.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.953+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94213317616784 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x7ff324037020 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 38 ==== watch-notify(notify (1) cookie 94213317222992 notify 124554051611 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55afbf4f7b90 con 0x7ff324037020 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff20f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94213317222992 notifier 4745 bl.length()=207 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 39 ==== osd_op_reply(140 notify.0 [notify cookie 94213317616784 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff20f7fe640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff16c0032c0 con 0x7ff324037020 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 40 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 41 ==== watch-notify(notify_complete (2) cookie 94213317616784 notify 124554051611 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55afbf4f77f0 con 0x7ff324037020 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:142 4.37 4:ed25d90e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x7ff334031040 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:143 4.39 4:9f443483:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf546490 con 0x55afbf4e2190 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:144 4.12 4:4b9c6ce6:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543b30 con 0x55afbf4dbf40 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:145 4.3f 4:ffa10de2:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543660 con 0x7ff324037020 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:146 4.1b 4:db919db8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf546490 con 0x7ff324037020 2024-04-26T07:55:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:147 4.13 4:cb192139:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543b30 con 0x7ff324037020 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:148 4.3e 4:7ef516d8:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf547310 con 0x7ff324037020 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:149 4.13 4:c90c768a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53f4a0 con 0x7ff324037020 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:150 4.37 4:ed7f502d:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5263f0 con 0x7ff334031040 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:151 4.2d 4:b7914a6a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf526d60 con 0x7ff334031040 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.954+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:152 4.30 4:0f0889b7:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53e300 con 0x55afbf4e2190 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.956+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== osd_op_reply(142 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.0 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.956+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(150 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.8 [delete] v29'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.956+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 42 ==== osd_op_reply(146 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.4 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.956+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 43 ==== osd_op_reply(148 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.6 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== osd_op_reply(151 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.9 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 39 ==== osd_op_reply(144 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.2 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 44 ==== osd_op_reply(147 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.5 [delete] v29'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 45 ==== osd_op_reply(145 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.3 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 32 ==== osd_op_reply(143 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.1 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff324069060 con 0x55afbf4e2190 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 33 ==== osd_op_reply(152 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.10 [delete] v29'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff324069060 con 0x55afbf4e2190 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 46 ==== osd_op_reply(149 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9.7 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff33d133800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 : miss 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff33d133800 20 rados->read ofs=0 len=0 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:153 6.11 6:8e12a31c:::pubsub..bucket.myfoo6%2f8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d890 con 0x55afbf4e2190 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 34 ==== osd_op_reply(153 pubsub..bucket.myfoo6/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7ff324069060 con 0x55afbf4e2190 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff33d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff33d133800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 info.flags=0x0 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff33d133800 10 adding default.rgw.log++pubsub..bucket.myfoo6/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 to cache LRU end 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.957+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:154 6.11 6:8e12a31c:::pubsub..bucket.myfoo6%2f8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d890 con 0x55afbf4e2190 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.958+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 35 ==== osd_op_reply(154 pubsub..bucket.myfoo6/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.9 [delete] v29'29 uv23 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7ff324069060 con 0x55afbf4e2190 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.958+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d890 con 0x55afbf4dbf40 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.959+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 40 ==== osd_op_reply(155 bud.buckets [call] v29'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.959+0000 7ff33d133800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.959+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d890 con 0x55afbf4dbf40 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.960+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 41 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v29'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.960+0000 7ff33d133800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.960+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94213317616720 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf53d890 con 0x7ff334031040 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== watch-notify(notify (1) cookie 94213317242528 notify 124554051620 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55afbf527600 con 0x7ff334031040 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff20f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051620 cookie 94213317242528 notifier 4745 bl.length()=170 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(157 notify.5 [notify cookie 94213317616720 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff20f7fe640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff16c0032c0 con 0x7ff334031040 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 41 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 42 ==== watch-notify(notify_complete (2) cookie 94213317616720 notify 124554051620 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55afbf4eeb70 con 0x7ff334031040 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff33d133800 10 removing email index: 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff33d133800 10 removing user buckets index 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.961+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf546450 con 0x55afbf4dbf40 2024-04-26T07:55:39.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.962+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 42 ==== osd_op_reply(159 bud.buckets [delete] v29'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.962+0000 7ff33d133800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.962+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94213317616720 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf543530 con 0x7ff334031040 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.962+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 43 ==== watch-notify(notify (1) cookie 94213317237184 notify 124554051621 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55afbf4eeb70 con 0x7ff334031040 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.962+0000 7ff20ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051621 cookie 94213317237184 notifier 4745 bl.length()=160 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.962+0000 7ff20ffff640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff1fc003d60 con 0x7ff334031040 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.962+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 44 ==== osd_op_reply(160 notify.6 [notify cookie 94213317616720 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.963+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 45 ==== watch-notify(notify_complete (2) cookie 94213317616720 notify 124554051621 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55afbf4a4b30 con 0x7ff334031040 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.963+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 46 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.963+0000 7ff33d133800 10 removing user index: bud 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.963+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf546450 con 0x7ff324037020 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.964+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 47 ==== osd_op_reply(162 bud [call,call,delete] v29'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.964+0000 7ff33d133800 10 removing default.rgw.meta+users.uid+bud from cache 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.964+0000 7ff33d133800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T07:55:39.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.964+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94213317616720 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55afbf5a4cc0 con 0x7ff334031040 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.964+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 47 ==== watch-notify(notify (1) cookie 94213317242528 notify 124554051622 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55afbf4a4b30 con 0x7ff334031040 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.964+0000 7ff20f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051622 cookie 94213317242528 notifier 4745 bl.length()=152 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.964+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 48 ==== osd_op_reply(163 notify.5 [notify cookie 94213317616720 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.964+0000 7ff20f7fe640 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff16c0032a0 con 0x7ff334031040 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.965+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 49 ==== watch-notify(notify_complete (2) cookie 94213317616720 notify 124554051622 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55afbf4a1e80 con 0x7ff334031040 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.965+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 50 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.966+0000 7ff1eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.966+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94213317247184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f3af0 con 0x55afbf4dbf40 2024-04-26T07:55:39.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.967+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 43 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94213317247184] v29'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.967+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94213317222992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f3af0 con 0x7ff324037020 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.968+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 48 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94213317222992] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.968+0000 7ff33d133800 20 remove_watcher() i=0 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.968+0000 7ff33d133800 2 removed watcher, disabling cache 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.968+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94213317227312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e6250 con 0x55afbf4dbf40 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.969+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 44 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94213317227312] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.969+0000 7ff33d133800 20 remove_watcher() i=1 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.969+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94213317231280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f3af0 con 0x55afbf4e2190 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.970+0000 7ff333fff640 1 -- 172.21.15.62:0/2578988624 <== osd.3 v2:172.21.15.62:6816/1472283839 36 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94213317231280] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324069060 con 0x55afbf4e2190 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.970+0000 7ff33d133800 20 remove_watcher() i=2 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.970+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94213317234912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e7330 con 0x7ff324037020 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.971+0000 7ff3396f3640 1 -- 172.21.15.62:0/2578988624 <== osd.2 v2:172.21.15.62:6808/1138534927 49 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94213317234912] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff334057040 con 0x7ff324037020 2024-04-26T07:55:39.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.971+0000 7ff33d133800 20 remove_watcher() i=3 2024-04-26T07:55:39.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.971+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94213317228368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e6250 con 0x55afbf4dbf40 2024-04-26T07:55:39.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.972+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.1 v2:172.21.15.62:6800/1888558046 45 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94213317228368] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x55afbf4dbf40 2024-04-26T07:55:39.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.972+0000 7ff33d133800 20 remove_watcher() i=4 2024-04-26T07:55:39.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.972+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94213317242528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4f3af0 con 0x7ff334031040 2024-04-26T07:55:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.973+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 51 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94213317242528] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.973+0000 7ff33d133800 20 remove_watcher() i=5 2024-04-26T07:55:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.973+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94213317237184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e6250 con 0x7ff334031040 2024-04-26T07:55:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.974+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 52 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94213317237184] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.974+0000 7ff33d133800 20 remove_watcher() i=6 2024-04-26T07:55:39.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.974+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94213317239808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55afbf4e99c0 con 0x7ff334031040 2024-04-26T07:55:39.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 <== osd.0 v2:172.21.15.1:6800/3827982423 53 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94213317239808] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32c075030 con 0x7ff334031040 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 20 remove_watcher() i=7 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff334031040 msgr2=0x7ff334032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff334031040 0x7ff334032940 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf4dbf40 msgr2=0x55afbf4de400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf4dbf40 0x55afbf4de400 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff324037020 msgr2=0x7ff32403f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff324037020 0x7ff32403f9c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55afbf4e2190 msgr2=0x55afbf4e4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.975+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55afbf4e2190 0x55afbf4e4580 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036eb0 msgr2=0x7ff204039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036eb0 0x7ff204039370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55afbf4a5e10 tx=0x7ff33401f000 comp rx=0 tx=0).stop 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 msgr2=0x55afbf4d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf4d0630 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff32400dcc0 tx=0x7ff32404d4c0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff338ef2640 1 -- 172.21.15.62:0/2578988624 reap_dead start 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 shutdown_connections 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 --2- 172.21.15.62:0/2578988624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a8700 0x55afbf4d0630 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 >> 172.21.15.62:0/2578988624 conn(0x55afbf4c3170 msgr2=0x55afbf4c07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 shutdown_connections 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/2578988624 wait complete. 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/3401821788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036e60 msgr2=0x7ff210039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 --2- 172.21.15.62:0/3401821788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036e60 0x7ff210039320 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55afbf4a9b60 tx=0x7ff334005840 comp rx=0 tx=0).stop 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/3401821788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf4b9ad0 msgr2=0x55afbf4b9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 --2- 172.21.15.62:0/3401821788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf4b9ad0 0x55afbf4b9ef0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff324001ed0 tx=0x7ff32400d7a0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/3401821788 shutdown_connections 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 --2- 172.21.15.62:0/3401821788 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036e60 0x7ff210039320 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 --2- 172.21.15.62:0/3401821788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf4b9ad0 0x55afbf4b9ef0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/3401821788 >> 172.21.15.62:0/3401821788 conn(0x55afbf4adb70 msgr2=0x55afbf4adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/3401821788 shutdown_connections 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.976+0000 7ff33d133800 1 -- 172.21.15.62:0/3401821788 wait complete. 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf3aba40 msgr2=0x55afbf4a88f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf3aba40 0x55afbf4a88f0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff220036e60 msgr2=0x7ff220039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff220036e60 0x7ff220039320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff324000f60 tx=0x7ff3240012b0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 msgr2=0x55afbf4a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf4a16b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff32c000c00 tx=0x7ff32c003020 comp rx=0 tx=0).stop 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 shutdown_connections 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55afbf3aba40 0x55afbf4a88f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff220036e60 0x7ff220039320 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 --2- 172.21.15.62:0/2765349272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afbf3a9110 0x55afbf4a16b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 >> 172.21.15.62:0/2765349272 conn(0x55afbf3a2be0 msgr2=0x55afbf493d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:39.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 shutdown_connections 2024-04-26T07:55:39.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:39.977+0000 7ff33d133800 1 -- 172.21.15.62:0/2765349272 wait complete. 2024-04-26T07:55:39.983 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-26T07:55:39.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-26T07:55:39.983 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-04-26T07:55:40.028 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:55:40.028 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.031+0000 7f63a572d800 1 Processor -- start 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a572d800 1 -- start start 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a572d800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a165682cc0 0x55a1656850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a572d800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1656855f0 con 0x55a16567f1b0 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a572d800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55a165520e20 con 0x55a165682cc0 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a0b7e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a165682cc0 0x55a1656850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a0b7e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a165682cc0 0x55a1656850b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35206/0 (socket says 172.21.15.62:35206) 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a0b7e640 1 -- 172.21.15.62:0/2632994978 learned_addr learned my addr 172.21.15.62:0/2632994978 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a137f640 1 --1- 172.21.15.62:0/2632994978 >> v1:172.21.15.1:6789/0 conn(0x55a16567f1b0 0x55a1656815a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:43558/0 (socket says 172.21.15.62:43558) 2024-04-26T07:55:40.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a0b7e640 1 -- 172.21.15.62:0/2632994978 >> v1:172.21.15.1:6789/0 conn(0x55a16567f1b0 legacy=0x55a1656815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.032+0000 7f63a0b7e640 1 -- 172.21.15.62:0/2632994978 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1656867d0 con 0x55a165682cc0 2024-04-26T07:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.034+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/2632994978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165682cc0 0x55a1656850b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f639800a520 tx=0x7f639801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753be303087be85d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.034+0000 7f6393fff640 1 -- 172.21.15.62:0/2632994978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6398057070 con 0x55a165682cc0 2024-04-26T07:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.034+0000 7f6393fff640 1 -- 172.21.15.62:0/2632994978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6398052570 con 0x55a165682cc0 2024-04-26T07:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.034+0000 7f6393fff640 1 -- 172.21.15.62:0/2632994978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639804ae60 con 0x55a165682cc0 2024-04-26T07:55:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.035+0000 7f63a572d800 1 -- 172.21.15.62:0/2632994978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165682cc0 msgr2=0x55a1656850b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.035+0000 7f63a572d800 1 --2- 172.21.15.62:0/2632994978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165682cc0 0x55a1656850b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f639800a520 tx=0x7f639801d010 comp rx=0 tx=0).stop 2024-04-26T07:55:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.035+0000 7f63a572d800 1 -- 172.21.15.62:0/2632994978 shutdown_connections 2024-04-26T07:55:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.035+0000 7f63a572d800 1 --2- 172.21.15.62:0/2632994978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165682cc0 0x55a1656850b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.035+0000 7f63a572d800 1 -- 172.21.15.62:0/2632994978 >> 172.21.15.62:0/2632994978 conn(0x55a165678be0 msgr2=0x55a16567b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.035+0000 7f63a572d800 1 -- 172.21.15.62:0/2632994978 shutdown_connections 2024-04-26T07:55:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.035+0000 7f63a572d800 1 -- 172.21.15.62:0/2632994978 wait complete. 2024-04-26T07:55:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.048+0000 7f63a572d800 1 Processor -- start 2024-04-26T07:55:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.048+0000 7f63a572d800 1 -- start start 2024-04-26T07:55:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.048+0000 7f63a572d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a16567eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.048+0000 7f63a572d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a1655c9d00 con 0x55a16567f1b0 2024-04-26T07:55:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.048+0000 7f63a137f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a16567eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.048+0000 7f63a137f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a16567eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35220/0 (socket says 172.21.15.62:35220) 2024-04-26T07:55:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.048+0000 7f63a137f640 1 -- 172.21.15.62:0/859760478 learned_addr learned my addr 172.21.15.62:0/859760478 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.049+0000 7f63a137f640 1 -- 172.21.15.62:0/859760478 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16567d0b0 con 0x55a16567f1b0 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.049+0000 7f63a137f640 1 --2- 172.21.15.62:0/859760478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a16567eaf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6394001e90 tx=0x7f639400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d15204917a30c5c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.049+0000 7f628f606640 1 -- 172.21.15.62:0/859760478 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639400e5c0 con 0x55a16567f1b0 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.049+0000 7f628f606640 1 -- 172.21.15.62:0/859760478 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6394006070 con 0x55a16567f1b0 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.049+0000 7f628f606640 1 -- 172.21.15.62:0/859760478 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639400e890 con 0x55a16567f1b0 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 -- 172.21.15.62:0/859760478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 msgr2=0x55a16567eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 --2- 172.21.15.62:0/859760478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a16567eaf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6394001e90 tx=0x7f639400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 -- 172.21.15.62:0/859760478 shutdown_connections 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 --2- 172.21.15.62:0/859760478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a16567eaf0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 -- 172.21.15.62:0/859760478 >> 172.21.15.62:0/859760478 conn(0x55a165678be0 msgr2=0x55a16576b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 -- 172.21.15.62:0/859760478 shutdown_connections 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 -- 172.21.15.62:0/859760478 wait complete. 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 Processor -- start 2024-04-26T07:55:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 -- start start 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a165779a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a572d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a165685ac0 con 0x55a16567f1b0 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a137f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a165779a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a137f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a165779a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35224/0 (socket says 172.21.15.62:35224) 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.050+0000 7f63a137f640 1 -- 172.21.15.62:0/979497021 learned_addr learned my addr 172.21.15.62:0/979497021 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.051+0000 7f63a137f640 1 -- 172.21.15.62:0/979497021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a165779f70 con 0x55a16567f1b0 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.051+0000 7f63a137f640 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a165779a30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6394001ed0 tx=0x7f6394000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.051+0000 7f628de03640 1 -- 172.21.15.62:0/979497021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639401a880 con 0x55a16567f1b0 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.051+0000 7f628de03640 1 -- 172.21.15.62:0/979497021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639401aa20 con 0x55a16567f1b0 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.051+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a16577a200 con 0x55a16567f1b0 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.051+0000 7f628de03640 1 -- 172.21.15.62:0/979497021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639401ad40 con 0x55a16567f1b0 2024-04-26T07:55:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.051+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16577ceb0 con 0x55a16567f1b0 2024-04-26T07:55:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.052+0000 7f628de03640 1 -- 172.21.15.62:0/979497021 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6394017070 con 0x55a16567f1b0 2024-04-26T07:55:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.052+0000 7f628de03640 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6288036e60 0x7f6288039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.052+0000 7f628de03640 1 -- 172.21.15.62:0/979497021 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f6394015020 con 0x55a16567f1b0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.052+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6288036e60 0x7f6288039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.052+0000 7f63a572d800 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a165682cc0 0x55a165780c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.052+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165781200 con 0x55a165682cc0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.052+0000 7f63a1b80640 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a165682cc0 0x55a165780c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.053+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6288036e60 0x7f6288039320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6398054000 tx=0x7f639804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.053+0000 7f63a1b80640 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a165682cc0 0x55a165780c70 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.053+0000 7f63a1b80640 1 -- 172.21.15.62:0/979497021 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f639c00a4a0 con 0x55a165682cc0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.053+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16577e240 con 0x55a165682cc0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.053+0000 7f63a1b80640 1 -- 172.21.15.62:0/979497021 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f639c00a4a0 con 0x55a165682cc0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.053+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165783040 con 0x55a165682cc0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.054+0000 7f63a1b80640 1 -- 172.21.15.62:0/979497021 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f639c00a4a0 con 0x55a165682cc0 2024-04-26T07:55:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.054+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165782380 con 0x55a165682cc0 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.054+0000 7f63a1b80640 1 -- 172.21.15.62:0/979497021 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f639c00a4a0 con 0x55a165682cc0 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.054+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657827d0 con 0x55a165682cc0 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.054+0000 7f63a1b80640 1 -- 172.21.15.62:0/979497021 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f639c00a4a0 con 0x55a165682cc0 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.055+0000 7f63a572d800 1 Processor -- start 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.055+0000 7f63a572d800 1 -- start start 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.055+0000 7f63a572d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165791e30 0x55a165792250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.055+0000 7f63a572d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a165571170 con 0x55a165791e30 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.055+0000 7f63a0b7e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165791e30 0x55a165792250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.055+0000 7f63a0b7e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165791e30 0x55a165792250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35236/0 (socket says 172.21.15.62:35236) 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.055+0000 7f63a0b7e640 1 -- 172.21.15.62:0/829304303 learned_addr learned my addr 172.21.15.62:0/829304303 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.055+0000 7f63a0b7e640 1 -- 172.21.15.62:0/829304303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a165792790 con 0x55a165791e30 2024-04-26T07:55:40.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.056+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/829304303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165791e30 0x55a165792250 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6398000c00 tx=0x7f6398002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.056+0000 7f6286ffd640 1 -- 172.21.15.62:0/829304303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6398057040 con 0x55a165791e30 2024-04-26T07:55:40.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.056+0000 7f6286ffd640 1 -- 172.21.15.62:0/829304303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639805d710 con 0x55a165791e30 2024-04-26T07:55:40.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.056+0000 7f63a572d800 1 -- 172.21.15.62:0/829304303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a165793200 con 0x55a165791e30 2024-04-26T07:55:40.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.056+0000 7f6286ffd640 1 -- 172.21.15.62:0/829304303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639805d9f0 con 0x55a165791e30 2024-04-26T07:55:40.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.056+0000 7f63a572d800 1 -- 172.21.15.62:0/829304303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1657936a0 con 0x55a165791e30 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f6286ffd640 1 -- 172.21.15.62:0/829304303 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6398067070 con 0x55a165791e30 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f6286ffd640 1 --2- 172.21.15.62:0/829304303 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6278036eb0 0x7f6278039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f6286ffd640 1 -- 172.21.15.62:0/829304303 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f639808fdd0 con 0x55a165791e30 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f63a1b80640 1 --2- 172.21.15.62:0/829304303 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6278036eb0 0x7f6278039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f63a572d800 1 Processor -- start 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f63a572d800 1 -- start start 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f63a1b80640 1 --2- 172.21.15.62:0/829304303 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6278036eb0 0x7f6278039370 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55a165781ea0 tx=0x7f639c005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f63a572d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a16579f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.057+0000 7f63a572d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a16567d430 con 0x55a16579f100 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f63a0b7e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a16579f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f63a0b7e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a16579f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35242/0 (socket says 172.21.15.62:35242) 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f63a0b7e640 1 -- 172.21.15.62:0/2481765561 learned_addr learned my addr 172.21.15.62:0/2481765561 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f63a0b7e640 1 -- 172.21.15.62:0/2481765561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16579fab0 con 0x55a16579f100 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/2481765561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a16579f4e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f639808e110 tx=0x7f639805dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d435e46c6b7af707 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f6284ff9640 1 -- 172.21.15.62:0/2481765561 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6398071400 con 0x55a16579f100 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f6284ff9640 1 -- 172.21.15.62:0/2481765561 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6398068c20 con 0x55a16579f100 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f6284ff9640 1 -- 172.21.15.62:0/2481765561 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63980715a0 con 0x55a16579f100 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.058+0000 7f63a572d800 1 -- 172.21.15.62:0/2481765561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 msgr2=0x55a16579f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 --2- 172.21.15.62:0/2481765561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a16579f4e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f639808e110 tx=0x7f639805dd70 comp rx=0 tx=0).stop 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 -- 172.21.15.62:0/2481765561 shutdown_connections 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 --2- 172.21.15.62:0/2481765561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a16579f4e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 -- 172.21.15.62:0/2481765561 >> 172.21.15.62:0/2481765561 conn(0x55a16579b3d0 msgr2=0x55a165799430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 -- 172.21.15.62:0/2481765561 shutdown_connections 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 -- 172.21.15.62:0/2481765561 wait complete. 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 Processor -- start 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 -- start start 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a1657a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a572d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a1657a0280 con 0x55a16579f100 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a0b7e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a1657a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a0b7e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a1657a6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:35250/0 (socket says 172.21.15.62:35250) 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.059+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 learned_addr learned my addr 172.21.15.62:0/139857939 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.060+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1657a6c60 con 0x55a16579f100 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.060+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a1657a6720 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f63980679e0 tx=0x7f639808e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.060+0000 7f6276ffd640 1 -- 172.21.15.62:0/139857939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639809b070 con 0x55a16579f100 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.060+0000 7f6276ffd640 1 -- 172.21.15.62:0/139857939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6398007f60 con 0x55a16579f100 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.060+0000 7f6276ffd640 1 -- 172.21.15.62:0/139857939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63980073e0 con 0x55a16579f100 2024-04-26T07:55:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.060+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1657a6ef0 con 0x55a16579f100 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.060+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1657a9ba0 con 0x55a16579f100 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.061+0000 7f6276ffd640 1 -- 172.21.15.62:0/139857939 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f639809e070 con 0x55a16579f100 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.061+0000 7f6276ffd640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f626c036e10 0x7f626c0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.061+0000 7f6276ffd640 1 -- 172.21.15.62:0/139857939 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f63980a1d50 con 0x55a16579f100 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.061+0000 7f63a1b80640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f626c036e10 0x7f626c0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a572d800 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a1657b2230 0x55a1657b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657b4e40 con 0x55a1657b2230 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a1b80640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f626c036e10 0x7f626c0392d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55a16577e190 tx=0x7f639c01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a137f640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a1657b2230 0x55a1657b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a137f640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a1657b2230 0x55a1657b46f0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a572d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:40.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a572d800 20 realm 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657b5250 con 0x55a1657b2230 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.062+0000 7f63a572d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657b5b20 con 0x55a1657b2230 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657b5ec0 con 0x55a1657b2230 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:40.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657b6710 con 0x55a1657b2230 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 20 searching for the correct realm 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a1657b8480 0x55a1657ba870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.063+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.064+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a1657b8480 0x55a1657ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.064+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a1657b8480 0x55a1657ba870 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.064+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.064+0000 7f63a0b7e640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63980a0060 0x7f639805c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.064+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f63980a0060 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.064+0000 7f63a1b80640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63980a0060 0x7f639805c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.065+0000 7f63a1b80640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63980a0060 0x7f639805c720 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.065+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c01f070 con 0x7f63980a0060 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.065+0000 7f63a1b80640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f639c031040 0x7f639c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.065+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f639c031040 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.065+0000 7f63a137f640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f639c031040 0x7f639c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.066+0000 7f63a137f640 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f639c031040 0x7f639c032940 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.066+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.066+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.066+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.066+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.066+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.066+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.067+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.067+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f639c031040 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.067+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.067+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f63980a0060 2024-04-26T07:55:40.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.067+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c01f070 con 0x7f63980a0060 2024-04-26T07:55:40.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.067+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.067+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.067+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.068+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.068+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f639c031040 2024-04-26T07:55:40.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.068+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.068+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.068+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.068+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f63980a0060 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.068+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f639c01f070 con 0x7f63980a0060 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.068+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.069+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.069+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.069+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.069+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f639c031040 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.069+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.069+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.069+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.069+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.070+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.070+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.070+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.070+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.070+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.070+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f639c031040 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.070+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.071+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.071+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.071+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f63980a0060 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.071+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c01f070 con 0x7f63980a0060 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.071+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.071+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.071+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f639c031040 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.072+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.072+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.072+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.072+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f639c031040 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.072+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.072+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f63980a0060 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.072+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c01f070 con 0x7f63980a0060 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.072+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b8480 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.073+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.073+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f639c031040 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.073+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.073+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x55a1657b2230 2024-04-26T07:55:40.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.073+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.073+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bae80 con 0x7f63980a0060 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c01f070 con 0x7f63980a0060 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657b7090 con 0x55a1657b2230 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:40.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657b7930 con 0x55a1657b2230 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.074+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bb300 con 0x55a1657b2230 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 zone default found 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 4 Realm: () 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:55:40.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 zonegroup default 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bb7b0 con 0x7f639c031040 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bd190 con 0x55a1657b8480 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bd5d0 con 0x55a1657b8480 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 started sync module instance, tier type = 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.075+0000 7f63a572d800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.076+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bc620 con 0x7f63980a0060 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.077+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.077+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94151680707088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bc280 con 0x7f63980a0060 2024-04-26T07:55:40.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.077+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657be500 con 0x55a1657b2230 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.078+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94151680707088] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.078+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.078+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94151680711216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657be500 con 0x55a1657b2230 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.078+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bef00 con 0x55a1657b8480 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.079+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94151680711216] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.079+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.079+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94151680712784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657be470 con 0x55a1657b8480 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.079+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bfdc0 con 0x7f63980a0060 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.080+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94151680712784] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.080+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.080+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94151680719120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657bfd30 con 0x7f63980a0060 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.081+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c0c80 con 0x55a1657b2230 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.082+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.082+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94151680719120] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.082+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94151680721328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c0c80 con 0x55a1657b2230 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.082+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c1640 con 0x7f639c031040 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.083+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.083+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94151680721328] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.083+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94151680725392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c15b0 con 0x7f639c031040 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.083+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c2080 con 0x7f639c031040 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.084+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94151680725392] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.084+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.084+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94151680722896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c2080 con 0x7f639c031040 2024-04-26T07:55:40.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.084+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c2a40 con 0x7f639c031040 2024-04-26T07:55:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94151680722896] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94151680727456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c2a40 con 0x7f639c031040 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a572d800 20 add_watcher() i=0 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a572d800 20 add_watcher() i=1 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a572d800 20 add_watcher() i=2 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a572d800 20 add_watcher() i=3 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a572d800 20 add_watcher() i=4 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a572d800 20 add_watcher() i=5 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.085+0000 7f63a572d800 20 add_watcher() i=6 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.086+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94151680727456] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.086+0000 7f63a572d800 20 add_watcher() i=7 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.086+0000 7f63a572d800 2 all 8 watchers are set, enabling cache 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.086+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c5d50 con 0x55a1657b2230 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.087+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.087+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94151680743328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c2bb0 con 0x55a1657b2230 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.088+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94151680743328] v29'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.088+0000 7f62577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.088+0000 7f63a572d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.088+0000 7f63a572d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.088+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657c51b0 con 0x55a1657b2230 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.089+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.089+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cf050 con 0x7f639c031040 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.090+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.090+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cf500 con 0x55a1657b8480 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.091+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.091+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cf8a0 con 0x55a1657b2230 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.092+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.092+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cf8a0 con 0x7f63980a0060 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.093+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.093+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cfe10 con 0x55a1657b8480 2024-04-26T07:55:40.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.094+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.094+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d0240 con 0x55a1657b2230 2024-04-26T07:55:40.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.096+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.096+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d0240 con 0x7f639c031040 2024-04-26T07:55:40.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.097+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.097+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d0240 con 0x7f63980a0060 2024-04-26T07:55:40.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.098+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.098+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d08a0 con 0x55a1657b8480 2024-04-26T07:55:40.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.099+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.099+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d0c40 con 0x7f63980a0060 2024-04-26T07:55:40.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.100+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.100+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d11b0 con 0x7f639c031040 2024-04-26T07:55:40.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.101+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.101+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d11b0 con 0x7f63980a0060 2024-04-26T07:55:40.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.102+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.102+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x7f639c031040 2024-04-26T07:55:40.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.103+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.103+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b2230 2024-04-26T07:55:40.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.104+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.104+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.106+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.106+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x7f63980a0060 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.107+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.107+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.108+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.108+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b2230 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.109+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.109+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b2230 2024-04-26T07:55:40.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.110+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.110+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.111+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.111+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x7f63980a0060 2024-04-26T07:55:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.112+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.112+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.113+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.113+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.114+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.114+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.115+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.115+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.116+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.116+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x7f639c031040 2024-04-26T07:55:40.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.117+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.117+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.118+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.118+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x7f639c031040 2024-04-26T07:55:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.119+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.119+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x55a1657b8480 2024-04-26T07:55:40.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.121+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.121+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x7f639c031040 2024-04-26T07:55:40.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.122+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'56 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.122+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657d15f0 con 0x7f63980a0060 2024-04-26T07:55:40.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.123+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.123+0000 7f62567e4640 20 reqs_thread_entry: start 2024-04-26T07:55:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.123+0000 7f63a572d800 20 init_complete bucket index max shards: 11 2024-04-26T07:55:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.123+0000 7f63a572d800 20 Filter name: none 2024-04-26T07:55:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.123+0000 7f61c7fff640 20 reqs_thread_entry: start 2024-04-26T07:55:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.123+0000 7f63a572d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T07:55:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.123+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.123+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657fc450 con 0x7f639c031040 2024-04-26T07:55:40.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a572d800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a572d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a572d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a572d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657feea0 con 0x7f639c031040 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a572d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 : miss 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.124+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:96 8.10 8:0f7e256a:root::.bucket.meta.myfoo7%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1657fed80 con 0x55a1657b8480 2024-04-26T07:55:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 20 rados_obj.operate() r=0 bl.length=382 2024-04-26T07:55:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 info.flags=0x17 2024-04-26T07:55:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 to cache LRU end 2024-04-26T07:55:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:97 4.30 4:0f7e22e5:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587c200 con 0x55a1657b8480 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(97 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:98 4.b 4:d395a1b0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587c2a0 con 0x7f63980a0060 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(98 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.125+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:99 4.1d 4:ba669e8a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587c7e0 con 0x7f63980a0060 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.126+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(99 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.126+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:100 4.34 4:2dc06b19:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587c7e0 con 0x7f63980a0060 2024-04-26T07:55:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.126+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(100 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.126+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:101 4.3f 4:fe403f71:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587c7e0 con 0x7f63980a0060 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.127+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(101 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.127+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:102 4.23 4:c53ab778:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587c7e0 con 0x7f639c031040 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.127+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(102 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5 [call out=378b] v0'0 uv5 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.127+0000 7f63a572d800 10 cls_bucket_list_unordered: got fourteen 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.127+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:103 4.24 4:252c7486:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587c820 con 0x7f639c031040 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.128+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(103 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.128+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:104 4.28 4:17ff8b00:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587cd80 con 0x55a1657b2230 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.128+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(104 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.128+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:105 4.3d 4:bfe0dcaa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587cd80 con 0x55a1657b8480 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.128+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(105 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.128+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:106 4.1a 4:5846bde0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587cd80 con 0x7f63980a0060 2024-04-26T07:55:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.129+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(106 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.9 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.129+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:107 4.23 4:c7b7f291:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16587cd80 con 0x7f639c031040 2024-04-26T07:55:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.129+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(107 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.129+0000 7f63a572d800 20 get_obj_state: octx=0x7f6394001490 obj=myfoo7:fourteen state=0x55a1657ffb38 s->prefetch_data=0 2024-04-26T07:55:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.129+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:108 3.3fs0 3:ff813e1f:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165800960 con 0x7f63980a0060 2024-04-26T07:55:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.130+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(108 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.130+0000 7f63a572d800 10 manifest: total_size = 8 2024-04-26T07:55:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.130+0000 7f63a572d800 20 get_obj_state: setting s->obj_tag to 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.13713731849619517150 2024-04-26T07:55:40.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.130+0000 7f63a572d800 20 get_obj_state: octx=0x7f6394001490 obj=myfoo7:fourteen state=0x55a1657ffb38 s->prefetch_data=0 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.130+0000 7f63a572d800 20 prepare_atomic_modification: state is not atomic. state=0x55a1657ffb38 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.130+0000 7f63a572d800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.130+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:109 4.23 4:c53ab778:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165805260 con 0x7f639c031040 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.131+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(109 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5 [stat,call,call] v29'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.131+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:110 3.3fs0 3:ff813e1f:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165803240 con 0x7f63980a0060 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.132+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(110 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10_fourteen [call] v29'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f639c040040 con 0x7f63980a0060 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.132+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:111 4.23 4:c53ab778:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165805cf0 con 0x7f639c031040 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.132+0000 7f63a572d800 20 list_objects_ordered: starting attempt 1 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.132+0000 7f63a572d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.132+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:112 4.30 4:0f7e22e5:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658075e0 con 0x55a1657b8480 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.132+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:113 4.b 4:d395a1b0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165809ee0 con 0x7f63980a0060 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:114 4.1d 4:ba669e8a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658075e0 con 0x7f63980a0060 2024-04-26T07:55:40.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:115 4.34 4:2dc06b19:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165809ee0 con 0x7f63980a0060 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:116 4.3f 4:fe403f71:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658115c0 con 0x7f63980a0060 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:117 4.23 4:c53ab778:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658143e0 con 0x7f639c031040 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:118 4.24 4:252c7486:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165816d90 con 0x7f639c031040 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:119 4.28 4:17ff8b00:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165819760 con 0x55a1657b2230 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:120 4.3d 4:bfe0dcaa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165819760 con 0x55a1657b8480 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:121 4.1a 4:5846bde0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a16581e5c0 con 0x7f63980a0060 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(112 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(118 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:122 4.23 4:c7b7f291:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165821110 con 0x7f639c031040 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.133+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(119 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(120 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(122 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(113 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(114 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(111 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5 [stat,call,call] v29'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(115 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(116 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f6284ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(121 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.9 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== osd_op_reply(117 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10])"; uploads.size()=0; is_truncated=0 2024-04-26T07:55:40.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:123 4.30 4:0f7e22e5:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165819760 con 0x55a1657b8480 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:124 4.b 4:d395a1b0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165805cf0 con 0x7f63980a0060 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:125 4.1d 4:ba669e8a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165808ed0 con 0x7f63980a0060 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:126 4.34 4:2dc06b19:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165809300 con 0x7f63980a0060 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:127 4.3f 4:fe403f71:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165819760 con 0x7f63980a0060 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:128 4.23 4:c53ab778:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165809780 con 0x7f639c031040 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:129 4.24 4:252c7486:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165803200 con 0x7f639c031040 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:130 4.28 4:17ff8b00:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165805cf0 con 0x55a1657b2230 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:131 4.3d 4:bfe0dcaa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165808ed0 con 0x55a1657b8480 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:132 4.1a 4:5846bde0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165809300 con 0x7f63980a0060 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:133 4.23 4:c7b7f291:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165803200 con 0x7f639c031040 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(124 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== osd_op_reply(128 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(125 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.134+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(129 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.135+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 32 ==== osd_op_reply(126 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.135+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(133 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.135+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 33 ==== osd_op_reply(127 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.135+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(130 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.135+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 34 ==== osd_op_reply(132 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.9 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.135+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 31 ==== osd_op_reply(123 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f639809d030 con 0x55a1657b8480 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.135+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 32 ==== osd_op_reply(131 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f63980c1060 con 0x55a1657b8480 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.135+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165809300 con 0x7f639c031040 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== osd_op_reply(134 fud.buckets [call] v29'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a572d800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165809300 con 0x7f63980a0060 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 35 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a572d800 20 rados_obj.operate() r=0 bl.length=168 2024-04-26T07:55:40.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a572d800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-04-26T07:55:40.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a572d800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-04-26T07:55:40.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.136+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658075e0 con 0x7f63980a0060 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.137+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 36 ==== osd_op_reply(136 myfoo7 [call,call,delete] v29'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.137+0000 7f63a572d800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.137+0000 7f63a572d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.137+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94151681020672 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a165805cf0 con 0x7f63980a0060 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.138+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 37 ==== watch-notify(notify (1) cookie 94151680719120 notify 124554051612 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55a1657a6ef0 con 0x7f63980a0060 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.138+0000 7f6284ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94151680719120 notifier 4752 bl.length()=150 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.138+0000 7f6284ff9640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6264003d60 con 0x7f63980a0060 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.138+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 38 ==== osd_op_reply(137 notify.3 [notify cookie 94151681020672 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.138+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 39 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.138+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 40 ==== watch-notify(notify_complete (2) cookie 94151681020672 notify 124554051612 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a1657d0fe0 con 0x7f63980a0060 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.138+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:139 8.10 8:0f7e256a:root::.bucket.meta.myfoo7%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658075e0 con 0x55a1657b8480 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.139+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 33 ==== osd_op_reply(139 .bucket.meta.myfoo7:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 [call,call,delete] v29'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f63980c1060 con 0x55a1657b8480 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.139+0000 7f63a572d800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 from cache 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.139+0000 7f63a572d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10, ofs0, ns] 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.139+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94151681021824 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x55a1657b2230 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.139+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== watch-notify(notify (1) cookie 94151680711216 notify 124554051605 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55a1657d0c40 con 0x55a1657b2230 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.139+0000 7f6277fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94151680711216 notifier 4752 bl.length()=208 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.139+0000 7f6277fff640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f61d4003320 con 0x55a1657b2230 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.139+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(140 notify.1 [notify cookie 94151681021824 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== watch-notify(notify_complete (2) cookie 94151681021824 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a16577ceb0 con 0x55a1657b2230 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:142 4.30 4:0f7e22e5:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165809780 con 0x55a1657b8480 2024-04-26T07:55:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:143 4.b 4:d395a1b0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165805cf0 con 0x7f63980a0060 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:144 4.1d 4:ba669e8a:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x7f63980a0060 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:145 4.34 4:2dc06b19:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165804860 con 0x7f63980a0060 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:146 4.3f 4:fe403f71:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165805cf0 con 0x7f63980a0060 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:147 4.23 4:c53ab778:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x7f639c031040 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:148 4.24 4:252c7486:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165804860 con 0x7f639c031040 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:149 4.28 4:17ff8b00:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165805cf0 con 0x55a1657b2230 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:150 4.3d 4:bfe0dcaa:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165809780 con 0x55a1657b8480 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:151 4.1a 4:5846bde0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x7f63980a0060 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.140+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:152 4.23 4:c7b7f291:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165804860 con 0x7f639c031040 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 41 ==== osd_op_reply(144 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.2 [delete] v29'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 42 ==== osd_op_reply(151 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.9 [delete] v29'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 43 ==== osd_op_reply(143 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.1 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(149 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.7 [delete] v29'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(148 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.6 [delete] v29'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 34 ==== osd_op_reply(142 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.0 [delete] v29'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f63980c1060 con 0x55a1657b8480 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== osd_op_reply(147 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.5 [delete] v29'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 35 ==== osd_op_reply(150 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.8 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f63980c1060 con 0x55a1657b8480 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 44 ==== osd_op_reply(146 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.4 [delete] v29'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== osd_op_reply(152 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.10 [delete] v29'9 uv9 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 45 ==== osd_op_reply(145 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10.3 [delete] v29'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a572d800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 : miss 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a572d800 20 rados->read ofs=0 len=0 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.142+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:153 6.14 6:281cf9d2:::pubsub..bucket.myfoo7%2f8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x7f63980a0060 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.143+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 46 ==== osd_op_reply(153 pubsub..bucket.myfoo7/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.143+0000 7f63a572d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.143+0000 7f63a572d800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 info.flags=0x0 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.143+0000 7f63a572d800 10 adding default.rgw.log++pubsub..bucket.myfoo7/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 to cache LRU end 2024-04-26T07:55:40.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.143+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:154 6.14 6:281cf9d2:::pubsub..bucket.myfoo7%2f8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a165805cf0 con 0x7f63980a0060 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.144+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 47 ==== osd_op_reply(154 pubsub..bucket.myfoo7/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.10 [delete] v29'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.144+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x7f639c031040 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.145+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(155 fud.buckets [call] v29'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.145+0000 7f63a572d800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.145+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x7f639c031040 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 41 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v29'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a572d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94151681087216 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658056a0 con 0x55a1657b8480 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 36 ==== watch-notify(notify (1) cookie 94151680712784 notify 124554051591 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a1657fe260 con 0x55a1657b8480 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f6277fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 94151680712784 notifier 4752 bl.length()=170 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f6277fff640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f61d4003300 con 0x55a1657b8480 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 37 ==== osd_op_reply(157 notify.2 [notify cookie 94151681087216 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63980c1060 con 0x55a1657b8480 2024-04-26T07:55:40.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 38 ==== watch-notify(notify_complete (2) cookie 94151681087216 notify 124554051591 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a1657a6c60 con 0x55a1657b8480 2024-04-26T07:55:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 39 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63980c1060 con 0x55a1657b8480 2024-04-26T07:55:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a572d800 10 removing email index: 2024-04-26T07:55:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a572d800 10 removing user buckets index 2024-04-26T07:55:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.146+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x7f639c031040 2024-04-26T07:55:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 42 ==== osd_op_reply(159 fud.buckets [delete] v29'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a572d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-26T07:55:40.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94151681087216 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658056a0 con 0x7f639c031040 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 43 ==== watch-notify(notify (1) cookie 94151680722896 notify 124554051623 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a16577ceb0 con 0x7f639c031040 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f6284ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051623 cookie 94151680722896 notifier 4752 bl.length()=160 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f6284ff9640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6264003d60 con 0x7f639c031040 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 44 ==== osd_op_reply(160 notify.6 [notify cookie 94151681087216 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 45 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 46 ==== watch-notify(notify_complete (2) cookie 94151681087216 notify 124554051623 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a1657c4970 con 0x7f639c031040 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a572d800 10 removing user index: fud 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.148+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1658196f0 con 0x7f639c031040 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.149+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 47 ==== osd_op_reply(162 fud [call,call,delete] v29'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.149+0000 7f63a572d800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.149+0000 7f63a572d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T07:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.149+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94151681087216 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a1658056a0 con 0x7f639c031040 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.150+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 48 ==== watch-notify(notify (1) cookie 94151680725392 notify 124554051624 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55a1657c4970 con 0x7f639c031040 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.150+0000 7f6277fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051624 cookie 94151680725392 notifier 4752 bl.length()=152 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.150+0000 7f6277fff640 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f61d4003300 con 0x7f639c031040 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.150+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 49 ==== osd_op_reply(163 notify.5 [notify cookie 94151681087216 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.150+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 50 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.150+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 51 ==== watch-notify(notify_complete (2) cookie 94151681087216 notify 124554051624 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a16577a200 con 0x7f639c031040 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.151+0000 7f62577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.151+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94151680743328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x55a1657b2230 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.152+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 38 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94151680743328] v29'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.152+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94151680707088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x7f63980a0060 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.153+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 48 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94151680707088] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.153+0000 7f63a572d800 20 remove_watcher() i=0 2024-04-26T07:55:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.153+0000 7f63a572d800 2 removed watcher, disabling cache 2024-04-26T07:55:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.153+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94151680711216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x55a1657b2230 2024-04-26T07:55:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.155+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 39 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94151680711216] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.155+0000 7f63a572d800 20 remove_watcher() i=1 2024-04-26T07:55:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.155+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94151680712784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x55a1657b8480 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.156+0000 7f63a0b7e640 1 -- 172.21.15.62:0/139857939 <== osd.3 v2:172.21.15.62:6816/1472283839 40 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94151680712784] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63980c1060 con 0x55a1657b8480 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.156+0000 7f63a572d800 20 remove_watcher() i=2 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.156+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94151680719120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x7f63980a0060 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.157+0000 7f63a1b80640 1 -- 172.21.15.62:0/139857939 <== osd.2 v2:172.21.15.62:6808/1138534927 49 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94151680719120] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c049040 con 0x7f63980a0060 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.157+0000 7f63a572d800 20 remove_watcher() i=3 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.157+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94151680721328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x55a1657b2230 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.158+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.1 v2:172.21.15.62:6800/1888558046 40 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94151680721328] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x55a1657b2230 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.158+0000 7f63a572d800 20 remove_watcher() i=4 2024-04-26T07:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.158+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94151680725392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x7f639c031040 2024-04-26T07:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.159+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 52 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94151680725392] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.159+0000 7f63a572d800 20 remove_watcher() i=5 2024-04-26T07:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.159+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94151680722896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x7f639c031040 2024-04-26T07:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.160+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 53 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94151680722896] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.160+0000 7f63a572d800 20 remove_watcher() i=6 2024-04-26T07:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.160+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94151680727456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a1657cb260 con 0x7f639c031040 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.161+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 <== osd.0 v2:172.21.15.1:6800/3827982423 54 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94151680727456] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639402e070 con 0x7f639c031040 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.161+0000 7f63a572d800 20 remove_watcher() i=7 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f639c031040 msgr2=0x7f639c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f639c031040 0x7f639c032940 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a1657b2230 msgr2=0x55a1657b46f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a1657b2230 0x55a1657b46f0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63980a0060 msgr2=0x7f639805c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f63980a0060 0x7f639805c720 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a1657b8480 msgr2=0x55a1657ba870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a1657b8480 0x55a1657ba870 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f626c036e10 msgr2=0x7f626c0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f626c036e10 0x7f626c0392d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55a16577e190 tx=0x7f639c01f000 comp rx=0 tx=0).stop 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 msgr2=0x55a1657a6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/139857939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16579f100 0x55a1657a6720 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f63980679e0 tx=0x7f639808e0a0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 reap_dead start 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a137f640 1 -- 172.21.15.62:0/139857939 reap_dead start 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 shutdown_connections 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 >> 172.21.15.62:0/139857939 conn(0x55a16579b3d0 msgr2=0x55a165798a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 shutdown_connections 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/139857939 wait complete. 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/829304303 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6278036eb0 msgr2=0x7f6278039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/829304303 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6278036eb0 0x7f6278039370 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55a165781ea0 tx=0x7f639c005840 comp rx=0 tx=0).stop 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/829304303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165791e30 msgr2=0x55a165792250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/829304303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165791e30 0x55a165792250 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6398000c00 tx=0x7f6398002fb0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/829304303 shutdown_connections 2024-04-26T07:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/829304303 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6278036eb0 0x7f6278039370 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 --2- 172.21.15.62:0/829304303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a165791e30 0x55a165792250 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/829304303 >> 172.21.15.62:0/829304303 conn(0x55a165785ed0 msgr2=0x55a1657862d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/829304303 shutdown_connections 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.162+0000 7f63a572d800 1 -- 172.21.15.62:0/829304303 wait complete. 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a165682cc0 msgr2=0x55a165780c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a165682cc0 0x55a165780c70 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6288036e60 msgr2=0x7f6288039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6288036e60 0x7f6288039320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6398054000 tx=0x7f639804e000 comp rx=0 tx=0).stop 2024-04-26T07:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 msgr2=0x55a165779a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a165779a30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6394001ed0 tx=0x7f6394000ed0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 shutdown_connections 2024-04-26T07:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a165682cc0 0x55a165780c70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6288036e60 0x7f6288039320 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 --2- 172.21.15.62:0/979497021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a16567f1b0 0x55a165779a30 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 >> 172.21.15.62:0/979497021 conn(0x55a165678be0 msgr2=0x55a16567d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 shutdown_connections 2024-04-26T07:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:55:40.163+0000 7f63a572d800 1 -- 172.21.15.62:0/979497021 wait complete. 2024-04-26T07:56:20.171 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-04-26T07:56:20.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-04-26T07:56:20.172 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-04-26T07:56:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.228+0000 7f552f011800 1 Processor -- start 2024-04-26T07:56:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.228+0000 7f552f011800 1 -- start start 2024-04-26T07:56:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.228+0000 7f552f011800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x562fbbfc1ae0 0x562fbbfc3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.228+0000 7f552f011800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562fbbfc44a0 con 0x562fbbfbd740 2024-04-26T07:56:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.228+0000 7f552f011800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x562fbbe5fe20 con 0x562fbbfc1ae0 2024-04-26T07:56:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.228+0000 7f5529e13640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x562fbbfc1ae0 0x562fbbfc3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.228+0000 7f552a614640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x562fbbfbd740 0x562fbbfbdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:55528/0 (socket says 172.21.15.62:55528) 2024-04-26T07:56:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.228+0000 7f552a614640 1 -- 172.21.15.62:0/3118710254 learned_addr learned my addr 172.21.15.62:0/3118710254 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.229+0000 7f5529e13640 1 -- 172.21.15.62:0/3118710254 >> v1:172.21.15.1:6789/0 conn(0x562fbbfbd740 legacy=0x562fbbfbdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.229+0000 7f5529612640 1 -- 172.21.15.62:0/3118710254 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2343107204 0 0) 0x562fbbfc44a0 con 0x562fbbfbd740 2024-04-26T07:56:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.229+0000 7f5529e13640 1 -- 172.21.15.62:0/3118710254 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fbbfc56d0 con 0x562fbbfc1ae0 2024-04-26T07:56:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.231+0000 7f5529e13640 1 --2- 172.21.15.62:0/3118710254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfc1ae0 0x562fbbfc3ed0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f551400a470 tx=0x7f551401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62211e38500b1116 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.231+0000 7f5529612640 1 -- 172.21.15.62:0/3118710254 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514057070 con 0x562fbbfc1ae0 2024-04-26T07:56:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.231+0000 7f5529612640 1 -- 172.21.15.62:0/3118710254 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514052570 con 0x562fbbfc1ae0 2024-04-26T07:56:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.231+0000 7f5529612640 1 -- 172.21.15.62:0/3118710254 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514052870 con 0x562fbbfc1ae0 2024-04-26T07:56:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.231+0000 7f552f011800 1 -- 172.21.15.62:0/3118710254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfc1ae0 msgr2=0x562fbbfc3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.231+0000 7f552f011800 1 --2- 172.21.15.62:0/3118710254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfc1ae0 0x562fbbfc3ed0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f551400a470 tx=0x7f551401ce90 comp rx=0 tx=0).stop 2024-04-26T07:56:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.232+0000 7f552f011800 1 -- 172.21.15.62:0/3118710254 shutdown_connections 2024-04-26T07:56:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.232+0000 7f552f011800 1 --2- 172.21.15.62:0/3118710254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfc1ae0 0x562fbbfc3ed0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.232+0000 7f552f011800 1 -- 172.21.15.62:0/3118710254 >> 172.21.15.62:0/3118710254 conn(0x562fbbfb8d20 msgr2=0x562fbbfbb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.232+0000 7f552f011800 1 -- 172.21.15.62:0/3118710254 shutdown_connections 2024-04-26T07:56:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.232+0000 7f552f011800 1 -- 172.21.15.62:0/3118710254 wait complete. 2024-04-26T07:56:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.246+0000 7f552f011800 1 Processor -- start 2024-04-26T07:56:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.246+0000 7f552f011800 1 -- start start 2024-04-26T07:56:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.247+0000 7f552f011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.247+0000 7f552f011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562fbbf08cd0 con 0x562fbbfbd740 2024-04-26T07:56:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.247+0000 7f552a614640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.247+0000 7f552a614640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47604/0 (socket says 172.21.15.62:47604) 2024-04-26T07:56:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.247+0000 7f552a614640 1 -- 172.21.15.62:0/37337569 learned_addr learned my addr 172.21.15.62:0/37337569 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.247+0000 7f552a614640 1 -- 172.21.15.62:0/37337569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fbc0aefd0 con 0x562fbbfbd740 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.248+0000 7f552a614640 1 --2- 172.21.15.62:0/37337569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0aea00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f551c001660 tx=0x7f551c001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4feb05f05dfb2198 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.248+0000 7f5418608640 1 -- 172.21.15.62:0/37337569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c003450 con 0x562fbbfbd740 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.248+0000 7f5418608640 1 -- 172.21.15.62:0/37337569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c003610 con 0x562fbbfbd740 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.248+0000 7f5418608640 1 -- 172.21.15.62:0/37337569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c0039b0 con 0x562fbbfbd740 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.248+0000 7f552f011800 1 -- 172.21.15.62:0/37337569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 msgr2=0x562fbc0aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.248+0000 7f552f011800 1 --2- 172.21.15.62:0/37337569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0aea00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f551c001660 tx=0x7f551c001b20 comp rx=0 tx=0).stop 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 -- 172.21.15.62:0/37337569 shutdown_connections 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 --2- 172.21.15.62:0/37337569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0aea00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 -- 172.21.15.62:0/37337569 >> 172.21.15.62:0/37337569 conn(0x562fbbfb8d20 msgr2=0x562fbc0aa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 -- 172.21.15.62:0/37337569 shutdown_connections 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 -- 172.21.15.62:0/37337569 wait complete. 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 Processor -- start 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 -- start start 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.249+0000 7f552f011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562fbbfc4970 con 0x562fbbfbd740 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f552a614640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f552a614640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47608/0 (socket says 172.21.15.62:47608) 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f552a614640 1 -- 172.21.15.62:0/163633260 learned_addr learned my addr 172.21.15.62:0/163633260 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f552a614640 1 -- 172.21.15.62:0/163633260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fbc0b6ac0 con 0x562fbbfbd740 2024-04-26T07:56:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f552a614640 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0b6580 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x562fbc0af790 tx=0x7f551c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f5416e05640 1 -- 172.21.15.62:0/163633260 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c025070 con 0x562fbbfbd740 2024-04-26T07:56:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f5416e05640 1 -- 172.21.15.62:0/163633260 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c019040 con 0x562fbbfbd740 2024-04-26T07:56:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fbc0b6d50 con 0x562fbbfbd740 2024-04-26T07:56:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f5416e05640 1 -- 172.21.15.62:0/163633260 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c013950 con 0x562fbbfbd740 2024-04-26T07:56:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.250+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fbc0b9a00 con 0x562fbbfbd740 2024-04-26T07:56:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.251+0000 7f5416e05640 1 -- 172.21.15.62:0/163633260 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f551c010070 con 0x562fbbfbd740 2024-04-26T07:56:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.251+0000 7f5416e05640 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5410036eb0 0x7f5410039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.251+0000 7f5416e05640 1 -- 172.21.15.62:0/163633260 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f551c04c4b0 con 0x562fbbfbd740 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.252+0000 7f5529e13640 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5410036eb0 0x7f5410039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.252+0000 7f552f011800 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbbfc1ae0 0x562fbc0bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.252+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0bdd90 con 0x562fbbfc1ae0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.252+0000 7f552ae15640 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbbfc1ae0 0x562fbc0bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.252+0000 7f552ae15640 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbbfc1ae0 0x562fbc0bd7c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.252+0000 7f5529e13640 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5410036eb0 0x7f5410039370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5514054000 tx=0x7f551404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.252+0000 7f552ae15640 1 -- 172.21.15.62:0/163633260 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55240083e0 con 0x562fbbfc1ae0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.252+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0bad50 con 0x562fbbfc1ae0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.253+0000 7f552ae15640 1 -- 172.21.15.62:0/163633260 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55240083e0 con 0x562fbbfc1ae0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.253+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0bfb90 con 0x562fbbfc1ae0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.253+0000 7f552ae15640 1 -- 172.21.15.62:0/163633260 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f55240083e0 con 0x562fbbfc1ae0 2024-04-26T07:56:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.253+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0beed0 con 0x562fbbfc1ae0 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.254+0000 7f552ae15640 1 -- 172.21.15.62:0/163633260 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55240083e0 con 0x562fbbfc1ae0 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.254+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0bf2c0 con 0x562fbbfc1ae0 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.254+0000 7f552ae15640 1 -- 172.21.15.62:0/163633260 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55240083e0 con 0x562fbbfc1ae0 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.254+0000 7f552f011800 1 Processor -- start 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.254+0000 7f552f011800 1 -- start start 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.255+0000 7f552f011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbc0ce980 0x562fbc0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.255+0000 7f552f011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562fbbeb0170 con 0x562fbc0ce980 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.255+0000 7f5529e13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbc0ce980 0x562fbc0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.255+0000 7f5529e13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbc0ce980 0x562fbc0ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47610/0 (socket says 172.21.15.62:47610) 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.255+0000 7f5529e13640 1 -- 172.21.15.62:0/1359170328 learned_addr learned my addr 172.21.15.62:0/1359170328 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.255+0000 7f5529e13640 1 -- 172.21.15.62:0/1359170328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fbc0cf2e0 con 0x562fbc0ce980 2024-04-26T07:56:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.255+0000 7f5529e13640 1 --2- 172.21.15.62:0/1359170328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbc0ce980 0x562fbc0ceda0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5514000c00 tx=0x7f5514002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.256+0000 7f540ffff640 1 -- 172.21.15.62:0/1359170328 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514057040 con 0x562fbc0ce980 2024-04-26T07:56:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.256+0000 7f540ffff640 1 -- 172.21.15.62:0/1359170328 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551406d070 con 0x562fbc0ce980 2024-04-26T07:56:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.256+0000 7f552f011800 1 -- 172.21.15.62:0/1359170328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fbc0cfd50 con 0x562fbc0ce980 2024-04-26T07:56:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.256+0000 7f540ffff640 1 -- 172.21.15.62:0/1359170328 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551405ea70 con 0x562fbc0ce980 2024-04-26T07:56:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.256+0000 7f552f011800 1 -- 172.21.15.62:0/1359170328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fbc0d01f0 con 0x562fbc0ce980 2024-04-26T07:56:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.256+0000 7f540ffff640 1 -- 172.21.15.62:0/1359170328 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5514067070 con 0x562fbc0ce980 2024-04-26T07:56:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.257+0000 7f540ffff640 1 --2- 172.21.15.62:0/1359170328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5404036e60 0x7f5404039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.257+0000 7f540ffff640 1 -- 172.21.15.62:0/1359170328 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f5514090480 con 0x562fbc0ce980 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.257+0000 7f552ae15640 1 --2- 172.21.15.62:0/1359170328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5404036e60 0x7f5404039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.257+0000 7f552f011800 1 Processor -- start 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.257+0000 7f552f011800 1 -- start start 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.257+0000 7f552ae15640 1 --2- 172.21.15.62:0/1359170328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5404036e60 0x7f5404039320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x562fbc0be9f0 tx=0x7f5524000f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.257+0000 7f552f011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbbf33100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.257+0000 7f552f011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562fbc0af2f0 con 0x562fbbf32ce0 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.258+0000 7f5529e13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbbf33100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.258+0000 7f5529e13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbbf33100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47618/0 (socket says 172.21.15.62:47618) 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.258+0000 7f5529e13640 1 -- 172.21.15.62:0/59902946 learned_addr learned my addr 172.21.15.62:0/59902946 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.258+0000 7f5529e13640 1 -- 172.21.15.62:0/59902946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fbbf314e0 con 0x562fbbf32ce0 2024-04-26T07:56:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.258+0000 7f5529e13640 1 --2- 172.21.15.62:0/59902946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbbf33100 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f551408e700 tx=0x7f551408e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec5aef48daf66d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.258+0000 7f540dffb640 1 -- 172.21.15.62:0/59902946 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551408d130 con 0x562fbbf32ce0 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f540dffb640 1 -- 172.21.15.62:0/59902946 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514080070 con 0x562fbbf32ce0 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f540dffb640 1 -- 172.21.15.62:0/59902946 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551408d2d0 con 0x562fbbf32ce0 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f552f011800 1 -- 172.21.15.62:0/59902946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 msgr2=0x562fbbf33100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f552f011800 1 --2- 172.21.15.62:0/59902946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbbf33100 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f551408e700 tx=0x7f551408e840 comp rx=0 tx=0).stop 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f552f011800 1 -- 172.21.15.62:0/59902946 shutdown_connections 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f552f011800 1 --2- 172.21.15.62:0/59902946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbbf33100 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f552f011800 1 -- 172.21.15.62:0/59902946 >> 172.21.15.62:0/59902946 conn(0x562fbc0d7f60 msgr2=0x562fbc0d5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f552f011800 1 -- 172.21.15.62:0/59902946 shutdown_connections 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.259+0000 7f552f011800 1 -- 172.21.15.62:0/59902946 wait complete. 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.260+0000 7f552f011800 1 Processor -- start 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.260+0000 7f552f011800 1 -- start start 2024-04-26T07:56:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.260+0000 7f552f011800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbc0e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.260+0000 7f552f011800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562fbbf31950 con 0x562fbbf32ce0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.260+0000 7f5529e13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbc0e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.260+0000 7f5529e13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbc0e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47624/0 (socket says 172.21.15.62:47624) 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.260+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 learned_addr learned my addr 172.21.15.62:0/2222076636 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.260+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fbc0e58e0 con 0x562fbbf32ce0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.261+0000 7f5529e13640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbc0e53a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f551408e700 tx=0x7f551408e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.261+0000 7f53fbfff640 1 -- 172.21.15.62:0/2222076636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514094070 con 0x562fbbf32ce0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.261+0000 7f53fbfff640 1 -- 172.21.15.62:0/2222076636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551408ed20 con 0x562fbbf32ce0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.261+0000 7f53fbfff640 1 -- 172.21.15.62:0/2222076636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514067de0 con 0x562fbbf32ce0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.261+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fbc0e5b70 con 0x562fbbf32ce0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.261+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fbc0e8820 con 0x562fbbf32ce0 2024-04-26T07:56:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.262+0000 7f53fbfff640 1 -- 172.21.15.62:0/2222076636 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5514097070 con 0x562fbbf32ce0 2024-04-26T07:56:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.262+0000 7f53fbfff640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53f4036e10 0x7f53f40392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.262+0000 7f53fbfff640 1 -- 172.21.15.62:0/2222076636 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f551409ad60 con 0x562fbbf32ce0 2024-04-26T07:56:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.262+0000 7f552ae15640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53f4036e10 0x7f53f40392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552ae15640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53f4036e10 0x7f53f40392d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f552400f010 tx=0x7f552400c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbc0f0f30 0x562fbc0f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f3b40 con 0x562fbc0f0f30 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552a614640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbc0f0f30 0x562fbc0f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552a614640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbc0f0f30 0x562fbc0f33f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552f011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552f011800 20 realm 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.263+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f3f50 con 0x562fbc0f0f30 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f4820 con 0x562fbc0f0f30 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f4bc0 con 0x562fbc0f0f30 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.264+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f5410 con 0x562fbc0f0f30 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.265+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.265+0000 7f552f011800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.265+0000 7f552f011800 20 searching for the correct realm 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.265+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562fbc0f7180 0x562fbc0f9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.265+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.265+0000 7f5529e13640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562fbc0f7180 0x562fbc0f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.265+0000 7f5529e13640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562fbc0f7180 0x562fbc0f9570 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.266+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.266+0000 7f5529e13640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5514099070 0x7f5514092110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.266+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5514099070 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.266+0000 7f552ae15640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5514099070 0x7f5514092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.266+0000 7f552ae15640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5514099070 0x7f5514092110 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.266+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.267+0000 7f552ae15640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f5524019040 0x7f5524019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.267+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5524019040 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.267+0000 7f552a614640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f5524019040 0x7f5524019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.267+0000 7f552a614640 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f5524019040 0x7f5524019930 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.268+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.268+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f0f30 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.268+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.268+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f0f30 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.268+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.268+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f0f30 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.268+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.268+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5524019040 2024-04-26T07:56:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.269+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.269+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5514099070 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.269+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.269+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.269+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.269+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f0f30 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.270+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.270+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5524019040 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.270+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.270+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f0f30 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.270+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.270+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5514099070 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.271+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.271+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.271+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.271+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.271+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.271+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5524019040 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.272+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.272+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.272+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.272+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.272+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.272+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f0f30 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.272+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.272+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f0f30 2024-04-26T07:56:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.273+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.273+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5524019040 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.273+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.273+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.273+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.273+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5514099070 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.274+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.274+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f0f30 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.274+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.274+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5524019040 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.274+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.274+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.275+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.275+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5524019040 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.275+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.275+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5514099070 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.275+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.275+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x562fbc0f7180 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.276+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.276+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9b50 con 0x7f5524019040 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.276+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.276+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f551c055040 con 0x562fbc0f0f30 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.276+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.276+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f551c055040 con 0x7f5514099070 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f5c60 con 0x562fbc0f0f30 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f6050 con 0x562fbc0f0f30 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.277+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f6050 con 0x562fbc0f0f30 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 20 zone default found 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 4 Realm: () 2024-04-26T07:56:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 20 zonegroup default 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0f9fd0 con 0x7f5524019040 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.278+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fb9b0 con 0x562fbc0f7180 2024-04-26T07:56:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f552f011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fbd50 con 0x562fbc0f7180 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f552f011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f552f011800 20 started sync module instance, tier type = 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f552f011800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.279+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fae50 con 0x7f5514099070 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.280+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.280+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94763018597280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fae50 con 0x7f5514099070 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.280+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fc710 con 0x562fbc0f0f30 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.281+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94763018597280] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.282+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.282+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94763018595200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fc710 con 0x562fbc0f0f30 2024-04-26T07:56:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.282+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fd0d0 con 0x562fbc0f7180 2024-04-26T07:56:20.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.283+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94763018595200] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.283+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.283+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94763018601056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fc680 con 0x562fbc0f7180 2024-04-26T07:56:20.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.283+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fdf90 con 0x7f5514099070 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.284+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94763018601056] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.285+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.285+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94763018607328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fe3b0 con 0x7f5514099070 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.285+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fed70 con 0x562fbc0f0f30 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.286+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.286+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94763018610880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0ff190 con 0x562fbc0f0f30 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.286+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0ffc80 con 0x7f5524019040 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.286+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94763018607328] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.287+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94763018610880] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.287+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.287+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94763018614608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fece0 con 0x7f5524019040 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.287+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc100520 con 0x7f5524019040 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.288+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94763018614608] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.289+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.289+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94763018608384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fece0 con 0x7f5524019040 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.289+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc100ac0 con 0x7f5524019040 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94763018608384] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94763018618288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc100a80 con 0x7f5524019040 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552f011800 20 add_watcher() i=0 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552f011800 20 add_watcher() i=1 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552f011800 20 add_watcher() i=2 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552f011800 20 add_watcher() i=3 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552f011800 20 add_watcher() i=4 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552f011800 20 add_watcher() i=5 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.290+0000 7f552f011800 20 add_watcher() i=6 2024-04-26T07:56:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.291+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94763018618288] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.291+0000 7f552f011800 20 add_watcher() i=7 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.291+0000 7f552f011800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.291+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc103f40 con 0x562fbc0f0f30 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.291+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.291+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94763018616512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc101430 con 0x562fbc0f0f30 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94763018616512] v29'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f53e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f552f011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f552f011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f552f011800 5 note: GC not initialized 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f535b7fe640 20 reqs_thread_entry: start 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f552f011800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f552f011800 20 Filter name: none 2024-04-26T07:56:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f53597fa640 20 reqs_thread_entry: start 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f552f011800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.293+0000 7f552f011800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.294+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562fbc137720 con 0x562fbc0f0f30 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.294+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.294+0000 7f552f011800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.294+0000 7f552f011800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.294+0000 7f552f011800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.294+0000 7f552f011800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.294+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc13a1b0 con 0x7f5524019040 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.296+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 usage.10 [call] v29'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.296+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc13a1b0 con 0x7f5524019040 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.297+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(64 usage.10 [call] v29'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.298+0000 7f53e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.298+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94763018616512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0ed650 con 0x562fbc0f0f30 2024-04-26T07:56:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.299+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94763018616512] v29'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.299+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94763018597280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0ffec0 con 0x7f5514099070 2024-04-26T07:56:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.300+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94763018597280] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.300+0000 7f552f011800 20 remove_watcher() i=0 2024-04-26T07:56:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.300+0000 7f552f011800 2 removed watcher, disabling cache 2024-04-26T07:56:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.300+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94763018595200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc1372c0 con 0x562fbc0f0f30 2024-04-26T07:56:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.301+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94763018595200] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.301+0000 7f552f011800 20 remove_watcher() i=1 2024-04-26T07:56:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.301+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94763018601056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc1372c0 con 0x562fbc0f7180 2024-04-26T07:56:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.302+0000 7f5529e13640 1 -- 172.21.15.62:0/2222076636 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94763018601056] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140a0070 con 0x562fbc0f7180 2024-04-26T07:56:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.303+0000 7f552f011800 20 remove_watcher() i=2 2024-04-26T07:56:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.303+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94763018607328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0ffec0 con 0x7f5514099070 2024-04-26T07:56:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.304+0000 7f552ae15640 1 -- 172.21.15.62:0/2222076636 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94763018607328] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552402f040 con 0x7f5514099070 2024-04-26T07:56:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.304+0000 7f552f011800 20 remove_watcher() i=3 2024-04-26T07:56:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.304+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94763018610880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fc260 con 0x562fbc0f0f30 2024-04-26T07:56:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.305+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94763018610880] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x562fbc0f0f30 2024-04-26T07:56:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.305+0000 7f552f011800 20 remove_watcher() i=4 2024-04-26T07:56:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.305+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94763018614608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fdae0 con 0x7f5524019040 2024-04-26T07:56:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.306+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94763018614608] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.306+0000 7f552f011800 20 remove_watcher() i=5 2024-04-26T07:56:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.306+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94763018608384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0ffec0 con 0x7f5524019040 2024-04-26T07:56:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.307+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94763018608384] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.307+0000 7f552f011800 20 remove_watcher() i=6 2024-04-26T07:56:20.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.307+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94763018618288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562fbc0fdf90 con 0x7f5524019040 2024-04-26T07:56:20.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94763018618288] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c00f030 con 0x7f5524019040 2024-04-26T07:56:20.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 20 remove_watcher() i=7 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f5524019040 msgr2=0x7f5524019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f5524019040 0x7f5524019930 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbc0f0f30 msgr2=0x562fbc0f33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbc0f0f30 0x562fbc0f33f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5514099070 msgr2=0x7f5514092110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f5514099070 0x7f5514092110 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562fbc0f7180 msgr2=0x562fbc0f9570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x562fbc0f7180 0x562fbc0f9570 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53f4036e10 msgr2=0x7f53f40392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53f4036e10 0x7f53f40392d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f552400f010 tx=0x7f552400c040 comp rx=0 tx=0).stop 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552a614640 1 -- 172.21.15.62:0/2222076636 reap_dead start 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 msgr2=0x562fbc0e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbc0e53a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f551408e700 tx=0x7f551408e690 comp rx=0 tx=0).stop 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 shutdown_connections 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/2222076636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbf32ce0 0x562fbc0e53a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 >> 172.21.15.62:0/2222076636 conn(0x562fbc0d7f60 msgr2=0x562fbc0d55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 shutdown_connections 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/2222076636 wait complete. 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/1359170328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5404036e60 msgr2=0x7f5404039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/1359170328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5404036e60 0x7f5404039320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x562fbc0be9f0 tx=0x7f5524000f90 comp rx=0 tx=0).stop 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 -- 172.21.15.62:0/1359170328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbc0ce980 msgr2=0x562fbc0ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.309+0000 7f552f011800 1 --2- 172.21.15.62:0/1359170328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbc0ce980 0x562fbc0ceda0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5514000c00 tx=0x7f5514002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/1359170328 shutdown_connections 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 --2- 172.21.15.62:0/1359170328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5404036e60 0x7f5404039320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 --2- 172.21.15.62:0/1359170328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbc0ce980 0x562fbc0ceda0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/1359170328 >> 172.21.15.62:0/1359170328 conn(0x562fbc0c2a20 msgr2=0x562fbc0c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/1359170328 shutdown_connections 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/1359170328 wait complete. 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbbfc1ae0 msgr2=0x562fbc0bd7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbbfc1ae0 0x562fbc0bd7c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5410036eb0 msgr2=0x7f5410039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5410036eb0 0x7f5410039370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5514054000 tx=0x7f551404e000 comp rx=0 tx=0).stop 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 msgr2=0x562fbc0b6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0b6580 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x562fbc0af790 tx=0x7f551c001250 comp rx=0 tx=0).stop 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 shutdown_connections 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x562fbbfc1ae0 0x562fbc0bd7c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5410036eb0 0x7f5410039370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 --2- 172.21.15.62:0/163633260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562fbbfbd740 0x562fbc0b6580 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 >> 172.21.15.62:0/163633260 conn(0x562fbbfb8d20 msgr2=0x562fbc0a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 shutdown_connections 2024-04-26T07:56:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.310+0000 7f552f011800 1 -- 172.21.15.62:0/163633260 wait complete. 2024-04-26T07:56:20.316 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-26T07:56:20.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-26T07:56:20.316 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-26T07:56:20.360 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.364+0000 7fc19580e800 1 Processor -- start 2024-04-26T07:56:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.364+0000 7fc19580e800 1 -- start start 2024-04-26T07:56:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.364+0000 7fc19580e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564f1e4f9b00 0x564f1e502600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.364+0000 7fc19580e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f1e46c8b0 con 0x564f1e4f7fc0 2024-04-26T07:56:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.364+0000 7fc19580e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x564f1e39be20 con 0x564f1e4f9b00 2024-04-26T07:56:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.365+0000 7fc192b13640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x564f1e4f9b00 0x564f1e502600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.365+0000 7fc193314640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x564f1e4f7fc0 0x564f1e4f83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:55540/0 (socket says 172.21.15.62:55540) 2024-04-26T07:56:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.365+0000 7fc193314640 1 -- 172.21.15.62:0/4102277274 learned_addr learned my addr 172.21.15.62:0/4102277274 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.365+0000 7fc192b13640 1 -- 172.21.15.62:0/4102277274 >> v1:172.21.15.1:6789/0 conn(0x564f1e4f7fc0 legacy=0x564f1e4f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.365+0000 7fc192b13640 1 -- 172.21.15.62:0/4102277274 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1e46ca80 con 0x564f1e4f9b00 2024-04-26T07:56:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.367+0000 7fc192b13640 1 --2- 172.21.15.62:0/4102277274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f9b00 0x564f1e502600 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc18800a470 tx=0x7fc18801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a68a65d2f6873e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.367+0000 7fc192312640 1 -- 172.21.15.62:0/4102277274 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188057070 con 0x564f1e4f9b00 2024-04-26T07:56:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.367+0000 7fc192312640 1 -- 172.21.15.62:0/4102277274 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188052570 con 0x564f1e4f9b00 2024-04-26T07:56:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.367+0000 7fc192312640 1 -- 172.21.15.62:0/4102277274 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188052870 con 0x564f1e4f9b00 2024-04-26T07:56:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.368+0000 7fc19580e800 1 -- 172.21.15.62:0/4102277274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f9b00 msgr2=0x564f1e502600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.368+0000 7fc19580e800 1 --2- 172.21.15.62:0/4102277274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f9b00 0x564f1e502600 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc18800a470 tx=0x7fc18801ce90 comp rx=0 tx=0).stop 2024-04-26T07:56:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.368+0000 7fc19580e800 1 -- 172.21.15.62:0/4102277274 shutdown_connections 2024-04-26T07:56:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.368+0000 7fc19580e800 1 --2- 172.21.15.62:0/4102277274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f9b00 0x564f1e502600 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.368+0000 7fc19580e800 1 -- 172.21.15.62:0/4102277274 >> 172.21.15.62:0/4102277274 conn(0x564f1e4f3ba0 msgr2=0x564f1e4f5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.368+0000 7fc19580e800 1 -- 172.21.15.62:0/4102277274 shutdown_connections 2024-04-26T07:56:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.368+0000 7fc19580e800 1 -- 172.21.15.62:0/4102277274 wait complete. 2024-04-26T07:56:20.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.380+0000 7fc19580e800 1 Processor -- start 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.380+0000 7fc19580e800 1 -- start start 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.380+0000 7fc19580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.380+0000 7fc19580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f1e444cd0 con 0x564f1e4f7fc0 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.381+0000 7fc193314640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.381+0000 7fc193314640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5eceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47654/0 (socket says 172.21.15.62:47654) 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.381+0000 7fc193314640 1 -- 172.21.15.62:0/2715380225 learned_addr learned my addr 172.21.15.62:0/2715380225 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.381+0000 7fc193314640 1 -- 172.21.15.62:0/2715380225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1e5ed480 con 0x564f1e4f7fc0 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.381+0000 7fc193314640 1 --2- 172.21.15.62:0/2715380225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5eceb0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc184001de0 tx=0x7fc18400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae88c86a724d300 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc08160a640 1 -- 172.21.15.62:0/2715380225 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184012020 con 0x564f1e4f7fc0 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc08160a640 1 -- 172.21.15.62:0/2715380225 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18400e5a0 con 0x564f1e4f7fc0 2024-04-26T07:56:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc08160a640 1 -- 172.21.15.62:0/2715380225 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18400e8c0 con 0x564f1e4f7fc0 2024-04-26T07:56:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc19580e800 1 -- 172.21.15.62:0/2715380225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 msgr2=0x564f1e5eceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc19580e800 1 --2- 172.21.15.62:0/2715380225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5eceb0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc184001de0 tx=0x7fc18400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc19580e800 1 -- 172.21.15.62:0/2715380225 shutdown_connections 2024-04-26T07:56:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc19580e800 1 --2- 172.21.15.62:0/2715380225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5eceb0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc19580e800 1 -- 172.21.15.62:0/2715380225 >> 172.21.15.62:0/2715380225 conn(0x564f1e4f3ba0 msgr2=0x564f1e5e87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc19580e800 1 -- 172.21.15.62:0/2715380225 shutdown_connections 2024-04-26T07:56:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.382+0000 7fc19580e800 1 -- 172.21.15.62:0/2715380225 wait complete. 2024-04-26T07:56:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.383+0000 7fc19580e800 1 Processor -- start 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.383+0000 7fc19580e800 1 -- start start 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.383+0000 7fc19580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.383+0000 7fc19580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f1e502e10 con 0x564f1e4f7fc0 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.383+0000 7fc193314640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.383+0000 7fc193314640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5f49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47664/0 (socket says 172.21.15.62:47664) 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.383+0000 7fc193314640 1 -- 172.21.15.62:0/1082137559 learned_addr learned my addr 172.21.15.62:0/1082137559 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.383+0000 7fc193314640 1 -- 172.21.15.62:0/1082137559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1e5f4f30 con 0x564f1e4f7fc0 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.384+0000 7fc193314640 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5f49f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc18400c010 tx=0x7fc184000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.384+0000 7fc07fe07640 1 -- 172.21.15.62:0/1082137559 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184012070 con 0x564f1e4f7fc0 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.384+0000 7fc07fe07640 1 -- 172.21.15.62:0/1082137559 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18401a7a0 con 0x564f1e4f7fc0 2024-04-26T07:56:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.384+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f1e5f51c0 con 0x564f1e4f7fc0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.384+0000 7fc07fe07640 1 -- 172.21.15.62:0/1082137559 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18401aa80 con 0x564f1e4f7fc0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.384+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1e5f7e70 con 0x564f1e4f7fc0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.385+0000 7fc07fe07640 1 -- 172.21.15.62:0/1082137559 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc184015020 con 0x564f1e4f7fc0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.385+0000 7fc07fe07640 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc078036eb0 0x7fc078039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.385+0000 7fc07fe07640 1 -- 172.21.15.62:0/1082137559 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc184020070 con 0x564f1e4f7fc0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.385+0000 7fc192b13640 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc078036eb0 0x7fc078039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.385+0000 7fc19580e800 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e4f9b00 0x564f1e5fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.385+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e5fc170 con 0x564f1e4f9b00 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.385+0000 7fc193b15640 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e4f9b00 0x564f1e5fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.385+0000 7fc192b13640 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc078036eb0 0x7fc078039370 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc188054000 tx=0x7fc18804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.386+0000 7fc193b15640 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e4f9b00 0x564f1e5fbc30 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.386+0000 7fc193b15640 1 -- 172.21.15.62:0/1082137559 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.386+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e5f9200 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.386+0000 7fc193b15640 1 -- 172.21.15.62:0/1082137559 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.386+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e5fdfb0 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.387+0000 7fc193b15640 1 -- 172.21.15.62:0/1082137559 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.387+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e5fd2f0 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.387+0000 7fc193b15640 1 -- 172.21.15.62:0/1082137559 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.387+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e5fd690 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.387+0000 7fc193b15640 1 -- 172.21.15.62:0/1082137559 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564f1e4f9b00 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.387+0000 7fc19580e800 1 Processor -- start 2024-04-26T07:56:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.387+0000 7fc19580e800 1 -- start start 2024-04-26T07:56:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.388+0000 7fc19580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e60ce20 0x564f1e60d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.388+0000 7fc19580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f1e3ec170 con 0x564f1e60ce20 2024-04-26T07:56:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.388+0000 7fc192b13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e60ce20 0x564f1e60d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.388+0000 7fc192b13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e60ce20 0x564f1e60d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47680/0 (socket says 172.21.15.62:47680) 2024-04-26T07:56:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.388+0000 7fc192b13640 1 -- 172.21.15.62:0/2372266332 learned_addr learned my addr 172.21.15.62:0/2372266332 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.388+0000 7fc192b13640 1 -- 172.21.15.62:0/2372266332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1e60d7a0 con 0x564f1e60ce20 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.388+0000 7fc192b13640 1 --2- 172.21.15.62:0/2372266332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e60ce20 0x564f1e60d260 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc188055040 tx=0x7fc188002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.389+0000 7fc07d602640 1 -- 172.21.15.62:0/2372266332 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188057040 con 0x564f1e60ce20 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.389+0000 7fc07d602640 1 -- 172.21.15.62:0/2372266332 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18806d070 con 0x564f1e60ce20 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.389+0000 7fc07d602640 1 -- 172.21.15.62:0/2372266332 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18805dcb0 con 0x564f1e60ce20 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.389+0000 7fc19580e800 1 -- 172.21.15.62:0/2372266332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f1e60e130 con 0x564f1e60ce20 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.389+0000 7fc19580e800 1 -- 172.21.15.62:0/2372266332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1e60e5d0 con 0x564f1e60ce20 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.389+0000 7fc07d602640 1 -- 172.21.15.62:0/2372266332 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc188067070 con 0x564f1e60ce20 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc07d602640 1 --2- 172.21.15.62:0/2372266332 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc06c036e60 0x7fc06c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc07d602640 1 -- 172.21.15.62:0/2372266332 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc1880901e0 con 0x564f1e60ce20 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc193b15640 1 --2- 172.21.15.62:0/2372266332 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc06c036e60 0x7fc06c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc19580e800 1 Processor -- start 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc19580e800 1 -- start start 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc193b15640 1 --2- 172.21.15.62:0/2372266332 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc06c036e60 0x7fc06c039320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x564f1e5fce10 tx=0x7fc18c005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc19580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e61a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc19580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f1e5ed800 con 0x564f1e61a000 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc192b13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e61a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc192b13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e61a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47682/0 (socket says 172.21.15.62:47682) 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.390+0000 7fc192b13640 1 -- 172.21.15.62:0/3365614634 learned_addr learned my addr 172.21.15.62:0/3365614634 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.391+0000 7fc192b13640 1 -- 172.21.15.62:0/3365614634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1e61a9f0 con 0x564f1e61a000 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.391+0000 7fc192b13640 1 --2- 172.21.15.62:0/3365614634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e61a420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc188090150 tx=0x7fc188006640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2722e780ac8e5816 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.391+0000 7fc076ffd640 1 -- 172.21.15.62:0/3365614634 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188068580 con 0x564f1e61a000 2024-04-26T07:56:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.391+0000 7fc076ffd640 1 -- 172.21.15.62:0/3365614634 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188067360 con 0x564f1e61a000 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.391+0000 7fc076ffd640 1 -- 172.21.15.62:0/3365614634 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188067c80 con 0x564f1e61a000 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 -- 172.21.15.62:0/3365614634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 msgr2=0x564f1e61a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 --2- 172.21.15.62:0/3365614634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e61a420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc188090150 tx=0x7fc188006640 comp rx=0 tx=0).stop 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 -- 172.21.15.62:0/3365614634 shutdown_connections 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 --2- 172.21.15.62:0/3365614634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e61a420 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 -- 172.21.15.62:0/3365614634 >> 172.21.15.62:0/3365614634 conn(0x564f1e616360 msgr2=0x564f1e6143c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 -- 172.21.15.62:0/3365614634 shutdown_connections 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 -- 172.21.15.62:0/3365614634 wait complete. 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 Processor -- start 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 -- start start 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e6216a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc19580e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564f1e61b160 con 0x564f1e61a000 2024-04-26T07:56:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc192b13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e6216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc192b13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e6216a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47686/0 (socket says 172.21.15.62:47686) 2024-04-26T07:56:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.392+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 learned_addr learned my addr 172.21.15.62:0/1328544144 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.393+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1e621be0 con 0x564f1e61a000 2024-04-26T07:56:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.393+0000 7fc192b13640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e6216a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc18805d830 tx=0x7fc18808e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.393+0000 7fc0757fa640 1 -- 172.21.15.62:0/1328544144 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188067510 con 0x564f1e61a000 2024-04-26T07:56:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.393+0000 7fc0757fa640 1 -- 172.21.15.62:0/1328544144 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188072460 con 0x564f1e61a000 2024-04-26T07:56:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.393+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f1e621e70 con 0x564f1e61a000 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.393+0000 7fc0757fa640 1 -- 172.21.15.62:0/1328544144 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc188072740 con 0x564f1e61a000 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.393+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1e624b20 con 0x564f1e61a000 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.394+0000 7fc0757fa640 1 -- 172.21.15.62:0/1328544144 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc1880728e0 con 0x564f1e61a000 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.394+0000 7fc0757fa640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc05c036eb0 0x7fc05c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.394+0000 7fc0757fa640 1 -- 172.21.15.62:0/1328544144 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc18809ad40 con 0x564f1e61a000 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.394+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.394+0000 7fc193b15640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc05c036eb0 0x7fc05c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.394+0000 7fc19580e800 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e62d140 0x564f1e62f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.394+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e62fd30 con 0x564f1e62d140 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.394+0000 7fc193314640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e62d140 0x564f1e62f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc193b15640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc05c036eb0 0x7fc05c039370 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x564f1e5f9150 tx=0x7fc18c01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc193314640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e62d140 0x564f1e62f5e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 20 realm 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e630140 con 0x564f1e62d140 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e630a10 con 0x564f1e62d140 2024-04-26T07:56:20.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.395+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e630db0 con 0x564f1e62d140 2024-04-26T07:56:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc19580e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:20.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e631210 con 0x564f1e62d140 2024-04-26T07:56:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc19580e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc19580e800 20 searching for the correct realm 2024-04-26T07:56:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc19580e800 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f1e633260 0x564f1e635650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc192b13640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f1e633260 0x564f1e635650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.396+0000 7fc192b13640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f1e633260 0x564f1e635650 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.397+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.397+0000 7fc192b13640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc188006ba0 0x7fc18808b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.397+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc188006ba0 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.397+0000 7fc193b15640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc188006ba0 0x7fc18808b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.397+0000 7fc193b15640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc188006ba0 0x7fc18808b450 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.398+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c01f070 con 0x7fc188006ba0 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.398+0000 7fc193b15640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc18c031040 0x7fc18c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.398+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc18c031040 2024-04-26T07:56:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.398+0000 7fc193314640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc18c031040 0x7fc18c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.398+0000 7fc193314640 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc18c031040 0x7fc18c032940 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.398+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.398+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.399+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.399+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.399+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.399+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.399+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.399+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc18c031040 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.400+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.400+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc188006ba0 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.400+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c01f070 con 0x7fc188006ba0 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.400+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.400+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.400+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.400+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.400+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc18c031040 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.401+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.401+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.401+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.401+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc188006ba0 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.401+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc18c01f070 con 0x7fc188006ba0 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.401+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.401+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.401+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.402+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.402+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc18c031040 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.402+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.402+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.402+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.402+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.402+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.402+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.403+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.403+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.403+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.403+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc18c031040 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.403+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.403+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.404+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.404+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc188006ba0 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.404+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c01f070 con 0x7fc188006ba0 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.404+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.404+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.404+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc18c031040 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.404+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.404+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.405+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.405+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc18c031040 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.405+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.405+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc188006ba0 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.405+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c01f070 con 0x7fc188006ba0 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.405+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e633260 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc18c031040 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x564f1e62d140 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f1e635d00 con 0x7fc188006ba0 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c01f070 con 0x7fc188006ba0 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc19580e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc19580e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc19580e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc19580e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc19580e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc19580e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.406+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e631cb0 con 0x564f1e62d140 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e632550 con 0x564f1e62d140 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e6318f0 con 0x564f1e62d140 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 20 zone default found 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 4 Realm: () 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 20 zonegroup default 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.407+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e632550 con 0x7fc18c031040 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e637b40 con 0x564f1e633260 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e637ee0 con 0x564f1e633260 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 20 started sync module instance, tier type = 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.408+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e636fe0 con 0x7fc188006ba0 2024-04-26T07:56:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.409+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c040040 con 0x7fc188006ba0 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.409+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94897812239360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e638780 con 0x7fc188006ba0 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.410+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e638fd0 con 0x564f1e62d140 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.411+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94897812239360] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c040040 con 0x7fc188006ba0 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.411+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.411+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94897812243152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e638cc0 con 0x564f1e62d140 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.411+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e6397e0 con 0x564f1e633260 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.412+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94897812243152] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.412+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.412+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94897812247216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e639bd0 con 0x564f1e633260 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.412+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63a5d0 con 0x7fc188006ba0 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.413+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c040040 con 0x7fc188006ba0 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.413+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94897812247216] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.413+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94897812250848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63ae70 con 0x7fc188006ba0 2024-04-26T07:56:20.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.413+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63b460 con 0x564f1e62d140 2024-04-26T07:56:20.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.414+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94897812250848] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c040040 con 0x7fc188006ba0 2024-04-26T07:56:20.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.415+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.415+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94897812244272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63ae70 con 0x564f1e62d140 2024-04-26T07:56:20.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.415+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63be70 con 0x7fc18c031040 2024-04-26T07:56:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.416+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.416+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94897812257216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63bde0 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.416+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63ce40 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.416+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94897812244272] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.417+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(56 notify.6 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.417+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94897812261168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63ce00 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.417+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63d870 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.417+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94897812257216] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94897812261168] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94897812253120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63c260 con 0x7fc18c031040 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc19580e800 20 add_watcher() i=0 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc19580e800 20 add_watcher() i=1 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc19580e800 20 add_watcher() i=2 2024-04-26T07:56:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc19580e800 20 add_watcher() i=3 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc19580e800 20 add_watcher() i=4 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc19580e800 20 add_watcher() i=5 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.418+0000 7fc19580e800 20 add_watcher() i=6 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.419+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94897812253120] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.419+0000 7fc19580e800 20 add_watcher() i=7 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.419+0000 7fc19580e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.419+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e6408a0 con 0x564f1e62d140 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.419+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.419+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94897812263840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63dd60 con 0x564f1e62d140 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94897812263840] v29'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc049fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc19580e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc19580e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc19580e800 5 note: GC not initialized 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc048fe1640 20 reqs_thread_entry: start 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc19580e800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc19580e800 20 Filter name: none 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fbfc27fc640 20 reqs_thread_entry: start 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc19580e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.421+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e673a00 con 0x564f1e62d140 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.422+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.422+0000 7fc19580e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.422+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f1e674f50 con 0x7fc18c031040 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.422+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.423+0000 7fc049fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.423+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94897812263840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63fcc0 con 0x564f1e62d140 2024-04-26T07:56:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.424+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94897812263840] v29'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.424+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94897812239360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63d3a0 con 0x7fc188006ba0 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.425+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94897812239360] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c040040 con 0x7fc188006ba0 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.425+0000 7fc19580e800 20 remove_watcher() i=0 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.425+0000 7fc19580e800 2 removed watcher, disabling cache 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.425+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94897812243152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63d3a0 con 0x564f1e62d140 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.426+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94897812243152] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.426+0000 7fc19580e800 20 remove_watcher() i=1 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.426+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94897812247216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e6382d0 con 0x564f1e633260 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.427+0000 7fc192b13640 1 -- 172.21.15.62:0/1328544144 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94897812247216] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18809f020 con 0x564f1e633260 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.427+0000 7fc19580e800 20 remove_watcher() i=2 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.427+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94897812250848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63d3a0 con 0x7fc188006ba0 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.428+0000 7fc193b15640 1 -- 172.21.15.62:0/1328544144 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94897812250848] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c040040 con 0x7fc188006ba0 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.428+0000 7fc19580e800 20 remove_watcher() i=3 2024-04-26T07:56:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.428+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94897812244272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e6392b0 con 0x564f1e62d140 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.430+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94897812244272] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x564f1e62d140 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.430+0000 7fc19580e800 20 remove_watcher() i=4 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.430+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94897812257216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63d3a0 con 0x7fc18c031040 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.431+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94897812257216] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.431+0000 7fc19580e800 20 remove_watcher() i=5 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.431+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94897812261168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e6392b0 con 0x7fc18c031040 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.432+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94897812261168] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.432+0000 7fc19580e800 20 remove_watcher() i=6 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.432+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94897812253120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f1e63b9c0 con 0x7fc18c031040 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94897812253120] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18402b070 con 0x7fc18c031040 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 20 remove_watcher() i=7 2024-04-26T07:56:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc18c031040 msgr2=0x7fc18c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fc18c031040 0x7fc18c032940 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e62d140 msgr2=0x564f1e62f5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e62d140 0x564f1e62f5e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc188006ba0 msgr2=0x7fc18808b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fc188006ba0 0x7fc18808b450 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f1e633260 msgr2=0x564f1e635650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x564f1e633260 0x564f1e635650 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc05c036eb0 msgr2=0x7fc05c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc05c036eb0 0x7fc05c039370 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x564f1e5f9150 tx=0x7fc18c01f000 comp rx=0 tx=0).stop 2024-04-26T07:56:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 msgr2=0x564f1e6216a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 --2- 172.21.15.62:0/1328544144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e61a000 0x564f1e6216a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc18805d830 tx=0x7fc18808e4b0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 reap_dead start 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc193314640 1 -- 172.21.15.62:0/1328544144 reap_dead start 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 shutdown_connections 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 >> 172.21.15.62:0/1328544144 conn(0x564f1e616360 msgr2=0x564f1e6139c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 shutdown_connections 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.433+0000 7fc19580e800 1 -- 172.21.15.62:0/1328544144 wait complete. 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/2372266332 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc06c036e60 msgr2=0x7fc06c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/2372266332 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc06c036e60 0x7fc06c039320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x564f1e5fce10 tx=0x7fc18c005840 comp rx=0 tx=0).stop 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/2372266332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e60ce20 msgr2=0x564f1e60d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/2372266332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e60ce20 0x564f1e60d260 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc188055040 tx=0x7fc188002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/2372266332 shutdown_connections 2024-04-26T07:56:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/2372266332 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc06c036e60 0x7fc06c039320 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/2372266332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e60ce20 0x564f1e60d260 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/2372266332 >> 172.21.15.62:0/2372266332 conn(0x564f1e600e70 msgr2=0x564f1e601270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/2372266332 shutdown_connections 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/2372266332 wait complete. 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e4f9b00 msgr2=0x564f1e5fbc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e4f9b00 0x564f1e5fbc30 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc078036eb0 msgr2=0x7fc078039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc078036eb0 0x7fc078039370 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc188054000 tx=0x7fc18804e000 comp rx=0 tx=0).stop 2024-04-26T07:56:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 msgr2=0x564f1e5f49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5f49f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc18400c010 tx=0x7fc184000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 shutdown_connections 2024-04-26T07:56:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x564f1e4f9b00 0x564f1e5fbc30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc078036eb0 0x7fc078039370 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 --2- 172.21.15.62:0/1082137559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564f1e4f7fc0 0x564f1e5f49f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 >> 172.21.15.62:0/1082137559 conn(0x564f1e4f3ba0 msgr2=0x564f1e5e6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 shutdown_connections 2024-04-26T07:56:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.434+0000 7fc19580e800 1 -- 172.21.15.62:0/1082137559 wait complete. 2024-04-26T07:56:20.449 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[],"summary":[]} 2024-04-26T07:56:20.449 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-26T07:56:20.449 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-26T07:56:20.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-26T07:56:20.450 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-04-26T07:56:20.495 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:20.495 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a3462800 1 Processor -- start 2024-04-26T07:56:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a3462800 1 -- start start 2024-04-26T07:56:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a3462800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55dd21823ae0 0x55dd21825ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a3462800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dd218264a0 con 0x55dd2181f740 2024-04-26T07:56:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a3462800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55dd216c1e20 con 0x55dd21823ae0 2024-04-26T07:56:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a0760640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55dd21823ae0 0x55dd21825ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a0760640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55dd21823ae0 0x55dd21825ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47688/0 (socket says 172.21.15.62:47688) 2024-04-26T07:56:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a0760640 1 -- 172.21.15.62:0/3953630026 learned_addr learned my addr 172.21.15.62:0/3953630026 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a0f61640 1 --1- 172.21.15.62:0/3953630026 >> v1:172.21.15.1:6789/0 conn(0x55dd2181f740 0x55dd2181fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:55542/0 (socket says 172.21.15.62:55542) 2024-04-26T07:56:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.499+0000 7f01a0760640 1 -- 172.21.15.62:0/3953630026 >> v1:172.21.15.1:6789/0 conn(0x55dd2181f740 legacy=0x55dd2181fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.500+0000 7f01a0760640 1 -- 172.21.15.62:0/3953630026 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd218276d0 con 0x55dd21823ae0 2024-04-26T07:56:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.501+0000 7f01a0760640 1 --2- 172.21.15.62:0/3953630026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21823ae0 0x55dd21825ed0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f018800a520 tx=0x7f018801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1445c2758eadb39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f019ff5f640 1 -- 172.21.15.62:0/3953630026 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0188057070 con 0x55dd21823ae0 2024-04-26T07:56:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f019ff5f640 1 -- 172.21.15.62:0/3953630026 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0188052570 con 0x55dd21823ae0 2024-04-26T07:56:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f019ff5f640 1 -- 172.21.15.62:0/3953630026 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018804ae60 con 0x55dd21823ae0 2024-04-26T07:56:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f01a3462800 1 -- 172.21.15.62:0/3953630026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21823ae0 msgr2=0x55dd21825ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f01a3462800 1 --2- 172.21.15.62:0/3953630026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21823ae0 0x55dd21825ed0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f018800a520 tx=0x7f018801d010 comp rx=0 tx=0).stop 2024-04-26T07:56:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f01a3462800 1 -- 172.21.15.62:0/3953630026 shutdown_connections 2024-04-26T07:56:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f01a3462800 1 --2- 172.21.15.62:0/3953630026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21823ae0 0x55dd21825ed0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f01a3462800 1 -- 172.21.15.62:0/3953630026 >> 172.21.15.62:0/3953630026 conn(0x55dd2181ad60 msgr2=0x55dd2181d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f01a3462800 1 -- 172.21.15.62:0/3953630026 shutdown_connections 2024-04-26T07:56:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.502+0000 7f01a3462800 1 -- 172.21.15.62:0/3953630026 wait complete. 2024-04-26T07:56:20.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.515+0000 7f01a3462800 1 Processor -- start 2024-04-26T07:56:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.515+0000 7f01a3462800 1 -- start start 2024-04-26T07:56:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.515+0000 7f01a3462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21910c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.515+0000 7f01a3462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd2176ad00 con 0x55dd2181f740 2024-04-26T07:56:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.515+0000 7f01a0f61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21910c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.515+0000 7f01a0f61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21910c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47696/0 (socket says 172.21.15.62:47696) 2024-04-26T07:56:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.515+0000 7f01a0f61640 1 -- 172.21.15.62:0/2891480093 learned_addr learned my addr 172.21.15.62:0/2891480093 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.516+0000 7f01a0f61640 1 -- 172.21.15.62:0/2891480093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd21911230 con 0x55dd2181f740 2024-04-26T07:56:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.516+0000 7f01a0f61640 1 --2- 172.21.15.62:0/2891480093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21910c60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f019000b230 tx=0x7f019000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974c6980d615e907 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.516+0000 7f008ee0d640 1 -- 172.21.15.62:0/2891480093 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019000e5c0 con 0x55dd2181f740 2024-04-26T07:56:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.516+0000 7f008ee0d640 1 -- 172.21.15.62:0/2891480093 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0190006070 con 0x55dd2181f740 2024-04-26T07:56:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.516+0000 7f008ee0d640 1 -- 172.21.15.62:0/2891480093 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019000e890 con 0x55dd2181f740 2024-04-26T07:56:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 -- 172.21.15.62:0/2891480093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 msgr2=0x55dd21910c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 --2- 172.21.15.62:0/2891480093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21910c60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f019000b230 tx=0x7f019000b6f0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 -- 172.21.15.62:0/2891480093 shutdown_connections 2024-04-26T07:56:20.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 --2- 172.21.15.62:0/2891480093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21910c60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 -- 172.21.15.62:0/2891480093 >> 172.21.15.62:0/2891480093 conn(0x55dd2181ad60 msgr2=0x55dd2190c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 -- 172.21.15.62:0/2891480093 shutdown_connections 2024-04-26T07:56:20.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 -- 172.21.15.62:0/2891480093 wait complete. 2024-04-26T07:56:20.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 Processor -- start 2024-04-26T07:56:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 -- start start 2024-04-26T07:56:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21918860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.517+0000 7f01a3462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd21826970 con 0x55dd2181f740 2024-04-26T07:56:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f01a0f61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21918860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f01a0f61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21918860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47700/0 (socket says 172.21.15.62:47700) 2024-04-26T07:56:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f01a0f61640 1 -- 172.21.15.62:0/2152964861 learned_addr learned my addr 172.21.15.62:0/2152964861 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f01a0f61640 1 -- 172.21.15.62:0/2152964861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd21918da0 con 0x55dd2181f740 2024-04-26T07:56:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f01a0f61640 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21918860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0190000fd0 tx=0x7f0190000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f008d60a640 1 -- 172.21.15.62:0/2152964861 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019000f8d0 con 0x55dd2181f740 2024-04-26T07:56:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f008d60a640 1 -- 172.21.15.62:0/2152964861 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019000fa90 con 0x55dd2181f740 2024-04-26T07:56:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd21919030 con 0x55dd2181f740 2024-04-26T07:56:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f008d60a640 1 -- 172.21.15.62:0/2152964861 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019000fdb0 con 0x55dd2181f740 2024-04-26T07:56:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.518+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd2191bce0 con 0x55dd2181f740 2024-04-26T07:56:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.519+0000 7f008d60a640 1 -- 172.21.15.62:0/2152964861 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0190017070 con 0x55dd2181f740 2024-04-26T07:56:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.519+0000 7f008d60a640 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0088036e60 0x7f0088039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.519+0000 7f008d60a640 1 -- 172.21.15.62:0/2152964861 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f0190015020 con 0x55dd2181f740 2024-04-26T07:56:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.519+0000 7f01a0760640 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0088036e60 0x7f0088039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.519+0000 7f01a3462800 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21823ae0 0x55dd2191faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.520+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21920030 con 0x55dd21823ae0 2024-04-26T07:56:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.520+0000 7f01a1762640 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21823ae0 0x55dd2191faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.520+0000 7f01a0760640 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0088036e60 0x7f0088039320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0188054000 tx=0x7f018804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.520+0000 7f01a1762640 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21823ae0 0x55dd2191faa0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.520+0000 7f01a1762640 1 -- 172.21.15.62:0/2152964861 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019800a4a0 con 0x55dd21823ae0 2024-04-26T07:56:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.520+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd2191d070 con 0x55dd21823ae0 2024-04-26T07:56:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.520+0000 7f01a1762640 1 -- 172.21.15.62:0/2152964861 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f019800a4a0 con 0x55dd21823ae0 2024-04-26T07:56:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.521+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21921e50 con 0x55dd21823ae0 2024-04-26T07:56:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.521+0000 7f01a1762640 1 -- 172.21.15.62:0/2152964861 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f019800a4a0 con 0x55dd21823ae0 2024-04-26T07:56:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.521+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21921190 con 0x55dd21823ae0 2024-04-26T07:56:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.521+0000 7f01a1762640 1 -- 172.21.15.62:0/2152964861 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f019800a4a0 con 0x55dd21823ae0 2024-04-26T07:56:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.521+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219215e0 con 0x55dd21823ae0 2024-04-26T07:56:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.522+0000 7f01a1762640 1 -- 172.21.15.62:0/2152964861 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f019800a4a0 con 0x55dd21823ae0 2024-04-26T07:56:20.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.522+0000 7f01a3462800 1 Processor -- start 2024-04-26T07:56:20.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.522+0000 7f01a3462800 1 -- start start 2024-04-26T07:56:20.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.522+0000 7f01a3462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21795290 0x55dd21793700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.522+0000 7f01a3462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd21712170 con 0x55dd21795290 2024-04-26T07:56:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.522+0000 7f01a0760640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21795290 0x55dd21793700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.522+0000 7f01a0760640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21795290 0x55dd21793700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47706/0 (socket says 172.21.15.62:47706) 2024-04-26T07:56:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.522+0000 7f01a0760640 1 -- 172.21.15.62:0/1963737876 learned_addr learned my addr 172.21.15.62:0/1963737876 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.523+0000 7f01a0760640 1 -- 172.21.15.62:0/1963737876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd21793c40 con 0x55dd21795290 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.523+0000 7f01a0760640 1 --2- 172.21.15.62:0/1963737876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21795290 0x55dd21793700 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f018804b010 tx=0x7f0188002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.523+0000 7f00867fc640 1 -- 172.21.15.62:0/1963737876 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0188057040 con 0x55dd21795290 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.523+0000 7f00867fc640 1 -- 172.21.15.62:0/1963737876 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018805d900 con 0x55dd21795290 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.523+0000 7f01a3462800 1 -- 172.21.15.62:0/1963737876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd21793e70 con 0x55dd21795290 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.523+0000 7f00867fc640 1 -- 172.21.15.62:0/1963737876 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018805dbe0 con 0x55dd21795290 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.523+0000 7f01a3462800 1 -- 172.21.15.62:0/1963737876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd21794310 con 0x55dd21795290 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.524+0000 7f00867fc640 1 -- 172.21.15.62:0/1963737876 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0188067070 con 0x55dd21795290 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.524+0000 7f00867fc640 1 --2- 172.21.15.62:0/1963737876 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0078036e60 0x7f0078039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.524+0000 7f00867fc640 1 -- 172.21.15.62:0/1963737876 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f018808fe60 con 0x55dd21795290 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.524+0000 7f01a1762640 1 --2- 172.21.15.62:0/1963737876 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0078036e60 0x7f0078039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.525+0000 7f01a3462800 1 Processor -- start 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.525+0000 7f01a3462800 1 -- start start 2024-04-26T07:56:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.525+0000 7f01a1762640 1 --2- 172.21.15.62:0/1963737876 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0078036e60 0x7f0078039320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55dd21920cb0 tx=0x7f0198005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.525+0000 7f01a3462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd219403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.525+0000 7f01a3462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd219115b0 con 0x55dd2193ffa0 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.525+0000 7f01a0760640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd219403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.525+0000 7f01a0760640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd219403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47720/0 (socket says 172.21.15.62:47720) 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.525+0000 7f01a0760640 1 -- 172.21.15.62:0/4226115274 learned_addr learned my addr 172.21.15.62:0/4226115274 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a0760640 1 -- 172.21.15.62:0/4226115274 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd21940990 con 0x55dd2193ffa0 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a0760640 1 --2- 172.21.15.62:0/4226115274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd219403c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f018808e1d0 tx=0x7f018805b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12a34faaf52326a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f0077fff640 1 -- 172.21.15.62:0/4226115274 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0188071ca0 con 0x55dd2193ffa0 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f0077fff640 1 -- 172.21.15.62:0/4226115274 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018807f070 con 0x55dd2193ffa0 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f0077fff640 1 -- 172.21.15.62:0/4226115274 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0188006380 con 0x55dd2193ffa0 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a3462800 1 -- 172.21.15.62:0/4226115274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 msgr2=0x55dd219403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a3462800 1 --2- 172.21.15.62:0/4226115274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd219403c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f018808e1d0 tx=0x7f018805b4b0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a3462800 1 -- 172.21.15.62:0/4226115274 shutdown_connections 2024-04-26T07:56:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a3462800 1 --2- 172.21.15.62:0/4226115274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd219403c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a3462800 1 -- 172.21.15.62:0/4226115274 >> 172.21.15.62:0/4226115274 conn(0x55dd2193c300 msgr2=0x55dd2193a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a3462800 1 -- 172.21.15.62:0/4226115274 shutdown_connections 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.526+0000 7f01a3462800 1 -- 172.21.15.62:0/4226115274 wait complete. 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.527+0000 7f01a3462800 1 Processor -- start 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.527+0000 7f01a3462800 1 -- start start 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.527+0000 7f01a3462800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd21947630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.527+0000 7f01a3462800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd21941100 con 0x55dd2193ffa0 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.527+0000 7f01a0760640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd21947630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.527+0000 7f01a0760640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd21947630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:47736/0 (socket says 172.21.15.62:47736) 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.527+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 learned_addr learned my addr 172.21.15.62:0/379798084 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.527+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd21947b70 con 0x55dd2193ffa0 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.528+0000 7f01a0760640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd21947630 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0188070770 tx=0x7f018808e130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.528+0000 7f00767fc640 1 -- 172.21.15.62:0/379798084 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0188071610 con 0x55dd2193ffa0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.528+0000 7f00767fc640 1 -- 172.21.15.62:0/379798084 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01880717b0 con 0x55dd2193ffa0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.528+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd21947e00 con 0x55dd2193ffa0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.528+0000 7f00767fc640 1 -- 172.21.15.62:0/379798084 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01880707e0 con 0x55dd2193ffa0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.528+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd2194aab0 con 0x55dd2193ffa0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f00767fc640 1 -- 172.21.15.62:0/379798084 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0188070980 con 0x55dd2193ffa0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f00767fc640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f006c036e60 0x7f006c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f00767fc640 1 -- 172.21.15.62:0/379798084 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f0188002030 con 0x55dd2193ffa0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f01a1762640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f006c036e60 0x7f006c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f01a1762640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f006c036e60 0x7f006c039320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55dd21919680 tx=0x7f019801f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21953120 0x55dd219555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21955d30 con 0x55dd21953120 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.529+0000 7f01a0f61640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21953120 0x55dd219555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a0f61640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21953120 0x55dd219555e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 20 realm 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21956140 con 0x55dd21953120 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21956a10 con 0x55dd21953120 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.530+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21956db0 con 0x55dd21953120 2024-04-26T07:56:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a3462800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21957600 con 0x55dd21953120 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a3462800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a3462800 20 searching for the correct realm 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dd21959370 0x55dd2195b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a0760640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dd21959370 0x55dd2195b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.531+0000 7f01a0760640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dd21959370 0x55dd2195b760 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.532+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.532+0000 7f01a0760640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0188086040 0x7f0188083840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.532+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0188086040 2024-04-26T07:56:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.532+0000 7f01a1762640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0188086040 0x7f0188083840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.532+0000 7f01a1762640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0188086040 0x7f0188083840 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.533+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019801f070 con 0x7f0188086040 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.533+0000 7f01a1762640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0198031040 0x7f0198032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.533+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0198031040 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.533+0000 7f01a0f61640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0198031040 0x7f0198032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.533+0000 7f01a0f61640 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0198031040 0x7f0198032940 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.534+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.534+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.534+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.534+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.534+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.534+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.534+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.534+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0198031040 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.535+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.535+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0188086040 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.535+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019801f070 con 0x7f0188086040 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.535+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.535+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.535+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.535+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.535+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0198031040 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.536+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.536+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.536+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.536+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0188086040 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.536+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f019801f070 con 0x7f0188086040 2024-04-26T07:56:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.536+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.536+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.536+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.537+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.537+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0198031040 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.537+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.537+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.538+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.538+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.538+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.538+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.538+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.538+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.538+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.538+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0198031040 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.539+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.539+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.539+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.539+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0188086040 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.539+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019801f070 con 0x7f0188086040 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.539+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.540+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.540+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0198031040 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.540+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.540+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.540+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.540+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0198031040 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.540+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.540+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0188086040 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.541+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019801f070 con 0x7f0188086040 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.541+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21959370 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.541+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.541+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0198031040 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.541+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.541+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x55dd21953120 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195bd40 con 0x7f0188086040 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019801f070 con 0x7f0188086040 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21957fb0 con 0x55dd21953120 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21958850 con 0x55dd21953120 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.542+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195c1c0 con 0x55dd21953120 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 20 zone default found 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 4 Realm: () 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 20 zonegroup default 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195c670 con 0x7f0198031040 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195e050 con 0x55dd21959370 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.543+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195e4c0 con 0x55dd21959370 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.544+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.544+0000 7f01a3462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.544+0000 7f01a3462800 20 started sync module instance, tier type = 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.544+0000 7f01a3462800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.544+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195d4e0 con 0x7f0188086040 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.545+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.545+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94408239601920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195edd0 con 0x7f0188086040 2024-04-26T07:56:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.545+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195f620 con 0x55dd21953120 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.546+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94408239601920] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.546+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.546+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94408239606048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195f290 con 0x55dd21953120 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.546+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2195fdb0 con 0x55dd21959370 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.547+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94408239606048] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.547+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.547+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94408239609984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219601a0 con 0x55dd21959370 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.547+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21960ba0 con 0x7f0188086040 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.548+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94408239609984] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.549+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.549+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94408239607104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21960f90 con 0x7f0188086040 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.549+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219619d0 con 0x55dd21953120 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.550+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.550+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94408239617184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21961990 con 0x55dd21953120 2024-04-26T07:56:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.550+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21962990 con 0x7f0198031040 2024-04-26T07:56:20.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.550+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94408239607104] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.551+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.551+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94408239621312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21962990 con 0x7f0198031040 2024-04-26T07:56:20.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.551+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219633a0 con 0x7f0198031040 2024-04-26T07:56:20.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.551+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94408239617184] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.552+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94408239621312] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.552+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.552+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94408239613616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21962ef0 con 0x7f0198031040 2024-04-26T07:56:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.552+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219637c0 con 0x7f0198031040 2024-04-26T07:56:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.553+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.553+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94408239613616] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.554+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94408239623920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21963310 con 0x7f0198031040 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.554+0000 7f01a3462800 20 add_watcher() i=0 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.554+0000 7f01a3462800 20 add_watcher() i=1 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.554+0000 7f01a3462800 20 add_watcher() i=2 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.554+0000 7f01a3462800 20 add_watcher() i=3 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.554+0000 7f01a3462800 20 add_watcher() i=4 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.554+0000 7f01a3462800 20 add_watcher() i=5 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.554+0000 7f01a3462800 20 add_watcher() i=6 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.555+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94408239623920] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.555+0000 7f01a3462800 20 add_watcher() i=7 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.555+0000 7f01a3462800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.555+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21966c70 con 0x55dd21953120 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.555+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.555+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94408239619376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21964190 con 0x55dd21953120 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.556+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94408239619376] v29'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.556+0000 7f0056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.556+0000 7f01a3462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.556+0000 7f01a3462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.556+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21966ac0 con 0x55dd21953120 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.558+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.558+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2196ffd0 con 0x7f0198031040 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.559+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.559+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2196fe90 con 0x55dd21959370 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.560+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.560+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21970310 con 0x55dd21953120 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.561+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.561+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21970310 con 0x7f0188086040 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.562+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.562+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21970880 con 0x55dd21959370 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.563+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.563+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21970cb0 con 0x55dd21953120 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.564+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.564+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21970cb0 con 0x7f0198031040 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.565+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.565+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21970cb0 con 0x7f0188086040 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.566+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.566+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971300 con 0x55dd21959370 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.567+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.567+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971300 con 0x7f0188086040 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.568+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.568+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971870 con 0x7f0198031040 2024-04-26T07:56:20.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.569+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.570+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971870 con 0x7f0188086040 2024-04-26T07:56:20.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.571+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.571+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x7f0198031040 2024-04-26T07:56:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.572+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.572+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21953120 2024-04-26T07:56:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.573+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.573+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.574+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.574+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x7f0188086040 2024-04-26T07:56:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.575+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.575+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.576+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.576+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21953120 2024-04-26T07:56:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.578+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.578+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21953120 2024-04-26T07:56:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.579+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.579+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.580+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.580+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x7f0188086040 2024-04-26T07:56:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.581+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.581+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.582+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.582+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.583+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.583+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.584+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.584+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.585+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.585+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x7f0198031040 2024-04-26T07:56:20.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.586+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.586+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.587+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.587+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x7f0198031040 2024-04-26T07:56:20.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.588+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.588+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x55dd21959370 2024-04-26T07:56:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.589+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.589+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x7f0198031040 2024-04-26T07:56:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.590+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'58 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.591+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21971d20 con 0x7f0188086040 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.592+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.592+0000 7f0055fe3640 20 reqs_thread_entry: start 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.592+0000 7f01a3462800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.592+0000 7f01a3462800 20 Filter name: none 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.592+0000 7effc77fe640 20 reqs_thread_entry: start 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.592+0000 7f01a3462800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.592+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.592+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd2199cc40 con 0x55dd21953120 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f019002e070 con 0x55dd21953120 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T07:56:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd2199cbf0 con 0x7f0188086040 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 : miss 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:96 8.b 8:d67b21b9:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd2199f3a0 con 0x55dd21959370 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(96 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 info.flags=0x17 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 to cache LRU end 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.593+0000 7f01a3462800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T07:56:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.594+0000 7f01a3462800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 2024-04-26T07:56:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.594+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:97 4.7 4:e0264e55:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca40 con 0x7f0198031040 2024-04-26T07:56:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.594+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(97 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.594+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:98 4.23 4:c6e9e0bb:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca40 con 0x7f0198031040 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.594+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(98 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.594+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:99 4.3f 4:fd2c03f3:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca40 con 0x7f0188086040 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.595+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(99 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.595+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 4.37 4:ee8ad417:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca40 con 0x7f0198031040 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.595+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(100 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f019002e070 con 0x7f0198031040 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.595+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:101 4.3c 4:3f70ae06:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca40 con 0x55dd21953120 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.596+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(101 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f01900621c0 con 0x55dd21953120 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.596+0000 7f01a3462800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.596+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:102 4.31 4:8e55df70:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca40 con 0x55dd21953120 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.596+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(102 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01900621c0 con 0x55dd21953120 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.596+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:103 4.3e 4:7e7d1a33:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca80 con 0x7f0188086040 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.596+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(103 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.596+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:104 4.32 4:4df60cda:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca80 con 0x55dd21953120 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.597+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(104 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01900621c0 con 0x55dd21953120 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.597+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:105 4.1c 4:3bbc13cf:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca80 con 0x7f0198031040 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.597+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(105 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01900621c0 con 0x7f0198031040 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.597+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:106 4.3e 4:7ccf1af0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca80 con 0x7f0188086040 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(106 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:107 4.2b 4:d799780e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1ca80 con 0x55dd21953120 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(107 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 20 get_obj_state: octx=0x7f019001b4d0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55dd21a1ab08 s->prefetch_data=0 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:108 3.2cs0 3:37f77151:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1b930 con 0x55dd21959370 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(108 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 10 manifest: total_size = 6 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 20 get_obj_state: setting s->obj_tag to 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.4462930551839418109 2024-04-26T07:56:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 20 get_obj_state: octx=0x7f019001b4d0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55dd21a1ab08 s->prefetch_data=0 2024-04-26T07:56:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 20 prepare_atomic_modification: state is not atomic. state=0x55dd21a1ab08 2024-04-26T07:56:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 20 bucket index object: :.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4 2024-04-26T07:56:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.598+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:109 4.3c 4:3f70ae06:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1c420 con 0x55dd21953120 2024-04-26T07:56:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.599+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(109 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4 [stat,call,call] v29'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.599+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:110 3.2cs0 3:37f77151:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd21a1be70 con 0x55dd21959370 2024-04-26T07:56:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(110 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7_15f6f8dc036519d7fe15b39338f6e5db [call] v29'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:111 4.3c 4:3f70ae06:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a4150 con 0x55dd21953120 2024-04-26T07:56:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 20 list_objects_ordered: starting attempt 1 2024-04-26T07:56:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T07:56:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:112 4.7 4:e0264e55:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a4150 con 0x7f0198031040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:113 4.23 4:c6e9e0bb:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a83d0 con 0x7f0198031040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:114 4.3f 4:fd2c03f3:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a4150 con 0x7f0188086040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:115 4.37 4:ee8ad417:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a83d0 con 0x7f0198031040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:116 4.3c 4:3f70ae06:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a83d0 con 0x55dd21953120 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:117 4.31 4:8e55df70:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1df0 con 0x55dd21953120 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:118 4.3e 4:7e7d1a33:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b48c0 con 0x7f0188086040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:119 4.32 4:4df60cda:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b7250 con 0x55dd21953120 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:120 4.1c 4:3bbc13cf:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219ba000 con 0x7f0198031040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:121 4.3e 4:7ccf1af0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219bcb00 con 0x7f0188086040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(114 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.601+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:122 4.2b 4:d799780e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219bcb00 con 0x55dd21953120 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(112 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(118 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(115 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(113 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(120 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(117 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(119 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(121 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.602+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 38 ==== osd_op_reply(122 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 39 ==== osd_op_reply(111 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4 [stat,call,call] v29'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f00777fe640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-04-26T07:56:20.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 40 ==== osd_op_reply(116 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T07:56:20.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T07:56:20.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7])"; uploads.size()=0; is_truncated=0 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:123 4.7 4:e0264e55:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219ba000 con 0x7f0198031040 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:124 4.23 4:c6e9e0bb:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1860 con 0x7f0198031040 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:125 4.3f 4:fd2c03f3:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c90 con 0x7f0188086040 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:126 4.37 4:ee8ad417:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219ba000 con 0x7f0198031040 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:127 4.3c 4:3f70ae06:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1860 con 0x55dd21953120 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.604+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:128 4.31 4:8e55df70:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219ba000 con 0x55dd21953120 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:129 4.3e 4:7e7d1a33:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c90 con 0x7f0188086040 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:130 4.32 4:4df60cda:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a87b0 con 0x55dd21953120 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:131 4.1c 4:3bbc13cf:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1860 con 0x7f0198031040 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:132 4.3e 4:7ccf1af0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219ba000 con 0x7f0188086040 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:133 4.2b 4:d799780e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c90 con 0x55dd21953120 2024-04-26T07:56:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(125 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(129 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(124 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== osd_op_reply(123 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== osd_op_reply(126 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 41 ==== osd_op_reply(128 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 42 ==== osd_op_reply(127 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 43 ==== osd_op_reply(130 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(132 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(131 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 44 ==== osd_op_reply(133 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.605+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x7f0188086040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(134 foo.buckets [call] v29'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a3462800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x7f0188086040 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a3462800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a3462800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a3462800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.607+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x7f0188086040 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.608+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(136 myfoo [call,call,delete] v29'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.608+0000 7f01a3462800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.608+0000 7f01a3462800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.608+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94408239889568 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x7f0198031040 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.608+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== watch-notify(notify (1) cookie 94408239613616 notify 124554051625 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55dd21971300 con 0x7f0198031040 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.608+0000 7f00777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051625 cookie 94408239613616 notifier 4773 bl.length()=149 2024-04-26T07:56:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.608+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== osd_op_reply(137 notify.6 [notify cookie 94408239889568 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.608+0000 7f00777fe640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7effd40032c0 con 0x7f0198031040 2024-04-26T07:56:20.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.609+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.609+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== watch-notify(notify_complete (2) cookie 94408239889568 notify 124554051625 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd219661f0 con 0x7f0198031040 2024-04-26T07:56:20.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.609+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:139 8.b 8:d67b21b9:root::.bucket.meta.myfoo%3a8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x55dd21959370 2024-04-26T07:56:20.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.610+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(139 .bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 [call,call,delete] v29'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.610+0000 7f01a3462800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 from cache 2024-04-26T07:56:20.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.610+0000 7f01a3462800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7, ofs0, ns] 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.610+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94408239889536 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.610+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== watch-notify(notify (1) cookie 94408239621312 notify 124554051626 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55dd219661f0 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.610+0000 7f00777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051626 cookie 94408239621312 notifier 4773 bl.length()=206 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.610+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(140 notify.5 [notify cookie 94408239889536 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.610+0000 7f00777fe640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7effd40032c0 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 41 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 42 ==== watch-notify(notify_complete (2) cookie 94408239889536 notify 124554051626 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd2191bce0 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:142 4.7 4:e0264e55:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:143 4.23 4:c6e9e0bb:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b98a0 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:144 4.3f 4:fd2c03f3:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b9c40 con 0x7f0188086040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:145 4.37 4:ee8ad417:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2199e1c0 con 0x7f0198031040 2024-04-26T07:56:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:146 4.3c 4:3f70ae06:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x55dd21953120 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:147 4.31 4:8e55df70:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b98a0 con 0x55dd21953120 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:148 4.3e 4:7e7d1a33:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2199e1c0 con 0x7f0188086040 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:149 4.32 4:4df60cda:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x55dd21953120 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:150 4.1c 4:3bbc13cf:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd2199e1c0 con 0x7f0198031040 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:151 4.3e 4:7ccf1af0:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b7f90 con 0x7f0188086040 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.611+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:152 4.2b 4:d799780e:::.dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219b1c40 con 0x55dd21953120 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.612+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 43 ==== osd_op_reply(143 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.1 [delete] v29'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(144 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.2 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 45 ==== osd_op_reply(152 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.10 [delete] v29'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 44 ==== osd_op_reply(145 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.3 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 45 ==== osd_op_reply(142 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.0 [delete] v29'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 46 ==== osd_op_reply(150 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.8 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 46 ==== osd_op_reply(146 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.4 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 47 ==== osd_op_reply(149 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.7 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 48 ==== osd_op_reply(147 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.5 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.613+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 32 ==== osd_op_reply(148 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.6 [delete] v29'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 33 ==== osd_op_reply(151 .dir.8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7.9 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a3462800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 : miss 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a3462800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:153 6.0 6:02e2d460:::pubsub..bucket.myfoo%2f8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0198031040 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 47 ==== osd_op_reply(153 pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a3462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a3462800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 info.flags=0x0 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a3462800 10 adding default.rgw.log++pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 to cache LRU end 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.614+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:154 6.0 6:02e2d460:::pubsub..bucket.myfoo%2f8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0198031040 2024-04-26T07:56:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.615+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 48 ==== osd_op_reply(154 pubsub..bucket.myfoo/8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.7 [delete] v29'59 uv44 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.615+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0188086040 2024-04-26T07:56:20.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.616+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 34 ==== osd_op_reply(155 foo.buckets [call] v29'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.616+0000 7f01a3462800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-04-26T07:56:20.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.616+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0198031040 2024-04-26T07:56:20.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.617+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 49 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v29'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.617+0000 7f01a3462800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.617+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94408239869040 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0188086040 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.618+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 35 ==== watch-notify(notify (1) cookie 94408239607104 notify 124554051613 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55dd21966480 con 0x7f0188086040 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.618+0000 7f0077fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94408239607104 notifier 4773 bl.length()=170 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.618+0000 7f0077fff640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0064003d60 con 0x7f0188086040 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.618+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 36 ==== osd_op_reply(157 notify.3 [notify cookie 94408239869040 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.618+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 37 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.618+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 38 ==== watch-notify(notify_complete (2) cookie 94408239869040 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd219716a0 con 0x7f0188086040 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.618+0000 7f01a3462800 10 removing email index: foo@foo.com 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.618+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x55dd21953120 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.619+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 49 ==== osd_op_reply(159 foo@foo.com [delete] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.619+0000 7f01a3462800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.619+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94408239869040 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0188086040 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.619+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 39 ==== watch-notify(notify (1) cookie 94408239607104 notify 124554051614 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55dd219716a0 con 0x7f0188086040 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.619+0000 7f00777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 94408239607104 notifier 4773 bl.length()=162 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.619+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 40 ==== osd_op_reply(160 notify.3 [notify cookie 94408239869040 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.619+0000 7f00777fe640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7effd40032c0 con 0x7f0188086040 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.620+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 41 ==== watch-notify(notify_complete (2) cookie 94408239869040 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd21970360 con 0x7f0188086040 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.620+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 42 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.620+0000 7f01a3462800 10 removing user buckets index 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.620+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0188086040 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 43 ==== osd_op_reply(162 foo.buckets [delete] v29'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f01a3462800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94408239868960 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0198031040 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 50 ==== watch-notify(notify (1) cookie 94408239621312 notify 124554051627 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55dd2191bce0 con 0x7f0198031040 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f0077fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051627 cookie 94408239621312 notifier 4773 bl.length()=160 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 51 ==== osd_op_reply(163 notify.5 [notify cookie 94408239868960 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f0077fff640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0064003d60 con 0x7f0198031040 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 52 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.621+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 53 ==== watch-notify(notify_complete (2) cookie 94408239868960 notify 124554051627 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd21919030 con 0x7f0198031040 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.622+0000 7f01a3462800 10 removing user index: foo 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.622+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x55dd21953120 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 50 ==== osd_op_reply(165 foo [call,call,delete] v29'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f01a3462800 10 removing default.rgw.meta+users.uid+foo from cache 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f01a3462800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94408239868832 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x55dd21953120 2024-04-26T07:56:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 51 ==== watch-notify(notify (1) cookie 94408239617184 notify 124554051606 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55dd21919030 con 0x55dd21953120 2024-04-26T07:56:20.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f00777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94408239617184 notifier 4773 bl.length()=152 2024-04-26T07:56:20.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 52 ==== osd_op_reply(166 notify.4 [notify cookie 94408239868832 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f00777fe640 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7effd40032c0 con 0x55dd21953120 2024-04-26T07:56:20.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 53 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.623+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 54 ==== watch-notify(notify_complete (2) cookie 94408239868832 notify 124554051606 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd21918da0 con 0x55dd21953120 2024-04-26T07:56:20.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.624+0000 7f0056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:20.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.624+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94408239619376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x55dd21953120 2024-04-26T07:56:20.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.625+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 55 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94408239619376] v29'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.625+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94408239601920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0188086040 2024-04-26T07:56:20.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.626+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 44 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94408239601920] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.626+0000 7f01a3462800 20 remove_watcher() i=0 2024-04-26T07:56:20.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.626+0000 7f01a3462800 2 removed watcher, disabling cache 2024-04-26T07:56:20.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.626+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94408239606048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x55dd21953120 2024-04-26T07:56:20.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.628+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 56 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94408239606048] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.628+0000 7f01a3462800 20 remove_watcher() i=1 2024-04-26T07:56:20.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.628+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94408239609984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x55dd21959370 2024-04-26T07:56:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.629+0000 7f01a0760640 1 -- 172.21.15.62:0/379798084 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94408239609984] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0188066030 con 0x55dd21959370 2024-04-26T07:56:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.629+0000 7f01a3462800 20 remove_watcher() i=2 2024-04-26T07:56:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.629+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94408239607104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0188086040 2024-04-26T07:56:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.630+0000 7f01a1762640 1 -- 172.21.15.62:0/379798084 <== osd.2 v2:172.21.15.62:6808/1138534927 45 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94408239607104] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198040040 con 0x7f0188086040 2024-04-26T07:56:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.630+0000 7f01a3462800 20 remove_watcher() i=3 2024-04-26T07:56:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.630+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94408239617184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x55dd21953120 2024-04-26T07:56:20.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.631+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.1 v2:172.21.15.62:6800/1888558046 57 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94408239617184] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x55dd21953120 2024-04-26T07:56:20.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.631+0000 7f01a3462800 20 remove_watcher() i=4 2024-04-26T07:56:20.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.631+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94408239621312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0198031040 2024-04-26T07:56:20.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.632+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 54 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94408239621312] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.632+0000 7f01a3462800 20 remove_watcher() i=5 2024-04-26T07:56:20.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.632+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94408239613616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0198031040 2024-04-26T07:56:20.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.633+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 55 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94408239613616] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.633+0000 7f01a3462800 20 remove_watcher() i=6 2024-04-26T07:56:20.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.633+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94408239623920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd219a3c00 con 0x7f0198031040 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 <== osd.0 v2:172.21.15.1:6800/3827982423 56 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94408239623920] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0190068060 con 0x7f0198031040 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 20 remove_watcher() i=7 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0198031040 msgr2=0x7f0198032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0198031040 0x7f0198032940 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21953120 msgr2=0x55dd219555e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21953120 0x55dd219555e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0188086040 msgr2=0x7f0188083840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0188086040 0x7f0188083840 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dd21959370 msgr2=0x55dd2195b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55dd21959370 0x55dd2195b760 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f006c036e60 msgr2=0x7f006c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f006c036e60 0x7f006c039320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55dd21919680 tx=0x7f019801f000 comp rx=0 tx=0).stop 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 msgr2=0x55dd21947630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd21947630 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0188070770 tx=0x7f018808e130 comp rx=0 tx=0).stop 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a0f61640 1 -- 172.21.15.62:0/379798084 reap_dead start 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 shutdown_connections 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 --2- 172.21.15.62:0/379798084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2193ffa0 0x55dd21947630 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 >> 172.21.15.62:0/379798084 conn(0x55dd2193c300 msgr2=0x55dd21939960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 shutdown_connections 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.634+0000 7f01a3462800 1 -- 172.21.15.62:0/379798084 wait complete. 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/1963737876 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0078036e60 msgr2=0x7f0078039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/1963737876 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0078036e60 0x7f0078039320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55dd21920cb0 tx=0x7f0198005840 comp rx=0 tx=0).stop 2024-04-26T07:56:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/1963737876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21795290 msgr2=0x55dd21793700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/1963737876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21795290 0x55dd21793700 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f018804b010 tx=0x7f0188002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/1963737876 shutdown_connections 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/1963737876 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0078036e60 0x7f0078039320 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/1963737876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd21795290 0x55dd21793700 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/1963737876 >> 172.21.15.62:0/1963737876 conn(0x55dd21924c60 msgr2=0x55dd21925060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/1963737876 shutdown_connections 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/1963737876 wait complete. 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21823ae0 msgr2=0x55dd2191faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21823ae0 0x55dd2191faa0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0088036e60 msgr2=0x7f0088039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0088036e60 0x7f0088039320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0188054000 tx=0x7f018804e000 comp rx=0 tx=0).stop 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 msgr2=0x55dd21918860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21918860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0190000fd0 tx=0x7f0190000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 shutdown_connections 2024-04-26T07:56:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55dd21823ae0 0x55dd2191faa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0088036e60 0x7f0088039320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 --2- 172.21.15.62:0/2152964861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd2181f740 0x55dd21918860 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 >> 172.21.15.62:0/2152964861 conn(0x55dd2181ad60 msgr2=0x55dd2190ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 shutdown_connections 2024-04-26T07:56:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.635+0000 7f01a3462800 1 -- 172.21.15.62:0/2152964861 wait complete. 2024-04-26T07:56:20.641 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T07:56:20.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T07:56:20.641 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T07:56:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.688+0000 7f422d52e800 1 Processor -- start 2024-04-26T07:56:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.688+0000 7f422d52e800 1 -- start start 2024-04-26T07:56:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.688+0000 7f422d52e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559d2e0a9b00 0x559d2e0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.688+0000 7f422d52e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d2e01c8b0 con 0x559d2e0a7fc0 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.688+0000 7f422d52e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x559d2df4be20 con 0x559d2e0a9b00 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.689+0000 7f4228a91640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559d2e0a9b00 0x559d2e0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.689+0000 7f4228a91640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x559d2e0a9b00 0x559d2e0b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40410/0 (socket says 172.21.15.62:40410) 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.689+0000 7f4228a91640 1 -- 172.21.15.62:0/1326861135 learned_addr learned my addr 172.21.15.62:0/1326861135 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.689+0000 7f4229292640 1 --1- 172.21.15.62:0/1326861135 >> v1:172.21.15.1:6789/0 conn(0x559d2e0a7fc0 0x559d2e0a83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33102/0 (socket says 172.21.15.62:33102) 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.689+0000 7f4228a91640 1 -- 172.21.15.62:0/1326861135 >> v1:172.21.15.1:6789/0 conn(0x559d2e0a7fc0 legacy=0x559d2e0a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.689+0000 7f4228a91640 1 -- 172.21.15.62:0/1326861135 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2e01ca80 con 0x559d2e0a9b00 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.691+0000 7f4228a91640 1 --2- 172.21.15.62:0/1326861135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a9b00 0x559d2e0b2600 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f422000a520 tx=0x7f422001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04622aa580606ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.691+0000 7f421bfff640 1 -- 172.21.15.62:0/1326861135 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4220057070 con 0x559d2e0a9b00 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.691+0000 7f421bfff640 1 -- 172.21.15.62:0/1326861135 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4220052570 con 0x559d2e0a9b00 2024-04-26T07:56:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.691+0000 7f421bfff640 1 -- 172.21.15.62:0/1326861135 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f422004ae60 con 0x559d2e0a9b00 2024-04-26T07:56:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.692+0000 7f422d52e800 1 -- 172.21.15.62:0/1326861135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a9b00 msgr2=0x559d2e0b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.692+0000 7f422d52e800 1 --2- 172.21.15.62:0/1326861135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a9b00 0x559d2e0b2600 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f422000a520 tx=0x7f422001d010 comp rx=0 tx=0).stop 2024-04-26T07:56:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.692+0000 7f422d52e800 1 -- 172.21.15.62:0/1326861135 shutdown_connections 2024-04-26T07:56:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.692+0000 7f422d52e800 1 --2- 172.21.15.62:0/1326861135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a9b00 0x559d2e0b2600 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.692+0000 7f422d52e800 1 -- 172.21.15.62:0/1326861135 >> 172.21.15.62:0/1326861135 conn(0x559d2e0a3ba0 msgr2=0x559d2e0a5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.692+0000 7f422d52e800 1 -- 172.21.15.62:0/1326861135 shutdown_connections 2024-04-26T07:56:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.692+0000 7f422d52e800 1 -- 172.21.15.62:0/1326861135 wait complete. 2024-04-26T07:56:20.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.704+0000 7f422d52e800 1 Processor -- start 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.704+0000 7f422d52e800 1 -- start start 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f422d52e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f422d52e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559d2dff4cd0 con 0x559d2e0a7fc0 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f4229292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f4229292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40420/0 (socket says 172.21.15.62:40420) 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f4229292640 1 -- 172.21.15.62:0/3477408631 learned_addr learned my addr 172.21.15.62:0/3477408631 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f4229292640 1 -- 172.21.15.62:0/3477408631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2e19d480 con 0x559d2e0a7fc0 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f4229292640 1 --2- 172.21.15.62:0/3477408631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e19ceb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f421c001e90 tx=0x7f421c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f2ec259d102cf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f4117606640 1 -- 172.21.15.62:0/3477408631 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f421c00e5c0 con 0x559d2e0a7fc0 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f4117606640 1 -- 172.21.15.62:0/3477408631 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c006070 con 0x559d2e0a7fc0 2024-04-26T07:56:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.705+0000 7f4117606640 1 -- 172.21.15.62:0/3477408631 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f421c00e890 con 0x559d2e0a7fc0 2024-04-26T07:56:20.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.706+0000 7f422d52e800 1 -- 172.21.15.62:0/3477408631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 msgr2=0x559d2e19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.706+0000 7f422d52e800 1 --2- 172.21.15.62:0/3477408631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e19ceb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f421c001e90 tx=0x7f421c00b6c0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.706+0000 7f422d52e800 1 -- 172.21.15.62:0/3477408631 shutdown_connections 2024-04-26T07:56:20.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.706+0000 7f422d52e800 1 --2- 172.21.15.62:0/3477408631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e19ceb0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.706+0000 7f422d52e800 1 -- 172.21.15.62:0/3477408631 >> 172.21.15.62:0/3477408631 conn(0x559d2e0a3ba0 msgr2=0x559d2e1987d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.706+0000 7f422d52e800 1 -- 172.21.15.62:0/3477408631 shutdown_connections 2024-04-26T07:56:20.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.706+0000 7f422d52e800 1 -- 172.21.15.62:0/3477408631 wait complete. 2024-04-26T07:56:20.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.706+0000 7f422d52e800 1 Processor -- start 2024-04-26T07:56:20.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.707+0000 7f422d52e800 1 -- start start 2024-04-26T07:56:20.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.707+0000 7f422d52e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e1a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.707+0000 7f422d52e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559d2e0b2e10 con 0x559d2e0a7fc0 2024-04-26T07:56:20.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.707+0000 7f4229292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e1a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.707+0000 7f4229292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e1a4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40428/0 (socket says 172.21.15.62:40428) 2024-04-26T07:56:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.707+0000 7f4229292640 1 -- 172.21.15.62:0/3490882595 learned_addr learned my addr 172.21.15.62:0/3490882595 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.707+0000 7f4229292640 1 -- 172.21.15.62:0/3490882595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2e1a4f60 con 0x559d2e0a7fc0 2024-04-26T07:56:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.707+0000 7f4229292640 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e1a4a20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c010 tx=0x7f421c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.708+0000 7f4115e03640 1 -- 172.21.15.62:0/3490882595 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f421c00f8d0 con 0x559d2e0a7fc0 2024-04-26T07:56:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.708+0000 7f4115e03640 1 -- 172.21.15.62:0/3490882595 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c00fa90 con 0x559d2e0a7fc0 2024-04-26T07:56:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.708+0000 7f4115e03640 1 -- 172.21.15.62:0/3490882595 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f421c00fdb0 con 0x559d2e0a7fc0 2024-04-26T07:56:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.708+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d2e1a51f0 con 0x559d2e0a7fc0 2024-04-26T07:56:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.708+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2e1a7ea0 con 0x559d2e0a7fc0 2024-04-26T07:56:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.708+0000 7f4115e03640 1 -- 172.21.15.62:0/3490882595 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f421c017070 con 0x559d2e0a7fc0 2024-04-26T07:56:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.709+0000 7f4115e03640 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4110036e60 0x7f4110039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.709+0000 7f4115e03640 1 -- 172.21.15.62:0/3490882595 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f421c015020 con 0x559d2e0a7fc0 2024-04-26T07:56:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.709+0000 7f4228a91640 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4110036e60 0x7f4110039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.709+0000 7f422d52e800 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e0a9b00 0x559d2e1abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.709+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ac1f0 con 0x559d2e0a9b00 2024-04-26T07:56:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.709+0000 7f4229a93640 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e0a9b00 0x559d2e1abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.709+0000 7f4228a91640 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4110036e60 0x7f4110039320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4220054000 tx=0x7f422004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.709+0000 7f4229a93640 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e0a9b00 0x559d2e1abc60 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.710+0000 7f4229a93640 1 -- 172.21.15.62:0/3490882595 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f422400a4a0 con 0x559d2e0a9b00 2024-04-26T07:56:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.710+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1a9230 con 0x559d2e0a9b00 2024-04-26T07:56:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.710+0000 7f4229a93640 1 -- 172.21.15.62:0/3490882595 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f422400a4a0 con 0x559d2e0a9b00 2024-04-26T07:56:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.710+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ae030 con 0x559d2e0a9b00 2024-04-26T07:56:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.710+0000 7f4229a93640 1 -- 172.21.15.62:0/3490882595 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f422400a4a0 con 0x559d2e0a9b00 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.710+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ad370 con 0x559d2e0a9b00 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.710+0000 7f4229a93640 1 -- 172.21.15.62:0/3490882595 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f422400a4a0 con 0x559d2e0a9b00 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.711+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ad7c0 con 0x559d2e0a9b00 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.711+0000 7f4229a93640 1 -- 172.21.15.62:0/3490882595 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f422400a4a0 con 0x559d2e0a9b00 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.711+0000 7f422d52e800 1 Processor -- start 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.711+0000 7f422d52e800 1 -- start start 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.711+0000 7f422d52e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1bce50 0x559d2e1bd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.711+0000 7f422d52e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559d2df9c170 con 0x559d2e1bce50 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.711+0000 7f4228a91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1bce50 0x559d2e1bd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f4228a91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1bce50 0x559d2e1bd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40438/0 (socket says 172.21.15.62:40438) 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f4228a91640 1 -- 172.21.15.62:0/2923872389 learned_addr learned my addr 172.21.15.62:0/2923872389 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f4228a91640 1 -- 172.21.15.62:0/2923872389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2e1bd7d0 con 0x559d2e1bce50 2024-04-26T07:56:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f4228a91640 1 --2- 172.21.15.62:0/2923872389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1bce50 0x559d2e1bd290 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f4220002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f410effd640 1 -- 172.21.15.62:0/2923872389 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4220057040 con 0x559d2e1bce50 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f410effd640 1 -- 172.21.15.62:0/2923872389 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f422005d650 con 0x559d2e1bce50 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f422d52e800 1 -- 172.21.15.62:0/2923872389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d2e1be160 con 0x559d2e1bce50 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f410effd640 1 -- 172.21.15.62:0/2923872389 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f422005d930 con 0x559d2e1bce50 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.712+0000 7f422d52e800 1 -- 172.21.15.62:0/2923872389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2e1be600 con 0x559d2e1bce50 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.713+0000 7f410effd640 1 -- 172.21.15.62:0/2923872389 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4220067070 con 0x559d2e1bce50 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.713+0000 7f410effd640 1 --2- 172.21.15.62:0/2923872389 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4104036eb0 0x7f4104039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.713+0000 7f410effd640 1 -- 172.21.15.62:0/2923872389 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f422008ff10 con 0x559d2e1bce50 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.713+0000 7f4229a93640 1 --2- 172.21.15.62:0/2923872389 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4104036eb0 0x7f4104039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f422d52e800 1 Processor -- start 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f422d52e800 1 -- start start 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f4229a93640 1 --2- 172.21.15.62:0/2923872389 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4104036eb0 0x7f4104039370 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x559d2e1ace90 tx=0x7f4224005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f422d52e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f422d52e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559d2e19d800 con 0x559d2e1ca0c0 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f4228a91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f4228a91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40440/0 (socket says 172.21.15.62:40440) 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f4228a91640 1 -- 172.21.15.62:0/3226946267 learned_addr learned my addr 172.21.15.62:0/3226946267 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f4228a91640 1 -- 172.21.15.62:0/3226946267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2e1caa90 con 0x559d2e1ca0c0 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f4228a91640 1 --2- 172.21.15.62:0/3226946267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1ca4c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f422008e190 tx=0x7f4220067d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73552b126baaa965 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.714+0000 7f410cff9640 1 -- 172.21.15.62:0/3226946267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4220071400 con 0x559d2e1ca0c0 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f410cff9640 1 -- 172.21.15.62:0/3226946267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4220067360 con 0x559d2e1ca0c0 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f410cff9640 1 -- 172.21.15.62:0/3226946267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42200715a0 con 0x559d2e1ca0c0 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 -- 172.21.15.62:0/3226946267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 msgr2=0x559d2e1ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 --2- 172.21.15.62:0/3226946267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1ca4c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f422008e190 tx=0x7f4220067d20 comp rx=0 tx=0).stop 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 -- 172.21.15.62:0/3226946267 shutdown_connections 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 --2- 172.21.15.62:0/3226946267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1ca4c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 -- 172.21.15.62:0/3226946267 >> 172.21.15.62:0/3226946267 conn(0x559d2e1c6390 msgr2=0x559d2e1c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 -- 172.21.15.62:0/3226946267 shutdown_connections 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 -- 172.21.15.62:0/3226946267 wait complete. 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 Processor -- start 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.715+0000 7f422d52e800 1 -- start start 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.716+0000 7f422d52e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.716+0000 7f422d52e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559d2e1cb240 con 0x559d2e1ca0c0 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.716+0000 7f4228a91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.716+0000 7f4228a91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40442/0 (socket says 172.21.15.62:40442) 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.716+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 learned_addr learned my addr 172.21.15.62:0/1011327734 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.716+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2e1d1be0 con 0x559d2e1ca0c0 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.716+0000 7f4228a91640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1d16a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4220007000 tx=0x7f422008e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.717+0000 7f40faffd640 1 -- 172.21.15.62:0/1011327734 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42200065b0 con 0x559d2e1ca0c0 2024-04-26T07:56:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.717+0000 7f40faffd640 1 -- 172.21.15.62:0/1011327734 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4220006750 con 0x559d2e1ca0c0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.717+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d2e1d1e70 con 0x559d2e1ca0c0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.717+0000 7f40faffd640 1 -- 172.21.15.62:0/1011327734 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4220006a30 con 0x559d2e1ca0c0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.717+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2e1d4b20 con 0x559d2e1ca0c0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.717+0000 7f40faffd640 1 -- 172.21.15.62:0/1011327734 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4220070360 con 0x559d2e1ca0c0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f40faffd640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f40f4036eb0 0x7f40f4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f40faffd640 1 -- 172.21.15.62:0/1011327734 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f4220097d50 con 0x559d2e1ca0c0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f4229a93640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f40f4036eb0 0x7f40f4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e1dd190 0x559d2e1df650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1dfda0 con 0x559d2e1dd190 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f4229292640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e1dd190 0x559d2e1df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f4229a93640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f40f4036eb0 0x7f40f4039370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x559d2e1a9180 tx=0x7f422401f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.718+0000 7f4229292640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e1dd190 0x559d2e1df650 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 realm 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e01b0 con 0x559d2e1dd190 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e0a80 con 0x559d2e1dd190 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e0e20 con 0x559d2e1dd190 2024-04-26T07:56:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.719+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e12c0 con 0x559d2e1dd190 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.720+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.720+0000 7f422d52e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.720+0000 7f422d52e800 20 searching for the correct realm 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.720+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559d2e1e3260 0x559d2e1e56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.720+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1e3260 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.720+0000 7f4228a91640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559d2e1e3260 0x559d2e1e56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.720+0000 7f4228a91640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559d2e1e3260 0x559d2e1e56b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.721+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.721+0000 7f4228a91640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4220086430 0x7f422007a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.721+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x7f4220086430 2024-04-26T07:56:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.721+0000 7f4229a93640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4220086430 0x7f422007a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.721+0000 7f4229a93640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4220086430 0x7f422007a3f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.721+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422401f070 con 0x7f4220086430 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.721+0000 7f4229a93640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f4224031040 0x7f4224032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.721+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x7f4224031040 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.722+0000 7f4229292640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f4224031040 0x7f4224032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.722+0000 7f4229292640 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f4224031040 0x7f4224032940 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.722+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.722+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1dd190 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.722+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.722+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1dd190 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.723+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.723+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1dd190 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.723+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.723+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x7f4224031040 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.723+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.723+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x7f4220086430 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.723+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422401f070 con 0x7f4220086430 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.723+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1e3260 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.724+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.724+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1dd190 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.724+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.724+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x7f4224031040 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.724+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.724+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1dd190 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.724+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.724+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x7f4220086430 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.725+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f422401f070 con 0x7f4220086430 2024-04-26T07:56:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.725+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1e3260 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.725+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.725+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1e3260 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.725+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.725+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x7f4224031040 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.725+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.725+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1e3260 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.726+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.726+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1e3260 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.726+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.726+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1dd190 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.726+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.726+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x559d2e1dd190 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.726+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.726+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e5d80 con 0x7f4224031040 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.727+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.727+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x559d2e1e3260 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.727+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.727+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x7f4220086430 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.727+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422401f070 con 0x7f4220086430 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.727+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x559d2e1dd190 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.727+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.727+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x7f4224031040 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.728+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.728+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x559d2e1e3260 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.728+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.728+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x7f4224031040 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.728+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.728+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x7f4220086430 2024-04-26T07:56:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.728+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422401f070 con 0x7f4220086430 2024-04-26T07:56:20.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.728+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x559d2e1e3260 2024-04-26T07:56:20.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x7f4224031040 2024-04-26T07:56:20.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x559d2e1dd190 2024-04-26T07:56:20.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f421c059040 con 0x7f4220086430 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f422401f070 con 0x7f4220086430 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f422d52e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f422d52e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f422d52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f422d52e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f422d52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.729+0000 7f422d52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e1cd0 con 0x559d2e1dd190 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e2570 con 0x559d2e1dd190 2024-04-26T07:56:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e1910 con 0x559d2e1dd190 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 zone default found 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 4 Realm: () 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 zonegroup default 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.730+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e2570 con 0x7f4224031040 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e7be0 con 0x559d2e1e3260 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e7f80 con 0x559d2e1e3260 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 20 started sync module instance, tier type = 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.731+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e7080 con 0x7f4220086430 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.732+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4224040040 con 0x7f4220086430 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.732+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94133571974304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e8820 con 0x7f4220086430 2024-04-26T07:56:20.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.732+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e9070 con 0x559d2e1dd190 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.733+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94133571974304] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4224040040 con 0x7f4220086430 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.734+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.734+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94133571978368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e8db0 con 0x559d2e1dd190 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.734+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e98c0 con 0x559d2e1e3260 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.735+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94133571978368] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.735+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.735+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94133571982192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e9cb0 con 0x559d2e1e3260 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.735+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ea6d0 con 0x7f4220086430 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.736+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94133571982192] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.736+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4224040040 con 0x7f4220086430 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.736+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94133571985856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1eaac0 con 0x7f4220086430 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.736+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1eb4e0 con 0x559d2e1dd190 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.737+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.737+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94133571989456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1eb4a0 con 0x559d2e1dd190 2024-04-26T07:56:20.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.737+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ec4a0 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.737+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94133571985856] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4224040040 con 0x7f4220086430 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.738+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94133571989456] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.738+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.738+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94133571993552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1eb680 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.738+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ecd40 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.739+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94133571993552] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.739+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.739+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94133571979424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ec970 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.739+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ed330 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94133571979424] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94133571994816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ed510 con 0x7f4224031040 2024-04-26T07:56:20.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f422d52e800 20 add_watcher() i=0 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f422d52e800 20 add_watcher() i=1 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f422d52e800 20 add_watcher() i=2 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f422d52e800 20 add_watcher() i=3 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f422d52e800 20 add_watcher() i=4 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f422d52e800 20 add_watcher() i=5 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.740+0000 7f422d52e800 20 add_watcher() i=6 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.741+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94133571994816] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.741+0000 7f422d52e800 20 add_watcher() i=7 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.741+0000 7f422d52e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.741+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1f06c0 con 0x559d2e1dd190 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.742+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.742+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94133572010160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ed480 con 0x559d2e1dd190 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94133572010160] v29'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f40df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f422d52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f422d52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f422d52e800 5 note: GC not initialized 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f40de7e4640 20 reqs_thread_entry: start 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f422d52e800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f422d52e800 20 Filter name: none 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f404ffff640 20 reqs_thread_entry: start 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f422d52e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.743+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d2e223a10 con 0x559d2e1dd190 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.744+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.744+0000 7f422d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:could not fetch user info: no user info saved 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.745+0000 7f40df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.745+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94133572010160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e2239d0 con 0x559d2e1dd190 2024-04-26T07:56:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.746+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94133572010160] v29'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.746+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94133571974304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e2239d0 con 0x7f4220086430 2024-04-26T07:56:20.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.747+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94133571974304] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4224040040 con 0x7f4220086430 2024-04-26T07:56:20.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.747+0000 7f422d52e800 20 remove_watcher() i=0 2024-04-26T07:56:20.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.747+0000 7f422d52e800 2 removed watcher, disabling cache 2024-04-26T07:56:20.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.747+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94133571978368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e2239d0 con 0x559d2e1dd190 2024-04-26T07:56:20.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.748+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94133571978368] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.748+0000 7f422d52e800 20 remove_watcher() i=1 2024-04-26T07:56:20.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.748+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94133571982192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e2239d0 con 0x559d2e1e3260 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.749+0000 7f4228a91640 1 -- 172.21.15.62:0/1011327734 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94133571982192] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f422009c020 con 0x559d2e1e3260 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.749+0000 7f422d52e800 20 remove_watcher() i=2 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.749+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94133571985856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e9370 con 0x7f4220086430 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.750+0000 7f4229a93640 1 -- 172.21.15.62:0/1011327734 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94133571985856] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4224040040 con 0x7f4220086430 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.750+0000 7f422d52e800 20 remove_watcher() i=3 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.750+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94133571989456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1ea1c0 con 0x559d2e1dd190 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.751+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94133571989456] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x559d2e1dd190 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.751+0000 7f422d52e800 20 remove_watcher() i=4 2024-04-26T07:56:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.751+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94133571993552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e8480 con 0x7f4224031040 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.752+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94133571993552] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.752+0000 7f422d52e800 20 remove_watcher() i=5 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.752+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94133571979424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e8480 con 0x7f4224031040 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.753+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94133571979424] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.753+0000 7f422d52e800 20 remove_watcher() i=6 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.753+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94133571994816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d2e1e74a0 con 0x7f4224031040 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94133571994816] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f421c02e070 con 0x7f4224031040 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 20 remove_watcher() i=7 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f4224031040 msgr2=0x7f4224032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f4224031040 0x7f4224032940 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e1dd190 msgr2=0x559d2e1df650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e1dd190 0x559d2e1df650 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4220086430 msgr2=0x7f422007a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f4220086430 0x7f422007a3f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559d2e1e3260 msgr2=0x559d2e1e56b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x559d2e1e3260 0x559d2e1e56b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f40f4036eb0 msgr2=0x7f40f4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.754+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f40f4036eb0 0x7f40f4039370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x559d2e1a9180 tx=0x7f422401f000 comp rx=0 tx=0).stop 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f4229292640 1 -- 172.21.15.62:0/1011327734 reap_dead start 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 msgr2=0x559d2e1d16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1d16a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4220007000 tx=0x7f422008e120 comp rx=0 tx=0).stop 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 shutdown_connections 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/1011327734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1ca0c0 0x559d2e1d16a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 >> 172.21.15.62:0/1011327734 conn(0x559d2e1c6390 msgr2=0x559d2e1c39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 shutdown_connections 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/1011327734 wait complete. 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/2923872389 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4104036eb0 msgr2=0x7f4104039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/2923872389 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4104036eb0 0x7f4104039370 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x559d2e1ace90 tx=0x7f4224005840 comp rx=0 tx=0).stop 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/2923872389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1bce50 msgr2=0x559d2e1bd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/2923872389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1bce50 0x559d2e1bd290 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f4220002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/2923872389 shutdown_connections 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/2923872389 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4104036eb0 0x7f4104039370 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/2923872389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e1bce50 0x559d2e1bd290 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/2923872389 >> 172.21.15.62:0/2923872389 conn(0x559d2e1b0ea0 msgr2=0x559d2e1b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/2923872389 shutdown_connections 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/2923872389 wait complete. 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e0a9b00 msgr2=0x559d2e1abc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e0a9b00 0x559d2e1abc60 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4110036e60 msgr2=0x7f4110039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4110036e60 0x7f4110039320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4220054000 tx=0x7f422004e000 comp rx=0 tx=0).stop 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 msgr2=0x559d2e1a4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.755+0000 7f422d52e800 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e1a4a20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c010 tx=0x7f421c000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.756+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 shutdown_connections 2024-04-26T07:56:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.756+0000 7f422d52e800 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x559d2e0a9b00 0x559d2e1abc60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.756+0000 7f422d52e800 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f4110036e60 0x7f4110039320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.756+0000 7f422d52e800 1 --2- 172.21.15.62:0/3490882595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559d2e0a7fc0 0x559d2e1a4a20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.756+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 >> 172.21.15.62:0/3490882595 conn(0x559d2e0a3ba0 msgr2=0x559d2e196fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.756+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 shutdown_connections 2024-04-26T07:56:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.756+0000 7f422d52e800 1 -- 172.21.15.62:0/3490882595 wait complete. 2024-04-26T07:56:20.762 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T07:56:20.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-04-26T07:56:20.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-04-26T07:56:20.762 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-04-26T07:56:20.846 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:20.847 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.850+0000 7ff32cb19800 1 Processor -- start 2024-04-26T07:56:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.850+0000 7ff32cb19800 1 -- start start 2024-04-26T07:56:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.850+0000 7ff32cb19800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55bcf861cb70 0x55bcf861ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.850+0000 7ff32cb19800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bcf861f530 con 0x55bcf8618820 2024-04-26T07:56:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.850+0000 7ff32cb19800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55bcf84bae20 con 0x55bcf861cb70 2024-04-26T07:56:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.851+0000 7ff329e17640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55bcf861cb70 0x55bcf861ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.851+0000 7ff329e17640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55bcf861cb70 0x55bcf861ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40454/0 (socket says 172.21.15.62:40454) 2024-04-26T07:56:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.851+0000 7ff32a618640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55bcf8618820 0x55bcf8618c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33110/0 (socket says 172.21.15.62:33110) 2024-04-26T07:56:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.851+0000 7ff329e17640 1 -- 172.21.15.62:0/1538754162 learned_addr learned my addr 172.21.15.62:0/1538754162 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.851+0000 7ff329e17640 1 -- 172.21.15.62:0/1538754162 >> v1:172.21.15.1:6789/0 conn(0x55bcf8618820 legacy=0x55bcf8618c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.851+0000 7ff329e17640 1 -- 172.21.15.62:0/1538754162 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcf8620760 con 0x55bcf861cb70 2024-04-26T07:56:20.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.853+0000 7ff329e17640 1 --2- 172.21.15.62:0/1538754162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf861cb70 0x55bcf861ef60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff32000a520 tx=0x7ff32001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db43db7b1af1159a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.853+0000 7ff329616640 1 -- 172.21.15.62:0/1538754162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff320057070 con 0x55bcf861cb70 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.853+0000 7ff329616640 1 -- 172.21.15.62:0/1538754162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff320052570 con 0x55bcf861cb70 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.853+0000 7ff329616640 1 -- 172.21.15.62:0/1538754162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32004ae60 con 0x55bcf861cb70 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.853+0000 7ff32cb19800 1 -- 172.21.15.62:0/1538754162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf861cb70 msgr2=0x55bcf861ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.853+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1538754162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf861cb70 0x55bcf861ef60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff32000a520 tx=0x7ff32001d010 comp rx=0 tx=0).stop 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.853+0000 7ff32cb19800 1 -- 172.21.15.62:0/1538754162 shutdown_connections 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.853+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1538754162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf861cb70 0x55bcf861ef60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.854+0000 7ff32cb19800 1 -- 172.21.15.62:0/1538754162 >> 172.21.15.62:0/1538754162 conn(0x55bcf8613e00 msgr2=0x55bcf8616220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.854+0000 7ff32cb19800 1 -- 172.21.15.62:0/1538754162 shutdown_connections 2024-04-26T07:56:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.854+0000 7ff32cb19800 1 -- 172.21.15.62:0/1538754162 wait complete. 2024-04-26T07:56:20.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.866+0000 7ff32cb19800 1 Processor -- start 2024-04-26T07:56:20.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.866+0000 7ff32cb19800 1 -- start start 2024-04-26T07:56:20.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.866+0000 7ff32cb19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf8709d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.866+0000 7ff32cb19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcf8563cd0 con 0x55bcf8618820 2024-04-26T07:56:20.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.867+0000 7ff32a618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf8709d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.867+0000 7ff32a618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf8709d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40466/0 (socket says 172.21.15.62:40466) 2024-04-26T07:56:20.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.867+0000 7ff32a618640 1 -- 172.21.15.62:0/145429953 learned_addr learned my addr 172.21.15.62:0/145429953 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.867+0000 7ff32a618640 1 -- 172.21.15.62:0/145429953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcf870a330 con 0x55bcf8618820 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.867+0000 7ff32a618640 1 --2- 172.21.15.62:0/145429953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf8709d60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b230 tx=0x7ff31c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305e342b2fedca57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.867+0000 7ff218608640 1 -- 172.21.15.62:0/145429953 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff31c00e5c0 con 0x55bcf8618820 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.867+0000 7ff218608640 1 -- 172.21.15.62:0/145429953 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31c006070 con 0x55bcf8618820 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.867+0000 7ff218608640 1 -- 172.21.15.62:0/145429953 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff31c00e890 con 0x55bcf8618820 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 -- 172.21.15.62:0/145429953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 msgr2=0x55bcf8709d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 --2- 172.21.15.62:0/145429953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf8709d60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b230 tx=0x7ff31c00b6f0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 -- 172.21.15.62:0/145429953 shutdown_connections 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 --2- 172.21.15.62:0/145429953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf8709d60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 -- 172.21.15.62:0/145429953 >> 172.21.15.62:0/145429953 conn(0x55bcf8613e00 msgr2=0x55bcf8705680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 -- 172.21.15.62:0/145429953 shutdown_connections 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 -- 172.21.15.62:0/145429953 wait complete. 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 Processor -- start 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.868+0000 7ff32cb19800 1 -- start start 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff32cb19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf858e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff32cb19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcf861fa00 con 0x55bcf8618820 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff32a618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf858e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff32a618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf858e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40478/0 (socket says 172.21.15.62:40478) 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff32a618640 1 -- 172.21.15.62:0/1584345183 learned_addr learned my addr 172.21.15.62:0/1584345183 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff32a618640 1 -- 172.21.15.62:0/1584345183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcf858c7d0 con 0x55bcf8618820 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff32a618640 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf858e0e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff31c000fd0 tx=0x7ff31c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff216e05640 1 -- 172.21.15.62:0/1584345183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff31c00f8d0 con 0x55bcf8618820 2024-04-26T07:56:20.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff216e05640 1 -- 172.21.15.62:0/1584345183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31c00fa90 con 0x55bcf8618820 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcf858ca60 con 0x55bcf8618820 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.869+0000 7ff216e05640 1 -- 172.21.15.62:0/1584345183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff31c00fdb0 con 0x55bcf8618820 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.870+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcf858cf80 con 0x55bcf8618820 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.870+0000 7ff32cb19800 1 Processor -- start 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.870+0000 7ff32cb19800 1 -- start start 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.870+0000 7ff216e05640 1 -- 172.21.15.62:0/1584345183 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff31c017070 con 0x55bcf8618820 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.870+0000 7ff32cb19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf87217e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.870+0000 7ff32cb19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcf850b170 con 0x55bcf87213c0 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.870+0000 7ff216e05640 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036eb0 0x7ff210039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.870+0000 7ff32ae19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf87217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff32ae19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf87217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40490/0 (socket says 172.21.15.62:40490) 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff32ae19640 1 -- 172.21.15.62:0/2056544666 learned_addr learned my addr 172.21.15.62:0/2056544666 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff216e05640 1 -- 172.21.15.62:0/1584345183 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff31c015020 con 0x55bcf8618820 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff32a618640 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036eb0 0x7ff210039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff32ae19640 1 -- 172.21.15.62:0/2056544666 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcf8721d20 con 0x55bcf87213c0 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff32a618640 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036eb0 0x7ff210039370 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff31c01d5c0 tx=0x7ff31c035040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff32ae19640 1 --2- 172.21.15.62:0/2056544666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf87217e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff32400a430 tx=0x7ff32400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82109c5c18d2d94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff214e01640 1 -- 172.21.15.62:0/2056544666 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff324015070 con 0x55bcf87213c0 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff214e01640 1 -- 172.21.15.62:0/2056544666 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff324001670 con 0x55bcf87213c0 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.871+0000 7ff214e01640 1 -- 172.21.15.62:0/2056544666 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff324001990 con 0x55bcf87213c0 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 -- 172.21.15.62:0/2056544666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 msgr2=0x55bcf87217e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 --2- 172.21.15.62:0/2056544666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf87217e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff32400a430 tx=0x7ff32400a8f0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 -- 172.21.15.62:0/2056544666 shutdown_connections 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 --2- 172.21.15.62:0/2056544666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf87217e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 -- 172.21.15.62:0/2056544666 >> 172.21.15.62:0/2056544666 conn(0x55bcf861cb70 msgr2=0x55bcf871de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 -- 172.21.15.62:0/2056544666 shutdown_connections 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 -- 172.21.15.62:0/2056544666 wait complete. 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 Processor -- start 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 -- start start 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf8728850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32cb19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcf87226b0 con 0x55bcf87213c0 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32ae19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf8728850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32ae19640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf8728850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40504/0 (socket says 172.21.15.62:40504) 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.872+0000 7ff32ae19640 1 -- 172.21.15.62:0/3639106538 learned_addr learned my addr 172.21.15.62:0/3639106538 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.873+0000 7ff32ae19640 1 -- 172.21.15.62:0/3639106538 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcf8728d90 con 0x55bcf87213c0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.873+0000 7ff32ae19640 1 --2- 172.21.15.62:0/3639106538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf8728850 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff32400a930 tx=0x7ff324003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.873+0000 7ff20effd640 1 -- 172.21.15.62:0/3639106538 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff324020020 con 0x55bcf87213c0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.873+0000 7ff20effd640 1 -- 172.21.15.62:0/3639106538 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3240108b0 con 0x55bcf87213c0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.873+0000 7ff32cb19800 1 -- 172.21.15.62:0/3639106538 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcf8729020 con 0x55bcf87213c0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.873+0000 7ff20effd640 1 -- 172.21.15.62:0/3639106538 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff324015040 con 0x55bcf87213c0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.873+0000 7ff32cb19800 1 -- 172.21.15.62:0/3639106538 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcf872bcd0 con 0x55bcf87213c0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.874+0000 7ff20effd640 1 -- 172.21.15.62:0/3639106538 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff324023020 con 0x55bcf87213c0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.874+0000 7ff20effd640 1 --2- 172.21.15.62:0/3639106538 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036e60 0x7ff204039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.874+0000 7ff20effd640 1 -- 172.21.15.62:0/3639106538 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff32404c700 con 0x55bcf87213c0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.874+0000 7ff329e17640 1 --2- 172.21.15.62:0/3639106538 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036e60 0x7ff204039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.874+0000 7ff32cb19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:20.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.874+0000 7ff32cb19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:20.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32cb19800 1 Processor -- start 2024-04-26T07:56:20.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff329e17640 1 --2- 172.21.15.62:0/3639106538 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036e60 0x7ff204039320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff320054000 tx=0x7ff32004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32cb19800 1 -- start start 2024-04-26T07:56:20.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32cb19800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8742f60 0x55bcf8743380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32cb19800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcf870a6b0 con 0x55bcf8742f60 2024-04-26T07:56:20.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32a618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8742f60 0x55bcf8743380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32a618640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8742f60 0x55bcf8743380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40512/0 (socket says 172.21.15.62:40512) 2024-04-26T07:56:20.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32a618640 1 -- 172.21.15.62:0/124246476 learned_addr learned my addr 172.21.15.62:0/124246476 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32a618640 1 -- 172.21.15.62:0/124246476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcf87438c0 con 0x55bcf8742f60 2024-04-26T07:56:20.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.875+0000 7ff32a618640 1 --2- 172.21.15.62:0/124246476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8742f60 0x55bcf8743380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00ff70 tx=0x7ff31c019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.876+0000 7ff1ef7e6640 1 -- 172.21.15.62:0/124246476 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff31c019dd0 con 0x55bcf8742f60 2024-04-26T07:56:20.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.876+0000 7ff1ef7e6640 1 -- 172.21.15.62:0/124246476 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31c017540 con 0x55bcf8742f60 2024-04-26T07:56:20.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.876+0000 7ff32cb19800 1 -- 172.21.15.62:0/124246476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcf8744330 con 0x55bcf8742f60 2024-04-26T07:56:20.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.876+0000 7ff1ef7e6640 1 -- 172.21.15.62:0/124246476 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff31c032460 con 0x55bcf8742f60 2024-04-26T07:56:20.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.876+0000 7ff32cb19800 1 -- 172.21.15.62:0/124246476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcf8744830 con 0x55bcf8742f60 2024-04-26T07:56:20.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.876+0000 7ff1ef7e6640 1 -- 172.21.15.62:0/124246476 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff31c04d810 con 0x55bcf8742f60 2024-04-26T07:56:20.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff1ef7e6640 1 --2- 172.21.15.62:0/124246476 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff168036e60 0x7ff168039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff1ef7e6640 1 -- 172.21.15.62:0/124246476 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff31c04ad40 con 0x55bcf8742f60 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff329e17640 1 --2- 172.21.15.62:0/124246476 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff168036e60 0x7ff168039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff1ed7e2640 20 reqs_thread_entry: start 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bcf8750960 0x55bcf8752e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bcf87534f0 con 0x55bcf8750960 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff329e17640 1 --2- 172.21.15.62:0/124246476 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff168036e60 0x7ff168039320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff320000c00 tx=0x7ff320005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff32ae19640 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bcf8750960 0x55bcf8752e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.877+0000 7ff32ae19640 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bcf8750960 0x55bcf8752e20 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.878+0000 7ff32ae19640 1 -- 172.21.15.62:0/1584345183 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff32400e070 con 0x55bcf8750960 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.878+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bcf8754db0 con 0x55bcf8750960 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.878+0000 7ff32ae19640 1 -- 172.21.15.62:0/1584345183 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff32400e070 con 0x55bcf8750960 2024-04-26T07:56:20.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/3639106538 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036e60 msgr2=0x7ff204039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 --2- 172.21.15.62:0/3639106538 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036e60 0x7ff204039320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff320054000 tx=0x7ff32004e000 comp rx=0 tx=0).stop 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/3639106538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 msgr2=0x55bcf8728850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 --2- 172.21.15.62:0/3639106538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf8728850 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff32400a930 tx=0x7ff324003370 comp rx=0 tx=0).stop 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/3639106538 shutdown_connections 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 --2- 172.21.15.62:0/3639106538 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff204036e60 0x7ff204039320 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 --2- 172.21.15.62:0/3639106538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf87213c0 0x55bcf8728850 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/3639106538 >> 172.21.15.62:0/3639106538 conn(0x55bcf861cb70 msgr2=0x55bcf871b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/3639106538 shutdown_connections 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/3639106538 wait complete. 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/124246476 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff168036e60 msgr2=0x7ff168039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 --2- 172.21.15.62:0/124246476 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff168036e60 0x7ff168039320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff320000c00 tx=0x7ff320005ac0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/124246476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8742f60 msgr2=0x55bcf8743380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 --2- 172.21.15.62:0/124246476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8742f60 0x55bcf8743380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00ff70 tx=0x7ff31c019b80 comp rx=0 tx=0).stop 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/124246476 shutdown_connections 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 --2- 172.21.15.62:0/124246476 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff168036e60 0x7ff168039320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 --2- 172.21.15.62:0/124246476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8742f60 0x55bcf8743380 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/124246476 >> 172.21.15.62:0/124246476 conn(0x55bcf8737a10 msgr2=0x55bcf8738430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/124246476 shutdown_connections 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.879+0000 7ff32cb19800 1 -- 172.21.15.62:0/124246476 wait complete. 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bcf8750960 msgr2=0x55bcf8752e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bcf8750960 0x55bcf8752e20 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036eb0 msgr2=0x7ff210039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036eb0 0x7ff210039370 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff31c01d5c0 tx=0x7ff31c035040 comp rx=0 tx=0).stop 2024-04-26T07:56:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 msgr2=0x55bcf858e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf858e0e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff31c000fd0 tx=0x7ff31c000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 shutdown_connections 2024-04-26T07:56:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55bcf8750960 0x55bcf8752e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff210036eb0 0x7ff210039370 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 --2- 172.21.15.62:0/1584345183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcf8618820 0x55bcf858e0e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 >> 172.21.15.62:0/1584345183 conn(0x55bcf8613e00 msgr2=0x55bcf8703e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 shutdown_connections 2024-04-26T07:56:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.880+0000 7ff32cb19800 1 -- 172.21.15.62:0/1584345183 wait complete. 2024-04-26T07:56:20.894 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T07:56:20.895 DEBUG:tasks.util.rgw: json result: {'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T07:56:20.895 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-04-26T07:56:20.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-04-26T07:56:20.895 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-04-26T07:56:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f5508125800 1 Processor -- start 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f5508125800 1 -- start start 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f5508125800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55b6924b2c10 0x55b6924b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f5508125800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b6924b5540 con 0x55b6924af100 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f5508125800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55b692350e20 con 0x55b6924b2c10 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f55036b6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55b6924b2c10 0x55b6924b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f55036b6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55b6924b2c10 0x55b6924b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40526/0 (socket says 172.21.15.62:40526) 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f55036b6640 1 -- 172.21.15.62:0/2178428906 learned_addr learned my addr 172.21.15.62:0/2178428906 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f5503eb7640 1 --1- 172.21.15.62:0/2178428906 >> v1:172.21.15.1:6789/0 conn(0x55b6924af100 0x55b6924b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33126/0 (socket says 172.21.15.62:33126) 2024-04-26T07:56:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f55036b6640 1 -- 172.21.15.62:0/2178428906 >> v1:172.21.15.1:6789/0 conn(0x55b6924af100 legacy=0x55b6924b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f55036b6640 1 -- 172.21.15.62:0/2178428906 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6924b6720 con 0x55b6924b2c10 2024-04-26T07:56:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.981+0000 7f5502eb5640 1 -- 172.21.15.62:0/2178428906 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963542890 0 0) 0x55b6924b5540 con 0x55b6924af100 2024-04-26T07:56:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.983+0000 7f55036b6640 1 --2- 172.21.15.62:0/2178428906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924b2c10 0x55b6924b5000 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f54f800a520 tx=0x7f54f801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e630f1d7970480 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5502eb5640 1 -- 172.21.15.62:0/2178428906 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f8057070 con 0x55b6924b2c10 2024-04-26T07:56:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5502eb5640 1 -- 172.21.15.62:0/2178428906 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f8052570 con 0x55b6924b2c10 2024-04-26T07:56:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5502eb5640 1 -- 172.21.15.62:0/2178428906 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f804ae60 con 0x55b6924b2c10 2024-04-26T07:56:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5508125800 1 -- 172.21.15.62:0/2178428906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924b2c10 msgr2=0x55b6924b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5508125800 1 --2- 172.21.15.62:0/2178428906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924b2c10 0x55b6924b5000 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f54f800a520 tx=0x7f54f801d010 comp rx=0 tx=0).stop 2024-04-26T07:56:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5508125800 1 -- 172.21.15.62:0/2178428906 shutdown_connections 2024-04-26T07:56:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5508125800 1 --2- 172.21.15.62:0/2178428906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924b2c10 0x55b6924b5000 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5508125800 1 -- 172.21.15.62:0/2178428906 >> 172.21.15.62:0/2178428906 conn(0x55b6924a8b90 msgr2=0x55b6924aafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5508125800 1 -- 172.21.15.62:0/2178428906 shutdown_connections 2024-04-26T07:56:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.984+0000 7f5508125800 1 -- 172.21.15.62:0/2178428906 wait complete. 2024-04-26T07:56:20.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.997+0000 7f5508125800 1 Processor -- start 2024-04-26T07:56:20.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.997+0000 7f5508125800 1 -- start start 2024-04-26T07:56:20.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.997+0000 7f5508125800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6924aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.997+0000 7f5508125800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b6923f9cc0 con 0x55b6924af100 2024-04-26T07:56:20.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.997+0000 7f5503eb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6924aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:20.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.997+0000 7f5503eb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6924aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40530/0 (socket says 172.21.15.62:40530) 2024-04-26T07:56:20.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.997+0000 7f5503eb7640 1 -- 172.21.15.62:0/2282826493 learned_addr learned my addr 172.21.15.62:0/2282826493 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:20.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.998+0000 7f5503eb7640 1 -- 172.21.15.62:0/2282826493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6924ad000 con 0x55b6924af100 2024-04-26T07:56:20.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.998+0000 7f5503eb7640 1 --2- 172.21.15.62:0/2282826493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6924aea40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f54f400b210 tx=0x7f54f400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c20cc8dca28de16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:20.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.998+0000 7f53f1e0b640 1 -- 172.21.15.62:0/2282826493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f4008070 con 0x55b6924af100 2024-04-26T07:56:20.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.998+0000 7f53f1e0b640 1 -- 172.21.15.62:0/2282826493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f400d500 con 0x55b6924af100 2024-04-26T07:56:20.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.998+0000 7f53f1e0b640 1 -- 172.21.15.62:0/2282826493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f400d840 con 0x55b6924af100 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 -- 172.21.15.62:0/2282826493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 msgr2=0x55b6924aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 --2- 172.21.15.62:0/2282826493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6924aea40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f54f400b210 tx=0x7f54f400b6d0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 -- 172.21.15.62:0/2282826493 shutdown_connections 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 --2- 172.21.15.62:0/2282826493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6924aea40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 -- 172.21.15.62:0/2282826493 >> 172.21.15.62:0/2282826493 conn(0x55b6924a8b90 msgr2=0x55b69259b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 -- 172.21.15.62:0/2282826493 shutdown_connections 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 -- 172.21.15.62:0/2282826493 wait complete. 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 Processor -- start 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 -- start start 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6925a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:20.999+0000 7f5508125800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b6924b5a10 con 0x55b6924af100 2024-04-26T07:56:20.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f5503eb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6925a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f5503eb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6925a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40544/0 (socket says 172.21.15.62:40544) 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 learned_addr learned my addr 172.21.15.62:0/959848355 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6925a9de0 con 0x55b6924af100 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f5503eb7640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6925a98a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f54f400b210 tx=0x7f54f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f53ebfff640 1 -- 172.21.15.62:0/959848355 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f400f950 con 0x55b6924af100 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f53ebfff640 1 -- 172.21.15.62:0/959848355 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f400faf0 con 0x55b6924af100 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6925aa070 con 0x55b6924af100 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f53ebfff640 1 -- 172.21.15.62:0/959848355 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f400fdd0 con 0x55b6924af100 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.000+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6925acd20 con 0x55b6924af100 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f5508125800 1 Processor -- start 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f5508125800 1 -- start start 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f5508125800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925b7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f53ebfff640 1 -- 172.21.15.62:0/959848355 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f54f4017040 con 0x55b6924af100 2024-04-26T07:56:21.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f5508125800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b6923a1170 con 0x55b6925b70e0 2024-04-26T07:56:21.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f53ebfff640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53ec036e10 0x7f53ec0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f55046b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f53ebfff640 1 -- 172.21.15.62:0/959848355 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f54f4015020 con 0x55b6924af100 2024-04-26T07:56:21.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f55046b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925b7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40558/0 (socket says 172.21.15.62:40558) 2024-04-26T07:56:21.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f55046b8640 1 -- 172.21.15.62:0/57846750 learned_addr learned my addr 172.21.15.62:0/57846750 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.001+0000 7f5503eb7640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53ec036e10 0x7f53ec0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f55046b8640 1 -- 172.21.15.62:0/57846750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6925b7a40 con 0x55b6925b70e0 2024-04-26T07:56:21.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f55046b8640 1 --2- 172.21.15.62:0/57846750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925b7500 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00a430 tx=0x7f54fc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6d0924ef36043c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f5503eb7640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53ec036e10 0x7f53ec0392d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f54f401b5b0 tx=0x7f54f401b440 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f53e9ffb640 1 -- 172.21.15.62:0/57846750 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54fc015070 con 0x55b6925b70e0 2024-04-26T07:56:21.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f53e9ffb640 1 -- 172.21.15.62:0/57846750 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54fc001670 con 0x55b6925b70e0 2024-04-26T07:56:21.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f53e9ffb640 1 -- 172.21.15.62:0/57846750 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54fc001990 con 0x55b6925b70e0 2024-04-26T07:56:21.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f5508125800 1 -- 172.21.15.62:0/57846750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 msgr2=0x55b6925b7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f5508125800 1 --2- 172.21.15.62:0/57846750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925b7500 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00a430 tx=0x7f54fc00a8f0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f5508125800 1 -- 172.21.15.62:0/57846750 shutdown_connections 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f5508125800 1 --2- 172.21.15.62:0/57846750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925b7500 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f5508125800 1 -- 172.21.15.62:0/57846750 >> 172.21.15.62:0/57846750 conn(0x55b6924b2c10 msgr2=0x55b6925b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f5508125800 1 -- 172.21.15.62:0/57846750 shutdown_connections 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.002+0000 7f5508125800 1 -- 172.21.15.62:0/57846750 wait complete. 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.003+0000 7f5508125800 1 Processor -- start 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.003+0000 7f5508125800 1 -- start start 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.003+0000 7f5508125800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925be570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.003+0000 7f5508125800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b6925b83d0 con 0x55b6925b70e0 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.003+0000 7f55046b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.003+0000 7f55046b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925be570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40572/0 (socket says 172.21.15.62:40572) 2024-04-26T07:56:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.003+0000 7f55046b8640 1 -- 172.21.15.62:0/2944710411 learned_addr learned my addr 172.21.15.62:0/2944710411 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.004+0000 7f55046b8640 1 -- 172.21.15.62:0/2944710411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6925beab0 con 0x55b6925b70e0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.004+0000 7f55046b8640 1 --2- 172.21.15.62:0/2944710411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925be570 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f54fc013040 tx=0x7f54fc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.004+0000 7f53e3fff640 1 -- 172.21.15.62:0/2944710411 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54fc020020 con 0x55b6925b70e0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.004+0000 7f5508125800 1 -- 172.21.15.62:0/2944710411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6925bed40 con 0x55b6925b70e0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.004+0000 7f53e3fff640 1 -- 172.21.15.62:0/2944710411 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54fc0108e0 con 0x55b6925b70e0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.004+0000 7f53e3fff640 1 -- 172.21.15.62:0/2944710411 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54fc015040 con 0x55b6925b70e0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.004+0000 7f5508125800 1 -- 172.21.15.62:0/2944710411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6925c19f0 con 0x55b6925b70e0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.005+0000 7f53e3fff640 1 -- 172.21.15.62:0/2944710411 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f54fc023020 con 0x55b6925b70e0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.005+0000 7f53e3fff640 1 --2- 172.21.15.62:0/2944710411 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53dc036e60 0x7f53dc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.005+0000 7f5508125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.005+0000 7f5508125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.005+0000 7f53e3fff640 1 -- 172.21.15.62:0/2944710411 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f54fc04c7c0 con 0x55b6925b70e0 2024-04-26T07:56:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f55036b6640 1 --2- 172.21.15.62:0/2944710411 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53dc036e60 0x7f53dc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f5508125800 1 Processor -- start 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f5508125800 1 -- start start 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f55036b6640 1 --2- 172.21.15.62:0/2944710411 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53dc036e60 0x7f53dc039320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f54f8054000 tx=0x7f54f804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f5508125800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925d8c60 0x55b6925d9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f5508125800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b6924ad380 con 0x55b6925d8c60 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f5503eb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925d8c60 0x55b6925d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f5503eb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925d8c60 0x55b6925d9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40576/0 (socket says 172.21.15.62:40576) 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.006+0000 7f5503eb7640 1 -- 172.21.15.62:0/2879972689 learned_addr learned my addr 172.21.15.62:0/2879972689 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.007+0000 7f5503eb7640 1 -- 172.21.15.62:0/2879972689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6925d95c0 con 0x55b6925d8c60 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.007+0000 7f5503eb7640 1 --2- 172.21.15.62:0/2879972689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925d8c60 0x55b6925d9080 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f54f4018fd0 tx=0x7f54f4018440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.007+0000 7f537bfff640 1 -- 172.21.15.62:0/2879972689 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f400e750 con 0x55b6925d8c60 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.007+0000 7f537bfff640 1 -- 172.21.15.62:0/2879972689 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4018630 con 0x55b6925d8c60 2024-04-26T07:56:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.007+0000 7f5508125800 1 -- 172.21.15.62:0/2879972689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6925da080 con 0x55b6925d8c60 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.007+0000 7f537bfff640 1 -- 172.21.15.62:0/2879972689 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f4019e40 con 0x55b6925d8c60 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.007+0000 7f5508125800 1 -- 172.21.15.62:0/2879972689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6925da580 con 0x55b6925d8c60 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.008+0000 7f537bfff640 1 -- 172.21.15.62:0/2879972689 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f54f401c5e0 con 0x55b6925d8c60 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.008+0000 7f537bfff640 1 --2- 172.21.15.62:0/2879972689 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5344036e60 0x7f5344039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.008+0000 7f537bfff640 1 -- 172.21.15.62:0/2879972689 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f54f404ad10 con 0x55b6925d8c60 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.008+0000 7f55036b6640 1 --2- 172.21.15.62:0/2879972689 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5344036e60 0x7f5344039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.008+0000 7f5379ffb640 20 reqs_thread_entry: start 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.008+0000 7f55036b6640 1 --2- 172.21.15.62:0/2879972689 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5344036e60 0x7f5344039320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54f804b010 tx=0x7f54f8005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.008+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b6925e6910 0x55b6925e8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.008+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6925e93e0 con 0x55b6925e6910 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.009+0000 7f55046b8640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b6925e6910 0x55b6925e8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.009+0000 7f55046b8640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b6925e6910 0x55b6925e8d60 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.009+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.009+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6925e9cc0 con 0x55b6925e6910 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.009+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.009+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6925eb070 con 0x55b6925e6910 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.010+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.010+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f7fa0 con 0x55b6925e6910 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:NOTICE: set zone's realm_id=2024-04-26T07:56:21.010+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.010+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b6925ef3a0 0x55b6925f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.010+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x55b6925ef3a0 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.011+0000 7f5503eb7640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b6925ef3a0 0x55b6925f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.011+0000 7f5503eb7640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b6925ef3a0 0x55b6925f22d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.011+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(5 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4046020 con 0x55b6925ef3a0 2024-04-26T07:56:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.011+0000 7f5503eb7640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f54f4049020 0x7f54f404d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.011+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x7f54f4049020 2024-04-26T07:56:21.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.011+0000 7f55036b6640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f54f4049020 0x7f54f404d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.012+0000 7f55036b6640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f54f4049020 0x7f54f404d8e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.012+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f8066030 con 0x7f54f4049020 2024-04-26T07:56:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.012+0000 7f55036b6640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f54f806a040 0x7f54f806b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.012+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x7f54f806a040 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.012+0000 7f55046b8640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f54f806a040 0x7f54f806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.013+0000 7f55046b8640 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f54f806a040 0x7f54f806b940 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.013+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x7f54f806a040 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.013+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x55b6925e6910 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.013+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.013+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x55b6925e6910 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.014+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.014+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x55b6925e6910 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.014+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.014+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x7f54f806a040 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.014+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x7f54f806a040 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.014+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x7f54f4049020 2024-04-26T07:56:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.014+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f8066030 con 0x7f54f4049020 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.014+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x55b6925ef3a0 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.015+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4046020 con 0x55b6925ef3a0 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.015+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x55b6925e6910 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.015+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.015+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x7f54f806a040 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.015+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x7f54f806a040 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.015+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x55b6925e6910 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.015+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.015+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f1e50 con 0x7f54f4049020 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.016+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(17 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f54f8066030 con 0x7f54f4049020 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.016+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925ef3a0 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.016+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4046020 con 0x55b6925ef3a0 2024-04-26T07:56:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.016+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925ef3a0 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.016+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4046020 con 0x55b6925ef3a0 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.016+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x7f54f806a040 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.017+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x7f54f806a040 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.017+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925ef3a0 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.017+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4046020 con 0x55b6925ef3a0 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.017+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925ef3a0 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.017+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4067040 con 0x55b6925ef3a0 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.017+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925e6910 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.017+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.017+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925e6910 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.018+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.018+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x7f54f806a040 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.018+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(25 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x7f54f806a040 2024-04-26T07:56:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.018+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925ef3a0 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.018+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4067040 con 0x55b6925ef3a0 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.018+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x7f54f4049020 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.019+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f8066030 con 0x7f54f4049020 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.019+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925e6910 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.019+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.019+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x7f54f806a040 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.019+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x7f54f806a040 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.019+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925ef3a0 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.019+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4067040 con 0x55b6925ef3a0 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.019+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x7f54f806a040 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.020+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x7f54f806a040 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.020+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x7f54f4049020 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.020+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f8066030 con 0x7f54f4049020 2024-04-26T07:56:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.020+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925ef3a0 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.020+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f4067040 con 0x55b6925ef3a0 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.020+0000 7f5503eb7640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x7f54f806a040 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.021+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54fc00e070 con 0x7f54f806a040 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.021+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x55b6925e6910 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.021+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(35 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.021+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f54f8078060 con 0x7f54f4049020 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.021+0000 7f55036b6640 1 -- 172.21.15.62:0/959848355 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(36 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f8066030 con 0x7f54f4049020 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.021+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f5eb0 con 0x55b6925e6910 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.022+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.022+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6925eb410 con 0x55b6925e6910 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.022+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.022+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f16e0 con 0x55b6925e6910 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.024+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [create,call,writefull 0~1155] v29'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.024+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f3480 con 0x55b6925e6910 2024-04-26T07:56:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.025+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v29'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.025+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6925f3480 con 0x55b6925e6910 2024-04-26T07:56:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.026+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v29'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f54fc00e070 con 0x55b6925e6910 2024-04-26T07:56:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.026+0000 7f5508125800 1 -- 172.21.15.62:0/2944710411 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53dc036e60 msgr2=0x7f53dc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.026+0000 7f5508125800 1 --2- 172.21.15.62:0/2944710411 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53dc036e60 0x7f53dc039320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f54f8054000 tx=0x7f54f804e000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.026+0000 7f5508125800 1 -- 172.21.15.62:0/2944710411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 msgr2=0x55b6925be570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.026+0000 7f5508125800 1 --2- 172.21.15.62:0/2944710411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925be570 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f54fc013040 tx=0x7f54fc003370 comp rx=0 tx=0).stop 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2944710411 shutdown_connections 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/2944710411 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53dc036e60 0x7f53dc039320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/2944710411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925b70e0 0x55b6925be570 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2944710411 >> 172.21.15.62:0/2944710411 conn(0x55b6924b2c10 msgr2=0x55b6925b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2944710411 shutdown_connections 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2944710411 wait complete. 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2879972689 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5344036e60 msgr2=0x7f5344039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/2879972689 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5344036e60 0x7f5344039320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54f804b010 tx=0x7f54f8005ac0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2879972689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925d8c60 msgr2=0x55b6925d9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/2879972689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925d8c60 0x55b6925d9080 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f54f4018fd0 tx=0x7f54f4018440 comp rx=0 tx=0).stop 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2879972689 shutdown_connections 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/2879972689 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f5344036e60 0x7f5344039320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/2879972689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6925d8c60 0x55b6925d9080 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2879972689 >> 172.21.15.62:0/2879972689 conn(0x55b6925cd760 msgr2=0x55b6925ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2879972689 shutdown_connections 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/2879972689 wait complete. 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f54f806a040 msgr2=0x7f54f806b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f54f806a040 0x7f54f806b940 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b6925e6910 msgr2=0x55b6925e8d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55b6925e6910 0x55b6925e8d60 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f54f4049020 msgr2=0x7f54f404d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f54f4049020 0x7f54f404d8e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b6925ef3a0 msgr2=0x55b6925f22d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55b6925ef3a0 0x55b6925f22d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53ec036e10 msgr2=0x7f53ec0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f53ec036e10 0x7f53ec0392d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f54f401b5b0 tx=0x7f54f401b440 comp rx=0 tx=0).stop 2024-04-26T07:56:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f55046b8640 1 -- 172.21.15.62:0/959848355 reap_dead start 2024-04-26T07:56:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 msgr2=0x55b6925a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.027+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6925a98a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f54f400b210 tx=0x7f54f4000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.028+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 shutdown_connections 2024-04-26T07:56:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.028+0000 7f5508125800 1 --2- 172.21.15.62:0/959848355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b6924af100 0x55b6925a98a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.028+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 >> 172.21.15.62:0/959848355 conn(0x55b6924a8b90 msgr2=0x55b6924ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.028+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 shutdown_connections 2024-04-26T07:56:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.028+0000 7f5508125800 1 -- 172.21.15.62:0/959848355 wait complete. 2024-04-26T07:56:21.033 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-26T07:56:21.033 DEBUG:tasks.util.rgw: json result: {'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-26T07:56:21.034 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-04-26T07:56:21.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-04-26T07:56:21.034 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-04-26T07:56:21.116 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:21.116 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:21.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.120+0000 7f0409735800 1 Processor -- start 2024-04-26T07:56:21.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.120+0000 7f0409735800 1 -- start start 2024-04-26T07:56:21.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.120+0000 7f0409735800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55d8a0ce6c90 0x55d8a0ce9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.120+0000 7f0409735800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8a0ce95c0 con 0x55d8a0ce3180 2024-04-26T07:56:21.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.120+0000 7f0409735800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55d8a0b84e20 con 0x55d8a0ce6c90 2024-04-26T07:56:21.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.120+0000 7f0404bb4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55d8a0ce6c90 0x55d8a0ce9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.120+0000 7f04053b5640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55d8a0ce3180 0x55d8a0ce5570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33142/0 (socket says 172.21.15.62:33142) 2024-04-26T07:56:21.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.120+0000 7f04053b5640 1 -- 172.21.15.62:0/1122189862 learned_addr learned my addr 172.21.15.62:0/1122189862 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:21.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.121+0000 7f03fffff640 1 -- 172.21.15.62:0/1122189862 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819589572 0 0) 0x55d8a0ce95c0 con 0x55d8a0ce3180 2024-04-26T07:56:21.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.121+0000 7f03fffff640 1 -- 172.21.15.62:0/1122189862 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03f4001e10 con 0x55d8a0ce3180 2024-04-26T07:56:21.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.121+0000 7f0404bb4640 1 -- 172.21.15.62:0/1122189862 >> v1:172.21.15.1:6789/0 conn(0x55d8a0ce3180 legacy=0x55d8a0ce5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.121+0000 7f0404bb4640 1 -- 172.21.15.62:0/1122189862 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a0cea7a0 con 0x55d8a0ce6c90 2024-04-26T07:56:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f0404bb4640 1 --2- 172.21.15.62:0/1122189862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce6c90 0x55d8a0ce9080 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f03f000a470 tx=0x7f03f001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d9b674114d7416 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f03fffff640 1 -- 172.21.15.62:0/1122189862 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f0057070 con 0x55d8a0ce6c90 2024-04-26T07:56:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f03fffff640 1 -- 172.21.15.62:0/1122189862 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f0052570 con 0x55d8a0ce6c90 2024-04-26T07:56:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f03fffff640 1 -- 172.21.15.62:0/1122189862 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f0052870 con 0x55d8a0ce6c90 2024-04-26T07:56:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f0409735800 1 -- 172.21.15.62:0/1122189862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce6c90 msgr2=0x55d8a0ce9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f0409735800 1 --2- 172.21.15.62:0/1122189862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce6c90 0x55d8a0ce9080 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f03f000a470 tx=0x7f03f001cdb0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f0409735800 1 -- 172.21.15.62:0/1122189862 shutdown_connections 2024-04-26T07:56:21.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f0409735800 1 --2- 172.21.15.62:0/1122189862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce6c90 0x55d8a0ce9080 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f0409735800 1 -- 172.21.15.62:0/1122189862 >> 172.21.15.62:0/1122189862 conn(0x55d8a0cdcb70 msgr2=0x55d8a0cdef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f0409735800 1 -- 172.21.15.62:0/1122189862 shutdown_connections 2024-04-26T07:56:21.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.123+0000 7f0409735800 1 -- 172.21.15.62:0/1122189862 wait complete. 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.136+0000 7f0409735800 1 Processor -- start 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.136+0000 7f0409735800 1 -- start start 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.136+0000 7f0409735800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ce2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.136+0000 7f0409735800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d8a0c2dcc0 con 0x55d8a0ce3180 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.137+0000 7f04053b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ce2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.137+0000 7f04053b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ce2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40598/0 (socket says 172.21.15.62:40598) 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.137+0000 7f04053b5640 1 -- 172.21.15.62:0/3044360192 learned_addr learned my addr 172.21.15.62:0/3044360192 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.137+0000 7f04053b5640 1 -- 172.21.15.62:0/3044360192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a0ce1080 con 0x55d8a0ce3180 2024-04-26T07:56:21.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.137+0000 7f04053b5640 1 --2- 172.21.15.62:0/3044360192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ce2ac0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0400001de0 tx=0x7f040000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3e47a5e6abceb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.137+0000 7f02f3606640 1 -- 172.21.15.62:0/3044360192 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0400012020 con 0x55d8a0ce3180 2024-04-26T07:56:21.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.137+0000 7f02f3606640 1 -- 172.21.15.62:0/3044360192 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040000e5a0 con 0x55d8a0ce3180 2024-04-26T07:56:21.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.137+0000 7f02f3606640 1 -- 172.21.15.62:0/3044360192 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040000e900 con 0x55d8a0ce3180 2024-04-26T07:56:21.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 -- 172.21.15.62:0/3044360192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 msgr2=0x55d8a0ce2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 --2- 172.21.15.62:0/3044360192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ce2ac0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0400001de0 tx=0x7f040000b6c0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 -- 172.21.15.62:0/3044360192 shutdown_connections 2024-04-26T07:56:21.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 --2- 172.21.15.62:0/3044360192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ce2ac0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 -- 172.21.15.62:0/3044360192 >> 172.21.15.62:0/3044360192 conn(0x55d8a0cdcb70 msgr2=0x55d8a0dcf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 -- 172.21.15.62:0/3044360192 shutdown_connections 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 -- 172.21.15.62:0/3044360192 wait complete. 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 Processor -- start 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 -- start start 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ddd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.138+0000 7f0409735800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d8a0ce9a90 con 0x55d8a0ce3180 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.139+0000 7f04053b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ddd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.139+0000 7f04053b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ddd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40606/0 (socket says 172.21.15.62:40606) 2024-04-26T07:56:21.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.139+0000 7f04053b5640 1 -- 172.21.15.62:0/521156859 learned_addr learned my addr 172.21.15.62:0/521156859 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.139+0000 7f04053b5640 1 -- 172.21.15.62:0/521156859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a0dddd50 con 0x55d8a0ce3180 2024-04-26T07:56:21.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.139+0000 7f04053b5640 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ddd810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f040000c010 tx=0x7f0400000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.140+0000 7f02f1e03640 1 -- 172.21.15.62:0/521156859 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0400012030 con 0x55d8a0ce3180 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.140+0000 7f02f1e03640 1 -- 172.21.15.62:0/521156859 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040001a7a0 con 0x55d8a0ce3180 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.140+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8a0dddfe0 con 0x55d8a0ce3180 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.140+0000 7f02f1e03640 1 -- 172.21.15.62:0/521156859 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040001a950 con 0x55d8a0ce3180 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.140+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8a0de0c90 con 0x55d8a0ce3180 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.140+0000 7f0409735800 1 Processor -- start 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.140+0000 7f0409735800 1 -- start start 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.140+0000 7f0409735800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0deb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f0409735800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d8a0bd5170 con 0x55d8a0deb050 2024-04-26T07:56:21.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f02f1e03640 1 -- 172.21.15.62:0/521156859 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0400015020 con 0x55d8a0ce3180 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f0405bb6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0deb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f0405bb6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0deb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40608/0 (socket says 172.21.15.62:40608) 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f0405bb6640 1 -- 172.21.15.62:0/2345117719 learned_addr learned my addr 172.21.15.62:0/2345117719 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f02f1e03640 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02ec036eb0 0x7f02ec039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f02f1e03640 1 -- 172.21.15.62:0/521156859 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f0400020030 con 0x55d8a0ce3180 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f04053b5640 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02ec036eb0 0x7f02ec039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f0405bb6640 1 -- 172.21.15.62:0/2345117719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a0deb9b0 con 0x55d8a0deb050 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f0405bb6640 1 --2- 172.21.15.62:0/2345117719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0deb470 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f03f800a430 tx=0x7f03f800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b50ef68300ca6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f04053b5640 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02ec036eb0 0x7f02ec039370 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0400018ac0 tx=0x7f0400018a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f02eb7fe640 1 -- 172.21.15.62:0/2345117719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f8015070 con 0x55d8a0deb050 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f02eb7fe640 1 -- 172.21.15.62:0/2345117719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f8001670 con 0x55d8a0deb050 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.141+0000 7f02eb7fe640 1 -- 172.21.15.62:0/2345117719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f8001990 con 0x55d8a0deb050 2024-04-26T07:56:21.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 -- 172.21.15.62:0/2345117719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 msgr2=0x55d8a0deb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 --2- 172.21.15.62:0/2345117719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0deb470 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f03f800a430 tx=0x7f03f800a8f0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 -- 172.21.15.62:0/2345117719 shutdown_connections 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 --2- 172.21.15.62:0/2345117719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0deb470 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 -- 172.21.15.62:0/2345117719 >> 172.21.15.62:0/2345117719 conn(0x55d8a0ce6c90 msgr2=0x55d8a0de7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 -- 172.21.15.62:0/2345117719 shutdown_connections 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 -- 172.21.15.62:0/2345117719 wait complete. 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 Processor -- start 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 -- start start 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0df2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.142+0000 7f0409735800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d8a0dec340 con 0x55d8a0deb050 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f0405bb6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0df2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f0405bb6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0df2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40622/0 (socket says 172.21.15.62:40622) 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f0405bb6640 1 -- 172.21.15.62:0/298641440 learned_addr learned my addr 172.21.15.62:0/298641440 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f0405bb6640 1 -- 172.21.15.62:0/298641440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a0df2aa0 con 0x55d8a0deb050 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f0405bb6640 1 --2- 172.21.15.62:0/298641440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0df2560 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f03f8013040 tx=0x7f03f8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f02e9ffb640 1 -- 172.21.15.62:0/298641440 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f8020020 con 0x55d8a0deb050 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f02e9ffb640 1 -- 172.21.15.62:0/298641440 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f80108e0 con 0x55d8a0deb050 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f02e9ffb640 1 -- 172.21.15.62:0/298641440 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f8015040 con 0x55d8a0deb050 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f0409735800 1 -- 172.21.15.62:0/298641440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8a0df2d30 con 0x55d8a0deb050 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.143+0000 7f0409735800 1 -- 172.21.15.62:0/298641440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8a0df59e0 con 0x55d8a0deb050 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.144+0000 7f02e9ffb640 1 -- 172.21.15.62:0/298641440 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f03f8023020 con 0x55d8a0deb050 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.144+0000 7f02e9ffb640 1 --2- 172.21.15.62:0/298641440 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02dc036e60 0x7f02dc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.144+0000 7f02e9ffb640 1 -- 172.21.15.62:0/298641440 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f03f804c880 con 0x55d8a0deb050 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.144+0000 7f0409735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.144+0000 7f0409735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f0404bb4640 1 --2- 172.21.15.62:0/298641440 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02dc036e60 0x7f02dc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f0409735800 1 Processor -- start 2024-04-26T07:56:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f0409735800 1 -- start start 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f0404bb4640 1 --2- 172.21.15.62:0/298641440 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02dc036e60 0x7f02dc039320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f03f0054000 tx=0x7f03f004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f0409735800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0e0cbe0 0x55d8a0e0d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f0409735800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d8a0ce1400 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f04053b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0e0cbe0 0x55d8a0e0d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f04053b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0e0cbe0 0x55d8a0e0d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40632/0 (socket says 172.21.15.62:40632) 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.145+0000 7f04053b5640 1 -- 172.21.15.62:0/339106685 learned_addr learned my addr 172.21.15.62:0/339106685 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.146+0000 7f04053b5640 1 -- 172.21.15.62:0/339106685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a0e0d540 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.146+0000 7f04053b5640 1 --2- 172.21.15.62:0/339106685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0e0cbe0 0x55d8a0e0d000 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f040000bc10 tx=0x7f0400006e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.146+0000 7f02cafdd640 1 -- 172.21.15.62:0/339106685 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0400049070 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.146+0000 7f02cafdd640 1 -- 172.21.15.62:0/339106685 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0400018430 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.146+0000 7f0409735800 1 -- 172.21.15.62:0/339106685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8a0e0dfb0 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.146+0000 7f02cafdd640 1 -- 172.21.15.62:0/339106685 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04000163b0 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.146+0000 7f0409735800 1 -- 172.21.15.62:0/339106685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8a0e0e4b0 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f02cafdd640 1 -- 172.21.15.62:0/339106685 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0400017c50 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f02cafdd640 1 --2- 172.21.15.62:0/339106685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f023c036e60 0x7f023c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f02cafdd640 1 -- 172.21.15.62:0/339106685 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f0400035040 con 0x55d8a0e0cbe0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f0404bb4640 1 --2- 172.21.15.62:0/339106685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f023c036e60 0x7f023c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f02c8fd9640 20 reqs_thread_entry: start 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f0409735800 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d8a0e1a6a0 0x55d8a0e1cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d8a0e1d160 con 0x55d8a0e1a6a0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f0404bb4640 1 --2- 172.21.15.62:0/339106685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f023c036e60 0x7f023c039320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f03f000a470 tx=0x7f03f0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.147+0000 7f0405bb6640 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d8a0e1a6a0 0x55d8a0e1cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.148+0000 7f0405bb6640 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d8a0e1a6a0 0x55d8a0e1cab0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.148+0000 7f0405bb6640 1 -- 172.21.15.62:0/521156859 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03f800e070 con 0x55d8a0e1a6a0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.148+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d8a0e1da40 con 0x55d8a0e1a6a0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.148+0000 7f0405bb6640 1 -- 172.21.15.62:0/521156859 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03f800e070 con 0x55d8a0e1a6a0 2024-04-26T07:56:21.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.148+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d8a0e1edf0 con 0x55d8a0e1a6a0 2024-04-26T07:56:21.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.149+0000 7f0405bb6640 1 -- 172.21.15.62:0/521156859 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f03f800e070 con 0x55d8a0e1a6a0 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.149+0000 7f0409735800 1 -- 172.21.15.62:0/298641440 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02dc036e60 msgr2=0x7f02dc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.149+0000 7f0409735800 1 --2- 172.21.15.62:0/298641440 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02dc036e60 0x7f02dc039320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f03f0054000 tx=0x7f03f004e000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.149+0000 7f0409735800 1 -- 172.21.15.62:0/298641440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 msgr2=0x55d8a0df2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.149+0000 7f0409735800 1 --2- 172.21.15.62:0/298641440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0df2560 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f03f8013040 tx=0x7f03f8003370 comp rx=0 tx=0).stop 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/298641440 shutdown_connections 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/298641440 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02dc036e60 0x7f02dc039320 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/298641440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0deb050 0x55d8a0df2560 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/298641440 >> 172.21.15.62:0/298641440 conn(0x55d8a0ce6c90 msgr2=0x55d8a0de5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/298641440 shutdown_connections 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/298641440 wait complete. 2024-04-26T07:56:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/339106685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f023c036e60 msgr2=0x7f023c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/339106685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f023c036e60 0x7f023c039320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f03f000a470 tx=0x7f03f0005a00 comp rx=0 tx=0).stop 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/339106685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0e0cbe0 msgr2=0x55d8a0e0d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/339106685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0e0cbe0 0x55d8a0e0d000 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f040000bc10 tx=0x7f0400006e60 comp rx=0 tx=0).stop 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/339106685 shutdown_connections 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/339106685 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f023c036e60 0x7f023c039320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/339106685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0e0cbe0 0x55d8a0e0d000 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/339106685 >> 172.21.15.62:0/339106685 conn(0x55d8a0e016b0 msgr2=0x55d8a0e020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/339106685 shutdown_connections 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/339106685 wait complete. 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d8a0e1a6a0 msgr2=0x55d8a0e1cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d8a0e1a6a0 0x55d8a0e1cab0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02ec036eb0 msgr2=0x7f02ec039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02ec036eb0 0x7f02ec039370 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0400018ac0 tx=0x7f0400018a10 comp rx=0 tx=0).stop 2024-04-26T07:56:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 msgr2=0x55d8a0ddd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ddd810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f040000c010 tx=0x7f0400000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 shutdown_connections 2024-04-26T07:56:21.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d8a0e1a6a0 0x55d8a0e1cab0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f02ec036eb0 0x7f02ec039370 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 --2- 172.21.15.62:0/521156859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8a0ce3180 0x55d8a0ddd810 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.150+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 >> 172.21.15.62:0/521156859 conn(0x55d8a0cdcb70 msgr2=0x55d8a0ce1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.151+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 shutdown_connections 2024-04-26T07:56:21.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.151+0000 7f0409735800 1 -- 172.21.15.62:0/521156859 wait complete. 2024-04-26T07:56:21.157 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-26T07:56:21.157 DEBUG:tasks.util.rgw: json result: {'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-26T07:56:21.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T07:56:21.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T07:56:21.158 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-26T07:56:21.245 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:21.245 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f1057e3c800 1 Processor -- start 2024-04-26T07:56:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f1057e3c800 1 -- start start 2024-04-26T07:56:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f1057e3c800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f9e3900cd0 0x55f9e39030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f1057e3c800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9e3903600 con 0x55f9e38fd1c0 2024-04-26T07:56:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f1057e3c800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55f9e379ee20 con 0x55f9e3900cd0 2024-04-26T07:56:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f105222b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f9e3900cd0 0x55f9e39030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f1052a2c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55f9e38fd1c0 0x55f9e38ff5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33152/0 (socket says 172.21.15.62:33152) 2024-04-26T07:56:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f1052a2c640 1 -- 172.21.15.62:0/235144377 learned_addr learned my addr 172.21.15.62:0/235144377 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:21.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f105222b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f9e3900cd0 0x55f9e39030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40634/0 (socket says 172.21.15.62:40634) 2024-04-26T07:56:21.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f105222b640 1 -- 172.21.15.62:0/235144377 >> v1:172.21.15.1:6789/0 conn(0x55f9e38fd1c0 legacy=0x55f9e38ff5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.249+0000 7f105222b640 1 -- 172.21.15.62:0/235144377 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e39047e0 con 0x55f9e3900cd0 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.251+0000 7f105222b640 1 --2- 172.21.15.62:0/235144377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3900cd0 0x55f9e39030c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f103c00a470 tx=0x7f103c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1922d197955177ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.251+0000 7f1051a2a640 1 -- 172.21.15.62:0/235144377 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c057070 con 0x55f9e3900cd0 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1051a2a640 1 -- 172.21.15.62:0/235144377 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c052570 con 0x55f9e3900cd0 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1051a2a640 1 -- 172.21.15.62:0/235144377 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c052870 con 0x55f9e3900cd0 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1057e3c800 1 -- 172.21.15.62:0/235144377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3900cd0 msgr2=0x55f9e39030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1057e3c800 1 --2- 172.21.15.62:0/235144377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3900cd0 0x55f9e39030c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f103c00a470 tx=0x7f103c01ce90 comp rx=0 tx=0).stop 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1057e3c800 1 -- 172.21.15.62:0/235144377 shutdown_connections 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1057e3c800 1 --2- 172.21.15.62:0/235144377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3900cd0 0x55f9e39030c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1057e3c800 1 -- 172.21.15.62:0/235144377 >> 172.21.15.62:0/235144377 conn(0x55f9e38f6c30 msgr2=0x55f9e38f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1057e3c800 1 -- 172.21.15.62:0/235144377 shutdown_connections 2024-04-26T07:56:21.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.252+0000 7f1057e3c800 1 -- 172.21.15.62:0/235144377 wait complete. 2024-04-26T07:56:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.265+0000 7f1057e3c800 1 Processor -- start 2024-04-26T07:56:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.265+0000 7f1057e3c800 1 -- start start 2024-04-26T07:56:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.265+0000 7f1057e3c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e39eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.265+0000 7f1057e3c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9e3847cf0 con 0x55f9e38fd1c0 2024-04-26T07:56:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.265+0000 7f1052a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e39eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.265+0000 7f1052a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e39eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40638/0 (socket says 172.21.15.62:40638) 2024-04-26T07:56:21.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.265+0000 7f1052a2c640 1 -- 172.21.15.62:0/2602328047 learned_addr learned my addr 172.21.15.62:0/2602328047 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.265+0000 7f1052a2c640 1 -- 172.21.15.62:0/2602328047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e39ee390 con 0x55f9e38fd1c0 2024-04-26T07:56:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.266+0000 7f1052a2c640 1 --2- 172.21.15.62:0/2602328047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e39eddc0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1044001de0 tx=0x7f104400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac15e8a8f468038 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.266+0000 7f0f40e09640 1 -- 172.21.15.62:0/2602328047 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1044012020 con 0x55f9e38fd1c0 2024-04-26T07:56:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.266+0000 7f0f40e09640 1 -- 172.21.15.62:0/2602328047 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104400e5a0 con 0x55f9e38fd1c0 2024-04-26T07:56:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.266+0000 7f0f40e09640 1 -- 172.21.15.62:0/2602328047 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104400e8c0 con 0x55f9e38fd1c0 2024-04-26T07:56:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.266+0000 7f1057e3c800 1 -- 172.21.15.62:0/2602328047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 msgr2=0x55f9e39eddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.266+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2602328047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e39eddc0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1044001de0 tx=0x7f104400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.266+0000 7f1057e3c800 1 -- 172.21.15.62:0/2602328047 shutdown_connections 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.266+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2602328047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e39eddc0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1057e3c800 1 -- 172.21.15.62:0/2602328047 >> 172.21.15.62:0/2602328047 conn(0x55f9e38f6c30 msgr2=0x55f9e39e96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1057e3c800 1 -- 172.21.15.62:0/2602328047 shutdown_connections 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1057e3c800 1 -- 172.21.15.62:0/2602328047 wait complete. 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1057e3c800 1 Processor -- start 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1057e3c800 1 -- start start 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1057e3c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e38fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1057e3c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9e3903ad0 con 0x55f9e38fd1c0 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1052a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e38fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1052a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e38fcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40650/0 (socket says 172.21.15.62:40650) 2024-04-26T07:56:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.267+0000 7f1052a2c640 1 -- 172.21.15.62:0/2456271626 learned_addr learned my addr 172.21.15.62:0/2456271626 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.268+0000 7f1052a2c640 1 -- 172.21.15.62:0/2456271626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e38fb1f0 con 0x55f9e38fd1c0 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.268+0000 7f1052a2c640 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e38fcb00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1044001de0 tx=0x7f1044000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.268+0000 7f0f3f606640 1 -- 172.21.15.62:0/2456271626 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1044012030 con 0x55f9e38fd1c0 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.268+0000 7f0f3f606640 1 -- 172.21.15.62:0/2456271626 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104401a7a0 con 0x55f9e38fd1c0 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.268+0000 7f0f3f606640 1 -- 172.21.15.62:0/2456271626 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104401aac0 con 0x55f9e38fd1c0 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.268+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9e38fb480 con 0x55f9e38fd1c0 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.268+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e38fb9a0 con 0x55f9e38fd1c0 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.268+0000 7f1057e3c800 1 Processor -- start 2024-04-26T07:56:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f1057e3c800 1 -- start start 2024-04-26T07:56:21.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f1057e3c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f1057e3c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9e37ef170 con 0x55f9e3a053c0 2024-04-26T07:56:21.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f0f3f606640 1 -- 172.21.15.62:0/2456271626 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1044015020 con 0x55f9e38fd1c0 2024-04-26T07:56:21.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f105322d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f0f3f606640 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f38036e60 0x7f0f38039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f105322d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a057e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40666/0 (socket says 172.21.15.62:40666) 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f105322d640 1 -- 172.21.15.62:0/156789716 learned_addr learned my addr 172.21.15.62:0/156789716 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f0f3f606640 1 -- 172.21.15.62:0/2456271626 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f1044020070 con 0x55f9e38fd1c0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f1052a2c640 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f38036e60 0x7f0f38039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f105322d640 1 -- 172.21.15.62:0/156789716 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e3a05d20 con 0x55f9e3a053c0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f1052a2c640 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f38036e60 0x7f0f38039320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1044014ff0 tx=0x7f104400ef30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.269+0000 7f105322d640 1 --2- 172.21.15.62:0/156789716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a057e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f104c00a430 tx=0x7f104c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c98aa262348ab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f0f3d602640 1 -- 172.21.15.62:0/156789716 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c015070 con 0x55f9e3a053c0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f0f3d602640 1 -- 172.21.15.62:0/156789716 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c001670 con 0x55f9e3a053c0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f0f3d602640 1 -- 172.21.15.62:0/156789716 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c001990 con 0x55f9e3a053c0 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f1057e3c800 1 -- 172.21.15.62:0/156789716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 msgr2=0x55f9e3a057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f1057e3c800 1 --2- 172.21.15.62:0/156789716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a057e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f104c00a430 tx=0x7f104c00a8f0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f1057e3c800 1 -- 172.21.15.62:0/156789716 shutdown_connections 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f1057e3c800 1 --2- 172.21.15.62:0/156789716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a057e0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f1057e3c800 1 -- 172.21.15.62:0/156789716 >> 172.21.15.62:0/156789716 conn(0x55f9e3900cd0 msgr2=0x55f9e3a01e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f1057e3c800 1 -- 172.21.15.62:0/156789716 shutdown_connections 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f1057e3c800 1 -- 172.21.15.62:0/156789716 wait complete. 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.270+0000 7f1057e3c800 1 Processor -- start 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.271+0000 7f1057e3c800 1 -- start start 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.271+0000 7f1057e3c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a0c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.271+0000 7f1057e3c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9e3a066b0 con 0x55f9e3a053c0 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.271+0000 7f105322d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a0c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.271+0000 7f105322d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a0c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40676/0 (socket says 172.21.15.62:40676) 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.271+0000 7f105322d640 1 -- 172.21.15.62:0/208351328 learned_addr learned my addr 172.21.15.62:0/208351328 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.271+0000 7f105322d640 1 -- 172.21.15.62:0/208351328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e3a0cd10 con 0x55f9e3a053c0 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.271+0000 7f105322d640 1 --2- 172.21.15.62:0/208351328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a0c7d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f104c013040 tx=0x7f104c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.272+0000 7f0f377fe640 1 -- 172.21.15.62:0/208351328 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c020020 con 0x55f9e3a053c0 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.272+0000 7f0f377fe640 1 -- 172.21.15.62:0/208351328 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c0108e0 con 0x55f9e3a053c0 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.272+0000 7f1057e3c800 1 -- 172.21.15.62:0/208351328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9e3a0cfa0 con 0x55f9e3a053c0 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.272+0000 7f0f377fe640 1 -- 172.21.15.62:0/208351328 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c015040 con 0x55f9e3a053c0 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.272+0000 7f1057e3c800 1 -- 172.21.15.62:0/208351328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e3a0fc50 con 0x55f9e3a053c0 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.272+0000 7f0f377fe640 1 -- 172.21.15.62:0/208351328 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f104c023020 con 0x55f9e3a053c0 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f0f377fe640 1 --2- 172.21.15.62:0/208351328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f2c036eb0 0x7f0f2c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f1057e3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f1057e3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f0f377fe640 1 -- 172.21.15.62:0/208351328 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f104c04c800 con 0x55f9e3a053c0 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f105222b640 1 --2- 172.21.15.62:0/208351328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f2c036eb0 0x7f0f2c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f1057e3c800 1 Processor -- start 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f1057e3c800 1 -- start start 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f1057e3c800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a26f00 0x55f9e3a27300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f1057e3c800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9e39ee710 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.273+0000 7f105222b640 1 --2- 172.21.15.62:0/208351328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f2c036eb0 0x7f0f2c039370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f103c054000 tx=0x7f103c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f1052a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a26f00 0x55f9e3a27300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f1052a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a26f00 0x55f9e3a27300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40684/0 (socket says 172.21.15.62:40684) 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f1052a2c640 1 -- 172.21.15.62:0/3318241133 learned_addr learned my addr 172.21.15.62:0/3318241133 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f1052a2c640 1 -- 172.21.15.62:0/3318241133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e3a27840 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f1052a2c640 1 --2- 172.21.15.62:0/3318241133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a26f00 0x55f9e3a27300 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f104404b560 tx=0x7f10440164e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f0f12ffd640 1 -- 172.21.15.62:0/3318241133 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1044035040 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f0f12ffd640 1 -- 172.21.15.62:0/3318241133 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1044016e20 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f1057e3c800 1 -- 172.21.15.62:0/3318241133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9e3a282d0 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f1057e3c800 1 -- 172.21.15.62:0/3318241133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e3a287d0 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.274+0000 7f0f12ffd640 1 -- 172.21.15.62:0/3318241133 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1044015310 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.275+0000 7f0f12ffd640 1 -- 172.21.15.62:0/3318241133 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f104400d3d0 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.275+0000 7f0f12ffd640 1 --2- 172.21.15.62:0/3318241133 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0e8c036e60 0x7f0e8c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.275+0000 7f0f12ffd640 1 -- 172.21.15.62:0/3318241133 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f1044050d00 con 0x55f9e3a26f00 2024-04-26T07:56:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.276+0000 7f105222b640 1 --2- 172.21.15.62:0/3318241133 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0e8c036e60 0x7f0e8c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.276+0000 7f0f10ff9640 20 reqs_thread_entry: start 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.276+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9e3a34950 0x55f9e3a36de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.276+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9e3a374b0 con 0x55f9e3a34950 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.276+0000 7f105222b640 1 --2- 172.21.15.62:0/3318241133 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0e8c036e60 0x7f0e8c039320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f103c052540 tx=0x7f103c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.276+0000 7f105322d640 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9e3a34950 0x55f9e3a36de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.276+0000 7f105322d640 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9e3a34950 0x55f9e3a36de0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.277+0000 7f105322d640 1 -- 172.21.15.62:0/2456271626 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f104c00e070 con 0x55f9e3a34950 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.277+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9e3a38d70 con 0x55f9e3a34950 2024-04-26T07:56:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.277+0000 7f105322d640 1 -- 172.21.15.62:0/2456271626 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f104c00e070 con 0x55f9e3a34950 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.277+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9e3a386f0 con 0x55f9e3a34950 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.278+0000 7f105322d640 1 -- 172.21.15.62:0/2456271626 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [stat,call,call,writefull 0~993] v29'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f104c00e070 con 0x55f9e3a34950 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 -- 172.21.15.62:0/208351328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f2c036eb0 msgr2=0x7f0f2c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 --2- 172.21.15.62:0/208351328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f2c036eb0 0x7f0f2c039370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f103c054000 tx=0x7f103c04e000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 -- 172.21.15.62:0/208351328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 msgr2=0x55f9e3a0c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 --2- 172.21.15.62:0/208351328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a0c7d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f104c013040 tx=0x7f104c003370 comp rx=0 tx=0).stop 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 -- 172.21.15.62:0/208351328 shutdown_connections 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 --2- 172.21.15.62:0/208351328 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f2c036eb0 0x7f0f2c039370 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 --2- 172.21.15.62:0/208351328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a053c0 0x55f9e3a0c7d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 -- 172.21.15.62:0/208351328 >> 172.21.15.62:0/208351328 conn(0x55f9e3900cd0 msgr2=0x55f9e39ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 -- 172.21.15.62:0/208351328 shutdown_connections 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 -- 172.21.15.62:0/208351328 wait complete. 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 -- 172.21.15.62:0/3318241133 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0e8c036e60 msgr2=0x7f0e8c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 --2- 172.21.15.62:0/3318241133 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0e8c036e60 0x7f0e8c039320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f103c052540 tx=0x7f103c005a00 comp rx=0 tx=0).stop 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 -- 172.21.15.62:0/3318241133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a26f00 msgr2=0x55f9e3a27300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.279+0000 7f1057e3c800 1 --2- 172.21.15.62:0/3318241133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a26f00 0x55f9e3a27300 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f104404b560 tx=0x7f10440164e0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/3318241133 shutdown_connections 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 --2- 172.21.15.62:0/3318241133 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0e8c036e60 0x7f0e8c039320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 --2- 172.21.15.62:0/3318241133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e3a26f00 0x55f9e3a27300 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/3318241133 >> 172.21.15.62:0/3318241133 conn(0x55f9e3a1b9b0 msgr2=0x55f9e3a1c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/3318241133 shutdown_connections 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/3318241133 wait complete. 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9e3a34950 msgr2=0x55f9e3a36de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9e3a34950 0x55f9e3a36de0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f38036e60 msgr2=0x7f0f38039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f38036e60 0x7f0f38039320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1044014ff0 tx=0x7f104400ef30 comp rx=0 tx=0).stop 2024-04-26T07:56:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 msgr2=0x55f9e38fcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e38fcb00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1044001de0 tx=0x7f1044000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 shutdown_connections 2024-04-26T07:56:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f9e3a34950 0x55f9e3a36de0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0f38036e60 0x7f0f38039320 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 --2- 172.21.15.62:0/2456271626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9e38fd1c0 0x55f9e38fcb00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 >> 172.21.15.62:0/2456271626 conn(0x55f9e38f6c30 msgr2=0x55f9e39e7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 shutdown_connections 2024-04-26T07:56:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.280+0000 7f1057e3c800 1 -- 172.21.15.62:0/2456271626 wait complete. 2024-04-26T07:56:21.286 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T07:56:21.286 DEBUG:tasks.util.rgw: json result: {'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T07:56:21.286 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-04-26T07:56:21.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-04-26T07:56:21.287 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-04-26T07:56:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:21.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.332+0000 7feb83fa2800 1 Processor -- start 2024-04-26T07:56:21.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.332+0000 7feb83fa2800 1 -- start start 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb83fa2800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f4575cecb0 0x55f4575d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb83fa2800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4575d15e0 con 0x55f4575cb1a0 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb83fa2800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55f45746ce20 con 0x55f4575cecb0 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb812a7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f4575cecb0 0x55f4575d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb812a7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f4575cecb0 0x55f4575d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40700/0 (socket says 172.21.15.62:40700) 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb812a7640 1 -- 172.21.15.62:0/2859092921 learned_addr learned my addr 172.21.15.62:0/2859092921 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb81aa8640 1 --1- 172.21.15.62:0/2859092921 >> v1:172.21.15.1:6789/0 conn(0x55f4575cb1a0 0x55f4575cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33164/0 (socket says 172.21.15.62:33164) 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb812a7640 1 -- 172.21.15.62:0/2859092921 >> v1:172.21.15.1:6789/0 conn(0x55f4575cb1a0 legacy=0x55f4575cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.333+0000 7feb812a7640 1 -- 172.21.15.62:0/2859092921 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4575d27c0 con 0x55f4575cecb0 2024-04-26T07:56:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.335+0000 7feb812a7640 1 --2- 172.21.15.62:0/2859092921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cecb0 0x55f4575d10a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7feb7800a520 tx=0x7feb7801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea32c283ac5996a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.335+0000 7feb80aa6640 1 -- 172.21.15.62:0/2859092921 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb78057070 con 0x55f4575cecb0 2024-04-26T07:56:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.335+0000 7feb80aa6640 1 -- 172.21.15.62:0/2859092921 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb78052570 con 0x55f4575cecb0 2024-04-26T07:56:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.335+0000 7feb80aa6640 1 -- 172.21.15.62:0/2859092921 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7804ae60 con 0x55f4575cecb0 2024-04-26T07:56:21.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.336+0000 7feb83fa2800 1 -- 172.21.15.62:0/2859092921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cecb0 msgr2=0x55f4575d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.336+0000 7feb83fa2800 1 --2- 172.21.15.62:0/2859092921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cecb0 0x55f4575d10a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7feb7800a520 tx=0x7feb7801d010 comp rx=0 tx=0).stop 2024-04-26T07:56:21.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.336+0000 7feb83fa2800 1 -- 172.21.15.62:0/2859092921 shutdown_connections 2024-04-26T07:56:21.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.336+0000 7feb83fa2800 1 --2- 172.21.15.62:0/2859092921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cecb0 0x55f4575d10a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.336+0000 7feb83fa2800 1 -- 172.21.15.62:0/2859092921 >> 172.21.15.62:0/2859092921 conn(0x55f4575c4b90 msgr2=0x55f4575c6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.336+0000 7feb83fa2800 1 -- 172.21.15.62:0/2859092921 shutdown_connections 2024-04-26T07:56:21.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.336+0000 7feb83fa2800 1 -- 172.21.15.62:0/2859092921 wait complete. 2024-04-26T07:56:21.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.348+0000 7feb83fa2800 1 Processor -- start 2024-04-26T07:56:21.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.349+0000 7feb83fa2800 1 -- start start 2024-04-26T07:56:21.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.349+0000 7feb83fa2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4575caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.349+0000 7feb83fa2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f457515cc0 con 0x55f4575cb1a0 2024-04-26T07:56:21.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.349+0000 7feb81aa8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4575caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.349+0000 7feb81aa8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4575caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40706/0 (socket says 172.21.15.62:40706) 2024-04-26T07:56:21.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.349+0000 7feb81aa8640 1 -- 172.21.15.62:0/1077142543 learned_addr learned my addr 172.21.15.62:0/1077142543 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.350+0000 7feb81aa8640 1 -- 172.21.15.62:0/1077142543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4575c90a0 con 0x55f4575cb1a0 2024-04-26T07:56:21.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.350+0000 7feb81aa8640 1 --2- 172.21.15.62:0/1077142543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4575caae0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7feb74001e10 tx=0x7feb7400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b2f8a0a4f75f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.350+0000 7fea6fe07640 1 -- 172.21.15.62:0/1077142543 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7400e5c0 con 0x55f4575cb1a0 2024-04-26T07:56:21.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.350+0000 7fea6fe07640 1 -- 172.21.15.62:0/1077142543 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb74006070 con 0x55f4575cb1a0 2024-04-26T07:56:21.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.350+0000 7fea6fe07640 1 -- 172.21.15.62:0/1077142543 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7400e930 con 0x55f4575cb1a0 2024-04-26T07:56:21.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 -- 172.21.15.62:0/1077142543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 msgr2=0x55f4575caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1077142543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4575caae0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7feb74001e10 tx=0x7feb7400b6c0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 -- 172.21.15.62:0/1077142543 shutdown_connections 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1077142543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4575caae0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 -- 172.21.15.62:0/1077142543 >> 172.21.15.62:0/1077142543 conn(0x55f4575c4b90 msgr2=0x55f4576b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 -- 172.21.15.62:0/1077142543 shutdown_connections 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 -- 172.21.15.62:0/1077142543 wait complete. 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 Processor -- start 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 -- start start 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4576c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb83fa2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f4575d1ab0 con 0x55f4575cb1a0 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb81aa8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4576c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb81aa8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4576c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40714/0 (socket says 172.21.15.62:40714) 2024-04-26T07:56:21.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.351+0000 7feb81aa8640 1 -- 172.21.15.62:0/972905740 learned_addr learned my addr 172.21.15.62:0/972905740 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.352+0000 7feb81aa8640 1 -- 172.21.15.62:0/972905740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4576c5ec0 con 0x55f4575cb1a0 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.352+0000 7feb81aa8640 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4576c5980 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7feb7400b700 tx=0x7feb74000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.352+0000 7fea6e604640 1 -- 172.21.15.62:0/972905740 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7400f8d0 con 0x55f4575cb1a0 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.352+0000 7fea6e604640 1 -- 172.21.15.62:0/972905740 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7400fa70 con 0x55f4575cb1a0 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.352+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4576c6150 con 0x55f4575cb1a0 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.352+0000 7fea6e604640 1 -- 172.21.15.62:0/972905740 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7400fd50 con 0x55f4575cb1a0 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.352+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4576c8e00 con 0x55f4575cb1a0 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7feb83fa2800 1 Processor -- start 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7feb83fa2800 1 -- start start 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7feb83fa2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7feb83fa2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f4574bd170 con 0x55f4576d3230 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7fea6e604640 1 -- 172.21.15.62:0/972905740 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7feb74017070 con 0x55f4575cb1a0 2024-04-26T07:56:21.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7fea6e604640 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea68036e60 0x7fea68039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7feb822a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7feb822a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576d3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40724/0 (socket says 172.21.15.62:40724) 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7fea6e604640 1 -- 172.21.15.62:0/972905740 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7feb74015020 con 0x55f4575cb1a0 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7feb822a9640 1 -- 172.21.15.62:0/1726614206 learned_addr learned my addr 172.21.15.62:0/1726614206 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.353+0000 7feb81aa8640 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea68036e60 0x7fea68039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7feb822a9640 1 -- 172.21.15.62:0/1726614206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4576d3b90 con 0x55f4576d3230 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7feb81aa8640 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea68036e60 0x7fea68039320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feb7401c5c0 tx=0x7feb7401c4d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7feb822a9640 1 --2- 172.21.15.62:0/1726614206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576d3650 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00a430 tx=0x7feb7c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0ea1f3391ad9bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7fea67fff640 1 -- 172.21.15.62:0/1726614206 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7c015070 con 0x55f4576d3230 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7fea67fff640 1 -- 172.21.15.62:0/1726614206 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c001670 con 0x55f4576d3230 2024-04-26T07:56:21.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7fea67fff640 1 -- 172.21.15.62:0/1726614206 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7c001990 con 0x55f4576d3230 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7feb83fa2800 1 -- 172.21.15.62:0/1726614206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 msgr2=0x55f4576d3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1726614206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576d3650 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00a430 tx=0x7feb7c00a8f0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7feb83fa2800 1 -- 172.21.15.62:0/1726614206 shutdown_connections 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1726614206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576d3650 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.354+0000 7feb83fa2800 1 -- 172.21.15.62:0/1726614206 >> 172.21.15.62:0/1726614206 conn(0x55f4575cecb0 msgr2=0x55f4576cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb83fa2800 1 -- 172.21.15.62:0/1726614206 shutdown_connections 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb83fa2800 1 -- 172.21.15.62:0/1726614206 wait complete. 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb83fa2800 1 Processor -- start 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb83fa2800 1 -- start start 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb83fa2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576da690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb83fa2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f4576d4520 con 0x55f4576d3230 2024-04-26T07:56:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb822a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576da690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb822a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576da690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40730/0 (socket says 172.21.15.62:40730) 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.355+0000 7feb822a9640 1 -- 172.21.15.62:0/1163273809 learned_addr learned my addr 172.21.15.62:0/1163273809 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.356+0000 7feb822a9640 1 -- 172.21.15.62:0/1163273809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4576dabd0 con 0x55f4576d3230 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.356+0000 7feb822a9640 1 --2- 172.21.15.62:0/1163273809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576da690 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7feb7c013040 tx=0x7feb7c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.356+0000 7fea667fc640 1 -- 172.21.15.62:0/1163273809 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7c020020 con 0x55f4576d3230 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.356+0000 7fea667fc640 1 -- 172.21.15.62:0/1163273809 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c0108e0 con 0x55f4576d3230 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.356+0000 7fea667fc640 1 -- 172.21.15.62:0/1163273809 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7c015040 con 0x55f4576d3230 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.356+0000 7feb83fa2800 1 -- 172.21.15.62:0/1163273809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4576dae60 con 0x55f4576d3230 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.356+0000 7feb83fa2800 1 -- 172.21.15.62:0/1163273809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4576ddb10 con 0x55f4576d3230 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.357+0000 7fea667fc640 1 -- 172.21.15.62:0/1163273809 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7feb7c023020 con 0x55f4576d3230 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.357+0000 7fea667fc640 1 --2- 172.21.15.62:0/1163273809 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea5c036e60 0x7fea5c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.357+0000 7fea667fc640 1 -- 172.21.15.62:0/1163273809 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7feb7c04c840 con 0x55f4576d3230 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.357+0000 7feb83fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.357+0000 7feb83fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.357+0000 7feb812a7640 1 --2- 172.21.15.62:0/1163273809 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea5c036e60 0x7fea5c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.358+0000 7feb83fa2800 1 Processor -- start 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.358+0000 7feb83fa2800 1 -- start start 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.358+0000 7feb812a7640 1 --2- 172.21.15.62:0/1163273809 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea5c036e60 0x7fea5c039320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feb78054000 tx=0x7feb7804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.358+0000 7feb83fa2800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576f4d80 0x55f4576f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.358+0000 7feb83fa2800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f4575c9420 con 0x55f4576f4d80 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.358+0000 7feb81aa8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576f4d80 0x55f4576f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.358+0000 7feb81aa8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576f4d80 0x55f4576f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40734/0 (socket says 172.21.15.62:40734) 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.358+0000 7feb81aa8640 1 -- 172.21.15.62:0/1587587203 learned_addr learned my addr 172.21.15.62:0/1587587203 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.359+0000 7feb81aa8640 1 -- 172.21.15.62:0/1587587203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4576f56e0 con 0x55f4576f4d80 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.359+0000 7feb81aa8640 1 --2- 172.21.15.62:0/1587587203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576f4d80 0x55f4576f51a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7feb7400ffd0 tx=0x7feb7401af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.359+0000 7fea467e4640 1 -- 172.21.15.62:0/1587587203 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7401bc50 con 0x55f4576f4d80 2024-04-26T07:56:21.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.359+0000 7fea467e4640 1 -- 172.21.15.62:0/1587587203 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7401d5f0 con 0x55f4576f4d80 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.359+0000 7feb83fa2800 1 -- 172.21.15.62:0/1587587203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4576f6150 con 0x55f4576f4d80 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.359+0000 7fea467e4640 1 -- 172.21.15.62:0/1587587203 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7404b0c0 con 0x55f4576f4d80 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.359+0000 7feb83fa2800 1 -- 172.21.15.62:0/1587587203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4576f6650 con 0x55f4576f4d80 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.360+0000 7fea467e4640 1 -- 172.21.15.62:0/1587587203 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7feb7404b260 con 0x55f4576f4d80 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.360+0000 7fea467e4640 1 --2- 172.21.15.62:0/1587587203 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9c4036eb0 0x7fe9c4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.360+0000 7fea467e4640 1 -- 172.21.15.62:0/1587587203 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7feb74044030 con 0x55f4576f4d80 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.360+0000 7feb812a7640 1 --2- 172.21.15.62:0/1587587203 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9c4036eb0 0x7fe9c4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.360+0000 7fe9b7fff640 20 reqs_thread_entry: start 2024-04-26T07:56:21.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.360+0000 7feb812a7640 1 --2- 172.21.15.62:0/1587587203 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9c4036eb0 0x7fe9c4039370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feb78055040 tx=0x7feb78005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.360+0000 7feb83fa2800 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f457702780 0x55f457704b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.360+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f4577051d0 con 0x55f457702780 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.361+0000 7feb822a9640 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f457702780 0x55f457704b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.361+0000 7feb822a9640 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f457702780 0x55f457704b70 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.361+0000 7feb822a9640 1 -- 172.21.15.62:0/972905740 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb7c00e070 con 0x55f457702780 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.361+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f457705ab0 con 0x55f457702780 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.361+0000 7feb822a9640 1 -- 172.21.15.62:0/972905740 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb7c00e070 con 0x55f457702780 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.361+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f457706e60 con 0x55f457702780 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.362+0000 7feb822a9640 1 -- 172.21.15.62:0/972905740 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feb7c00e070 con 0x55f457702780 2024-04-26T07:56:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.362+0000 7feb83fa2800 1 -- 172.21.15.62:0/1163273809 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea5c036e60 msgr2=0x7fea5c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.362+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1163273809 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea5c036e60 0x7fea5c039320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feb78054000 tx=0x7feb7804e000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.362+0000 7feb83fa2800 1 -- 172.21.15.62:0/1163273809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 msgr2=0x55f4576da690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.362+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1163273809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576da690 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7feb7c013040 tx=0x7feb7c003370 comp rx=0 tx=0).stop 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.362+0000 7feb83fa2800 1 -- 172.21.15.62:0/1163273809 shutdown_connections 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1163273809 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea5c036e60 0x7fea5c039320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1163273809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576d3230 0x55f4576da690 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1163273809 >> 172.21.15.62:0/1163273809 conn(0x55f4575cecb0 msgr2=0x55f4576cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1163273809 shutdown_connections 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1163273809 wait complete. 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1587587203 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9c4036eb0 msgr2=0x7fe9c4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1587587203 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9c4036eb0 0x7fe9c4039370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feb78055040 tx=0x7feb78005ac0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1587587203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576f4d80 msgr2=0x55f4576f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1587587203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576f4d80 0x55f4576f51a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7feb7400ffd0 tx=0x7feb7401af00 comp rx=0 tx=0).stop 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1587587203 shutdown_connections 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1587587203 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe9c4036eb0 0x7fe9c4039370 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/1587587203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4576f4d80 0x55f4576f51a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1587587203 >> 172.21.15.62:0/1587587203 conn(0x55f4576e9820 msgr2=0x55f4576ea290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1587587203 shutdown_connections 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/1587587203 wait complete. 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f457702780 msgr2=0x55f457704b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f457702780 0x55f457704b70 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea68036e60 msgr2=0x7fea68039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea68036e60 0x7fea68039320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feb7401c5c0 tx=0x7feb7401c4d0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 msgr2=0x55f4576c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4576c5980 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7feb7400b700 tx=0x7feb74000bc0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 shutdown_connections 2024-04-26T07:56:21.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f457702780 0x55f457704b70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fea68036e60 0x7fea68039320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 --2- 172.21.15.62:0/972905740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f4575cb1a0 0x55f4576c5980 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.363+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 >> 172.21.15.62:0/972905740 conn(0x55f4575c4b90 msgr2=0x55f4575c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.364+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 shutdown_connections 2024-04-26T07:56:21.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.364+0000 7feb83fa2800 1 -- 172.21.15.62:0/972905740 wait complete. 2024-04-26T07:56:21.372 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"76158cff-5435-4eb7-bdd8-fb93108eac49","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"8d767a7c-31da-4ded-9764-3a9d16d1fab7","zones":[{"id":"8d767a7c-31da-4ded-9764-3a9d16d1fab7","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-26T07:56:21.372 DEBUG:tasks.util.rgw: json result: {'id': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '8d767a7c-31da-4ded-9764-3a9d16d1fab7', 'zones': [{'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-04-26T07:56:21.375 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-04-26T07:56:21.394 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-26T07:56:21.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-26T07:56:21.394 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-04-26T07:56:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5cfa10800 1 Processor -- start 2024-04-26T07:56:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5cfa10800 1 -- start start 2024-04-26T07:56:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5cfa10800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ef54b0a520 0x55ef54b0a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5cfa10800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef54b0afc0 con 0x55ef54b0b780 2024-04-26T07:56:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5cfa10800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55ef549ade20 con 0x55ef54b0a520 2024-04-26T07:56:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5cafbe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ef54b0a520 0x55ef54b0a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5ca7bd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55ef54b0b780 0x55ef54b0bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33172/0 (socket says 172.21.15.62:33172) 2024-04-26T07:56:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5cafbe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ef54b0a520 0x55ef54b0a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40736/0 (socket says 172.21.15.62:40736) 2024-04-26T07:56:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.471+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/866908837 learned_addr learned my addr 172.21.15.62:0/866908837 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.472+0000 7fb5cafbe640 1 -- 172.21.15.62:0/866908837 >> v1:172.21.15.1:6789/0 conn(0x55ef54b0b780 legacy=0x55ef54b0bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.472+0000 7fb5cafbe640 1 -- 172.21.15.62:0/866908837 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef54b0c340 con 0x55ef54b0a520 2024-04-26T07:56:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5cafbe640 1 --2- 172.21.15.62:0/866908837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54b0a940 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00a470 tx=0x7fb5bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca65d5369da1a45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5c9fbc640 1 -- 172.21.15.62:0/866908837 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc057070 con 0x55ef54b0a520 2024-04-26T07:56:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5c9fbc640 1 -- 172.21.15.62:0/866908837 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc04adc0 con 0x55ef54b0a520 2024-04-26T07:56:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5c9fbc640 1 -- 172.21.15.62:0/866908837 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc052590 con 0x55ef54b0a520 2024-04-26T07:56:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5cfa10800 1 -- 172.21.15.62:0/866908837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 msgr2=0x55ef54b0a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/866908837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54b0a940 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00a470 tx=0x7fb5bc01ce90 comp rx=0 tx=0).stop 2024-04-26T07:56:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5cfa10800 1 -- 172.21.15.62:0/866908837 shutdown_connections 2024-04-26T07:56:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/866908837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54b0a940 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5cfa10800 1 -- 172.21.15.62:0/866908837 >> 172.21.15.62:0/866908837 conn(0x55ef54b05b40 msgr2=0x55ef54b07f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5cfa10800 1 -- 172.21.15.62:0/866908837 shutdown_connections 2024-04-26T07:56:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.474+0000 7fb5cfa10800 1 -- 172.21.15.62:0/866908837 wait complete. 2024-04-26T07:56:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.487+0000 7fb5cfa10800 1 Processor -- start 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.487+0000 7fb5cfa10800 1 -- start start 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.487+0000 7fb5cfa10800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54bfcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.487+0000 7fb5cfa10800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef54a56c70 con 0x55ef54b0a520 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.487+0000 7fb5cafbe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54bfcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.487+0000 7fb5cafbe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54bfcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40740/0 (socket says 172.21.15.62:40740) 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.488+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1730591117 learned_addr learned my addr 172.21.15.62:0/1730591117 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.488+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1730591117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef54bfd4c0 con 0x55ef54b0a520 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.488+0000 7fb5cafbe640 1 --2- 172.21.15.62:0/1730591117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54bfcef0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc055040 tx=0x7fb5bc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb9abe7c6a429a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.488+0000 7fb4b8e09640 1 -- 172.21.15.62:0/1730591117 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc057040 con 0x55ef54b0a520 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.488+0000 7fb4b8e09640 1 -- 172.21.15.62:0/1730591117 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc063070 con 0x55ef54b0a520 2024-04-26T07:56:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.488+0000 7fb4b8e09640 1 -- 172.21.15.62:0/1730591117 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc05d790 con 0x55ef54b0a520 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1730591117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 msgr2=0x55ef54bfcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1730591117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54bfcef0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc055040 tx=0x7fb5bc04c000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1730591117 shutdown_connections 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1730591117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54bfcef0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1730591117 >> 172.21.15.62:0/1730591117 conn(0x55ef54b05b40 msgr2=0x55ef54bf8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1730591117 shutdown_connections 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1730591117 wait complete. 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 Processor -- start 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 -- start start 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54c04900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.489+0000 7fb5cfa10800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef54a7dd20 con 0x55ef54b0a520 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb5cafbe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54c04900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb5cafbe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54c04900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40748/0 (socket says 172.21.15.62:40748) 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb5cafbe640 1 -- 172.21.15.62:0/2227878574 learned_addr learned my addr 172.21.15.62:0/2227878574 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb5cafbe640 1 -- 172.21.15.62:0/2227878574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef54c04e40 con 0x55ef54b0a520 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb5cafbe640 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54c04900 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc060040 tx=0x7fb5bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb4b7606640 1 -- 172.21.15.62:0/2227878574 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc057050 con 0x55ef54b0a520 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb4b7606640 1 -- 172.21.15.62:0/2227878574 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc05de00 con 0x55ef54b0a520 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef54c050d0 con 0x55ef54b0a520 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb4b7606640 1 -- 172.21.15.62:0/2227878574 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc052590 con 0x55ef54b0a520 2024-04-26T07:56:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.490+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef54c07d80 con 0x55ef54b0a520 2024-04-26T07:56:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.491+0000 7fb4b7606640 1 -- 172.21.15.62:0/2227878574 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb5bc052730 con 0x55ef54b0a520 2024-04-26T07:56:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.491+0000 7fb4b7606640 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4b0036e60 0x7fb4b0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.491+0000 7fb4b7606640 1 -- 172.21.15.62:0/2227878574 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fb5bc08e450 con 0x55ef54b0a520 2024-04-26T07:56:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.491+0000 7fb5ca7bd640 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4b0036e60 0x7fb4b0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.492+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54b0b780 0x55ef54c0bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.492+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c0c110 con 0x55ef54b0b780 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.492+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54b0b780 0x55ef54c0bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.492+0000 7fb5ca7bd640 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4b0036e60 0x7fb4b0039320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0000f60 tx=0x7fb5c00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.492+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54b0b780 0x55ef54c0bb40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.492+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/2227878574 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5c400a4a0 con 0x55ef54b0b780 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.492+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c09110 con 0x55ef54b0b780 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.493+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/2227878574 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5c400a4a0 con 0x55ef54b0b780 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.493+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c0df30 con 0x55ef54b0b780 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.493+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/2227878574 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5c400a4a0 con 0x55ef54b0b780 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.493+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c0d270 con 0x55ef54b0b780 2024-04-26T07:56:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.493+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/2227878574 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5c400a4a0 con 0x55ef54b0b780 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.493+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c0d6c0 con 0x55ef54b0b780 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.493+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/2227878574 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb5c400a4a0 con 0x55ef54b0b780 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.494+0000 7fb5cfa10800 1 Processor -- start 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.494+0000 7fb5cfa10800 1 -- start start 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.494+0000 7fb5cfa10800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54c1cd50 0x55ef54c1d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.494+0000 7fb5cfa10800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef549fe170 con 0x55ef54c1cd50 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.494+0000 7fb5ca7bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54c1cd50 0x55ef54c1d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.494+0000 7fb5ca7bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54c1cd50 0x55ef54c1d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40750/0 (socket says 172.21.15.62:40750) 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.494+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/874074456 learned_addr learned my addr 172.21.15.62:0/874074456 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.495+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/874074456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef54c1d6d0 con 0x55ef54c1cd50 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.495+0000 7fb5ca7bd640 1 --2- 172.21.15.62:0/874074456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54c1cd50 0x55ef54c1d190 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0001ed0 tx=0x7fb5c000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.495+0000 7fb4b4e01640 1 -- 172.21.15.62:0/874074456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c001b550 con 0x55ef54c1cd50 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.495+0000 7fb4b4e01640 1 -- 172.21.15.62:0/874074456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c001b6f0 con 0x55ef54c1cd50 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.495+0000 7fb5cfa10800 1 -- 172.21.15.62:0/874074456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef54c1e060 con 0x55ef54c1cd50 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.495+0000 7fb4b4e01640 1 -- 172.21.15.62:0/874074456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c001b9d0 con 0x55ef54c1cd50 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.495+0000 7fb5cfa10800 1 -- 172.21.15.62:0/874074456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef54c1e500 con 0x55ef54c1cd50 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.496+0000 7fb4b4e01640 1 -- 172.21.15.62:0/874074456 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb5c0023020 con 0x55ef54c1cd50 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.496+0000 7fb4b4e01640 1 --2- 172.21.15.62:0/874074456 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4a4036e60 0x7fb4a4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.496+0000 7fb4b4e01640 1 -- 172.21.15.62:0/874074456 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fb5c0021020 con 0x55ef54c1cd50 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.496+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/874074456 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4a4036e60 0x7fb4a4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.496+0000 7fb5cfa10800 1 Processor -- start 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5cfa10800 1 -- start start 2024-04-26T07:56:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/874074456 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4a4036e60 0x7fb4a4039320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ef54c0cd90 tx=0x7fb5c4005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5cfa10800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54b15600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5cfa10800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef54bfd780 con 0x55ef54b151e0 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5ca7bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54b15600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5ca7bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54b15600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40760/0 (socket says 172.21.15.62:40760) 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/842404527 learned_addr learned my addr 172.21.15.62:0/842404527 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/842404527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef54b139e0 con 0x55ef54b151e0 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.497+0000 7fb5ca7bd640 1 --2- 172.21.15.62:0/842404527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54b15600 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb5c004d530 tx=0x7fb5c003def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa381e9f0beffce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb4ae7fc640 1 -- 172.21.15.62:0/842404527 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c001be20 con 0x55ef54b151e0 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb4ae7fc640 1 -- 172.21.15.62:0/842404527 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c000c360 con 0x55ef54b151e0 2024-04-26T07:56:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb4ae7fc640 1 -- 172.21.15.62:0/842404527 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0024e10 con 0x55ef54b151e0 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 -- 172.21.15.62:0/842404527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 msgr2=0x55ef54b15600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/842404527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54b15600 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb5c004d530 tx=0x7fb5c003def0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 -- 172.21.15.62:0/842404527 shutdown_connections 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/842404527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54b15600 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 -- 172.21.15.62:0/842404527 >> 172.21.15.62:0/842404527 conn(0x55ef54c263b0 msgr2=0x55ef54c24410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 -- 172.21.15.62:0/842404527 shutdown_connections 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 -- 172.21.15.62:0/842404527 wait complete. 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 Processor -- start 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.498+0000 7fb5cfa10800 1 -- start start 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb5cfa10800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54c33870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb5cfa10800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ef54b13eb0 con 0x55ef54b151e0 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb5ca7bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54c33870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb5ca7bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54c33870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40762/0 (socket says 172.21.15.62:40762) 2024-04-26T07:56:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 learned_addr learned my addr 172.21.15.62:0/1044399362 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef54c33db0 con 0x55ef54b151e0 2024-04-26T07:56:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb5ca7bd640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54c33870 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000dcc0 tx=0x7fb5c004d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb4acff9640 1 -- 172.21.15.62:0/1044399362 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0032020 con 0x55ef54b151e0 2024-04-26T07:56:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef54c33db0 con 0x55ef54b151e0 2024-04-26T07:56:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb4acff9640 1 -- 172.21.15.62:0/1044399362 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c001be20 con 0x55ef54b151e0 2024-04-26T07:56:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.499+0000 7fb4acff9640 1 -- 172.21.15.62:0/1044399362 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0025980 con 0x55ef54b151e0 2024-04-26T07:56:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.500+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef54c33db0 con 0x55ef54b151e0 2024-04-26T07:56:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.500+0000 7fb4acff9640 1 -- 172.21.15.62:0/1044399362 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb5c0035020 con 0x55ef54b151e0 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.500+0000 7fb4acff9640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb494036e60 0x7fb494039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.500+0000 7fb4acff9640 1 -- 172.21.15.62:0/1044399362 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fb5c0038d10 con 0x55ef54b151e0 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.500+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb494036e60 0x7fb494039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.501+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb494036e60 0x7fb494039320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55ef54c09060 tx=0x7fb5c401f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.501+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.501+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54c3efb0 0x55ef54c41470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.501+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c41bc0 con 0x55ef54c3efb0 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.501+0000 7fb5cafbe640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54c3efb0 0x55ef54c41470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.501+0000 7fb5cafbe640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54c3efb0 0x55ef54c41470 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 realm 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c41fd0 con 0x55ef54c3efb0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c428a0 con 0x55ef54c3efb0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c42c40 con 0x55ef54c3efb0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.502+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c43490 con 0x55ef54c3efb0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.503+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.503+0000 7fb5cfa10800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.503+0000 7fb5cfa10800 20 searching for the correct realm 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.503+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ef54c45200 0x55ef54c475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.503+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c47c20 con 0x55ef54c45200 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.503+0000 7fb5ca7bd640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ef54c45200 0x55ef54c475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.503+0000 7fb5ca7bd640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ef54c45200 0x55ef54c475f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5ca7bd640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb5c0037020 0x7fb5c001f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c47c20 con 0x7fb5c0037020 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb5c0037020 0x7fb5c001f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb5c0037020 0x7fb5c001f130 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c401f070 con 0x7fb5c0037020 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5cb7bf640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fb5c4031040 0x7fb5c4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c47c20 con 0x7fb5c4031040 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.504+0000 7fb5cafbe640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fb5c4031040 0x7fb5c4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.505+0000 7fb5cafbe640 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fb5c4031040 0x7fb5c4032940 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.505+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.505+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c47c20 con 0x55ef54c3efb0 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.506+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.506+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c47c20 con 0x55ef54c3efb0 2024-04-26T07:56:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.506+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.506+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c47c20 con 0x55ef54c3efb0 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.506+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.506+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c4031040 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.506+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.506+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c0037020 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.507+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c401f070 con 0x7fb5c0037020 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.507+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c45200 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.507+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.507+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c3efb0 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.507+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.507+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c4031040 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.508+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.508+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c3efb0 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.508+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.508+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c0037020 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.508+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb5c401f070 con 0x7fb5c0037020 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.508+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c45200 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.508+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.508+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c45200 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.509+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.509+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c4031040 2024-04-26T07:56:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.509+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.509+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c45200 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.509+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.509+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c45200 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.509+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.510+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c3efb0 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.510+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.510+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c3efb0 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.510+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.510+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c4031040 2024-04-26T07:56:21.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.510+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.510+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c45200 2024-04-26T07:56:21.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.511+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.511+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c0037020 2024-04-26T07:56:21.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.511+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c401f070 con 0x7fb5c0037020 2024-04-26T07:56:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.511+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c3efb0 2024-04-26T07:56:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.511+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.511+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c4031040 2024-04-26T07:56:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.512+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.512+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c45200 2024-04-26T07:56:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.512+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.512+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c4031040 2024-04-26T07:56:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.512+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.512+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c0037020 2024-04-26T07:56:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.512+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c401f070 con 0x7fb5c0037020 2024-04-26T07:56:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.512+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c45200 2024-04-26T07:56:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.513+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.513+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c4031040 2024-04-26T07:56:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.513+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.513+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x55ef54c3efb0 2024-04-26T07:56:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.513+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.513+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5bc087040 con 0x7fb5c0037020 2024-04-26T07:56:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c401f070 con 0x7fb5c0037020 2024-04-26T07:56:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c43ce0 con 0x55ef54c3efb0 2024-04-26T07:56:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c440d0 con 0x55ef54c3efb0 2024-04-26T07:56:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c440d0 con 0x55ef54c3efb0 2024-04-26T07:56:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 zone default found 2024-04-26T07:56:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 4 Realm: () 2024-04-26T07:56:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 zonegroup default 2024-04-26T07:56:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.514+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c480a0 con 0x7fb5c4031040 2024-04-26T07:56:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c49a80 con 0x55ef54c45200 2024-04-26T07:56:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c49e20 con 0x55ef54c45200 2024-04-26T07:56:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 20 started sync module instance, tier type = 2024-04-26T07:56:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.515+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c48f20 con 0x7fb5c0037020 2024-04-26T07:56:21.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.516+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c4040040 con 0x7fb5c0037020 2024-04-26T07:56:21.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.516+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94486407713600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4a670 con 0x7fb5c0037020 2024-04-26T07:56:21.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.516+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4aec0 con 0x55ef54c3efb0 2024-04-26T07:56:21.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.517+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94486407713600] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c4040040 con 0x7fb5c0037020 2024-04-26T07:56:21.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.518+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.518+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94486407717312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4aa90 con 0x55ef54c3efb0 2024-04-26T07:56:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.518+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4b530 con 0x55ef54c45200 2024-04-26T07:56:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.519+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94486407717312] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.520+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.520+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94486407718368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4aa00 con 0x55ef54c45200 2024-04-26T07:56:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.520+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4c3f0 con 0x7fb5c0037020 2024-04-26T07:56:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.521+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c4040040 con 0x7fb5c0037020 2024-04-26T07:56:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.521+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94486407725344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4cb90 con 0x7fb5c0037020 2024-04-26T07:56:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.521+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4d690 con 0x55ef54c3efb0 2024-04-26T07:56:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.521+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94486407718368] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.522+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94486407725344] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c4040040 con 0x7fb5c0037020 2024-04-26T07:56:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.522+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.522+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94486407729536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4d650 con 0x55ef54c3efb0 2024-04-26T07:56:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.522+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4df60 con 0x7fb5c4031040 2024-04-26T07:56:21.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.523+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94486407729536] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.523+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.523+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94486407723296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4d650 con 0x7fb5c4031040 2024-04-26T07:56:21.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.523+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4e530 con 0x7fb5c4031040 2024-04-26T07:56:21.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.524+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(56 notify.6 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.524+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94486407733376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4e950 con 0x7fb5c4031040 2024-04-26T07:56:21.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.525+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4f450 con 0x7fb5c4031040 2024-04-26T07:56:21.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.525+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94486407723296] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94486407733376] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94486407731808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4e950 con 0x7fb5c4031040 2024-04-26T07:56:21.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cfa10800 20 add_watcher() i=0 2024-04-26T07:56:21.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cfa10800 20 add_watcher() i=1 2024-04-26T07:56:21.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cfa10800 20 add_watcher() i=2 2024-04-26T07:56:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cfa10800 20 add_watcher() i=3 2024-04-26T07:56:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cfa10800 20 add_watcher() i=4 2024-04-26T07:56:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cfa10800 20 add_watcher() i=5 2024-04-26T07:56:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.526+0000 7fb5cfa10800 20 add_watcher() i=6 2024-04-26T07:56:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.527+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94486407731808] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.527+0000 7fb5cfa10800 20 add_watcher() i=7 2024-04-26T07:56:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.527+0000 7fb5cfa10800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.527+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c52440 con 0x55ef54c3efb0 2024-04-26T07:56:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.527+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.527+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94486407734896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4f8c0 con 0x55ef54c3efb0 2024-04-26T07:56:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.528+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94486407734896] v29'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.528+0000 7fb4817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb5cfa10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb5cfa10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb5cfa10800 5 note: GC not initialized 2024-04-26T07:56:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb3fbfff640 20 reqs_thread_entry: start 2024-04-26T07:56:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb5cfa10800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb5cfa10800 20 Filter name: none 2024-04-26T07:56:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb3f9ffb640 20 reqs_thread_entry: start 2024-04-26T07:56:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb5cfa10800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.529+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c85b60 con 0x7fb5c4031040 2024-04-26T07:56:21.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-04-26T07:56:21.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:21.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-04-26T07:56:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c841a0 con 0x55ef54c3efb0 2024-04-26T07:56:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-04-26T07:56:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T07:56:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-26T07:56:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-26T07:56:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.530+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c84ba0 con 0x7fb5c4031040 2024-04-26T07:56:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.531+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v29'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.531+0000 7fb5cfa10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.531+0000 7fb5cfa10800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.531+0000 7fb5cfa10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94486407957344 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c89600 con 0x55ef54c3efb0 2024-04-26T07:56:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== watch-notify(notify (1) cookie 94486407729536 notify 124554051607 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55ef54c85780 con 0x55ef54c3efb0 2024-04-26T07:56:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb4ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94486407729536 notifier 4822 bl.length()=649 2024-04-26T07:56:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb4ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb4ae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb4ae7fc640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fb490003ea0 con 0x55ef54c3efb0 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify cookie 94486407957344 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== watch-notify(notify_complete (2) cookie 94486407957344 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb5bc082040 con 0x55ef54c3efb0 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.532+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c84b60 con 0x55ef54c3efb0 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.533+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v29'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.533+0000 7fb5cfa10800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.533+0000 7fb5cfa10800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.533+0000 7fb5cfa10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.533+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94486407957344 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c89600 con 0x55ef54c45200 2024-04-26T07:56:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.534+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== watch-notify(notify (1) cookie 94486407718368 notify 124554051592 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fb5c0043030 con 0x55ef54c45200 2024-04-26T07:56:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.534+0000 7fb4adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94486407718368 notifier 4822 bl.length()=177 2024-04-26T07:56:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.534+0000 7fb4adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-26T07:56:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.534+0000 7fb4adffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T07:56:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.534+0000 7fb4adffb640 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fb400003400 con 0x55ef54c45200 2024-04-26T07:56:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.534+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(68 notify.2 [notify cookie 94486407957344 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.534+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.534+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== watch-notify(notify_complete (2) cookie 94486407957344 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef54b139e0 con 0x55ef54c45200 2024-04-26T07:56:21.560 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.535+0000 7fb4817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.535+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94486407734896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c88050 con 0x55ef54c3efb0 2024-04-26T07:56:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.536+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94486407734896] v29'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.536+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94486407713600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4e640 con 0x7fb5c0037020 2024-04-26T07:56:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.537+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94486407713600] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c4040040 con 0x7fb5c0037020 2024-04-26T07:56:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.537+0000 7fb5cfa10800 20 remove_watcher() i=0 2024-04-26T07:56:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.537+0000 7fb5cfa10800 2 removed watcher, disabling cache 2024-04-26T07:56:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.537+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94486407717312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c49340 con 0x55ef54c3efb0 2024-04-26T07:56:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.538+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94486407717312] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.538+0000 7fb5cfa10800 20 remove_watcher() i=1 2024-04-26T07:56:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.538+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94486407718368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c49340 con 0x55ef54c45200 2024-04-26T07:56:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.539+0000 7fb5ca7bd640 1 -- 172.21.15.62:0/1044399362 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94486407718368] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c0009050 con 0x55ef54c45200 2024-04-26T07:56:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.539+0000 7fb5cfa10800 20 remove_watcher() i=2 2024-04-26T07:56:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.539+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94486407725344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c49340 con 0x7fb5c0037020 2024-04-26T07:56:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.540+0000 7fb5cb7bf640 1 -- 172.21.15.62:0/1044399362 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94486407725344] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c4040040 con 0x7fb5c0037020 2024-04-26T07:56:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.540+0000 7fb5cfa10800 20 remove_watcher() i=3 2024-04-26T07:56:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.540+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94486407729536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c49340 con 0x55ef54c3efb0 2024-04-26T07:56:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.541+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94486407729536] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55ef54c3efb0 2024-04-26T07:56:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.541+0000 7fb5cfa10800 20 remove_watcher() i=4 2024-04-26T07:56:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.541+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94486407723296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4d180 con 0x7fb5c4031040 2024-04-26T07:56:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.543+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94486407723296] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.543+0000 7fb5cfa10800 20 remove_watcher() i=5 2024-04-26T07:56:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.543+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94486407733376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c49340 con 0x7fb5c4031040 2024-04-26T07:56:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.544+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94486407733376] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.544+0000 7fb5cfa10800 20 remove_watcher() i=6 2024-04-26T07:56:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.544+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94486407731808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ef54c4d180 con 0x7fb5c4031040 2024-04-26T07:56:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94486407731808] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4031040 2024-04-26T07:56:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 20 remove_watcher() i=7 2024-04-26T07:56:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fb5c4031040 msgr2=0x7fb5c4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fb5c4031040 0x7fb5c4032940 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54c3efb0 msgr2=0x55ef54c41470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54c3efb0 0x55ef54c41470 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb5c0037020 msgr2=0x7fb5c001f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fb5c0037020 0x7fb5c001f130 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ef54c45200 msgr2=0x55ef54c475f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ef54c45200 0x55ef54c475f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb494036e60 msgr2=0x7fb494039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb494036e60 0x7fb494039320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55ef54c09060 tx=0x7fb5c401f000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 msgr2=0x55ef54c33870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/1044399362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b151e0 0x55ef54c33870 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000dcc0 tx=0x7fb5c004d4c0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cafbe640 1 -- 172.21.15.62:0/1044399362 reap_dead start 2024-04-26T07:56:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 shutdown_connections 2024-04-26T07:56:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 >> 172.21.15.62:0/1044399362 conn(0x55ef54c263b0 msgr2=0x55ef54c23a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 shutdown_connections 2024-04-26T07:56:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/1044399362 wait complete. 2024-04-26T07:56:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/874074456 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4a4036e60 msgr2=0x7fb4a4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/874074456 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4a4036e60 0x7fb4a4039320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ef54c0cd90 tx=0x7fb5c4005840 comp rx=0 tx=0).stop 2024-04-26T07:56:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/874074456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54c1cd50 msgr2=0x55ef54c1d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/874074456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54c1cd50 0x55ef54c1d190 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0001ed0 tx=0x7fb5c000d7a0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 -- 172.21.15.62:0/874074456 shutdown_connections 2024-04-26T07:56:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/874074456 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4a4036e60 0x7fb4a4039320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.545+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/874074456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54c1cd50 0x55ef54c1d190 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/874074456 >> 172.21.15.62:0/874074456 conn(0x55ef54c10da0 msgr2=0x55ef54c111a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/874074456 shutdown_connections 2024-04-26T07:56:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/874074456 wait complete. 2024-04-26T07:56:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54b0b780 msgr2=0x55ef54c0bb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54b0b780 0x55ef54c0bb40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4b0036e60 msgr2=0x7fb4b0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4b0036e60 0x7fb4b0039320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0000f60 tx=0x7fb5c00012b0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 msgr2=0x55ef54c04900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54c04900 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc060040 tx=0x7fb5bc002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 shutdown_connections 2024-04-26T07:56:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ef54b0b780 0x55ef54c0bb40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fb4b0036e60 0x7fb4b0039320 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 --2- 172.21.15.62:0/2227878574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ef54b0a520 0x55ef54c04900 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 >> 172.21.15.62:0/2227878574 conn(0x55ef54b05b40 msgr2=0x55ef54bf7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 shutdown_connections 2024-04-26T07:56:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.546+0000 7fb5cfa10800 1 -- 172.21.15.62:0/2227878574 wait complete. 2024-04-26T07:56:21.576 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:21.577 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:21.577 ERROR:root:0 2024-04-26T07:56:21.579 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:21.586 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000007edd208bd394d6d7-00662b5e25-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:56:21.587 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-04-26T07:56:21.599 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:21.600 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-04-26T07:56:21.613 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-04-26T07:56:21.614 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-04-26T07:56:21.631 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-26T07:56:21.632 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-26T07:56:21.641 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-04-26T07:56:21.641 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:21.645 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:21.646 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-04-26T07:56:21.651 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:21.652 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T07:56:21.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T07:56:21.652 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-04-26T07:56:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:21.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7faddb60e800 1 Processor -- start 2024-04-26T07:56:21.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7faddb60e800 1 -- start start 2024-04-26T07:56:21.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7faddb60e800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x556ec4bac740 0x556ec4bacb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7faddb60e800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ec4bad1e0 con 0x556ec4bad8b0 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7faddb60e800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x556ec4a4ee20 con 0x556ec4bac740 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7fadd910d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x556ec4bac740 0x556ec4bacb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7fadd910d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x556ec4bac740 0x556ec4bacb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40772/0 (socket says 172.21.15.62:40772) 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7fadd910d640 1 -- 172.21.15.62:0/3152068962 learned_addr learned my addr 172.21.15.62:0/3152068962 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7fadd890c640 1 --1- 172.21.15.62:0/3152068962 >> v1:172.21.15.1:6789/0 conn(0x556ec4bad8b0 0x556ec4badd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33180/0 (socket says 172.21.15.62:33180) 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7fadd910d640 1 -- 172.21.15.62:0/3152068962 >> v1:172.21.15.1:6789/0 conn(0x556ec4bad8b0 legacy=0x556ec4badd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.702+0000 7fadd910d640 1 -- 172.21.15.62:0/3152068962 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec4bae470 con 0x556ec4bac740 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.704+0000 7fadd910d640 1 --2- 172.21.15.62:0/3152068962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4bacb60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fadd4005fd0 tx=0x7fadd401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31572c2d5ecec390 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7fadd3fff640 1 -- 172.21.15.62:0/3152068962 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd4052540 con 0x556ec4bac740 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7fadd3fff640 1 -- 172.21.15.62:0/3152068962 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd404e070 con 0x556ec4bac740 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7fadd3fff640 1 -- 172.21.15.62:0/3152068962 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd4052890 con 0x556ec4bac740 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7faddb60e800 1 -- 172.21.15.62:0/3152068962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 msgr2=0x556ec4bacb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7faddb60e800 1 --2- 172.21.15.62:0/3152068962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4bacb60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fadd4005fd0 tx=0x7fadd401cd80 comp rx=0 tx=0).stop 2024-04-26T07:56:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7faddb60e800 1 -- 172.21.15.62:0/3152068962 shutdown_connections 2024-04-26T07:56:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7faddb60e800 1 --2- 172.21.15.62:0/3152068962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4bacb60 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7faddb60e800 1 -- 172.21.15.62:0/3152068962 >> 172.21.15.62:0/3152068962 conn(0x556ec4ba7d60 msgr2=0x556ec4baa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7faddb60e800 1 -- 172.21.15.62:0/3152068962 shutdown_connections 2024-04-26T07:56:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.705+0000 7faddb60e800 1 -- 172.21.15.62:0/3152068962 wait complete. 2024-04-26T07:56:21.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.718+0000 7faddb60e800 1 Processor -- start 2024-04-26T07:56:21.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.718+0000 7faddb60e800 1 -- start start 2024-04-26T07:56:21.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.718+0000 7faddb60e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4c9dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.718+0000 7faddb60e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556ec4af7d00 con 0x556ec4bac740 2024-04-26T07:56:21.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.718+0000 7fadd910d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4c9dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.718+0000 7fadd910d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4c9dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40776/0 (socket says 172.21.15.62:40776) 2024-04-26T07:56:21.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.718+0000 7fadd910d640 1 -- 172.21.15.62:0/743368606 learned_addr learned my addr 172.21.15.62:0/743368606 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.719+0000 7fadd910d640 1 -- 172.21.15.62:0/743368606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec4c9e370 con 0x556ec4bac740 2024-04-26T07:56:21.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.719+0000 7fadd910d640 1 --2- 172.21.15.62:0/743368606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4c9dda0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fadd400a190 tx=0x7fadd404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319ed3689e184be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.719+0000 7facc7606640 1 -- 172.21.15.62:0/743368606 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd4052410 con 0x556ec4bac740 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.719+0000 7facc7606640 1 -- 172.21.15.62:0/743368606 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd4062070 con 0x556ec4bac740 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.719+0000 7facc7606640 1 -- 172.21.15.62:0/743368606 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd4052700 con 0x556ec4bac740 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 -- 172.21.15.62:0/743368606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 msgr2=0x556ec4c9dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 --2- 172.21.15.62:0/743368606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4c9dda0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fadd400a190 tx=0x7fadd404c000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 -- 172.21.15.62:0/743368606 shutdown_connections 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 --2- 172.21.15.62:0/743368606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4c9dda0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 -- 172.21.15.62:0/743368606 >> 172.21.15.62:0/743368606 conn(0x556ec4ba7d60 msgr2=0x556ec4c996c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 -- 172.21.15.62:0/743368606 shutdown_connections 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 -- 172.21.15.62:0/743368606 wait complete. 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 Processor -- start 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 -- start start 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4ca5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.720+0000 7faddb60e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556ec4bb5d80 con 0x556ec4bac740 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7fadd910d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4ca5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7fadd910d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4ca5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40778/0 (socket says 172.21.15.62:40778) 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7fadd910d640 1 -- 172.21.15.62:0/3248435763 learned_addr learned my addr 172.21.15.62:0/3248435763 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7fadd910d640 1 -- 172.21.15.62:0/3248435763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec4ca5d60 con 0x556ec4bac740 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7fadd910d640 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4ca5820 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fadd405f040 tx=0x7fadd4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7facc5e03640 1 -- 172.21.15.62:0/3248435763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd405d630 con 0x556ec4bac740 2024-04-26T07:56:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7facc5e03640 1 -- 172.21.15.62:0/3248435763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd4058040 con 0x556ec4bac740 2024-04-26T07:56:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ec4ca5ff0 con 0x556ec4bac740 2024-04-26T07:56:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.721+0000 7facc5e03640 1 -- 172.21.15.62:0/3248435763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd405d900 con 0x556ec4bac740 2024-04-26T07:56:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.722+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec4ca8c50 con 0x556ec4bac740 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.722+0000 7facc5e03640 1 -- 172.21.15.62:0/3248435763 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fadd4050070 con 0x556ec4bac740 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.722+0000 7facc5e03640 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc0036e60 0x7facc0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7facc5e03640 1 -- 172.21.15.62:0/3248435763 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fadd408edb0 con 0x556ec4bac740 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7fadd890c640 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc0036e60 0x7facc0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7faddb60e800 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4bad8b0 0x556ec4caca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cacf90 con 0x556ec4bad8b0 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7fadd990e640 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4bad8b0 0x556ec4caca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7fadd890c640 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc0036e60 0x7facc0039320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fadc4000f60 tx=0x7fadc4001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7fadd990e640 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4bad8b0 0x556ec4caca10 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7fadd990e640 1 -- 172.21.15.62:0/3248435763 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadcc0083e0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.723+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ca9fc0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.724+0000 7fadd990e640 1 -- 172.21.15.62:0/3248435763 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadcc0083e0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.724+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4caeda0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.724+0000 7fadd990e640 1 -- 172.21.15.62:0/3248435763 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fadcc0083e0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.724+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cae0e0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.724+0000 7fadd990e640 1 -- 172.21.15.62:0/3248435763 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadcc0083e0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.724+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cae4d0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.725+0000 7fadd990e640 1 -- 172.21.15.62:0/3248435763 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fadcc0083e0 con 0x556ec4bad8b0 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.725+0000 7faddb60e800 1 Processor -- start 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.725+0000 7faddb60e800 1 -- start start 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.725+0000 7faddb60e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4b22270 0x556ec4b206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.725+0000 7faddb60e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556ec4a9f170 con 0x556ec4b22270 2024-04-26T07:56:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.725+0000 7fadd890c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4b22270 0x556ec4b206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.725+0000 7fadd890c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4b22270 0x556ec4b206e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40790/0 (socket says 172.21.15.62:40790) 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.725+0000 7fadd890c640 1 -- 172.21.15.62:0/2507828500 learned_addr learned my addr 172.21.15.62:0/2507828500 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.726+0000 7fadd890c640 1 -- 172.21.15.62:0/2507828500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec4b20c20 con 0x556ec4b22270 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.726+0000 7fadd890c640 1 --2- 172.21.15.62:0/2507828500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4b22270 0x556ec4b206e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fadc4001ed0 tx=0x7fadc400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.726+0000 7facbeffd640 1 -- 172.21.15.62:0/2507828500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc4022070 con 0x556ec4b22270 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.726+0000 7facbeffd640 1 -- 172.21.15.62:0/2507828500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc400d520 con 0x556ec4b22270 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.726+0000 7faddb60e800 1 -- 172.21.15.62:0/2507828500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ec4b20e50 con 0x556ec4b22270 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.726+0000 7facbeffd640 1 -- 172.21.15.62:0/2507828500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc400d800 con 0x556ec4b22270 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.726+0000 7faddb60e800 1 -- 172.21.15.62:0/2507828500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec4b21350 con 0x556ec4b22270 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.727+0000 7facbeffd640 1 -- 172.21.15.62:0/2507828500 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fadc4025070 con 0x556ec4b22270 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.727+0000 7facbeffd640 1 --2- 172.21.15.62:0/2507828500 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facb0036ed0 0x7facb0039390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.727+0000 7facbeffd640 1 -- 172.21.15.62:0/2507828500 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fadc404e480 con 0x556ec4b22270 2024-04-26T07:56:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.727+0000 7fadd990e640 1 --2- 172.21.15.62:0/2507828500 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facb0036ed0 0x7facb0039390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.727+0000 7faddb60e800 1 Processor -- start 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.728+0000 7faddb60e800 1 -- start start 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.728+0000 7fadd990e640 1 --2- 172.21.15.62:0/2507828500 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facb0036ed0 0x7facb0039390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x556ec4cadc00 tx=0x7fadcc000f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.728+0000 7faddb60e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4ccd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.728+0000 7faddb60e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556ec4c9e630 con 0x556ec4ccd0e0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.728+0000 7fadd890c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4ccd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.728+0000 7fadd890c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4ccd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40794/0 (socket says 172.21.15.62:40794) 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.728+0000 7fadd890c640 1 -- 172.21.15.62:0/946456920 learned_addr learned my addr 172.21.15.62:0/946456920 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.728+0000 7fadd890c640 1 -- 172.21.15.62:0/946456920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec4ccdad0 con 0x556ec4ccd0e0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7fadd890c640 1 --2- 172.21.15.62:0/946456920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4ccd500 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fadc404c7f0 tx=0x7fadc4024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9598062a891becc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7facbcff9640 1 -- 172.21.15.62:0/946456920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc4026730 con 0x556ec4ccd0e0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7facbcff9640 1 -- 172.21.15.62:0/946456920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc4025c50 con 0x556ec4ccd0e0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7facbcff9640 1 -- 172.21.15.62:0/946456920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc40268d0 con 0x556ec4ccd0e0 2024-04-26T07:56:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7faddb60e800 1 -- 172.21.15.62:0/946456920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 msgr2=0x556ec4ccd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7faddb60e800 1 --2- 172.21.15.62:0/946456920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4ccd500 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fadc404c7f0 tx=0x7fadc4024740 comp rx=0 tx=0).stop 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7faddb60e800 1 -- 172.21.15.62:0/946456920 shutdown_connections 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7faddb60e800 1 --2- 172.21.15.62:0/946456920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4ccd500 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7faddb60e800 1 -- 172.21.15.62:0/946456920 >> 172.21.15.62:0/946456920 conn(0x556ec4cc9440 msgr2=0x556ec4cc74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7faddb60e800 1 -- 172.21.15.62:0/946456920 shutdown_connections 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.729+0000 7faddb60e800 1 -- 172.21.15.62:0/946456920 wait complete. 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7faddb60e800 1 Processor -- start 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7faddb60e800 1 -- start start 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7faddb60e800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4cd4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7faddb60e800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556ec4cce240 con 0x556ec4ccd0e0 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7fadd890c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4cd4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7fadd890c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4cd4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40802/0 (socket says 172.21.15.62:40802) 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 learned_addr learned my addr 172.21.15.62:0/299121128 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec4cd4cb0 con 0x556ec4ccd0e0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.730+0000 7fadd890c640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4cd4770 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fadc401e040 tx=0x7fadc404c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.731+0000 7facaeffd640 1 -- 172.21.15.62:0/299121128 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc402f030 con 0x556ec4ccd0e0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.731+0000 7facaeffd640 1 -- 172.21.15.62:0/299121128 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc404e070 con 0x556ec4ccd0e0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.731+0000 7facaeffd640 1 -- 172.21.15.62:0/299121128 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc4025570 con 0x556ec4ccd0e0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.731+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ec4cd4cb0 con 0x556ec4ccd0e0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.731+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec4cd4cb0 con 0x556ec4ccd0e0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7facaeffd640 1 -- 172.21.15.62:0/299121128 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fadc400d9a0 con 0x556ec4ccd0e0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7facaeffd640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faca4036e60 0x7faca4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7facaeffd640 1 -- 172.21.15.62:0/299121128 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fadc4030070 con 0x556ec4ccd0e0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7fadd990e640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faca4036e60 0x7faca4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4cdfee0 0x556ec4ce23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7fadd990e640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faca4036e60 0x7faca4039320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00f010 tx=0x7fadcc00c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce2af0 con 0x556ec4cdfee0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.732+0000 7fadd910d640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4cdfee0 0x556ec4ce23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7fadd910d640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4cdfee0 0x556ec4ce23a0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 20 realm 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce2f00 con 0x556ec4cdfee0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce37d0 con 0x556ec4cdfee0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.733+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce3b70 con 0x556ec4cdfee0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7faddb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce43c0 con 0x556ec4cdfee0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7faddb60e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7faddb60e800 20 searching for the correct realm 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556ec4ce6130 0x556ec4ce8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7fadd890c640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556ec4ce6130 0x556ec4ce8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.734+0000 7fadd890c640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556ec4ce6130 0x556ec4ce8520 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.735+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.735+0000 7fadd890c640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fadc401ac20 0x7fadc4027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.735+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadc401ac20 2024-04-26T07:56:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.735+0000 7fadd990e640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fadc401ac20 0x7fadc4027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.735+0000 7fadd990e640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fadc401ac20 0x7fadc4027440 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.736+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.736+0000 7fadd990e640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fadcc019040 0x7fadcc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.736+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadcc019040 2024-04-26T07:56:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.736+0000 7fadd910d640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fadcc019040 0x7fadcc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.736+0000 7fadd910d640 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fadcc019040 0x7fadcc019930 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.737+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.737+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.737+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.737+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.737+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.737+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.737+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.737+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadcc019040 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.738+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.738+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadc401ac20 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.738+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.738+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.738+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.738+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.738+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.738+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadcc019040 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.739+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.739+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.739+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.739+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadc401ac20 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.739+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.739+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.740+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.740+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.740+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.740+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadcc019040 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.740+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.740+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.740+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.740+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.741+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.741+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.741+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.741+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.741+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.741+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadcc019040 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.741+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.742+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.742+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.742+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadc401ac20 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.742+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.742+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.742+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.742+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadcc019040 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.743+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.743+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.743+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.743+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadcc019040 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.743+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.743+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadc401ac20 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.743+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.743+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4ce6130 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.744+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.744+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadcc019040 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.744+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.744+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x556ec4cdfee0 2024-04-26T07:56:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.744+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.744+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8b00 con 0x7fadc401ac20 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce4d40 con 0x556ec4cdfee0 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce55e0 con 0x556ec4cdfee0 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce55e0 con 0x556ec4cdfee0 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 zone default found 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 4 Realm: () 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 zonegroup default 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.745+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce8f80 con 0x7fadcc019040 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cea9b0 con 0x556ec4ce6130 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ceae80 con 0x556ec4ce6130 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 20 started sync module instance, tier type = 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.746+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce9e00 con 0x7fadc401ac20 2024-04-26T07:56:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.748+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.748+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93934236640000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce9e00 con 0x7fadc401ac20 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.748+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ceb940 con 0x556ec4cdfee0 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.749+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93934236640000] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.749+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.749+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93934236644432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce9e00 con 0x556ec4cdfee0 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.749+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cec3d0 con 0x556ec4ce6130 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.750+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.750+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93934236647072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cecc70 con 0x556ec4ce6130 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.750+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ced730 con 0x7fadc401ac20 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.750+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 93934236644432] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.751+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93934236647072] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.751+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.751+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93934236649408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ce9950 con 0x7fadc401ac20 2024-04-26T07:56:21.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.751+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cee010 con 0x556ec4cdfee0 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.752+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.753+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93934236654368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cedfa0 con 0x556ec4cdfee0 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.753+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ceefb0 con 0x7fadcc019040 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.753+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93934236649408] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.754+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.754+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93934236658304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ceef70 con 0x7fadcc019040 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.754+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cefa60 con 0x7fadcc019040 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.754+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 93934236654368] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.755+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93934236658304] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.755+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.755+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93934236652032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cefa60 con 0x7fadcc019040 2024-04-26T07:56:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.755+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cefeb0 con 0x7fadcc019040 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93934236652032] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93934236656640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cefe70 con 0x7fadcc019040 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7faddb60e800 20 add_watcher() i=0 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7faddb60e800 20 add_watcher() i=1 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7faddb60e800 20 add_watcher() i=2 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7faddb60e800 20 add_watcher() i=3 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7faddb60e800 20 add_watcher() i=4 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7faddb60e800 20 add_watcher() i=5 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.756+0000 7faddb60e800 20 add_watcher() i=6 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.757+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93934236656640] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.757+0000 7faddb60e800 20 add_watcher() i=7 2024-04-26T07:56:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.757+0000 7faddb60e800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.757+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cf32d0 con 0x556ec4cdfee0 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.758+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.758+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93934236661056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cf07f0 con 0x556ec4cdfee0 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93934236661056] v29'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadd4077020 con 0x556ec4cdfee0 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7fac8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7faddb60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7faddb60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7faddb60e800 5 note: GC not initialized 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7fac8efe5640 20 reqs_thread_entry: start 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7faddb60e800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7faddb60e800 20 Filter name: none 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7fac8cfe1640 20 reqs_thread_entry: start 2024-04-26T07:56:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7faddb60e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7faddb60e800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.759+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4d26ab0 con 0x7fadcc019040 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.760+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fadd4077020 con 0x7fadcc019040 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.760+0000 7faddb60e800 20 rados_obj.operate() r=0 bl.length=473 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.760+0000 7faddb60e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.760+0000 7faddb60e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.760+0000 7faddb60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.760+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4d2d3d0 con 0x7fadcc019040 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.761+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fadd40b3040 con 0x7fadcc019040 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.761+0000 7faddb60e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.761+0000 7faddb60e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.761+0000 7faddb60e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.761+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93934236913216 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ec4d28ac0 con 0x556ec4cdfee0 2024-04-26T07:56:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.762+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 93934236654368 notify 124554051609 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fadd409e040 con 0x556ec4cdfee0 2024-04-26T07:56:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.762+0000 7facbcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 93934236654368 notifier 4829 bl.length()=636 2024-04-26T07:56:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.762+0000 7facbcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.762+0000 7facbcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.762+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 93934236913216 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fadd40b3040 con 0x556ec4cdfee0 2024-04-26T07:56:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.762+0000 7facbcff9640 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fac9c003ea0 con 0x556ec4cdfee0 2024-04-26T07:56:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.762+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd40b3040 con 0x556ec4cdfee0 2024-04-26T07:56:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.762+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 93934236913216 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ec4ca8c50 con 0x556ec4cdfee0 2024-04-26T07:56:21.768 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.763+0000 7fac8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.763+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93934236661056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4d28ed0 con 0x556ec4cdfee0 2024-04-26T07:56:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.764+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93934236661056] v29'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadd40b3040 con 0x556ec4cdfee0 2024-04-26T07:56:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.764+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93934236640000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cef540 con 0x7fadc401ac20 2024-04-26T07:56:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.765+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93934236640000] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.765+0000 7faddb60e800 20 remove_watcher() i=0 2024-04-26T07:56:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.765+0000 7faddb60e800 2 removed watcher, disabling cache 2024-04-26T07:56:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.765+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93934236644432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cea300 con 0x556ec4cdfee0 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.766+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93934236644432] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd40b3040 con 0x556ec4cdfee0 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.766+0000 7faddb60e800 20 remove_watcher() i=1 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.766+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93934236647072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cea300 con 0x556ec4ce6130 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.767+0000 7fadd890c640 1 -- 172.21.15.62:0/299121128 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93934236647072] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadc4058040 con 0x556ec4ce6130 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.767+0000 7faddb60e800 20 remove_watcher() i=2 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.767+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93934236649408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cebea0 con 0x7fadc401ac20 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.768+0000 7fadd990e640 1 -- 172.21.15.62:0/299121128 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93934236649408] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc02f040 con 0x7fadc401ac20 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.768+0000 7faddb60e800 20 remove_watcher() i=3 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.768+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93934236654368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cebea0 con 0x556ec4cdfee0 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.769+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93934236654368] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd40b3040 con 0x556ec4cdfee0 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.769+0000 7faddb60e800 20 remove_watcher() i=4 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.769+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93934236658304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cedb20 con 0x7fadcc019040 2024-04-26T07:56:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.770+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93934236658304] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd40b3040 con 0x7fadcc019040 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.771+0000 7faddb60e800 20 remove_watcher() i=5 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.771+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93934236652032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4cebea0 con 0x7fadcc019040 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.772+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93934236652032] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd40b3040 con 0x7fadcc019040 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.772+0000 7faddb60e800 20 remove_watcher() i=6 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.772+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93934236656640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ec4ceea80 con 0x7fadcc019040 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93934236656640] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd40b3040 con 0x7fadcc019040 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 20 remove_watcher() i=7 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fadcc019040 msgr2=0x7fadcc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fadcc019040 0x7fadcc019930 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4cdfee0 msgr2=0x556ec4ce23a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4cdfee0 0x556ec4ce23a0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fadc401ac20 msgr2=0x7fadc4027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fadc401ac20 0x7fadc4027440 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556ec4ce6130 msgr2=0x556ec4ce8520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x556ec4ce6130 0x556ec4ce8520 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faca4036e60 msgr2=0x7faca4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7faca4036e60 0x7faca4039320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00f010 tx=0x7fadcc00c040 comp rx=0 tx=0).stop 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 msgr2=0x556ec4cd4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7fadd910d640 1 -- 172.21.15.62:0/299121128 reap_dead start 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4cd4770 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fadc401e040 tx=0x7fadc404c750 comp rx=0 tx=0).stop 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 shutdown_connections 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/299121128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4ccd0e0 0x556ec4cd4770 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 >> 172.21.15.62:0/299121128 conn(0x556ec4cc9440 msgr2=0x556ec4cc6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 shutdown_connections 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/299121128 wait complete. 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/2507828500 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facb0036ed0 msgr2=0x7facb0039390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/2507828500 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facb0036ed0 0x7facb0039390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x556ec4cadc00 tx=0x7fadcc000f90 comp rx=0 tx=0).stop 2024-04-26T07:56:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 -- 172.21.15.62:0/2507828500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4b22270 msgr2=0x556ec4b206e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.773+0000 7faddb60e800 1 --2- 172.21.15.62:0/2507828500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4b22270 0x556ec4b206e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fadc4001ed0 tx=0x7fadc400ea00 comp rx=0 tx=0).stop 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/2507828500 shutdown_connections 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 --2- 172.21.15.62:0/2507828500 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facb0036ed0 0x7facb0039390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 --2- 172.21.15.62:0/2507828500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4b22270 0x556ec4b206e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/2507828500 >> 172.21.15.62:0/2507828500 conn(0x556ec4cb1c50 msgr2=0x556ec4cb2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/2507828500 shutdown_connections 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/2507828500 wait complete. 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4bad8b0 msgr2=0x556ec4caca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4bad8b0 0x556ec4caca10 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc0036e60 msgr2=0x7facc0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc0036e60 0x7facc0039320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fadc4000f60 tx=0x7fadc4001370 comp rx=0 tx=0).stop 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 msgr2=0x556ec4ca5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4ca5820 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fadd405f040 tx=0x7fadd4003330 comp rx=0 tx=0).stop 2024-04-26T07:56:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 shutdown_connections 2024-04-26T07:56:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x556ec4bad8b0 0x556ec4caca10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7facc0036e60 0x7facc0039320 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 --2- 172.21.15.62:0/3248435763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556ec4bac740 0x556ec4ca5820 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 >> 172.21.15.62:0/3248435763 conn(0x556ec4ba7d60 msgr2=0x556ec4c97ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 shutdown_connections 2024-04-26T07:56:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.774+0000 7faddb60e800 1 -- 172.21.15.62:0/3248435763 wait complete. 2024-04-26T07:56:21.780 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:21.780 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:21.780 ERROR:root:0 2024-04-26T07:56:21.780 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-26T07:56:21.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-26T07:56:21.780 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-04-26T07:56:21.834 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:21.834 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:21.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.837+0000 7f10dff26800 1 Processor -- start 2024-04-26T07:56:21.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10dff26800 1 -- start start 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10dff26800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fabed51b30 0x55fabed53f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10dff26800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fabed544f0 con 0x55fabed4b910 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10dff26800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55fabebefe20 con 0x55fabed51b30 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10db427640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fabed51b30 0x55fabed53f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10db427640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55fabed51b30 0x55fabed53f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40806/0 (socket says 172.21.15.62:40806) 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10db427640 1 -- 172.21.15.62:0/3123914176 learned_addr learned my addr 172.21.15.62:0/3123914176 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10dbc28640 1 --1- 172.21.15.62:0/3123914176 >> v1:172.21.15.1:6789/0 conn(0x55fabed4b910 0x55fabed4bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33186/0 (socket says 172.21.15.62:33186) 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10db427640 1 -- 172.21.15.62:0/3123914176 >> v1:172.21.15.1:6789/0 conn(0x55fabed4b910 legacy=0x55fabed4bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10db427640 1 -- 172.21.15.62:0/3123914176 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabed556d0 con 0x55fabed51b30 2024-04-26T07:56:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.838+0000 7f10dac26640 1 -- 172.21.15.62:0/3123914176 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543492577 0 0) 0x55fabed544f0 con 0x55fabed4b910 2024-04-26T07:56:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.840+0000 7f10db427640 1 --2- 172.21.15.62:0/3123914176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed51b30 0x55fabed53f20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f10d000a520 tx=0x7f10d001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34415da88e0dbea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.840+0000 7f10dac26640 1 -- 172.21.15.62:0/3123914176 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d0057070 con 0x55fabed51b30 2024-04-26T07:56:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dac26640 1 -- 172.21.15.62:0/3123914176 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d0052570 con 0x55fabed51b30 2024-04-26T07:56:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dac26640 1 -- 172.21.15.62:0/3123914176 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d004ae60 con 0x55fabed51b30 2024-04-26T07:56:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dff26800 1 -- 172.21.15.62:0/3123914176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed51b30 msgr2=0x55fabed53f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dff26800 1 --2- 172.21.15.62:0/3123914176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed51b30 0x55fabed53f20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f10d000a520 tx=0x7f10d001d010 comp rx=0 tx=0).stop 2024-04-26T07:56:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dff26800 1 -- 172.21.15.62:0/3123914176 shutdown_connections 2024-04-26T07:56:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dff26800 1 --2- 172.21.15.62:0/3123914176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed51b30 0x55fabed53f20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dff26800 1 -- 172.21.15.62:0/3123914176 >> 172.21.15.62:0/3123914176 conn(0x55fabed472c0 msgr2=0x55fabed496e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dff26800 1 -- 172.21.15.62:0/3123914176 shutdown_connections 2024-04-26T07:56:21.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.841+0000 7f10dff26800 1 -- 172.21.15.62:0/3123914176 wait complete. 2024-04-26T07:56:21.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.854+0000 7f10dff26800 1 Processor -- start 2024-04-26T07:56:21.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.854+0000 7f10dff26800 1 -- start start 2024-04-26T07:56:21.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.854+0000 7f10dff26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee3eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.854+0000 7f10dff26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fabec98c70 con 0x55fabed4b910 2024-04-26T07:56:21.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.854+0000 7f10dbc28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee3eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.854+0000 7f10dbc28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee3eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40814/0 (socket says 172.21.15.62:40814) 2024-04-26T07:56:21.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.854+0000 7f10dbc28640 1 -- 172.21.15.62:0/2150686976 learned_addr learned my addr 172.21.15.62:0/2150686976 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.855+0000 7f10dbc28640 1 -- 172.21.15.62:0/2150686976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabee3f080 con 0x55fabed4b910 2024-04-26T07:56:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.855+0000 7f10dbc28640 1 --2- 172.21.15.62:0/2150686976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee3eab0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b210 tx=0x7f10cc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a349de3a00149f73 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.855+0000 7f0fc9e0b640 1 -- 172.21.15.62:0/2150686976 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10cc008070 con 0x55fabed4b910 2024-04-26T07:56:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.855+0000 7f0fc9e0b640 1 -- 172.21.15.62:0/2150686976 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10cc00d500 con 0x55fabed4b910 2024-04-26T07:56:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.855+0000 7f0fc9e0b640 1 -- 172.21.15.62:0/2150686976 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10cc00d840 con 0x55fabed4b910 2024-04-26T07:56:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 -- 172.21.15.62:0/2150686976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 msgr2=0x55fabee3eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 --2- 172.21.15.62:0/2150686976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee3eab0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b210 tx=0x7f10cc00b6d0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 -- 172.21.15.62:0/2150686976 shutdown_connections 2024-04-26T07:56:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 --2- 172.21.15.62:0/2150686976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee3eab0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 -- 172.21.15.62:0/2150686976 >> 172.21.15.62:0/2150686976 conn(0x55fabed472c0 msgr2=0x55fabee3a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 -- 172.21.15.62:0/2150686976 shutdown_connections 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 -- 172.21.15.62:0/2150686976 wait complete. 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 Processor -- start 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 -- start start 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee46620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.856+0000 7f10dff26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fabed54990 con 0x55fabed4b910 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f10dbc28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee46620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f10dbc28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee46620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40818/0 (socket says 172.21.15.62:40818) 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f10dbc28640 1 -- 172.21.15.62:0/2377397249 learned_addr learned my addr 172.21.15.62:0/2377397249 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f10dbc28640 1 -- 172.21.15.62:0/2377397249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabee46b60 con 0x55fabed4b910 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f10dbc28640 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee46620 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f10cc001e60 tx=0x7f10cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f0fc3fff640 1 -- 172.21.15.62:0/2377397249 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10cc019870 con 0x55fabed4b910 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f0fc3fff640 1 -- 172.21.15.62:0/2377397249 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10cc019a10 con 0x55fabed4b910 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fabee46df0 con 0x55fabed4b910 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.857+0000 7f0fc3fff640 1 -- 172.21.15.62:0/2377397249 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10cc019cf0 con 0x55fabed4b910 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.858+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fabee49aa0 con 0x55fabed4b910 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.858+0000 7f0fc3fff640 1 -- 172.21.15.62:0/2377397249 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f10cc017040 con 0x55fabed4b910 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.858+0000 7f0fc3fff640 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fc4036e60 0x7f0fc4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.858+0000 7f0fc3fff640 1 -- 172.21.15.62:0/2377397249 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f10cc015020 con 0x55fabed4b910 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.859+0000 7f10db427640 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fc4036e60 0x7f0fc4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.859+0000 7f10dff26800 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabed51b30 0x55fabee4d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.859+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee4dde0 con 0x55fabed51b30 2024-04-26T07:56:21.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.859+0000 7f10dc429640 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabed51b30 0x55fabee4d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.859+0000 7f10db427640 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fc4036e60 0x7f0fc4039320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f10d0054000 tx=0x7f10d004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.859+0000 7f10dc429640 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabed51b30 0x55fabee4d860 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.859+0000 7f10dc429640 1 -- 172.21.15.62:0/2377397249 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10d400a4a0 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.859+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee4ae30 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.860+0000 7f10dc429640 1 -- 172.21.15.62:0/2377397249 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10d400a4a0 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.860+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee4fc20 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.860+0000 7f10dc429640 1 -- 172.21.15.62:0/2377397249 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f10d400a4a0 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.860+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee4ef60 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.860+0000 7f10dc429640 1 -- 172.21.15.62:0/2377397249 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10d400a4a0 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.860+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee4f3b0 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.861+0000 7f10dc429640 1 -- 172.21.15.62:0/2377397249 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f10d400a4a0 con 0x55fabed51b30 2024-04-26T07:56:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.861+0000 7f10dff26800 1 Processor -- start 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.861+0000 7f10dff26800 1 -- start start 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.861+0000 7f10dff26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabee5e9f0 0x55fabee5ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.861+0000 7f10dff26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fabec40170 con 0x55fabee5e9f0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.861+0000 7f10db427640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabee5e9f0 0x55fabee5ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.861+0000 7f10db427640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabee5e9f0 0x55fabee5ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40832/0 (socket says 172.21.15.62:40832) 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.861+0000 7f10db427640 1 -- 172.21.15.62:0/57967844 learned_addr learned my addr 172.21.15.62:0/57967844 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.862+0000 7f10db427640 1 -- 172.21.15.62:0/57967844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabee5f350 con 0x55fabee5e9f0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.862+0000 7f10db427640 1 --2- 172.21.15.62:0/57967844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabee5e9f0 0x55fabee5ee10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.862+0000 7f0fc17fa640 1 -- 172.21.15.62:0/57967844 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d0057040 con 0x55fabee5e9f0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.862+0000 7f0fc17fa640 1 -- 172.21.15.62:0/57967844 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d005d650 con 0x55fabee5e9f0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.862+0000 7f10dff26800 1 -- 172.21.15.62:0/57967844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fabee5fdc0 con 0x55fabee5e9f0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.862+0000 7f0fc17fa640 1 -- 172.21.15.62:0/57967844 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d005d930 con 0x55fabee5e9f0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.862+0000 7f10dff26800 1 -- 172.21.15.62:0/57967844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fabee60260 con 0x55fabee5e9f0 2024-04-26T07:56:21.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.863+0000 7f0fc17fa640 1 -- 172.21.15.62:0/57967844 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f10d0067070 con 0x55fabee5e9f0 2024-04-26T07:56:21.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.863+0000 7f0fc17fa640 1 --2- 172.21.15.62:0/57967844 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fb4036eb0 0x7f0fb4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.863+0000 7f0fc17fa640 1 -- 172.21.15.62:0/57967844 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f10d008fed0 con 0x55fabee5e9f0 2024-04-26T07:56:21.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.863+0000 7f10dc429640 1 --2- 172.21.15.62:0/57967844 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fb4036eb0 0x7f0fb4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.863+0000 7f10dff26800 1 Processor -- start 2024-04-26T07:56:21.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10dff26800 1 -- start start 2024-04-26T07:56:21.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10dc429640 1 --2- 172.21.15.62:0/57967844 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fb4036eb0 0x7f0fb4039370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55fabee4ea80 tx=0x7f10d4005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10dff26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabed4e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10dff26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fabee3f400 con 0x55fabed4def0 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10db427640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabed4e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10db427640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabed4e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40848/0 (socket says 172.21.15.62:40848) 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10db427640 1 -- 172.21.15.62:0/1475248483 learned_addr learned my addr 172.21.15.62:0/1475248483 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10db427640 1 -- 172.21.15.62:0/1475248483 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabed4c6f0 con 0x55fabed4def0 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.864+0000 7f10db427640 1 --2- 172.21.15.62:0/1475248483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabed4e310 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f10d008e190 tx=0x7f10d0067d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ff32a432b198ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f0fbaffd640 1 -- 172.21.15.62:0/1475248483 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d0071400 con 0x55fabed4def0 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f0fbaffd640 1 -- 172.21.15.62:0/1475248483 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d0067360 con 0x55fabed4def0 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f0fbaffd640 1 -- 172.21.15.62:0/1475248483 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d00715a0 con 0x55fabed4def0 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 -- 172.21.15.62:0/1475248483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 msgr2=0x55fabed4e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 --2- 172.21.15.62:0/1475248483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabed4e310 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f10d008e190 tx=0x7f10d0067d20 comp rx=0 tx=0).stop 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 -- 172.21.15.62:0/1475248483 shutdown_connections 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 --2- 172.21.15.62:0/1475248483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabed4e310 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 -- 172.21.15.62:0/1475248483 >> 172.21.15.62:0/1475248483 conn(0x55fabee67f90 msgr2=0x55fabee65ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 -- 172.21.15.62:0/1475248483 shutdown_connections 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 -- 172.21.15.62:0/1475248483 wait complete. 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 Processor -- start 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.865+0000 7f10dff26800 1 -- start start 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.866+0000 7f10dff26800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabee75430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.866+0000 7f10dff26800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fabed4cbc0 con 0x55fabed4def0 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.866+0000 7f10db427640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabee75430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.866+0000 7f10db427640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabee75430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40862/0 (socket says 172.21.15.62:40862) 2024-04-26T07:56:21.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.866+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 learned_addr learned my addr 172.21.15.62:0/2846837827 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.866+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabee75970 con 0x55fabed4def0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.866+0000 7f10db427640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabee75430 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f10d0007000 tx=0x7f10d008e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.866+0000 7f0fb97fa640 1 -- 172.21.15.62:0/2846837827 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d00065b0 con 0x55fabed4def0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.867+0000 7f0fb97fa640 1 -- 172.21.15.62:0/2846837827 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d0006750 con 0x55fabed4def0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.867+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fabee75c00 con 0x55fabed4def0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.867+0000 7f0fb97fa640 1 -- 172.21.15.62:0/2846837827 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d0006a70 con 0x55fabed4def0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.867+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fabee788b0 con 0x55fabed4def0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.867+0000 7f0fb97fa640 1 -- 172.21.15.62:0/2846837827 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f10d0070360 con 0x55fabed4def0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.867+0000 7f0fb97fa640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fa4036eb0 0x7f0fa4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.868+0000 7f0fb97fa640 1 -- 172.21.15.62:0/2846837827 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f10d0097d50 con 0x55fabed4def0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.868+0000 7f10dc429640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fa4036eb0 0x7f0fa4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.868+0000 7f10dc429640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fa4036eb0 0x7f0fa4039370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55fabee47440 tx=0x7f10d401f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.868+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.868+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabee80f80 0x55fabee83440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.868+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee83b90 con 0x55fabee80f80 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.868+0000 7f10dbc28640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabee80f80 0x55fabee83440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.868+0000 7f10dbc28640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabee80f80 0x55fabee83440 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 realm 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee83fa0 con 0x55fabee80f80 2024-04-26T07:56:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee84870 con 0x55fabee80f80 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee84c10 con 0x55fabee80f80 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.869+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee85460 con 0x55fabee80f80 2024-04-26T07:56:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.870+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.870+0000 7f10dff26800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.870+0000 7f10dff26800 20 searching for the correct realm 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.870+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fabee871d0 0x55fabee895c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.870+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.870+0000 7f10db427640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fabee871d0 0x55fabee895c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.870+0000 7f10db427640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fabee871d0 0x55fabee895c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10db427640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f10d007ac10 0x7f10d009f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d007ac10 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10dc429640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f10d007ac10 0x7f10d009f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10dc429640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f10d007ac10 0x7f10d009f8a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d401f070 con 0x7f10d007ac10 2024-04-26T07:56:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10dc429640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f10d4031040 0x7f10d4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d4031040 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.871+0000 7f10dbc28640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f10d4031040 0x7f10d4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.872+0000 7f10dbc28640 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f10d4031040 0x7f10d4032940 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.872+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.872+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.872+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.872+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.873+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.873+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.873+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.873+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d4031040 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.873+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.873+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d007ac10 2024-04-26T07:56:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.873+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d401f070 con 0x7f10d007ac10 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.873+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.874+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.874+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.874+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.874+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d4031040 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.874+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.874+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.874+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.874+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d007ac10 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.875+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f10d401f070 con 0x7f10d007ac10 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.875+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.875+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.875+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.875+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.875+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d4031040 2024-04-26T07:56:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.875+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.876+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d4031040 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.877+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.877+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.877+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.877+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d007ac10 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.877+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d401f070 con 0x7f10d007ac10 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.877+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.878+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.878+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d4031040 2024-04-26T07:56:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.878+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.878+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.878+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.878+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d4031040 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.878+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.878+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d007ac10 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.879+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d401f070 con 0x7f10d007ac10 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.879+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee871d0 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.879+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.879+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d4031040 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.879+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.879+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x55fabee80f80 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.879+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.879+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fabee89ba0 con 0x7f10d007ac10 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10d401f070 con 0x7f10d007ac10 2024-04-26T07:56:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee85db0 con 0x55fabee80f80 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee86650 con 0x55fabee80f80 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.880+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8a020 con 0x55fabee80f80 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 zone default found 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 4 Realm: () 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 zonegroup default 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee862b0 con 0x7f10d4031040 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8bf50 con 0x55fabee871d0 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8c2f0 con 0x55fabee871d0 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 started sync module instance, tier type = 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.881+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8b3f0 con 0x7f10d007ac10 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.883+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d4040040 con 0x7f10d007ac10 2024-04-26T07:56:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.883+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94535433107424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8b050 con 0x7f10d007ac10 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.883+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8d250 con 0x55fabee80f80 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.884+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94535433107424] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d4040040 con 0x7f10d007ac10 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.884+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.884+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94535433111424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8d250 con 0x55fabee80f80 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.884+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8dc90 con 0x55fabee871d0 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.885+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94535433111424] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.885+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.885+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94535433112992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8d1c0 con 0x55fabee871d0 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.885+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8eb50 con 0x7f10d007ac10 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.886+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94535433112992] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.886+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d4040040 con 0x7f10d007ac10 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.886+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94535433119392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8ef70 con 0x7f10d007ac10 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.886+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8f930 con 0x55fabee80f80 2024-04-26T07:56:21.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.887+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.887+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94535433122944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8fd50 con 0x55fabee80f80 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.887+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee90870 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.888+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94535433119392] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d4040040 con 0x7f10d007ac10 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.888+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.889+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94535433126720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee90830 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.889+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee912a0 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.889+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94535433122944] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.890+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94535433126720] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.890+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.890+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94535433120448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8f8a0 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.890+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee91750 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94535433120448] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94535433129424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee91750 con 0x7f10d4031040 2024-04-26T07:56:21.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dff26800 20 add_watcher() i=0 2024-04-26T07:56:21.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dff26800 20 add_watcher() i=1 2024-04-26T07:56:21.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dff26800 20 add_watcher() i=2 2024-04-26T07:56:21.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dff26800 20 add_watcher() i=3 2024-04-26T07:56:21.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dff26800 20 add_watcher() i=4 2024-04-26T07:56:21.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dff26800 20 add_watcher() i=5 2024-04-26T07:56:21.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.891+0000 7f10dff26800 20 add_watcher() i=6 2024-04-26T07:56:21.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.892+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94535433129424] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.892+0000 7f10dff26800 20 add_watcher() i=7 2024-04-26T07:56:21.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.892+0000 7f10dff26800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:21.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.892+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabee94a60 con 0x55fabee80f80 2024-04-26T07:56:21.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.892+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.892+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94535433131024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee91ce0 con 0x55fabee80f80 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.893+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94535433131024] v29'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.893+0000 7f0f91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.893+0000 7f10dff26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.893+0000 7f10dff26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.893+0000 7f10dff26800 5 note: GC not initialized 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f0f90fe1640 20 reqs_thread_entry: start 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 20 Filter name: none 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f0f0a7fc640 20 reqs_thread_entry: start 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabeec8290 con 0x7f10d4031040 2024-04-26T07:56:21.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 20 rados->read ofs=0 len=0 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.894+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabeec68d0 con 0x55fabee871d0 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.895+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.895+0000 7f10dff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.895+0000 7f10dff26800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.895+0000 7f10dff26800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.895+0000 7f10dff26800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.895+0000 7f10dff26800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.895+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabeec7360 con 0x7f10d4031040 2024-04-26T07:56:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v29'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f10dff26800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f10dff26800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f10dff26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94535433350480 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabeecbee0 con 0x7f10d007ac10 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== watch-notify(notify (1) cookie 94535433107424 notify 124554051617 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f10d4024680 con 0x7f10d007ac10 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f0fbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051617 cookie 94535433107424 notifier 4836 bl.length()=533 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f0fbaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f0fbaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(65 notify.0 [notify cookie 94535433350480 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f10d4040040 con 0x7f10d007ac10 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.896+0000 7f0fbaffd640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0fa0003ea0 con 0x7f10d007ac10 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.897+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d4040040 con 0x7f10d007ac10 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.897+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== watch-notify(notify_complete (2) cookie 94535433350480 notify 124554051617 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f10d4024920 con 0x7f10d007ac10 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.897+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabeec6d50 con 0x55fabee871d0 2024-04-26T07:56:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v29'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f10dff26800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f10dff26800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f10dff26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94535433369872 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fabeecc7c0 con 0x55fabee80f80 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94535433111424 notify 124554051610 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55fabee49aa0 con 0x55fabee80f80 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f0fba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94535433111424 notifier 4836 bl.length()=176 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f0fba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f0fba7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f0fba7fc640 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0f10003400 con 0x55fabee80f80 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.898+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(68 notify.1 [notify cookie 94535433369872 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.899+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== watch-notify(notify_complete (2) cookie 94535433369872 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fabeec7f30 con 0x55fabee80f80 2024-04-26T07:56:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.899+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.908 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-04-26T07:56:21.896252Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.896238Z","tags":[],"group_ids":[]} 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.900+0000 7f0f91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.900+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94535433131024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee94090 con 0x55fabee80f80 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.901+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94535433131024] v29'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.901+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94535433107424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee91410 con 0x7f10d007ac10 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.902+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94535433107424] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d4040040 con 0x7f10d007ac10 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.902+0000 7f10dff26800 20 remove_watcher() i=0 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.902+0000 7f10dff26800 2 removed watcher, disabling cache 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.902+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94535433111424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee91410 con 0x55fabee80f80 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.903+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94535433111424] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.903+0000 7f10dff26800 20 remove_watcher() i=1 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.903+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94535433112992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8c780 con 0x55fabee871d0 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.904+0000 7f10db427640 1 -- 172.21.15.62:0/2846837827 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94535433112992] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d009c020 con 0x55fabee871d0 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.904+0000 7f10dff26800 20 remove_watcher() i=2 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.904+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94535433119392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee91410 con 0x7f10d007ac10 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.905+0000 7f10dc429640 1 -- 172.21.15.62:0/2846837827 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94535433119392] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10d4040040 con 0x7f10d007ac10 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.905+0000 7f10dff26800 20 remove_watcher() i=3 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.905+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94535433122944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8cda0 con 0x55fabee80f80 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.906+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94535433122944] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x55fabee80f80 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.906+0000 7f10dff26800 20 remove_watcher() i=4 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.906+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94535433126720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8e6a0 con 0x7f10d4031040 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.907+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94535433126720] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.907+0000 7f10dff26800 20 remove_watcher() i=5 2024-04-26T07:56:21.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.907+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94535433120448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee91410 con 0x7f10d4031040 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.908+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94535433120448] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.908+0000 7f10dff26800 20 remove_watcher() i=6 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.908+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94535433129424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fabee8f480 con 0x7f10d4031040 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.909+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94535433129424] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10cc02d070 con 0x7f10d4031040 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 20 remove_watcher() i=7 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f10d4031040 msgr2=0x7f10d4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f10d4031040 0x7f10d4032940 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabee80f80 msgr2=0x55fabee83440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabee80f80 0x55fabee83440 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f10d007ac10 msgr2=0x7f10d009f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f10d007ac10 0x7f10d009f8a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fabee871d0 msgr2=0x55fabee895c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55fabee871d0 0x55fabee895c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fa4036eb0 msgr2=0x7f0fa4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fa4036eb0 0x7f0fa4039370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55fabee47440 tx=0x7f10d401f000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 msgr2=0x55fabee75430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dbc28640 1 -- 172.21.15.62:0/2846837827 reap_dead start 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabee75430 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f10d0007000 tx=0x7f10d008e120 comp rx=0 tx=0).stop 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 shutdown_connections 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/2846837827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4def0 0x55fabee75430 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 >> 172.21.15.62:0/2846837827 conn(0x55fabee67f90 msgr2=0x55fabee655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 shutdown_connections 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/2846837827 wait complete. 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/57967844 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fb4036eb0 msgr2=0x7f0fb4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/57967844 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fb4036eb0 0x7f0fb4039370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55fabee4ea80 tx=0x7f10d4005840 comp rx=0 tx=0).stop 2024-04-26T07:56:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/57967844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabee5e9f0 msgr2=0x55fabee5ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/57967844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabee5e9f0 0x55fabee5ee10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d0002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/57967844 shutdown_connections 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/57967844 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fb4036eb0 0x7f0fb4039370 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 --2- 172.21.15.62:0/57967844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabee5e9f0 0x55fabee5ee10 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/57967844 >> 172.21.15.62:0/57967844 conn(0x55fabee52a90 msgr2=0x55fabee52e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/57967844 shutdown_connections 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.910+0000 7f10dff26800 1 -- 172.21.15.62:0/57967844 wait complete. 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabed51b30 msgr2=0x55fabee4d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabed51b30 0x55fabee4d860 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fc4036e60 msgr2=0x7f0fc4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fc4036e60 0x7f0fc4039320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f10d0054000 tx=0x7f10d004e000 comp rx=0 tx=0).stop 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 msgr2=0x55fabee46620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee46620 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f10cc001e60 tx=0x7f10cc000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 shutdown_connections 2024-04-26T07:56:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55fabed51b30 0x55fabee4d860 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0fc4036e60 0x7f0fc4039320 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 --2- 172.21.15.62:0/2377397249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fabed4b910 0x55fabee46620 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 >> 172.21.15.62:0/2377397249 conn(0x55fabed472c0 msgr2=0x55fabee38c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 shutdown_connections 2024-04-26T07:56:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.911+0000 7f10dff26800 1 -- 172.21.15.62:0/2377397249 wait complete. 2024-04-26T07:56:21.919 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-26T07:56:21.896252Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.896238Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:21.919 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-26T07:56:21.896252Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.896238Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:21.919 ERROR:root:0 2024-04-26T07:56:21.920 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:21.924 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:21.925 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-04-26T07:56:21.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-04-26T07:56:21.925 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-04-26T07:56:21.969 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:21.969 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:21.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf76f46800 1 Processor -- start 2024-04-26T07:56:21.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf76f46800 1 -- start start 2024-04-26T07:56:21.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf76f46800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56361d2b2e30 0x56361d3475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf76f46800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56361d2b32e0 con 0x56361d2b4170 2024-04-26T07:56:21.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf76f46800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x56361d1e0e20 con 0x56361d2b2e30 2024-04-26T07:56:21.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf74244640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56361d2b2e30 0x56361d3475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf74a45640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x56361d2b4170 0x56361d2b2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33194/0 (socket says 172.21.15.62:33194) 2024-04-26T07:56:21.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf74244640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x56361d2b2e30 0x56361d3475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40866/0 (socket says 172.21.15.62:40866) 2024-04-26T07:56:21.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf74a45640 1 -- 172.21.15.62:0/807940322 learned_addr learned my addr 172.21.15.62:0/807940322 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:21.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf74244640 1 -- 172.21.15.62:0/807940322 >> v1:172.21.15.1:6789/0 conn(0x56361d2b4170 legacy=0x56361d2b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.973+0000 7fbf74244640 1 -- 172.21.15.62:0/807940322 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361d2b34e0 con 0x56361d2b2e30 2024-04-26T07:56:21.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.975+0000 7fbf74244640 1 --2- 172.21.15.62:0/807940322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d3475c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00a470 tx=0x7fbf5c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5abe1ca186374f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf73a43640 1 -- 172.21.15.62:0/807940322 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5c057070 con 0x56361d2b2e30 2024-04-26T07:56:21.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf73a43640 1 -- 172.21.15.62:0/807940322 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5c052570 con 0x56361d2b2e30 2024-04-26T07:56:21.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf73a43640 1 -- 172.21.15.62:0/807940322 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5c052870 con 0x56361d2b2e30 2024-04-26T07:56:21.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf76f46800 1 -- 172.21.15.62:0/807940322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 msgr2=0x56361d3475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf76f46800 1 --2- 172.21.15.62:0/807940322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d3475c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00a470 tx=0x7fbf5c01ce90 comp rx=0 tx=0).stop 2024-04-26T07:56:21.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf76f46800 1 -- 172.21.15.62:0/807940322 shutdown_connections 2024-04-26T07:56:21.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf76f46800 1 --2- 172.21.15.62:0/807940322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d3475c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf76f46800 1 -- 172.21.15.62:0/807940322 >> 172.21.15.62:0/807940322 conn(0x56361d339d20 msgr2=0x56361d33c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf76f46800 1 -- 172.21.15.62:0/807940322 shutdown_connections 2024-04-26T07:56:21.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.976+0000 7fbf76f46800 1 -- 172.21.15.62:0/807940322 wait complete. 2024-04-26T07:56:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.989+0000 7fbf76f46800 1 Processor -- start 2024-04-26T07:56:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.989+0000 7fbf76f46800 1 -- start start 2024-04-26T07:56:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.989+0000 7fbf76f46800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d431e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.989+0000 7fbf76f46800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56361d289cd0 con 0x56361d2b2e30 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.989+0000 7fbf74a45640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d431e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.989+0000 7fbf74a45640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d431e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40876/0 (socket says 172.21.15.62:40876) 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.989+0000 7fbf74a45640 1 -- 172.21.15.62:0/3309577850 learned_addr learned my addr 172.21.15.62:0/3309577850 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.990+0000 7fbf74a45640 1 -- 172.21.15.62:0/3309577850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361d432430 con 0x56361d2b2e30 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.990+0000 7fbf74a45640 1 --2- 172.21.15.62:0/3309577850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d431e60 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbf64001640 tx=0x7fbf64001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a01d0d6d2667a9b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.990+0000 7fbe62e0d640 1 -- 172.21.15.62:0/3309577850 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf64004520 con 0x56361d2b2e30 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.990+0000 7fbe62e0d640 1 -- 172.21.15.62:0/3309577850 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf640046c0 con 0x56361d2b2e30 2024-04-26T07:56:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.990+0000 7fbe62e0d640 1 -- 172.21.15.62:0/3309577850 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf64004a40 con 0x56361d2b2e30 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 -- 172.21.15.62:0/3309577850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 msgr2=0x56361d431e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3309577850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d431e60 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbf64001640 tx=0x7fbf64001b00 comp rx=0 tx=0).stop 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 -- 172.21.15.62:0/3309577850 shutdown_connections 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3309577850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d431e60 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 -- 172.21.15.62:0/3309577850 >> 172.21.15.62:0/3309577850 conn(0x56361d339d20 msgr2=0x56361d42d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 -- 172.21.15.62:0/3309577850 shutdown_connections 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 -- 172.21.15.62:0/3309577850 wait complete. 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 Processor -- start 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 -- start start 2024-04-26T07:56:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d4399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.991+0000 7fbf76f46800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56361d347e00 con 0x56361d2b2e30 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbf74a45640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d4399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbf74a45640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d4399d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40892/0 (socket says 172.21.15.62:40892) 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbf74a45640 1 -- 172.21.15.62:0/3032202647 learned_addr learned my addr 172.21.15.62:0/3032202647 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbf74a45640 1 -- 172.21.15.62:0/3032202647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361d439f10 con 0x56361d2b2e30 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbf74a45640 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d4399d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbf64001640 tx=0x7fbf64001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbe6160a640 1 -- 172.21.15.62:0/3032202647 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf64022020 con 0x56361d2b2e30 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbe6160a640 1 -- 172.21.15.62:0/3032202647 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf64014870 con 0x56361d2b2e30 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56361d43a1a0 con 0x56361d2b2e30 2024-04-26T07:56:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbe6160a640 1 -- 172.21.15.62:0/3032202647 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf64014b70 con 0x56361d2b2e30 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.992+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361d43ce50 con 0x56361d2b2e30 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.993+0000 7fbe6160a640 1 -- 172.21.15.62:0/3032202647 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbf64025020 con 0x56361d2b2e30 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.993+0000 7fbe6160a640 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe5c036e60 0x7fbe5c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.993+0000 7fbe6160a640 1 -- 172.21.15.62:0/3032202647 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fbf64018030 con 0x56361d2b2e30 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.993+0000 7fbf74244640 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe5c036e60 0x7fbe5c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.993+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d2b4170 0x56361d440c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.993+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d4411a0 con 0x56361d2b4170 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.994+0000 7fbf75246640 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d2b4170 0x56361d440c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.994+0000 7fbf74244640 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe5c036e60 0x7fbe5c039320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c054000 tx=0x7fbf5c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.994+0000 7fbf75246640 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d2b4170 0x56361d440c10 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.994+0000 7fbf75246640 1 -- 172.21.15.62:0/3032202647 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6c0083e0 con 0x56361d2b4170 2024-04-26T07:56:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.994+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d43e1a0 con 0x56361d2b4170 2024-04-26T07:56:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.994+0000 7fbf75246640 1 -- 172.21.15.62:0/3032202647 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf6c0083e0 con 0x56361d2b4170 2024-04-26T07:56:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.994+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d442fc0 con 0x56361d2b4170 2024-04-26T07:56:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.995+0000 7fbf75246640 1 -- 172.21.15.62:0/3032202647 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf6c0083e0 con 0x56361d2b4170 2024-04-26T07:56:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.995+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d442240 con 0x56361d2b4170 2024-04-26T07:56:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.995+0000 7fbf75246640 1 -- 172.21.15.62:0/3032202647 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf6c0083e0 con 0x56361d2b4170 2024-04-26T07:56:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.995+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d442630 con 0x56361d2b4170 2024-04-26T07:56:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.995+0000 7fbf75246640 1 -- 172.21.15.62:0/3032202647 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf6c0083e0 con 0x56361d2b4170 2024-04-26T07:56:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.996+0000 7fbf76f46800 1 Processor -- start 2024-04-26T07:56:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.996+0000 7fbf76f46800 1 -- start start 2024-04-26T07:56:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.996+0000 7fbf76f46800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d451df0 0x56361d452230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.996+0000 7fbf76f46800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56361d231170 con 0x56361d451df0 2024-04-26T07:56:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.996+0000 7fbf74244640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d451df0 0x56361d452230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.996+0000 7fbf74244640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d451df0 0x56361d452230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40900/0 (socket says 172.21.15.62:40900) 2024-04-26T07:56:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.996+0000 7fbf74244640 1 -- 172.21.15.62:0/3153779661 learned_addr learned my addr 172.21.15.62:0/3153779661 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.996+0000 7fbf74244640 1 -- 172.21.15.62:0/3153779661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361d452770 con 0x56361d451df0 2024-04-26T07:56:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.997+0000 7fbf74244640 1 --2- 172.21.15.62:0/3153779661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d451df0 0x56361d452230 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c000c00 tx=0x7fbf5c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.997+0000 7fbe5a7fc640 1 -- 172.21.15.62:0/3153779661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5c057040 con 0x56361d451df0 2024-04-26T07:56:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.997+0000 7fbe5a7fc640 1 -- 172.21.15.62:0/3153779661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5c06d070 con 0x56361d451df0 2024-04-26T07:56:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.997+0000 7fbe5a7fc640 1 -- 172.21.15.62:0/3153779661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5c05dc70 con 0x56361d451df0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.997+0000 7fbf76f46800 1 -- 172.21.15.62:0/3153779661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56361d453100 con 0x56361d451df0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.997+0000 7fbf76f46800 1 -- 172.21.15.62:0/3153779661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361d4535a0 con 0x56361d451df0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbe5a7fc640 1 -- 172.21.15.62:0/3153779661 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbf5c067070 con 0x56361d451df0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbe5a7fc640 1 --2- 172.21.15.62:0/3153779661 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe4c036e60 0x7fbe4c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbe5a7fc640 1 -- 172.21.15.62:0/3153779661 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fbf5c090190 con 0x56361d451df0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbf75246640 1 --2- 172.21.15.62:0/3153779661 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe4c036e60 0x7fbe4c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbf76f46800 1 Processor -- start 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbf76f46800 1 -- start start 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbf75246640 1 --2- 172.21.15.62:0/3153779661 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe4c036e60 0x7fbe4c039320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x56361d441d60 tx=0x7fbf6c000f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbf76f46800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d45f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.998+0000 7fbf76f46800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56361d4327b0 con 0x56361d45efd0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.999+0000 7fbf74244640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d45f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.999+0000 7fbf74244640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d45f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40914/0 (socket says 172.21.15.62:40914) 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.999+0000 7fbf74244640 1 -- 172.21.15.62:0/651918391 learned_addr learned my addr 172.21.15.62:0/651918391 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.999+0000 7fbf74244640 1 -- 172.21.15.62:0/651918391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361d45f9c0 con 0x56361d45efd0 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.999+0000 7fbf74244640 1 --2- 172.21.15.62:0/651918391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d45f3f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c08e480 tx=0x7fbf5c067e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c205860ce9347c9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.999+0000 7fbe4bfff640 1 -- 172.21.15.62:0/651918391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5c07f020 con 0x56361d45efd0 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.999+0000 7fbe4bfff640 1 -- 172.21.15.62:0/651918391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5c05c5a0 con 0x56361d45efd0 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:21.999+0000 7fbe4bfff640 1 -- 172.21.15.62:0/651918391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5c0064b0 con 0x56361d45efd0 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 -- 172.21.15.62:0/651918391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 msgr2=0x56361d45f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 --2- 172.21.15.62:0/651918391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d45f3f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c08e480 tx=0x7fbf5c067e80 comp rx=0 tx=0).stop 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 -- 172.21.15.62:0/651918391 shutdown_connections 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 --2- 172.21.15.62:0/651918391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d45f3f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 -- 172.21.15.62:0/651918391 >> 172.21.15.62:0/651918391 conn(0x56361d45b330 msgr2=0x56361d459390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 -- 172.21.15.62:0/651918391 shutdown_connections 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 -- 172.21.15.62:0/651918391 wait complete. 2024-04-26T07:56:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 Processor -- start 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 -- start start 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d466670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf76f46800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56361d460130 con 0x56361d45efd0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf74244640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d466670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf74244640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d466670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40930/0 (socket says 172.21.15.62:40930) 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.000+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 learned_addr learned my addr 172.21.15.62:0/784286815 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.001+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361d466bb0 con 0x56361d45efd0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.001+0000 7fbf74244640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d466670 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c05d830 tx=0x7fbf5c08e3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.001+0000 7fbe4a7fc640 1 -- 172.21.15.62:0/784286815 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5c094070 con 0x56361d45efd0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.001+0000 7fbe4a7fc640 1 -- 172.21.15.62:0/784286815 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5c0728a0 con 0x56361d45efd0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.001+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56361d466e40 con 0x56361d45efd0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.001+0000 7fbe4a7fc640 1 -- 172.21.15.62:0/784286815 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5c05c990 con 0x56361d45efd0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.001+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361d469af0 con 0x56361d45efd0 2024-04-26T07:56:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.002+0000 7fbe4a7fc640 1 -- 172.21.15.62:0/784286815 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbf5c082020 con 0x56361d45efd0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.002+0000 7fbe4a7fc640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe40036e60 0x7fbe40039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.002+0000 7fbe4a7fc640 1 -- 172.21.15.62:0/784286815 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fbf5c09b0c0 con 0x56361d45efd0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.002+0000 7fbf75246640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe40036e60 0x7fbe40039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.002+0000 7fbf75246640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe40036e60 0x7fbe40039320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00f010 tx=0x7fbf6c00c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d472190 0x56361d474650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d474da0 con 0x56361d472190 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf74a45640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d472190 0x56361d474650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf74a45640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d472190 0x56361d474650 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6401b070 con 0x56361d472190 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 20 realm 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d4751b0 con 0x56361d472190 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6401b070 con 0x56361d472190 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.003+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d475a80 con 0x56361d472190 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6401b070 con 0x56361d472190 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d475e20 con 0x56361d472190 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf6401b070 con 0x56361d472190 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d476670 con 0x56361d472190 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf6401b070 con 0x56361d472190 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 20 searching for the correct realm 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56361d4783e0 0x56361d47a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.004+0000 7fbf74244640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56361d4783e0 0x56361d47a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.005+0000 7fbf74244640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56361d4783e0 0x56361d47a7d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.005+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.005+0000 7fbf74244640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbf5c084070 0x7fbf5c0904b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.005+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf5c084070 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.005+0000 7fbf75246640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbf5c084070 0x7fbf5c0904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.006+0000 7fbf75246640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbf5c084070 0x7fbf5c0904b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.006+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.006+0000 7fbf75246640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbf6c019040 0x7fbf6c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.006+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf6c019040 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.006+0000 7fbf74a45640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbf6c019040 0x7fbf6c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.006+0000 7fbf74a45640 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbf6c019040 0x7fbf6c019930 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.007+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6401b070 con 0x7fbf6c019040 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.007+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.007+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6401b070 con 0x56361d472190 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.007+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.007+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbf6401b070 con 0x56361d472190 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.007+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.007+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf6401b070 con 0x56361d472190 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.007+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf6c019040 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.008+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x7fbf6c019040 2024-04-26T07:56:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.008+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf5c084070 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.008+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.008+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.008+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.008+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.008+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x56361d472190 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.008+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf6c019040 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.009+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x7fbf6c019040 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.009+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.009+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x56361d472190 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.009+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf5c084070 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.009+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.009+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.009+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.009+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf6c019040 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x7fbf6c019040 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x56361d472190 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.010+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.011+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf6404f040 con 0x56361d472190 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.011+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf6c019040 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.011+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x7fbf6c019040 2024-04-26T07:56:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.011+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.011+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.011+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf5c084070 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.012+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.012+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.012+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x56361d472190 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.012+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf6c019040 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.012+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x7fbf6c019040 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.012+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.012+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.012+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf6c019040 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.013+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x7fbf6c019040 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.013+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf5c084070 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.013+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.013+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d4783e0 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.013+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.013+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf6c019040 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6404f040 con 0x7fbf6c019040 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x56361d472190 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56361d47adb0 con 0x7fbf5c084070 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:22.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d476ff0 con 0x56361d472190 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.014+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d477890 con 0x56361d472190 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d477890 con 0x56361d472190 2024-04-26T07:56:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 zone default found 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 4 Realm: () 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 zonegroup default 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d47b230 con 0x7fbf6c019040 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d47cc40 con 0x56361d4783e0 2024-04-26T07:56:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.015+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d47d110 con 0x56361d4783e0 2024-04-26T07:56:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.016+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.016+0000 7fbf76f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.016+0000 7fbf76f46800 20 started sync module instance, tier type = 2024-04-26T07:56:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.016+0000 7fbf76f46800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.016+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47c0b0 con 0x7fbf5c084070 2024-04-26T07:56:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.017+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.017+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94790419465680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47c0b0 con 0x7fbf5c084070 2024-04-26T07:56:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.017+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47dbf0 con 0x56361d472190 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.018+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94790419465680] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.018+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.018+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94790419470048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47c0b0 con 0x56361d472190 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.018+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47e660 con 0x56361d4783e0 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.020+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94790419470048] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.020+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.020+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94790419463168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47c020 con 0x56361d4783e0 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.020+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47f550 con 0x7fbf5c084070 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.021+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94790419463168] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.021+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.021+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94790419476640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47f970 con 0x7fbf5c084070 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.021+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d480330 con 0x56361d472190 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.022+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94790419476640] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.022+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.022+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94790419480672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47f970 con 0x56361d472190 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.022+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d480d40 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.023+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.023+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94790419482768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d480cb0 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.023+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94790419480672] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.023+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4817d0 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.024+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94790419482768] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.024+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.024+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94790419477696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4817d0 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.024+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d482190 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.025+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94790419477696] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94790419487968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d482100 con 0x7fbf6c019040 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf76f46800 20 add_watcher() i=0 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf76f46800 20 add_watcher() i=1 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf76f46800 20 add_watcher() i=2 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf76f46800 20 add_watcher() i=3 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf76f46800 20 add_watcher() i=4 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf76f46800 20 add_watcher() i=5 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.026+0000 7fbf76f46800 20 add_watcher() i=6 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.027+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94790419487968] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.027+0000 7fbf76f46800 20 add_watcher() i=7 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.027+0000 7fbf76f46800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.027+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d4811f0 con 0x56361d472190 2024-04-26T07:56:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.027+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.027+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94790419490064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4811f0 con 0x56361d472190 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.028+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94790419490064] v29'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.028+0000 7fbe2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.028+0000 7fbf76f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.028+0000 7fbf76f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.028+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48e210 con 0x56361d472190 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.029+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.030+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48e8e0 con 0x7fbf6c019040 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.031+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.031+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48e8e0 con 0x56361d4783e0 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.032+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.032+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48ec80 con 0x56361d472190 2024-04-26T07:56:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.033+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.033+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48ec80 con 0x7fbf5c084070 2024-04-26T07:56:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.034+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.034+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48f1f0 con 0x56361d4783e0 2024-04-26T07:56:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.035+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.035+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48f590 con 0x56361d472190 2024-04-26T07:56:22.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.036+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.036+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48f590 con 0x7fbf6c019040 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.037+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.037+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48f590 con 0x7fbf5c084070 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.038+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.038+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48fba0 con 0x56361d4783e0 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.039+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.039+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d48ffd0 con 0x7fbf5c084070 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.040+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.040+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490540 con 0x7fbf6c019040 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.041+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.041+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490540 con 0x7fbf5c084070 2024-04-26T07:56:22.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.042+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.042+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490700 con 0x7fbf6c019040 2024-04-26T07:56:22.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.043+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.043+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490700 con 0x56361d472190 2024-04-26T07:56:22.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.044+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.044+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490700 con 0x56361d4783e0 2024-04-26T07:56:22.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.045+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.045+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490790 con 0x7fbf5c084070 2024-04-26T07:56:22.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.046+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.046+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490820 con 0x56361d4783e0 2024-04-26T07:56:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.047+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.047+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490820 con 0x56361d472190 2024-04-26T07:56:22.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.049+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.049+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490820 con 0x56361d472190 2024-04-26T07:56:22.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.050+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.050+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490820 con 0x56361d4783e0 2024-04-26T07:56:22.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.051+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.051+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d490820 con 0x7fbf5c084070 2024-04-26T07:56:22.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.052+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.052+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x56361d4783e0 2024-04-26T07:56:22.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.053+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.053+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x56361d4783e0 2024-04-26T07:56:22.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.054+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.054+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x56361d4783e0 2024-04-26T07:56:22.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.055+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.055+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x56361d4783e0 2024-04-26T07:56:22.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.055+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.055+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x7fbf6c019040 2024-04-26T07:56:22.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.057+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.057+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x56361d4783e0 2024-04-26T07:56:22.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.058+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.058+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x7fbf6c019040 2024-04-26T07:56:22.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.059+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.059+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x56361d4783e0 2024-04-26T07:56:22.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.060+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.060+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x7fbf6c019040 2024-04-26T07:56:22.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.061+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'61 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.061+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4908d0 con 0x7fbf5c084070 2024-04-26T07:56:22.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.062+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.062+0000 7fbe29fe3640 20 reqs_thread_entry: start 2024-04-26T07:56:22.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:22.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 20 Filter name: none 2024-04-26T07:56:22.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbd9b7fe640 20 reqs_thread_entry: start 2024-04-26T07:56:22.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-26T07:56:22.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d4bb9d0 con 0x7fbf6c019040 2024-04-26T07:56:22.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 20 rados_obj.operate() r=0 bl.length=349 2024-04-26T07:56:22.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-04-26T07:56:22.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T07:56:22.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.063+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d4bb9d0 con 0x7fbf6c019040 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.064+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.064+0000 7fbf76f46800 10 removing key index: system_akey 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.064+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4bb9d0 con 0x56361d4783e0 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(96 system_akey [delete] v29'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf76f46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94790419730304 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d4be960 con 0x56361d472190 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== watch-notify(notify (1) cookie 94790419470048 notify 124554051611 ret 0) ==== 203+0+0 (crc 0 0 0) 0x56361d48ff40 con 0x56361d472190 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbe4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94790419470048 notifier 4843 bl.length()=161 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbe4bfff640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbe38003d60 con 0x56361d472190 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(97 notify.1 [notify cookie 94790419730304 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== watch-notify(notify_complete (2) cookie 94790419730304 notify 124554051611 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbf64046040 con 0x56361d472190 2024-04-26T07:56:22.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf76f46800 10 removing email index: 2024-04-26T07:56:22.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf76f46800 10 removing user buckets index 2024-04-26T07:56:22.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.065+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4bc3d0 con 0x7fbf6c019040 2024-04-26T07:56:22.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.066+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(99 system_user.buckets [delete] v29'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.066+0000 7fbf76f46800 10 removing user index: system_user 2024-04-26T07:56:22.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.066+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d4bdf40 con 0x7fbf6c019040 2024-04-26T07:56:22.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.067+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(100 system_user [call,call,delete] v29'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.067+0000 7fbf76f46800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-04-26T07:56:22.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.067+0000 7fbf76f46800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-26T07:56:22.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.067+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94790419726112 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56361d4bd840 con 0x7fbf5c084070 2024-04-26T07:56:22.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.068+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== watch-notify(notify (1) cookie 94790419465680 notify 124554051618 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56361d48e1d0 con 0x7fbf5c084070 2024-04-26T07:56:22.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.068+0000 7fbe4b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051618 cookie 94790419465680 notifier 4843 bl.length()=160 2024-04-26T07:56:22.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.068+0000 7fbe4b7fe640 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbda80032c0 con 0x7fbf5c084070 2024-04-26T07:56:22.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.068+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(101 notify.0 [notify cookie 94790419726112 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.068+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.068+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== watch-notify(notify_complete (2) cookie 94790419726112 notify 124554051618 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56361d48ec80 con 0x7fbf5c084070 2024-04-26T07:56:22.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.069+0000 7fbe2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.069+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94790419490064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d489e10 con 0x56361d472190 2024-04-26T07:56:22.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.070+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94790419490064] v29'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.070+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94790419465680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d482510 con 0x7fbf5c084070 2024-04-26T07:56:22.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.071+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94790419465680] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.071+0000 7fbf76f46800 20 remove_watcher() i=0 2024-04-26T07:56:22.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.071+0000 7fbf76f46800 2 removed watcher, disabling cache 2024-04-26T07:56:22.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.071+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94790419470048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d482510 con 0x56361d472190 2024-04-26T07:56:22.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.072+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94790419470048] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.072+0000 7fbf76f46800 20 remove_watcher() i=1 2024-04-26T07:56:22.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.072+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94790419463168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d482510 con 0x56361d4783e0 2024-04-26T07:56:22.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.073+0000 7fbf74244640 1 -- 172.21.15.62:0/784286815 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94790419463168] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf5c066030 con 0x56361d4783e0 2024-04-26T07:56:22.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.073+0000 7fbf76f46800 20 remove_watcher() i=2 2024-04-26T07:56:22.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.073+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94790419476640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47bc00 con 0x7fbf5c084070 2024-04-26T07:56:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.074+0000 7fbf75246640 1 -- 172.21.15.62:0/784286815 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94790419476640] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02f040 con 0x7fbf5c084070 2024-04-26T07:56:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.074+0000 7fbf76f46800 20 remove_watcher() i=3 2024-04-26T07:56:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.074+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94790419480672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d482510 con 0x56361d472190 2024-04-26T07:56:22.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.075+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94790419480672] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x56361d472190 2024-04-26T07:56:22.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.075+0000 7fbf76f46800 20 remove_watcher() i=4 2024-04-26T07:56:22.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.075+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94790419482768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47f0a0 con 0x7fbf6c019040 2024-04-26T07:56:22.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.076+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94790419482768] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.076+0000 7fbf76f46800 20 remove_watcher() i=5 2024-04-26T07:56:22.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.076+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94790419477696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d47bc00 con 0x7fbf6c019040 2024-04-26T07:56:22.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.077+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94790419477696] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.077+0000 7fbf76f46800 20 remove_watcher() i=6 2024-04-26T07:56:22.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.077+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94790419487968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56361d482510 con 0x7fbf6c019040 2024-04-26T07:56:22.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94790419487968] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf64061080 con 0x7fbf6c019040 2024-04-26T07:56:22.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 20 remove_watcher() i=7 2024-04-26T07:56:22.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbf6c019040 msgr2=0x7fbf6c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbf6c019040 0x7fbf6c019930 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d472190 msgr2=0x56361d474650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d472190 0x56361d474650 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbf5c084070 msgr2=0x7fbf5c0904b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbf5c084070 0x7fbf5c0904b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56361d4783e0 msgr2=0x56361d47a7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.078+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x56361d4783e0 0x56361d47a7d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe40036e60 msgr2=0x7fbe40039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe40036e60 0x7fbe40039320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00f010 tx=0x7fbf6c00c040 comp rx=0 tx=0).stop 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 msgr2=0x56361d466670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf74a45640 1 -- 172.21.15.62:0/784286815 reap_dead start 2024-04-26T07:56:22.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d466670 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c05d830 tx=0x7fbf5c08e3e0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 shutdown_connections 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 --2- 172.21.15.62:0/784286815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d45efd0 0x56361d466670 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 >> 172.21.15.62:0/784286815 conn(0x56361d45b330 msgr2=0x56361d458990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 shutdown_connections 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/784286815 wait complete. 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/3153779661 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe4c036e60 msgr2=0x7fbe4c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3153779661 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe4c036e60 0x7fbe4c039320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x56361d441d60 tx=0x7fbf6c000f90 comp rx=0 tx=0).stop 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/3153779661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d451df0 msgr2=0x56361d452230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3153779661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d451df0 0x56361d452230 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c000c00 tx=0x7fbf5c002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/3153779661 shutdown_connections 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3153779661 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe4c036e60 0x7fbe4c039320 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3153779661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d451df0 0x56361d452230 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/3153779661 >> 172.21.15.62:0/3153779661 conn(0x56361d445e40 msgr2=0x56361d446240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/3153779661 shutdown_connections 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.079+0000 7fbf76f46800 1 -- 172.21.15.62:0/3153779661 wait complete. 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d2b4170 msgr2=0x56361d440c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d2b4170 0x56361d440c10 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe5c036e60 msgr2=0x7fbe5c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe5c036e60 0x7fbe5c039320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c054000 tx=0x7fbf5c04e000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 msgr2=0x56361d4399d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d4399d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbf64001640 tx=0x7fbf64001250 comp rx=0 tx=0).stop 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 shutdown_connections 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x56361d2b4170 0x56361d440c10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbe5c036e60 0x7fbe5c039320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 --2- 172.21.15.62:0/3032202647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361d2b2e30 0x56361d4399d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 >> 172.21.15.62:0/3032202647 conn(0x56361d339d20 msgr2=0x56361d42bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 shutdown_connections 2024-04-26T07:56:22.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.080+0000 7fbf76f46800 1 -- 172.21.15.62:0/3032202647 wait complete. 2024-04-26T07:56:22.085 ERROR:root:None 2024-04-26T07:56:22.085 ERROR:root:0 2024-04-26T07:56:22.086 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-26T07:56:22.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-26T07:56:22.086 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-04-26T07:56:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f032353f800 1 Processor -- start 2024-04-26T07:56:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f032353f800 1 -- start start 2024-04-26T07:56:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f032353f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c21aa69c40 0x55c21aa6c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f032353f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c21aa6c570 con 0x55c21aa66130 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f032353f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55c21a907e20 con 0x55c21aa69c40 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f031ea9a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c21aa69c40 0x55c21aa6c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f031ea9a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55c21aa69c40 0x55c21aa6c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40942/0 (socket says 172.21.15.62:40942) 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f031f29b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55c21aa66130 0x55c21aa68520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33200/0 (socket says 172.21.15.62:33200) 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.143+0000 7f031ea9a640 1 -- 172.21.15.62:0/3541403219 learned_addr learned my addr 172.21.15.62:0/3541403219 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.144+0000 7f031ea9a640 1 -- 172.21.15.62:0/3541403219 >> v1:172.21.15.1:6789/0 conn(0x55c21aa66130 legacy=0x55c21aa68520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.144+0000 7f031ea9a640 1 -- 172.21.15.62:0/3541403219 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21aa6d750 con 0x55c21aa69c40 2024-04-26T07:56:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.144+0000 7f031e299640 1 -- 172.21.15.62:0/3541403219 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353210207 0 0) 0x55c21aa6c570 con 0x55c21aa66130 2024-04-26T07:56:22.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.145+0000 7f031ea9a640 1 --2- 172.21.15.62:0/3541403219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa69c40 0x55c21aa6c030 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f030800a520 tx=0x7f030801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c832847f386aa78d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f031e299640 1 -- 172.21.15.62:0/3541403219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308057070 con 0x55c21aa69c40 2024-04-26T07:56:22.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f031e299640 1 -- 172.21.15.62:0/3541403219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0308052570 con 0x55c21aa69c40 2024-04-26T07:56:22.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f031e299640 1 -- 172.21.15.62:0/3541403219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030804ae60 con 0x55c21aa69c40 2024-04-26T07:56:22.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f032353f800 1 -- 172.21.15.62:0/3541403219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa69c40 msgr2=0x55c21aa6c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f032353f800 1 --2- 172.21.15.62:0/3541403219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa69c40 0x55c21aa6c030 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f030800a520 tx=0x7f030801d010 comp rx=0 tx=0).stop 2024-04-26T07:56:22.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f032353f800 1 -- 172.21.15.62:0/3541403219 shutdown_connections 2024-04-26T07:56:22.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f032353f800 1 --2- 172.21.15.62:0/3541403219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa69c40 0x55c21aa6c030 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f032353f800 1 -- 172.21.15.62:0/3541403219 >> 172.21.15.62:0/3541403219 conn(0x55c21aa5fb20 msgr2=0x55c21aa61f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f032353f800 1 -- 172.21.15.62:0/3541403219 shutdown_connections 2024-04-26T07:56:22.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.146+0000 7f032353f800 1 -- 172.21.15.62:0/3541403219 wait complete. 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.159+0000 7f032353f800 1 Processor -- start 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.159+0000 7f032353f800 1 -- start start 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.159+0000 7f032353f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab56a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.159+0000 7f032353f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c21a9b0c70 con 0x55c21aa66130 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.159+0000 7f031f29b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab56a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.159+0000 7f031f29b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab56a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40958/0 (socket says 172.21.15.62:40958) 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.159+0000 7f031f29b640 1 -- 172.21.15.62:0/2202857728 learned_addr learned my addr 172.21.15.62:0/2202857728 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.160+0000 7f031f29b640 1 -- 172.21.15.62:0/2202857728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21ab56fd0 con 0x55c21aa66130 2024-04-26T07:56:22.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.160+0000 7f031f29b640 1 --2- 172.21.15.62:0/2202857728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab56a00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f031000b210 tx=0x7f031000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cc193965e8133c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.160+0000 7f020d60a640 1 -- 172.21.15.62:0/2202857728 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0310008070 con 0x55c21aa66130 2024-04-26T07:56:22.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.160+0000 7f020d60a640 1 -- 172.21.15.62:0/2202857728 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031000d500 con 0x55c21aa66130 2024-04-26T07:56:22.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.160+0000 7f020d60a640 1 -- 172.21.15.62:0/2202857728 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031000d840 con 0x55c21aa66130 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 -- 172.21.15.62:0/2202857728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 msgr2=0x55c21ab56a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 --2- 172.21.15.62:0/2202857728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab56a00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f031000b210 tx=0x7f031000b6d0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 -- 172.21.15.62:0/2202857728 shutdown_connections 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 --2- 172.21.15.62:0/2202857728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab56a00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 -- 172.21.15.62:0/2202857728 >> 172.21.15.62:0/2202857728 conn(0x55c21aa5fb20 msgr2=0x55c21ab52320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 -- 172.21.15.62:0/2202857728 shutdown_connections 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 -- 172.21.15.62:0/2202857728 wait complete. 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 Processor -- start 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 -- start start 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab5e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f032353f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c21aa6ca40 con 0x55c21aa66130 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f031f29b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab5e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f031f29b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab5e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40966/0 (socket says 172.21.15.62:40966) 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.161+0000 7f031f29b640 1 -- 172.21.15.62:0/1630381722 learned_addr learned my addr 172.21.15.62:0/1630381722 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.162+0000 7f031f29b640 1 -- 172.21.15.62:0/1630381722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21ab5eaf0 con 0x55c21aa66130 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.162+0000 7f031f29b640 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab5e5b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0310001e60 tx=0x7f0310000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.162+0000 7f020be07640 1 -- 172.21.15.62:0/1630381722 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0310019870 con 0x55c21aa66130 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.162+0000 7f020be07640 1 -- 172.21.15.62:0/1630381722 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0310019a10 con 0x55c21aa66130 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.162+0000 7f020be07640 1 -- 172.21.15.62:0/1630381722 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0310019cf0 con 0x55c21aa66130 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.162+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c21ab5ed80 con 0x55c21aa66130 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.162+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21ab61a30 con 0x55c21aa66130 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.163+0000 7f020be07640 1 -- 172.21.15.62:0/1630381722 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0310017040 con 0x55c21aa66130 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.163+0000 7f020be07640 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0204036eb0 0x7f0204039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.163+0000 7f020be07640 1 -- 172.21.15.62:0/1630381722 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f0310015020 con 0x55c21aa66130 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.163+0000 7f031ea9a640 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0204036eb0 0x7f0204039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.163+0000 7f032353f800 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21aa69c40 0x55c21ab657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.163+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab65d80 con 0x55c21aa69c40 2024-04-26T07:56:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.164+0000 7f031fa9c640 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21aa69c40 0x55c21ab657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.164+0000 7f031ea9a640 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0204036eb0 0x7f0204039370 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0308054000 tx=0x7f030804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.164+0000 7f031fa9c640 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21aa69c40 0x55c21ab657f0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.164+0000 7f031fa9c640 1 -- 172.21.15.62:0/1630381722 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f031800a4a0 con 0x55c21aa69c40 2024-04-26T07:56:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.164+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab62dc0 con 0x55c21aa69c40 2024-04-26T07:56:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.164+0000 7f031fa9c640 1 -- 172.21.15.62:0/1630381722 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f031800a4a0 con 0x55c21aa69c40 2024-04-26T07:56:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.165+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab67ba0 con 0x55c21aa69c40 2024-04-26T07:56:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.165+0000 7f031fa9c640 1 -- 172.21.15.62:0/1630381722 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f031800a4a0 con 0x55c21aa69c40 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.165+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab66ee0 con 0x55c21aa69c40 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.165+0000 7f031fa9c640 1 -- 172.21.15.62:0/1630381722 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f031800a4a0 con 0x55c21aa69c40 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.165+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab67330 con 0x55c21aa69c40 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.165+0000 7f031fa9c640 1 -- 172.21.15.62:0/1630381722 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f031800a4a0 con 0x55c21aa69c40 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.166+0000 7f032353f800 1 Processor -- start 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.166+0000 7f032353f800 1 -- start start 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.166+0000 7f032353f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab76970 0x55c21ab76d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.166+0000 7f032353f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c21a958170 con 0x55c21ab76970 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.166+0000 7f031ea9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab76970 0x55c21ab76d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.166+0000 7f031ea9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab76970 0x55c21ab76d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40972/0 (socket says 172.21.15.62:40972) 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.166+0000 7f031ea9a640 1 -- 172.21.15.62:0/1137809659 learned_addr learned my addr 172.21.15.62:0/1137809659 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.167+0000 7f031ea9a640 1 -- 172.21.15.62:0/1137809659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21ab772d0 con 0x55c21ab76970 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.167+0000 7f031ea9a640 1 --2- 172.21.15.62:0/1137809659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab76970 0x55c21ab76d90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f030801d050 tx=0x7f0308002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.167+0000 7f0209602640 1 -- 172.21.15.62:0/1137809659 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308057040 con 0x55c21ab76970 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.167+0000 7f0209602640 1 -- 172.21.15.62:0/1137809659 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f030806d070 con 0x55c21ab76970 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.167+0000 7f0209602640 1 -- 172.21.15.62:0/1137809659 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030805d7c0 con 0x55c21ab76970 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.167+0000 7f032353f800 1 -- 172.21.15.62:0/1137809659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c21ab77d40 con 0x55c21ab76970 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.167+0000 7f032353f800 1 -- 172.21.15.62:0/1137809659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21ab781e0 con 0x55c21ab76970 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f0209602640 1 -- 172.21.15.62:0/1137809659 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0308067070 con 0x55c21ab76970 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f0209602640 1 --2- 172.21.15.62:0/1137809659 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01f8036e60 0x7f01f8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f0209602640 1 -- 172.21.15.62:0/1137809659 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f030808ff40 con 0x55c21ab76970 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f031fa9c640 1 --2- 172.21.15.62:0/1137809659 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01f8036e60 0x7f01f8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f032353f800 1 Processor -- start 2024-04-26T07:56:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f032353f800 1 -- start start 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f031fa9c640 1 --2- 172.21.15.62:0/1137809659 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01f8036e60 0x7f01f8039320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55c21ab66a00 tx=0x7f0318005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f032353f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21ab84080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.168+0000 7f032353f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c21ab57350 con 0x55c21ab83c80 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.169+0000 7f031ea9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21ab84080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.169+0000 7f031ea9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21ab84080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40982/0 (socket says 172.21.15.62:40982) 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.169+0000 7f031ea9a640 1 -- 172.21.15.62:0/3021168858 learned_addr learned my addr 172.21.15.62:0/3021168858 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.169+0000 7f031ea9a640 1 -- 172.21.15.62:0/3021168858 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21ab84650 con 0x55c21ab83c80 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.169+0000 7f031ea9a640 1 --2- 172.21.15.62:0/3021168858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21ab84080 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0308055040 tx=0x7f0308067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d735662689ff1b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.169+0000 7f0202ffd640 1 -- 172.21.15.62:0/3021168858 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030807f020 con 0x55c21ab83c80 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.169+0000 7f0202ffd640 1 -- 172.21.15.62:0/3021168858 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0308072980 con 0x55c21ab83c80 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.169+0000 7f0202ffd640 1 -- 172.21.15.62:0/3021168858 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308072460 con 0x55c21ab83c80 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 -- 172.21.15.62:0/3021168858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 msgr2=0x55c21ab84080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 --2- 172.21.15.62:0/3021168858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21ab84080 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0308055040 tx=0x7f0308067ab0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 -- 172.21.15.62:0/3021168858 shutdown_connections 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 --2- 172.21.15.62:0/3021168858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21ab84080 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 -- 172.21.15.62:0/3021168858 >> 172.21.15.62:0/3021168858 conn(0x55c21ab7ff50 msgr2=0x55c21ab7dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 -- 172.21.15.62:0/3021168858 shutdown_connections 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 -- 172.21.15.62:0/3021168858 wait complete. 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 Processor -- start 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 -- start start 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21aa659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f032353f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c21ab84e00 con 0x55c21ab83c80 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f031ea9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21aa659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f031ea9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21aa659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:40998/0 (socket says 172.21.15.62:40998) 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.170+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 learned_addr learned my addr 172.21.15.62:0/2288043619 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.171+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21aa65f10 con 0x55c21ab83c80 2024-04-26T07:56:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.171+0000 7f031ea9a640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21aa659d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0308052d10 tx=0x7f030808e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.171+0000 7f02017fa640 1 -- 172.21.15.62:0/2288043619 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308068e60 con 0x55c21ab83c80 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.171+0000 7f02017fa640 1 -- 172.21.15.62:0/2288043619 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0308098070 con 0x55c21ab83c80 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.171+0000 7f02017fa640 1 -- 172.21.15.62:0/2288043619 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03080066c0 con 0x55c21ab83c80 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.171+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c21aa640c0 con 0x55c21ab83c80 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.171+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21aa64560 con 0x55c21ab83c80 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.172+0000 7f02017fa640 1 -- 172.21.15.62:0/2288043619 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0308082020 con 0x55c21ab83c80 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.172+0000 7f02017fa640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01e8036e60 0x7f01e8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.172+0000 7f02017fa640 1 -- 172.21.15.62:0/2288043619 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f03080610d0 con 0x55c21ab83c80 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.172+0000 7f031fa9c640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01e8036e60 0x7f01e8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.172+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f031fa9c640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01e8036e60 0x7f01e8039320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55c21ab5f3d0 tx=0x7f031801f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21ab98f30 0x55c21ab9b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab9bb40 con 0x55c21ab98f30 2024-04-26T07:56:22.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f031f29b640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21ab98f30 0x55c21ab9b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f031f29b640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21ab98f30 0x55c21ab9b3f0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 20 realm 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab9bf50 con 0x55c21ab98f30 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.173+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab9c820 con 0x55c21ab98f30 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab9cbc0 con 0x55c21ab98f30 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab9d410 con 0x55c21ab98f30 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 20 searching for the correct realm 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c21ab9f180 0x55c21aba1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.174+0000 7f031ea9a640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c21ab9f180 0x55c21aba1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.175+0000 7f031ea9a640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c21ab9f180 0x55c21aba1570 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.175+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.175+0000 7f031ea9a640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0308084040 0x7f030807b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.175+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0308084040 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.175+0000 7f031fa9c640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0308084040 0x7f030807b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.175+0000 7f031fa9c640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0308084040 0x7f030807b420 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.176+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031801f070 con 0x7f0308084040 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.176+0000 7f031fa9c640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0318031040 0x7f0318032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.176+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0318031040 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.176+0000 7f031f29b640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0318031040 0x7f0318032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.176+0000 7f031f29b640 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0318031040 0x7f0318032940 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.177+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.177+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.177+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.177+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.177+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.177+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.178+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.178+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0318031040 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.178+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.178+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0308084040 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.178+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031801f070 con 0x7f0308084040 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.178+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.178+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.178+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.179+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.179+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0318031040 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.179+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.179+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.179+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.179+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0308084040 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.179+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f031801f070 con 0x7f0308084040 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.179+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.180+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.180+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.180+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.180+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0318031040 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.180+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.180+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.180+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.180+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.181+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.181+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.181+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.181+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.181+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.181+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0318031040 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.182+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.182+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.182+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.182+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0308084040 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.182+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031801f070 con 0x7f0308084040 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.182+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.182+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.182+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0318031040 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.183+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.183+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.183+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.183+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0318031040 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.183+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.183+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0308084040 2024-04-26T07:56:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.183+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031801f070 con 0x7f0308084040 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.183+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab9f180 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0318031040 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x55c21ab98f30 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1b50 con 0x7f0308084040 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031801f070 con 0x7f0308084040 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f032353f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f032353f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f032353f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f032353f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f032353f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f032353f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.184+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab9dd90 con 0x55c21ab98f30 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab9e630 con 0x55c21ab98f30 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21ab9e630 con 0x55c21ab98f30 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 20 zone default found 2024-04-26T07:56:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 4 Realm: () 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 20 zonegroup default 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.185+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba1fd0 con 0x7f0318031040 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba3a00 con 0x55c21ab9f180 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba3f40 con 0x55c21ab9f180 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 20 started sync module instance, tier type = 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.186+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba2e50 con 0x7f0308084040 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.187+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0318040040 con 0x7f0308084040 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.187+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94292160426560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba2ab0 con 0x7f0308084040 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.187+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba4e70 con 0x55c21ab98f30 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.188+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94292160426560] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0318040040 con 0x7f0308084040 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.189+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.189+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94292160431008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba4e70 con 0x55c21ab98f30 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.189+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba5920 con 0x55c21ab9f180 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.190+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94292160431008] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.190+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.190+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94292160432576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba4de0 con 0x55c21ab9f180 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.190+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba67e0 con 0x7f0308084040 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.191+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94292160432576] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.191+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0318040040 con 0x7f0308084040 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.191+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94292160439088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba6750 con 0x7f0308084040 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.191+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba7570 con 0x55c21ab98f30 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.192+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.192+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94292160442496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba7570 con 0x55c21ab98f30 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.192+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba8530 con 0x7f0318031040 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.192+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94292160439088] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0318040040 con 0x7f0308084040 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.193+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94292160442496] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.193+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.193+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94292160446464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba8530 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.193+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba7a00 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.194+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94292160446464] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.194+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.194+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94292160444864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba8920 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.195+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba9370 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94292160444864] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94292160450144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba9330 con 0x7f0318031040 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f032353f800 20 add_watcher() i=0 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f032353f800 20 add_watcher() i=1 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f032353f800 20 add_watcher() i=2 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f032353f800 20 add_watcher() i=3 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f032353f800 20 add_watcher() i=4 2024-04-26T07:56:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f032353f800 20 add_watcher() i=5 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f032353f800 20 add_watcher() i=6 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.196+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94292160450144] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.197+0000 7f032353f800 20 add_watcher() i=7 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.197+0000 7f032353f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.197+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21abac7c0 con 0x55c21ab98f30 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.197+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.197+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94292160441296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba9c70 con 0x55c21ab98f30 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.198+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94292160441296] v29'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.198+0000 7f01d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.198+0000 7f032353f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.198+0000 7f032353f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.198+0000 7f032353f800 5 note: GC not initialized 2024-04-26T07:56:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.198+0000 7f01d4fe1640 20 reqs_thread_entry: start 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.198+0000 7f032353f800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 20 Filter name: none 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f014e7fc640 20 reqs_thread_entry: start 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21abdffa0 con 0x55c21ab9f180 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21abdea90 con 0x55c21ab9f180 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-04-26T07:56:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T07:56:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-26T07:56:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-26T07:56:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.199+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21abe3590 con 0x55c21ab9f180 2024-04-26T07:56:22.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.200+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v29'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.200+0000 7f032353f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-26T07:56:22.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.200+0000 7f032353f800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T07:56:22.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.200+0000 7f032353f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-26T07:56:22.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.200+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94292160671504 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21abe4060 con 0x55c21ab9f180 2024-04-26T07:56:22.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== watch-notify(notify (1) cookie 94292160432576 notify 124554051593 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55c21abde810 con 0x55c21ab9f180 2024-04-26T07:56:22.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f0202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94292160432576 notifier 4850 bl.length()=542 2024-04-26T07:56:22.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f0202ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f0202ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f0202ffd640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f01e4003ea0 con 0x55c21ab9f180 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(65 notify.2 [notify cookie 94292160671504 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== watch-notify(notify_complete (2) cookie 94292160671504 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c21aa65f10 con 0x55c21ab9f180 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.201+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21abdef10 con 0x55c21ab9f180 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.202+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v29'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.202+0000 7f032353f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.202+0000 7f032353f800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.202+0000 7f032353f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.202+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94292160671504 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c21abe4490 con 0x7f0318031040 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.203+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== watch-notify(notify (1) cookie 94292160446464 notify 124554051628 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55c21ab61a30 con 0x7f0318031040 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.203+0000 7f02027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051628 cookie 94292160446464 notifier 4850 bl.length()=175 2024-04-26T07:56:22.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.203+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(68 notify.5 [notify cookie 94292160671504 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.203+0000 7f02027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-26T07:56:22.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.203+0000 7f02027fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T07:56:22.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.203+0000 7f02027fc640 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0154003400 con 0x7f0318031040 2024-04-26T07:56:22.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.203+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== watch-notify(notify_complete (2) cookie 94292160671504 notify 124554051628 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c21ab5ed80 con 0x7f0318031040 2024-04-26T07:56:22.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.203+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.212 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-04-26T07:56:22.200741Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:22.200727Z","tags":[],"group_ids":[]} 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.204+0000 7f01d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.204+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94292160441296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21abac300 con 0x55c21ab98f30 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.205+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94292160441296] v29'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.205+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94292160426560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21ababe50 con 0x7f0308084040 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.206+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94292160426560] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0318040040 con 0x7f0308084040 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.206+0000 7f032353f800 20 remove_watcher() i=0 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.206+0000 7f032353f800 2 removed watcher, disabling cache 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.206+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94292160431008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba3240 con 0x55c21ab98f30 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.207+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94292160431008] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.207+0000 7f032353f800 20 remove_watcher() i=1 2024-04-26T07:56:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.207+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94292160432576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba3240 con 0x55c21ab9f180 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.208+0000 7f031ea9a640 1 -- 172.21.15.62:0/2288043619 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94292160432576] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0308066030 con 0x55c21ab9f180 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.208+0000 7f032353f800 20 remove_watcher() i=2 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.208+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94292160439088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba49c0 con 0x7f0308084040 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.209+0000 7f031fa9c640 1 -- 172.21.15.62:0/2288043619 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94292160439088] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0318040040 con 0x7f0308084040 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.209+0000 7f032353f800 20 remove_watcher() i=3 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.209+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94292160442496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba3240 con 0x55c21ab98f30 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.210+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94292160442496] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x55c21ab98f30 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.210+0000 7f032353f800 20 remove_watcher() i=4 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.210+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94292160446464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba6330 con 0x7f0318031040 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.211+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94292160446464] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.211+0000 7f032353f800 20 remove_watcher() i=5 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.211+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94292160444864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba49c0 con 0x7f0318031040 2024-04-26T07:56:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.212+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94292160444864] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.212+0000 7f032353f800 20 remove_watcher() i=6 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.212+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94292160450144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c21aba3240 con 0x7f0318031040 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.213+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94292160450144] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002d070 con 0x7f0318031040 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.213+0000 7f032353f800 20 remove_watcher() i=7 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0318031040 msgr2=0x7f0318032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f0318031040 0x7f0318032940 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21ab98f30 msgr2=0x55c21ab9b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21ab98f30 0x55c21ab9b3f0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0308084040 msgr2=0x7f030807b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f0308084040 0x7f030807b420 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c21ab9f180 msgr2=0x55c21aba1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55c21ab9f180 0x55c21aba1570 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01e8036e60 msgr2=0x7f01e8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01e8036e60 0x7f01e8039320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55c21ab5f3d0 tx=0x7f031801f000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 msgr2=0x55c21aa659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/2288043619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab83c80 0x55c21aa659d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0308052d10 tx=0x7f030808e150 comp rx=0 tx=0).stop 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 reap_dead start 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f031f29b640 1 -- 172.21.15.62:0/2288043619 reap_dead start 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 shutdown_connections 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 >> 172.21.15.62:0/2288043619 conn(0x55c21ab7ff50 msgr2=0x55c21ab7d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 shutdown_connections 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/2288043619 wait complete. 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/1137809659 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01f8036e60 msgr2=0x7f01f8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/1137809659 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01f8036e60 0x7f01f8039320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55c21ab66a00 tx=0x7f0318005840 comp rx=0 tx=0).stop 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/1137809659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab76970 msgr2=0x55c21ab76d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/1137809659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab76970 0x55c21ab76d90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f030801d050 tx=0x7f0308002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/1137809659 shutdown_connections 2024-04-26T07:56:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/1137809659 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f01f8036e60 0x7f01f8039320 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 --2- 172.21.15.62:0/1137809659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21ab76970 0x55c21ab76d90 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/1137809659 >> 172.21.15.62:0/1137809659 conn(0x55c21ab6aa10 msgr2=0x55c21ab6ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/1137809659 shutdown_connections 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.214+0000 7f032353f800 1 -- 172.21.15.62:0/1137809659 wait complete. 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21aa69c40 msgr2=0x55c21ab657f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21aa69c40 0x55c21ab657f0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0204036eb0 msgr2=0x7f0204039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0204036eb0 0x7f0204039370 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0308054000 tx=0x7f030804e000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 msgr2=0x55c21ab5e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab5e5b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0310001e60 tx=0x7f0310000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 shutdown_connections 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55c21aa69c40 0x55c21ab657f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0204036eb0 0x7f0204039370 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 --2- 172.21.15.62:0/1630381722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c21aa66130 0x55c21ab5e5b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 >> 172.21.15.62:0/1630381722 conn(0x55c21aa5fb20 msgr2=0x55c21ab50bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 shutdown_connections 2024-04-26T07:56:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.215+0000 7f032353f800 1 -- 172.21.15.62:0/1630381722 wait complete. 2024-04-26T07:56:22.223 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-26T07:56:22.200741Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:22.200727Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.223 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-26T07:56:22.200741Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:22.200727Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.223 ERROR:root:0 2024-04-26T07:56:22.224 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:22.228 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:22.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-04-26T07:56:22.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-04-26T07:56:22.229 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-04-26T07:56:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.276+0000 7fd8b4f33800 1 Processor -- start 2024-04-26T07:56:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.276+0000 7fd8b4f33800 1 -- start start 2024-04-26T07:56:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.276+0000 7fd8b4f33800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5604ef627b00 0x5604ef630600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.276+0000 7fd8b4f33800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5604ef59b120 con 0x5604ef625fc0 2024-04-26T07:56:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.276+0000 7fd8b4f33800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5604ef4c9e20 con 0x5604ef627b00 2024-04-26T07:56:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.277+0000 7fd8b03f4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5604ef627b00 0x5604ef630600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.277+0000 7fd8b0bf5640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5604ef625fc0 0x5604ef6263e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33212/0 (socket says 172.21.15.62:33212) 2024-04-26T07:56:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.277+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/4144079796 learned_addr learned my addr 172.21.15.62:0/4144079796 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.277+0000 7fd8b03f4640 1 -- 172.21.15.62:0/4144079796 >> v1:172.21.15.1:6789/0 conn(0x5604ef625fc0 legacy=0x5604ef6263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.277+0000 7fd8afbf3640 1 -- 172.21.15.62:0/4144079796 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802928356 0 0) 0x5604ef59b120 con 0x5604ef625fc0 2024-04-26T07:56:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.277+0000 7fd8b03f4640 1 -- 172.21.15.62:0/4144079796 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ef59b2f0 con 0x5604ef627b00 2024-04-26T07:56:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.279+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/4144079796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef627b00 0x5604ef630600 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400a470 tx=0x7fd8a401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71a5aedca299057 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.279+0000 7fd8afbf3640 1 -- 172.21.15.62:0/4144079796 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a4057070 con 0x5604ef627b00 2024-04-26T07:56:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.279+0000 7fd8afbf3640 1 -- 172.21.15.62:0/4144079796 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a4052570 con 0x5604ef627b00 2024-04-26T07:56:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.279+0000 7fd8afbf3640 1 -- 172.21.15.62:0/4144079796 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a4052870 con 0x5604ef627b00 2024-04-26T07:56:22.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.280+0000 7fd8b4f33800 1 -- 172.21.15.62:0/4144079796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef627b00 msgr2=0x5604ef630600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.280+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/4144079796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef627b00 0x5604ef630600 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400a470 tx=0x7fd8a401ce90 comp rx=0 tx=0).stop 2024-04-26T07:56:22.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.280+0000 7fd8b4f33800 1 -- 172.21.15.62:0/4144079796 shutdown_connections 2024-04-26T07:56:22.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.280+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/4144079796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef627b00 0x5604ef630600 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.280+0000 7fd8b4f33800 1 -- 172.21.15.62:0/4144079796 >> 172.21.15.62:0/4144079796 conn(0x5604ef621b80 msgr2=0x5604ef623fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.280+0000 7fd8b4f33800 1 -- 172.21.15.62:0/4144079796 shutdown_connections 2024-04-26T07:56:22.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.280+0000 7fd8b4f33800 1 -- 172.21.15.62:0/4144079796 wait complete. 2024-04-26T07:56:22.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.292+0000 7fd8b4f33800 1 Processor -- start 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.292+0000 7fd8b4f33800 1 -- start start 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd8b4f33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef71ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd8b4f33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604ef572cd0 con 0x5604ef625fc0 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd8b0bf5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef71ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd8b0bf5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef71ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41012/0 (socket says 172.21.15.62:41012) 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/2939523750 learned_addr learned my addr 172.21.15.62:0/2939523750 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/2939523750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ef71b1d0 con 0x5604ef625fc0 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd8b0bf5640 1 --2- 172.21.15.62:0/2939523750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef71ac00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b210 tx=0x7fd8a000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8820aded1274e4af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd79ee0d640 1 -- 172.21.15.62:0/2939523750 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a0008070 con 0x5604ef625fc0 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd79ee0d640 1 -- 172.21.15.62:0/2939523750 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a000d500 con 0x5604ef625fc0 2024-04-26T07:56:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.293+0000 7fd79ee0d640 1 -- 172.21.15.62:0/2939523750 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a000d840 con 0x5604ef625fc0 2024-04-26T07:56:22.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.294+0000 7fd8b4f33800 1 -- 172.21.15.62:0/2939523750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 msgr2=0x5604ef71ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.294+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/2939523750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef71ac00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b210 tx=0x7fd8a000b6d0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.294+0000 7fd8b4f33800 1 -- 172.21.15.62:0/2939523750 shutdown_connections 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.294+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/2939523750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef71ac00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.294+0000 7fd8b4f33800 1 -- 172.21.15.62:0/2939523750 >> 172.21.15.62:0/2939523750 conn(0x5604ef621b80 msgr2=0x5604ef716520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.294+0000 7fd8b4f33800 1 -- 172.21.15.62:0/2939523750 shutdown_connections 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.294+0000 7fd8b4f33800 1 -- 172.21.15.62:0/2939523750 wait complete. 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.294+0000 7fd8b4f33800 1 Processor -- start 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.295+0000 7fd8b4f33800 1 -- start start 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.295+0000 7fd8b4f33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef722780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.295+0000 7fd8b4f33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604ef630e10 con 0x5604ef625fc0 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.295+0000 7fd8b0bf5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef722780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.295+0000 7fd8b0bf5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef722780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41026/0 (socket says 172.21.15.62:41026) 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.295+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/3666810430 learned_addr learned my addr 172.21.15.62:0/3666810430 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.295+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/3666810430 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ef722cc0 con 0x5604ef625fc0 2024-04-26T07:56:22.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.295+0000 7fd8b0bf5640 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef722780 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b210 tx=0x7fd8a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.296+0000 7fd79d60a640 1 -- 172.21.15.62:0/3666810430 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a000f950 con 0x5604ef625fc0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.296+0000 7fd79d60a640 1 -- 172.21.15.62:0/3666810430 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a000faf0 con 0x5604ef625fc0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.296+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604ef722f50 con 0x5604ef625fc0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.296+0000 7fd79d60a640 1 -- 172.21.15.62:0/3666810430 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a000fdd0 con 0x5604ef625fc0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.296+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ef725c00 con 0x5604ef625fc0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.296+0000 7fd79d60a640 1 -- 172.21.15.62:0/3666810430 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd8a0017040 con 0x5604ef625fc0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.297+0000 7fd79d60a640 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd798036e60 0x7fd798039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.297+0000 7fd79d60a640 1 -- 172.21.15.62:0/3666810430 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd8a0015020 con 0x5604ef625fc0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.297+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd798036e60 0x7fd798039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.297+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef627b00 0x5604ef7299c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.297+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef729f00 con 0x5604ef627b00 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.297+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef627b00 0x5604ef7299c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.297+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd798036e60 0x7fd798039320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4054000 tx=0x7fd8a404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.297+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef627b00 0x5604ef7299c0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.298+0000 7fd8b13f6640 1 -- 172.21.15.62:0/3666810430 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a800a4a0 con 0x5604ef627b00 2024-04-26T07:56:22.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.298+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef726f90 con 0x5604ef627b00 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.298+0000 7fd8b13f6640 1 -- 172.21.15.62:0/3666810430 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8a800a4a0 con 0x5604ef627b00 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.298+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef72bd20 con 0x5604ef627b00 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.298+0000 7fd8b13f6640 1 -- 172.21.15.62:0/3666810430 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8a800a4a0 con 0x5604ef627b00 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.298+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef72b060 con 0x5604ef627b00 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.298+0000 7fd8b13f6640 1 -- 172.21.15.62:0/3666810430 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8a800a4a0 con 0x5604ef627b00 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.298+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef72b4b0 con 0x5604ef627b00 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.299+0000 7fd8b13f6640 1 -- 172.21.15.62:0/3666810430 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8a800a4a0 con 0x5604ef627b00 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.299+0000 7fd8b4f33800 1 Processor -- start 2024-04-26T07:56:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.299+0000 7fd8b4f33800 1 -- start start 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.299+0000 7fd8b4f33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef73aaf0 0x5604ef73af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.299+0000 7fd8b4f33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604ef51a170 con 0x5604ef73aaf0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd8b03f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef73aaf0 0x5604ef73af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd8b03f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef73aaf0 0x5604ef73af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41040/0 (socket says 172.21.15.62:41040) 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd8b03f4640 1 -- 172.21.15.62:0/116347445 learned_addr learned my addr 172.21.15.62:0/116347445 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd8b03f4640 1 -- 172.21.15.62:0/116347445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ef73b450 con 0x5604ef73aaf0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/116347445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef73aaf0 0x5604ef73af10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4000c00 tx=0x7fd8a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd7967fc640 1 -- 172.21.15.62:0/116347445 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a4057040 con 0x5604ef73aaf0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd7967fc640 1 -- 172.21.15.62:0/116347445 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a406d070 con 0x5604ef73aaf0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd8b4f33800 1 -- 172.21.15.62:0/116347445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604ef73bec0 con 0x5604ef73aaf0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd7967fc640 1 -- 172.21.15.62:0/116347445 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a405ea70 con 0x5604ef73aaf0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.300+0000 7fd8b4f33800 1 -- 172.21.15.62:0/116347445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ef73c360 con 0x5604ef73aaf0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.301+0000 7fd7967fc640 1 -- 172.21.15.62:0/116347445 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd8a4067070 con 0x5604ef73aaf0 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.301+0000 7fd7967fc640 1 --2- 172.21.15.62:0/116347445 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd788036e60 0x7fd788039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.301+0000 7fd7967fc640 1 -- 172.21.15.62:0/116347445 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd8a40903c0 con 0x5604ef73aaf0 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.301+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/116347445 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd788036e60 0x7fd788039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.301+0000 7fd8b4f33800 1 Processor -- start 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b4f33800 1 -- start start 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/116347445 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd788036e60 0x7fd788039320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5604ef72ab80 tx=0x7fd8a8005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b4f33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef748200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b4f33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604ef71b550 con 0x5604ef747e00 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b03f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef748200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b03f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef748200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41044/0 (socket says 172.21.15.62:41044) 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1906465763 learned_addr learned my addr 172.21.15.62:0/1906465763 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1906465763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ef7487d0 con 0x5604ef747e00 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.302+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/1906465763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef748200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd8a408e700 tx=0x7fd8a4072d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663e310fe116ce19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd787fff640 1 -- 172.21.15.62:0/1906465763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a4081070 con 0x5604ef747e00 2024-04-26T07:56:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd787fff640 1 -- 172.21.15.62:0/1906465763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a4006380 con 0x5604ef747e00 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd787fff640 1 -- 172.21.15.62:0/1906465763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a408d130 con 0x5604ef747e00 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1906465763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 msgr2=0x5604ef748200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1906465763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef748200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd8a408e700 tx=0x7fd8a4072d00 comp rx=0 tx=0).stop 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1906465763 shutdown_connections 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1906465763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef748200 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1906465763 >> 172.21.15.62:0/1906465763 conn(0x5604ef7440d0 msgr2=0x5604ef742130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1906465763 shutdown_connections 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1906465763 wait complete. 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 Processor -- start 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 -- start start 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.303+0000 7fd8b4f33800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef74f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd8b4f33800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5604ef748f80 con 0x5604ef747e00 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd8b03f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef74f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd8b03f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef74f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41056/0 (socket says 172.21.15.62:41056) 2024-04-26T07:56:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 learned_addr learned my addr 172.21.15.62:0/1962700694 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ef74f920 con 0x5604ef747e00 2024-04-26T07:56:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef74f3e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd8a408e700 tx=0x7fd8a408e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd7867fc640 1 -- 172.21.15.62:0/1962700694 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a4081050 con 0x5604ef747e00 2024-04-26T07:56:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd7867fc640 1 -- 172.21.15.62:0/1962700694 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a4082040 con 0x5604ef747e00 2024-04-26T07:56:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604ef74fbb0 con 0x5604ef747e00 2024-04-26T07:56:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd7867fc640 1 -- 172.21.15.62:0/1962700694 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a408c040 con 0x5604ef747e00 2024-04-26T07:56:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.304+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ef752860 con 0x5604ef747e00 2024-04-26T07:56:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.305+0000 7fd7867fc640 1 -- 172.21.15.62:0/1962700694 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd8a4006b90 con 0x5604ef747e00 2024-04-26T07:56:22.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.305+0000 7fd7867fc640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd77c036eb0 0x7fd77c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.305+0000 7fd7867fc640 1 -- 172.21.15.62:0/1962700694 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fd8a409b0b0 con 0x5604ef747e00 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.306+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd77c036eb0 0x7fd77c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.306+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.306+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef75af10 0x5604ef75d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.306+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef75db20 con 0x5604ef75af10 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.306+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd77c036eb0 0x7fd77c039370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5604ef7235a0 tx=0x7fd8a801f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.306+0000 7fd8b0bf5640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef75af10 0x5604ef75d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.306+0000 7fd8b0bf5640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef75af10 0x5604ef75d3d0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 realm 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef75df30 con 0x5604ef75af10 2024-04-26T07:56:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef75e800 con 0x5604ef75af10 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef75eba0 con 0x5604ef75af10 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.307+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef75f3f0 con 0x5604ef75af10 2024-04-26T07:56:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.308+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.308+0000 7fd8b4f33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.308+0000 7fd8b4f33800 20 searching for the correct realm 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.308+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604ef761160 0x5604ef763550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.308+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.308+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604ef761160 0x5604ef763550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.308+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604ef761160 0x5604ef763550 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.309+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.309+0000 7fd8b03f4640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd8a4099c20 0x7fd8a4086880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.309+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a4099c20 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.309+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd8a4099c20 0x7fd8a4086880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.309+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd8a4099c20 0x7fd8a4086880 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.309+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a801f070 con 0x7fd8a4099c20 2024-04-26T07:56:22.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.309+0000 7fd8b13f6640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd8a8031040 0x7fd8a8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.309+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a8031040 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.310+0000 7fd8b0bf5640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd8a8031040 0x7fd8a8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.310+0000 7fd8b0bf5640 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd8a8031040 0x7fd8a8032940 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.310+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.310+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.310+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.310+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.311+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.311+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.311+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.311+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a8031040 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.311+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.311+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a4099c20 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.311+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a801f070 con 0x7fd8a4099c20 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.311+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.312+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.312+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.312+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.312+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a8031040 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.312+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.312+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.312+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.312+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a4099c20 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.313+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd8a801f070 con 0x7fd8a4099c20 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.313+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.313+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.313+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.313+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.313+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a8031040 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.313+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.313+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.314+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.314+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.314+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.314+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.314+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.314+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.314+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.314+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a8031040 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.315+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.315+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.315+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.315+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a4099c20 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.315+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a801f070 con 0x7fd8a4099c20 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.315+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.315+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.315+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a8031040 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.316+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.316+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.316+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.316+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a8031040 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.317+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.317+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a4099c20 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.317+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a801f070 con 0x7fd8a4099c20 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.317+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef761160 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.317+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.317+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a8031040 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.317+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.317+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x5604ef75af10 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763b60 con 0x7fd8a4099c20 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a801f070 con 0x7fd8a4099c20 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef75fd70 con 0x5604ef75af10 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef760610 con 0x5604ef75af10 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.318+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef760610 con 0x5604ef75af10 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 20 zone default found 2024-04-26T07:56:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 4 Realm: () 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 20 zonegroup default 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef763fc0 con 0x7fd8a8031040 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7659f0 con 0x5604ef761160 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.319+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef765ec0 con 0x5604ef761160 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.320+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.320+0000 7fd8b4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.320+0000 7fd8b4f33800 20 started sync module instance, tier type = 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.320+0000 7fd8b4f33800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.320+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef764e40 con 0x7fd8a4099c20 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.321+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.321+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94579197366832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef764aa0 con 0x7fd8a4099c20 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.321+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef766df0 con 0x5604ef75af10 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.322+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94579197366832] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.322+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.322+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94579197371168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef766df0 con 0x5604ef75af10 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.322+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7677f0 con 0x5604ef761160 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.323+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94579197371168] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.323+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.323+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94579197372736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef766d60 con 0x5604ef761160 2024-04-26T07:56:22.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.323+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7686b0 con 0x7fd8a4099c20 2024-04-26T07:56:22.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.324+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94579197372736] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.324+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.324+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94579197379072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef768620 con 0x7fd8a4099c20 2024-04-26T07:56:22.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.324+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef769570 con 0x5604ef75af10 2024-04-26T07:56:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.326+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.326+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94579197382848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef769990 con 0x5604ef75af10 2024-04-26T07:56:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.326+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76a470 con 0x7fd8a8031040 2024-04-26T07:56:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.326+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94579197379072] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.327+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94579197382848] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.327+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.327+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94579197386624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7694e0 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.327+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76ad10 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.328+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94579197386624] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.328+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.328+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94579197381280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76ab20 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.328+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76b370 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94579197381280] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94579197388672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76b190 con 0x7fd8a8031040 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b4f33800 20 add_watcher() i=0 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b4f33800 20 add_watcher() i=1 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b4f33800 20 add_watcher() i=2 2024-04-26T07:56:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b4f33800 20 add_watcher() i=3 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b4f33800 20 add_watcher() i=4 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b4f33800 20 add_watcher() i=5 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.329+0000 7fd8b4f33800 20 add_watcher() i=6 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.330+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94579197388672] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.330+0000 7fd8b4f33800 20 add_watcher() i=7 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.330+0000 7fd8b4f33800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.330+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76e6d0 con 0x5604ef75af10 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.330+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.330+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94579197389856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76bb50 con 0x5604ef75af10 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.331+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94579197389856] v29'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.331+0000 7fd7677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.332+0000 7fd8b4f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.332+0000 7fd8b4f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.332+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76e490 con 0x5604ef75af10 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.333+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.333+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef777920 con 0x7fd8a8031040 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.334+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.334+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef777dd0 con 0x5604ef761160 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.335+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.335+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef778170 con 0x5604ef75af10 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.336+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.336+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef778170 con 0x7fd8a4099c20 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.337+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.337+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7786e0 con 0x5604ef761160 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.338+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.338+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef778a80 con 0x5604ef75af10 2024-04-26T07:56:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.339+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.339+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef778a80 con 0x7fd8a8031040 2024-04-26T07:56:22.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.340+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.340+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef778a80 con 0x7fd8a4099c20 2024-04-26T07:56:22.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.341+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.341+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef778ff0 con 0x5604ef761160 2024-04-26T07:56:22.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.342+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.342+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7795e0 con 0x7fd8a4099c20 2024-04-26T07:56:22.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.343+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.343+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779b50 con 0x7fd8a8031040 2024-04-26T07:56:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.344+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.344+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779b50 con 0x7fd8a4099c20 2024-04-26T07:56:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.345+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.345+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x7fd8a8031040 2024-04-26T07:56:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.346+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.346+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef75af10 2024-04-26T07:56:22.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.347+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.347+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.349+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.349+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x7fd8a4099c20 2024-04-26T07:56:22.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.350+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.350+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.351+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.351+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef75af10 2024-04-26T07:56:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.352+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.352+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef75af10 2024-04-26T07:56:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.353+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.353+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.354+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.354+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x7fd8a4099c20 2024-04-26T07:56:22.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.355+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.355+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.356+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.356+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.357+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.357+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.358+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.358+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.359+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.359+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x7fd8a8031040 2024-04-26T07:56:22.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.360+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.360+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.361+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.361+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x7fd8a8031040 2024-04-26T07:56:22.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.362+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.362+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x5604ef761160 2024-04-26T07:56:22.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.363+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.364+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x7fd8a8031040 2024-04-26T07:56:22.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.365+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'63 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.365+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef779f30 con 0x7fd8a4099c20 2024-04-26T07:56:22.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.366+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.366+0000 7fd7667e4640 20 reqs_thread_entry: start 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.366+0000 7fd8b4f33800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.366+0000 7fd8b4f33800 20 Filter name: none 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.366+0000 7fd75f7fe640 20 reqs_thread_entry: start 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.366+0000 7fd8b4f33800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.366+0000 7fd8b4f33800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.366+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7a4ef0 con 0x5604ef761160 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b4f33800 20 rados_obj.operate() r=0 bl.length=363 2024-04-26T07:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b4f33800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-04-26T07:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b4f33800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T07:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b4f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7a7910 con 0x5604ef761160 2024-04-26T07:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fd8a4084070 con 0x5604ef761160 2024-04-26T07:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b4f33800 10 removing key index: true_admin_akey 2024-04-26T07:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.367+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7a58f0 con 0x5604ef761160 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.368+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(96 true_admin_akey [delete] v29'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fd8a40b7040 con 0x5604ef761160 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.368+0000 7fd8b4f33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.368+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94579197633536 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7a7e20 con 0x7fd8a8031040 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.368+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== watch-notify(notify (1) cookie 94579197386624 notify 124554051629 ret 0) ==== 207+0+0 (crc 0 0 0) 0x5604ef7795e0 con 0x7fd8a8031040 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.368+0000 7fd787fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051629 cookie 94579197386624 notifier 4857 bl.length()=165 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.368+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(97 notify.5 [notify cookie 94579197633536 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.368+0000 7fd787fff640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fd774003d60 con 0x7fd8a8031040 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.369+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.369+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== watch-notify(notify_complete (2) cookie 94579197633536 notify 124554051629 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5604ef76e830 con 0x7fd8a8031040 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.369+0000 7fd8b4f33800 10 removing email index: 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.369+0000 7fd8b4f33800 10 removing user buckets index 2024-04-26T07:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.369+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7a7d20 con 0x5604ef761160 2024-04-26T07:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.370+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(99 a_user.buckets [delete] v29'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fd8a40b7040 con 0x5604ef761160 2024-04-26T07:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.370+0000 7fd8b4f33800 10 removing user index: a_user 2024-04-26T07:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.370+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7a7d20 con 0x5604ef761160 2024-04-26T07:56:22.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.370+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(100 a_user [call,call,delete] v29'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fd8a40b7040 con 0x5604ef761160 2024-04-26T07:56:22.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.370+0000 7fd8b4f33800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-04-26T07:56:22.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.370+0000 7fd8b4f33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-26T07:56:22.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.370+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94579197638768 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7a7c90 con 0x5604ef761160 2024-04-26T07:56:22.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.371+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 31 ==== watch-notify(notify (1) cookie 94579197372736 notify 124554051594 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5604ef778a80 con 0x5604ef761160 2024-04-26T07:56:22.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.371+0000 7fd7877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94579197372736 notifier 4857 bl.length()=155 2024-04-26T07:56:22.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.371+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 32 ==== osd_op_reply(101 notify.2 [notify cookie 94579197638768 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8a40b7040 con 0x5604ef761160 2024-04-26T07:56:22.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.371+0000 7fd7877fe640 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fd6d80032c0 con 0x5604ef761160 2024-04-26T07:56:22.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.371+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a40b7040 con 0x5604ef761160 2024-04-26T07:56:22.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.371+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 34 ==== watch-notify(notify_complete (2) cookie 94579197638768 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5604ef74f920 con 0x5604ef761160 2024-04-26T07:56:22.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.372+0000 7fd7677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.372+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94579197389856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef776cc0 con 0x5604ef75af10 2024-04-26T07:56:22.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.373+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94579197389856] v29'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.373+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94579197366832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef76abe0 con 0x7fd8a4099c20 2024-04-26T07:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.374+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94579197366832] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.374+0000 7fd8b4f33800 20 remove_watcher() i=0 2024-04-26T07:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.374+0000 7fd8b4f33800 2 removed watcher, disabling cache 2024-04-26T07:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.374+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94579197371168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef765230 con 0x5604ef75af10 2024-04-26T07:56:22.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.376+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94579197371168] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.376+0000 7fd8b4f33800 20 remove_watcher() i=1 2024-04-26T07:56:22.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.376+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94579197372736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef765230 con 0x5604ef761160 2024-04-26T07:56:22.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.377+0000 7fd8b03f4640 1 -- 172.21.15.62:0/1962700694 <== osd.3 v2:172.21.15.62:6816/1472283839 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94579197372736] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a40b7040 con 0x5604ef761160 2024-04-26T07:56:22.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.377+0000 7fd8b4f33800 20 remove_watcher() i=2 2024-04-26T07:56:22.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.377+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94579197379072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef766940 con 0x7fd8a4099c20 2024-04-26T07:56:22.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.378+0000 7fd8b13f6640 1 -- 172.21.15.62:0/1962700694 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94579197379072] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a8040040 con 0x7fd8a4099c20 2024-04-26T07:56:22.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.378+0000 7fd8b4f33800 20 remove_watcher() i=3 2024-04-26T07:56:22.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.378+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94579197382848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef768200 con 0x5604ef75af10 2024-04-26T07:56:22.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.379+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94579197382848] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x5604ef75af10 2024-04-26T07:56:22.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.379+0000 7fd8b4f33800 20 remove_watcher() i=4 2024-04-26T07:56:22.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.379+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94579197386624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef766940 con 0x7fd8a8031040 2024-04-26T07:56:22.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.380+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94579197386624] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.380+0000 7fd8b4f33800 20 remove_watcher() i=5 2024-04-26T07:56:22.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.380+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94579197381280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef7690c0 con 0x7fd8a8031040 2024-04-26T07:56:22.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.381+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94579197381280] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.381+0000 7fd8b4f33800 20 remove_watcher() i=6 2024-04-26T07:56:22.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.381+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94579197388672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5604ef768200 con 0x7fd8a8031040 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94579197388672] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a002d070 con 0x7fd8a8031040 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 20 remove_watcher() i=7 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd8a8031040 msgr2=0x7fd8a8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fd8a8031040 0x7fd8a8032940 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef75af10 msgr2=0x5604ef75d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef75af10 0x5604ef75d3d0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd8a4099c20 msgr2=0x7fd8a4086880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fd8a4099c20 0x7fd8a4086880 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604ef761160 msgr2=0x5604ef763550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5604ef761160 0x5604ef763550 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd77c036eb0 msgr2=0x7fd77c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd77c036eb0 0x7fd77c039370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5604ef7235a0 tx=0x7fd8a801f000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 msgr2=0x5604ef74f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b0bf5640 1 -- 172.21.15.62:0/1962700694 reap_dead start 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef74f3e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd8a408e700 tx=0x7fd8a408e690 comp rx=0 tx=0).stop 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 shutdown_connections 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/1962700694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef747e00 0x5604ef74f3e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 >> 172.21.15.62:0/1962700694 conn(0x5604ef7440d0 msgr2=0x5604ef741730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 shutdown_connections 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.382+0000 7fd8b4f33800 1 -- 172.21.15.62:0/1962700694 wait complete. 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/116347445 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd788036e60 msgr2=0x7fd788039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/116347445 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd788036e60 0x7fd788039320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5604ef72ab80 tx=0x7fd8a8005840 comp rx=0 tx=0).stop 2024-04-26T07:56:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/116347445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef73aaf0 msgr2=0x5604ef73af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/116347445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef73aaf0 0x5604ef73af10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4000c00 tx=0x7fd8a4002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/116347445 shutdown_connections 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/116347445 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd788036e60 0x7fd788039320 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/116347445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef73aaf0 0x5604ef73af10 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/116347445 >> 172.21.15.62:0/116347445 conn(0x5604ef72eb90 msgr2=0x5604ef72ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/116347445 shutdown_connections 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/116347445 wait complete. 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef627b00 msgr2=0x5604ef7299c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef627b00 0x5604ef7299c0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd798036e60 msgr2=0x7fd798039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd798036e60 0x7fd798039320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4054000 tx=0x7fd8a404e000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 msgr2=0x5604ef722780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef722780 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b210 tx=0x7fd8a0000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 shutdown_connections 2024-04-26T07:56:22.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5604ef627b00 0x5604ef7299c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fd798036e60 0x7fd798039320 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 --2- 172.21.15.62:0/3666810430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5604ef625fc0 0x5604ef722780 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 >> 172.21.15.62:0/3666810430 conn(0x5604ef621b80 msgr2=0x5604ef714de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 shutdown_connections 2024-04-26T07:56:22.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.383+0000 7fd8b4f33800 1 -- 172.21.15.62:0/3666810430 wait complete. 2024-04-26T07:56:22.388 ERROR:root:None 2024-04-26T07:56:22.389 ERROR:root:0 2024-04-26T07:56:22.389 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-26T07:56:22.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-26T07:56:22.389 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-04-26T07:56:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.438+0000 7f8f2d010800 1 Processor -- start 2024-04-26T07:56:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.438+0000 7f8f2d010800 1 -- start start 2024-04-26T07:56:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.439+0000 7f8f2d010800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557f3ab8ec90 0x557f3ab91080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.439+0000 7f8f2d010800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557f3ab915c0 con 0x557f3ab8b180 2024-04-26T07:56:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.439+0000 7f8f2d010800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x557f3aa2ce20 con 0x557f3ab8ec90 2024-04-26T07:56:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.439+0000 7f8f27f5b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557f3ab8ec90 0x557f3ab91080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.439+0000 7f8f27f5b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x557f3ab8ec90 0x557f3ab91080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41060/0 (socket says 172.21.15.62:41060) 2024-04-26T07:56:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.439+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2836198717 learned_addr learned my addr 172.21.15.62:0/2836198717 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.439+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2836198717 >> v1:172.21.15.1:6789/0 conn(0x557f3ab8b180 legacy=0x557f3ab8d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.439+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2836198717 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3ab927a0 con 0x557f3ab8ec90 2024-04-26T07:56:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.441+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/2836198717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8ec90 0x557f3ab91080 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00a520 tx=0x7f8f1c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb173ebd79d97f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.441+0000 7f8f2775a640 1 -- 172.21.15.62:0/2836198717 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c057070 con 0x557f3ab8ec90 2024-04-26T07:56:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.441+0000 7f8f2775a640 1 -- 172.21.15.62:0/2836198717 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c052570 con 0x557f3ab8ec90 2024-04-26T07:56:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.441+0000 7f8f2775a640 1 -- 172.21.15.62:0/2836198717 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c04ae60 con 0x557f3ab8ec90 2024-04-26T07:56:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.442+0000 7f8f2d010800 1 -- 172.21.15.62:0/2836198717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8ec90 msgr2=0x557f3ab91080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.442+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2836198717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8ec90 0x557f3ab91080 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00a520 tx=0x7f8f1c01d010 comp rx=0 tx=0).stop 2024-04-26T07:56:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.442+0000 7f8f2d010800 1 -- 172.21.15.62:0/2836198717 shutdown_connections 2024-04-26T07:56:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.442+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2836198717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8ec90 0x557f3ab91080 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.442+0000 7f8f2d010800 1 -- 172.21.15.62:0/2836198717 >> 172.21.15.62:0/2836198717 conn(0x557f3ab84bb0 msgr2=0x557f3ab86fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.442+0000 7f8f2d010800 1 -- 172.21.15.62:0/2836198717 shutdown_connections 2024-04-26T07:56:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.442+0000 7f8f2d010800 1 -- 172.21.15.62:0/2836198717 wait complete. 2024-04-26T07:56:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.454+0000 7f8f2d010800 1 Processor -- start 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.454+0000 7f8f2d010800 1 -- start start 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.455+0000 7f8f2d010800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ab8aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.455+0000 7f8f2d010800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f3aad5d00 con 0x557f3ab8b180 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.455+0000 7f8f2875c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ab8aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.455+0000 7f8f2875c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ab8aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41072/0 (socket says 172.21.15.62:41072) 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.455+0000 7f8f2875c640 1 -- 172.21.15.62:0/3175394064 learned_addr learned my addr 172.21.15.62:0/3175394064 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.455+0000 7f8f2875c640 1 -- 172.21.15.62:0/3175394064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3ab89080 con 0x557f3ab8b180 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.455+0000 7f8f2875c640 1 --2- 172.21.15.62:0/3175394064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ab8aac0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8f18001d20 tx=0x7f8f1800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acf36af88e25cda server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.455+0000 7f8e1660c640 1 -- 172.21.15.62:0/3175394064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1800f400 con 0x557f3ab8b180 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8e1660c640 1 -- 172.21.15.62:0/3175394064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1800f5a0 con 0x557f3ab8b180 2024-04-26T07:56:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8e1660c640 1 -- 172.21.15.62:0/3175394064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1800f7d0 con 0x557f3ab8b180 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8f2d010800 1 -- 172.21.15.62:0/3175394064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 msgr2=0x557f3ab8aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8f2d010800 1 --2- 172.21.15.62:0/3175394064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ab8aac0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8f18001d20 tx=0x7f8f1800b5b0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8f2d010800 1 -- 172.21.15.62:0/3175394064 shutdown_connections 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8f2d010800 1 --2- 172.21.15.62:0/3175394064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ab8aac0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8f2d010800 1 -- 172.21.15.62:0/3175394064 >> 172.21.15.62:0/3175394064 conn(0x557f3ab84bb0 msgr2=0x557f3ac77600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8f2d010800 1 -- 172.21.15.62:0/3175394064 shutdown_connections 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.456+0000 7f8f2d010800 1 -- 172.21.15.62:0/3175394064 wait complete. 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2d010800 1 Processor -- start 2024-04-26T07:56:22.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2d010800 1 -- start start 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2d010800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ac85a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2d010800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f3ab91a90 con 0x557f3ab8b180 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2875c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ac85a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2875c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ac85a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41084/0 (socket says 172.21.15.62:41084) 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2875c640 1 -- 172.21.15.62:0/2676712631 learned_addr learned my addr 172.21.15.62:0/2676712631 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2875c640 1 -- 172.21.15.62:0/2676712631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3ac85f70 con 0x557f3ab8b180 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.457+0000 7f8f2875c640 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ac85a30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x557f3ab8a0f0 tx=0x7f8f18000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.458+0000 7f8e14e09640 1 -- 172.21.15.62:0/2676712631 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1801a690 con 0x557f3ab8b180 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.458+0000 7f8e14e09640 1 -- 172.21.15.62:0/2676712631 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1801a830 con 0x557f3ab8b180 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.458+0000 7f8e14e09640 1 -- 172.21.15.62:0/2676712631 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1801ab30 con 0x557f3ab8b180 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.458+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f3ac86200 con 0x557f3ab8b180 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.458+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3ac88eb0 con 0x557f3ab8b180 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.458+0000 7f8e14e09640 1 -- 172.21.15.62:0/2676712631 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f18017070 con 0x557f3ab8b180 2024-04-26T07:56:22.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.459+0000 7f8e14e09640 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e10036eb0 0x7f8e10039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.459+0000 7f8e14e09640 1 -- 172.21.15.62:0/2676712631 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f8f18015020 con 0x557f3ab8b180 2024-04-26T07:56:22.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.459+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e10036eb0 0x7f8e10039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.459+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3ab8ec90 0x557f3ac8cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.459+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3ac8d1f0 con 0x557f3ab8ec90 2024-04-26T07:56:22.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.459+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3ab8ec90 0x557f3ac8cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.459+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e10036eb0 0x7f8e10039370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c054000 tx=0x7f8f1c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.459+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3ab8ec90 0x557f3ac8cc70 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.460+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2676712631 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f2000a4a0 con 0x557f3ab8ec90 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.460+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3ac8a240 con 0x557f3ab8ec90 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.460+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2676712631 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f2000a4a0 con 0x557f3ab8ec90 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.460+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3ac8eff0 con 0x557f3ab8ec90 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.460+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2676712631 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f2000a4a0 con 0x557f3ab8ec90 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.460+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3ac8e330 con 0x557f3ab8ec90 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.461+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2676712631 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f2000a4a0 con 0x557f3ab8ec90 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.461+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3ac8e780 con 0x557f3ab8ec90 2024-04-26T07:56:22.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.461+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2676712631 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f2000a4a0 con 0x557f3ab8ec90 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.461+0000 7f8f2d010800 1 Processor -- start 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.461+0000 7f8f2d010800 1 -- start start 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.461+0000 7f8f2d010800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ac9ddc0 0x557f3ac9e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.461+0000 7f8f2d010800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f3aa7d170 con 0x557f3ac9ddc0 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8f27f5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ac9ddc0 0x557f3ac9e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8f27f5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ac9ddc0 0x557f3ac9e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41092/0 (socket says 172.21.15.62:41092) 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8f27f5b640 1 -- 172.21.15.62:0/3133306300 learned_addr learned my addr 172.21.15.62:0/3133306300 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8f27f5b640 1 -- 172.21.15.62:0/3133306300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3ac9e720 con 0x557f3ac9ddc0 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/3133306300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ac9ddc0 0x557f3ac9e1e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c04b010 tx=0x7f8f1c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8e0dffb640 1 -- 172.21.15.62:0/3133306300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c057040 con 0x557f3ac9ddc0 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8e0dffb640 1 -- 172.21.15.62:0/3133306300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c05d900 con 0x557f3ac9ddc0 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8f2d010800 1 -- 172.21.15.62:0/3133306300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f3ac9f190 con 0x557f3ac9ddc0 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.462+0000 7f8e0dffb640 1 -- 172.21.15.62:0/3133306300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c05dbe0 con 0x557f3ac9ddc0 2024-04-26T07:56:22.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.463+0000 7f8f2d010800 1 -- 172.21.15.62:0/3133306300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3ac9f630 con 0x557f3ac9ddc0 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.463+0000 7f8e0dffb640 1 -- 172.21.15.62:0/3133306300 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f1c067070 con 0x557f3ac9ddc0 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.463+0000 7f8e0dffb640 1 --2- 172.21.15.62:0/3133306300 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e00036eb0 0x7f8e00039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.463+0000 7f8e0dffb640 1 -- 172.21.15.62:0/3133306300 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f8f1c08fed0 con 0x557f3ac9ddc0 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.463+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/3133306300 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e00036eb0 0x7f8e00039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f2d010800 1 Processor -- start 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f2d010800 1 -- start start 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/3133306300 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e00036eb0 0x7f8e00039370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x557f3ac8de50 tx=0x7f8f20005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f2d010800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3acab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f2d010800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f3ab89400 con 0x557f3acaafc0 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f27f5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3acab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f27f5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3acab3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41096/0 (socket says 172.21.15.62:41096) 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f27f5b640 1 -- 172.21.15.62:0/601217206 learned_addr learned my addr 172.21.15.62:0/601217206 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.464+0000 7f8f27f5b640 1 -- 172.21.15.62:0/601217206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3acab9b0 con 0x557f3acaafc0 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/601217206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3acab3e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c08e150 tx=0x7f8f1c067e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148a2ff0a67a43bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8e077fe640 1 -- 172.21.15.62:0/601217206 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c05b340 con 0x557f3acaafc0 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8e077fe640 1 -- 172.21.15.62:0/601217206 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c05ce30 con 0x557f3acaafc0 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8e077fe640 1 -- 172.21.15.62:0/601217206 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c070520 con 0x557f3acaafc0 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f2d010800 1 -- 172.21.15.62:0/601217206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 msgr2=0x557f3acab3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f2d010800 1 --2- 172.21.15.62:0/601217206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3acab3e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c08e150 tx=0x7f8f1c067e80 comp rx=0 tx=0).stop 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f2d010800 1 -- 172.21.15.62:0/601217206 shutdown_connections 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f2d010800 1 --2- 172.21.15.62:0/601217206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3acab3e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f2d010800 1 -- 172.21.15.62:0/601217206 >> 172.21.15.62:0/601217206 conn(0x557f3aca7320 msgr2=0x557f3aca5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f2d010800 1 -- 172.21.15.62:0/601217206 shutdown_connections 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f2d010800 1 -- 172.21.15.62:0/601217206 wait complete. 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.465+0000 7f8f2d010800 1 Processor -- start 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8f2d010800 1 -- start start 2024-04-26T07:56:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8f2d010800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3ac7f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8f2d010800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557f3acac120 con 0x557f3acaafc0 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8f27f5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3ac7f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8f27f5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3ac7f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41098/0 (socket says 172.21.15.62:41098) 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 learned_addr learned my addr 172.21.15.62:0/2871548825 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3ac7f700 con 0x557f3acaafc0 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3ac7f1c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c05d000 tx=0x7f8f1c08e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.466+0000 7f8e05ffb640 1 -- 172.21.15.62:0/2871548825 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c05b340 con 0x557f3acaafc0 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.467+0000 7f8e05ffb640 1 -- 172.21.15.62:0/2871548825 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c006380 con 0x557f3acaafc0 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.467+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f3ac7f990 con 0x557f3acaafc0 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.467+0000 7f8e05ffb640 1 -- 172.21.15.62:0/2871548825 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c071400 con 0x557f3acaafc0 2024-04-26T07:56:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.467+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3ac7bf50 con 0x557f3acaafc0 2024-04-26T07:56:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.467+0000 7f8e05ffb640 1 -- 172.21.15.62:0/2871548825 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f1c0715a0 con 0x557f3acaafc0 2024-04-26T07:56:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.467+0000 7f8e05ffb640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8df8036eb0 0x7f8df8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.467+0000 7f8e05ffb640 1 -- 172.21.15.62:0/2871548825 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f8f1c0a0d00 con 0x557f3acaafc0 2024-04-26T07:56:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.468+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8df8036eb0 0x7f8df8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.468+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8df8036eb0 0x7f8df8039370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x557f3ac86c50 tx=0x7f8f2001f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.468+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.468+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3acc2590 0x557f3acc4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.468+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acc51a0 con 0x557f3acc2590 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.468+0000 7f8f2875c640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3acc2590 0x557f3acc4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.468+0000 7f8f2875c640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3acc2590 0x557f3acc4a50 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 realm 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acc55b0 con 0x557f3acc2590 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:22.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acc5e80 con 0x557f3acc2590 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acc6220 con 0x557f3acc2590 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.469+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acc6a70 con 0x557f3acc2590 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.470+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.470+0000 7f8f2d010800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.470+0000 7f8f2d010800 20 searching for the correct realm 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.470+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f3acc87e0 0x557f3accabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.470+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc87e0 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.470+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f3acc87e0 0x557f3accabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.470+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f3acc87e0 0x557f3accabd0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.470+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.471+0000 7f8f27f5b640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f1c08e4f0 0x7f8f1c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.471+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.471+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f1c08e4f0 0x7f8f1c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.471+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f1c08e4f0 0x7f8f1c0707e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.471+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2001f070 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.471+0000 7f8f28f5d640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8f20031040 0x7f8f20032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.471+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f20031040 2024-04-26T07:56:22.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.471+0000 7f8f2875c640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8f20031040 0x7f8f20032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.472+0000 7f8f2875c640 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8f20031040 0x7f8f20032940 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.472+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.472+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc2590 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.472+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.472+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc2590 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.472+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.473+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc2590 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.473+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.473+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f20031040 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.473+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.473+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.473+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2001f070 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.473+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc87e0 2024-04-26T07:56:22.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.474+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.474+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc2590 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.474+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.474+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f20031040 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.474+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.474+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc2590 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.474+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.474+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f2001f070 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc87e0 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc87e0 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f20031040 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc87e0 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.475+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc87e0 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.476+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.476+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc2590 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.476+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.476+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc2590 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.476+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.476+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f20031040 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.476+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.476+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc87e0 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.477+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.477+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.477+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2001f070 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.477+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x557f3acc2590 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.477+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.477+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb200 con 0x7f8f20031040 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.477+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.477+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f1805f040 con 0x557f3acc87e0 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.478+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.478+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f1805f040 con 0x7f8f20031040 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.478+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.478+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f1805f040 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.478+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2001f070 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.478+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f1805f040 con 0x557f3acc87e0 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.478+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.478+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f1805f040 con 0x7f8f20031040 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f1805f040 con 0x557f3acc2590 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f1805f040 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2001f070 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2d010800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2d010800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2d010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2d010800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2d010800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:22.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2d010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.479+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acc7420 con 0x557f3acc2590 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acc7cc0 con 0x557f3acc2590 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acc7cc0 con 0x557f3acc2590 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 zone default found 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 4 Realm: () 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 zonegroup default 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3accb680 con 0x7f8f20031040 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.480+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3accd0e0 con 0x557f3acc87e0 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f2d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3accd5b0 con 0x557f3acc87e0 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f2d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f2d010800 20 started sync module instance, tier type = 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f2d010800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.481+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3accc500 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.482+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040040 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.482+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94004935706864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3accdec0 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.482+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acce710 con 0x557f3acc2590 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.483+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94004935706864] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040040 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.483+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.483+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94004935711248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acce360 con 0x557f3acc2590 2024-04-26T07:56:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.483+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3accee80 con 0x557f3acc87e0 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.484+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94004935711248] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.485+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.485+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94004935715152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3accf270 con 0x557f3acc87e0 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.485+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3accfc70 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.486+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94004935715152] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.486+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040040 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.486+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94004935712304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd0060 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.486+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd0ac0 con 0x557f3acc2590 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.487+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.487+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94004935722400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd0ac0 con 0x557f3acc2590 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.487+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd1a40 con 0x7f8f20031040 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.487+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94004935712304] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040040 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.488+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94004935722400] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.488+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.488+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94004935726384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd0ca0 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.488+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd0ca0 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.489+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94004935726384] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.489+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.489+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94004935718784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd1ed0 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.489+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd2890 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94004935718784] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94004935728128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd2890 con 0x7f8f20031040 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2d010800 20 add_watcher() i=0 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2d010800 20 add_watcher() i=1 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2d010800 20 add_watcher() i=2 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2d010800 20 add_watcher() i=3 2024-04-26T07:56:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2d010800 20 add_watcher() i=4 2024-04-26T07:56:22.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2d010800 20 add_watcher() i=5 2024-04-26T07:56:22.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.490+0000 7f8f2d010800 20 add_watcher() i=6 2024-04-26T07:56:22.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.491+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94004935728128] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.491+0000 7f8f2d010800 20 add_watcher() i=7 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.491+0000 7f8f2d010800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.491+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd5c90 con 0x557f3acc2590 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.492+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.492+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94004935730608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd3150 con 0x557f3acc2590 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.493+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94004935730608] v29'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.493+0000 7f8dde7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.493+0000 7f8f2d010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.493+0000 7f8f2d010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.493+0000 7f8f2d010800 5 note: GC not initialized 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.493+0000 7f8ddd7e2640 20 reqs_thread_entry: start 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.493+0000 7f8f2d010800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.493+0000 7f8f2d010800 20 Filter name: none 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8d4effd640 20 reqs_thread_entry: start 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2d010800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2d010800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3ad09490 con 0x7f8f20031040 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2d010800 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2d010800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2d010800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2d010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.494+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3ad0faa0 con 0x7f8f20031040 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.495+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.495+0000 7f8f2d010800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.495+0000 7f8f2d010800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.495+0000 7f8f2d010800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94004935980304 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f3ad0b1b0 con 0x557f3acc2590 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94004935722400 notify 124554051612 ret 0) ==== 708+0+0 (crc 0 0 0) 0x557f3ac88eb0 con 0x557f3acc2590 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8e077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94004935722400 notifier 4864 bl.length()=666 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8e077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8e077fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8e077fe640 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8dec003ea0 con 0x557f3acc2590 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94004935980304 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.496+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94004935980304 notify 124554051612 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557f3ac86200 con 0x557f3acc2590 2024-04-26T07:56:22.499 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.497+0000 7f8dde7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.497+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94004935730608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd5380 con 0x557f3acc2590 2024-04-26T07:56:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.498+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94004935730608] v29'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.498+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94004935706864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd2580 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.499+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94004935706864] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040040 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.499+0000 7f8f2d010800 20 remove_watcher() i=0 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.499+0000 7f8f2d010800 2 removed watcher, disabling cache 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.499+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94004935711248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3accc8f0 con 0x557f3acc2590 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.500+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94004935711248] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.500+0000 7f8f2d010800 20 remove_watcher() i=1 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.500+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94004935715152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3accda10 con 0x557f3acc87e0 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.501+0000 7f8f27f5b640 1 -- 172.21.15.62:0/2871548825 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94004935715152] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1c09c020 con 0x557f3acc87e0 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.501+0000 7f8f2d010800 20 remove_watcher() i=2 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.502+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94004935712304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acce950 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.503+0000 7f8f28f5d640 1 -- 172.21.15.62:0/2871548825 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94004935712304] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040040 con 0x7f8f1c08e4f0 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.503+0000 7f8f2d010800 20 remove_watcher() i=3 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.503+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94004935722400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd2580 con 0x557f3acc2590 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.504+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94004935722400] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x557f3acc2590 2024-04-26T07:56:22.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.504+0000 7f8f2d010800 20 remove_watcher() i=4 2024-04-26T07:56:22.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.504+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94004935726384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd2580 con 0x7f8f20031040 2024-04-26T07:56:22.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.505+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94004935726384] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.505+0000 7f8f2d010800 20 remove_watcher() i=5 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.505+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94004935718784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd1530 con 0x7f8f20031040 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.506+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94004935718784] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.506+0000 7f8f2d010800 20 remove_watcher() i=6 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.506+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94004935728128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f3acd2580 con 0x7f8f20031040 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94004935728128] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1802e070 con 0x7f8f20031040 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 20 remove_watcher() i=7 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8f20031040 msgr2=0x7f8f20032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8f20031040 0x7f8f20032940 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3acc2590 msgr2=0x557f3acc4a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3acc2590 0x557f3acc4a50 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f1c08e4f0 msgr2=0x7f8f1c0707e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8f1c08e4f0 0x7f8f1c0707e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f3acc87e0 msgr2=0x557f3accabd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x557f3acc87e0 0x557f3accabd0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8df8036eb0 msgr2=0x7f8df8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8df8036eb0 0x7f8df8039370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x557f3ac86c50 tx=0x7f8f2001f000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 msgr2=0x557f3ac7f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2871548825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3acaafc0 0x557f3ac7f1c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c05d000 tx=0x7f8f1c08e0e0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 reap_dead start 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2875c640 1 -- 172.21.15.62:0/2871548825 reap_dead start 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 shutdown_connections 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 >> 172.21.15.62:0/2871548825 conn(0x557f3aca7320 msgr2=0x557f3aca4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 shutdown_connections 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.507+0000 7f8f2d010800 1 -- 172.21.15.62:0/2871548825 wait complete. 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/3133306300 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e00036eb0 msgr2=0x7f8e00039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/3133306300 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e00036eb0 0x7f8e00039370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x557f3ac8de50 tx=0x7f8f20005840 comp rx=0 tx=0).stop 2024-04-26T07:56:22.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/3133306300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ac9ddc0 msgr2=0x557f3ac9e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/3133306300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ac9ddc0 0x557f3ac9e1e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c04b010 tx=0x7f8f1c002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/3133306300 shutdown_connections 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/3133306300 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e00036eb0 0x7f8e00039370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/3133306300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ac9ddc0 0x557f3ac9e1e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/3133306300 >> 172.21.15.62:0/3133306300 conn(0x557f3ac91e60 msgr2=0x557f3ac92260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/3133306300 shutdown_connections 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/3133306300 wait complete. 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3ab8ec90 msgr2=0x557f3ac8cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3ab8ec90 0x557f3ac8cc70 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e10036eb0 msgr2=0x7f8e10039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e10036eb0 0x7f8e10039370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c054000 tx=0x7f8f1c04e000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 msgr2=0x557f3ac85a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ac85a30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x557f3ab8a0f0 tx=0x7f8f18000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 shutdown_connections 2024-04-26T07:56:22.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x557f3ab8ec90 0x557f3ac8cc70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f8e10036eb0 0x7f8e10039370 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 --2- 172.21.15.62:0/2676712631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557f3ab8b180 0x557f3ac85a30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 >> 172.21.15.62:0/2676712631 conn(0x557f3ab84bb0 msgr2=0x557f3ab89960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 shutdown_connections 2024-04-26T07:56:22.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.508+0000 7f8f2d010800 1 -- 172.21.15.62:0/2676712631 wait complete. 2024-04-26T07:56:22.514 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.514 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.514 ERROR:root:0 2024-04-26T07:56:22.514 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:22.519 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:22.519 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-26T07:56:22.520 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-26T07:56:22.520 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-04-26T07:56:22.566 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:22.566 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a98813800 1 Processor -- start 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a98813800 1 -- start start 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a98813800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5590668baa70 0x5590668bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a98813800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5590668bd430 con 0x5590668b6ac0 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a98813800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x559066759e20 con 0x5590668baa70 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a93746640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5590668baa70 0x5590668bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a93f47640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5590668b6ac0 0x5590668b6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33230/0 (socket says 172.21.15.62:33230) 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a93746640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5590668baa70 0x5590668bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41100/0 (socket says 172.21.15.62:41100) 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a93f47640 1 -- 172.21.15.62:0/193864316 learned_addr learned my addr 172.21.15.62:0/193864316 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a93746640 1 -- 172.21.15.62:0/193864316 >> v1:172.21.15.1:6789/0 conn(0x5590668b6ac0 legacy=0x5590668b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a92f45640 1 -- 172.21.15.62:0/193864316 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815174235 0 0) 0x5590668bd430 con 0x5590668b6ac0 2024-04-26T07:56:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.570+0000 7f8a93746640 1 -- 172.21.15.62:0/193864316 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590668be660 con 0x5590668baa70 2024-04-26T07:56:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.572+0000 7f8a93746640 1 --2- 172.21.15.62:0/193864316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668baa70 0x5590668bce60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800a470 tx=0x7f8a8801cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3dcf4168f0457 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a92f45640 1 -- 172.21.15.62:0/193864316 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88057070 con 0x5590668baa70 2024-04-26T07:56:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a92f45640 1 -- 172.21.15.62:0/193864316 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a88052570 con 0x5590668baa70 2024-04-26T07:56:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a92f45640 1 -- 172.21.15.62:0/193864316 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88052870 con 0x5590668baa70 2024-04-26T07:56:22.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a98813800 1 -- 172.21.15.62:0/193864316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668baa70 msgr2=0x5590668bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a98813800 1 --2- 172.21.15.62:0/193864316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668baa70 0x5590668bce60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800a470 tx=0x7f8a8801cf20 comp rx=0 tx=0).stop 2024-04-26T07:56:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a98813800 1 -- 172.21.15.62:0/193864316 shutdown_connections 2024-04-26T07:56:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a98813800 1 --2- 172.21.15.62:0/193864316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668baa70 0x5590668bce60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a98813800 1 -- 172.21.15.62:0/193864316 >> 172.21.15.62:0/193864316 conn(0x5590668b1360 msgr2=0x5590668b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a98813800 1 -- 172.21.15.62:0/193864316 shutdown_connections 2024-04-26T07:56:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.573+0000 7f8a98813800 1 -- 172.21.15.62:0/193864316 wait complete. 2024-04-26T07:56:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.586+0000 7f8a98813800 1 Processor -- start 2024-04-26T07:56:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.586+0000 7f8a98813800 1 -- start start 2024-04-26T07:56:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.586+0000 7f8a98813800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669a6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.586+0000 7f8a98813800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559066802d00 con 0x5590668b6ac0 2024-04-26T07:56:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.586+0000 7f8a93f47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.586+0000 7f8a93f47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41108/0 (socket says 172.21.15.62:41108) 2024-04-26T07:56:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.586+0000 7f8a93f47640 1 -- 172.21.15.62:0/868192445 learned_addr learned my addr 172.21.15.62:0/868192445 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.586+0000 7f8a93f47640 1 -- 172.21.15.62:0/868192445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590669a6ef0 con 0x5590668b6ac0 2024-04-26T07:56:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.587+0000 7f8a93f47640 1 --2- 172.21.15.62:0/868192445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669a6920 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400b240 tx=0x7f8a8400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa80c0074b7f2bc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.587+0000 7f8981e0b640 1 -- 172.21.15.62:0/868192445 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a84008070 con 0x5590668b6ac0 2024-04-26T07:56:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.587+0000 7f8981e0b640 1 -- 172.21.15.62:0/868192445 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8400d500 con 0x5590668b6ac0 2024-04-26T07:56:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.587+0000 7f8981e0b640 1 -- 172.21.15.62:0/868192445 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a8400d860 con 0x5590668b6ac0 2024-04-26T07:56:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.587+0000 7f8a98813800 1 -- 172.21.15.62:0/868192445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 msgr2=0x5590669a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.587+0000 7f8a98813800 1 --2- 172.21.15.62:0/868192445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669a6920 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400b240 tx=0x7f8a8400b700 comp rx=0 tx=0).stop 2024-04-26T07:56:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.587+0000 7f8a98813800 1 -- 172.21.15.62:0/868192445 shutdown_connections 2024-04-26T07:56:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.587+0000 7f8a98813800 1 --2- 172.21.15.62:0/868192445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669a6920 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a98813800 1 -- 172.21.15.62:0/868192445 >> 172.21.15.62:0/868192445 conn(0x5590668b1360 msgr2=0x5590669a2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a98813800 1 -- 172.21.15.62:0/868192445 shutdown_connections 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a98813800 1 -- 172.21.15.62:0/868192445 wait complete. 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a98813800 1 Processor -- start 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a98813800 1 -- start start 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a98813800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a98813800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5590668bd900 con 0x5590668b6ac0 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a93f47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a93f47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41118/0 (socket says 172.21.15.62:41118) 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.588+0000 7f8a93f47640 1 -- 172.21.15.62:0/575876186 learned_addr learned my addr 172.21.15.62:0/575876186 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.589+0000 7f8a93f47640 1 -- 172.21.15.62:0/575876186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590669ae9e0 con 0x5590668b6ac0 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.589+0000 7f8a93f47640 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669ae4a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x5590669a76b0 tx=0x7f8a84000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.589+0000 7f897bfff640 1 -- 172.21.15.62:0/575876186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a84019870 con 0x5590668b6ac0 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.589+0000 7f897bfff640 1 -- 172.21.15.62:0/575876186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a84019a10 con 0x5590668b6ac0 2024-04-26T07:56:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.589+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590669aec70 con 0x5590668b6ac0 2024-04-26T07:56:22.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.589+0000 7f897bfff640 1 -- 172.21.15.62:0/575876186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a84019d30 con 0x5590668b6ac0 2024-04-26T07:56:22.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.589+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590669b1920 con 0x5590668b6ac0 2024-04-26T07:56:22.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.590+0000 7f897bfff640 1 -- 172.21.15.62:0/575876186 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8a84017040 con 0x5590668b6ac0 2024-04-26T07:56:22.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.590+0000 7f897bfff640 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f897c036eb0 0x7f897c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.590+0000 7f897bfff640 1 -- 172.21.15.62:0/575876186 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f8a84015020 con 0x5590668b6ac0 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.590+0000 7f8a93746640 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f897c036eb0 0x7f897c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.590+0000 7f8a98813800 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590668baa70 0x5590669b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.590+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669b5c70 con 0x5590668baa70 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.590+0000 7f8a94748640 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590668baa70 0x5590669b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.591+0000 7f8a93746640 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f897c036eb0 0x7f897c039370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8a88054000 tx=0x7f8a8804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.591+0000 7f8a94748640 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590668baa70 0x5590669b56e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.591+0000 7f8a94748640 1 -- 172.21.15.62:0/575876186 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a8c00a4a0 con 0x5590668baa70 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.591+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669b2c90 con 0x5590668baa70 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.591+0000 7f8a94748640 1 -- 172.21.15.62:0/575876186 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a8c00a4a0 con 0x5590668baa70 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.591+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669b7a90 con 0x5590668baa70 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.592+0000 7f8a94748640 1 -- 172.21.15.62:0/575876186 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a8c00a4a0 con 0x5590668baa70 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.592+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669b6dd0 con 0x5590668baa70 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.592+0000 7f8a94748640 1 -- 172.21.15.62:0/575876186 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a8c00a4a0 con 0x5590668baa70 2024-04-26T07:56:22.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.592+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669b71f0 con 0x5590668baa70 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.592+0000 7f8a94748640 1 -- 172.21.15.62:0/575876186 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a8c00a4a0 con 0x5590668baa70 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.593+0000 7f8a98813800 1 Processor -- start 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.593+0000 7f8a98813800 1 -- start start 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.593+0000 7f8a98813800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669c68a0 0x5590669c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.593+0000 7f8a98813800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5590667aa170 con 0x5590669c68a0 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.593+0000 7f8a93746640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669c68a0 0x5590669c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.593+0000 7f8a93746640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669c68a0 0x5590669c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41120/0 (socket says 172.21.15.62:41120) 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.593+0000 7f8a93746640 1 -- 172.21.15.62:0/2239482578 learned_addr learned my addr 172.21.15.62:0/2239482578 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.593+0000 7f8a93746640 1 -- 172.21.15.62:0/2239482578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590669c7200 con 0x5590669c68a0 2024-04-26T07:56:22.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.594+0000 7f8a93746640 1 --2- 172.21.15.62:0/2239482578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669c68a0 0x5590669c6cc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8a88000c00 tx=0x7f8a88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.594+0000 7f89797fa640 1 -- 172.21.15.62:0/2239482578 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88057040 con 0x5590669c68a0 2024-04-26T07:56:22.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.594+0000 7f89797fa640 1 -- 172.21.15.62:0/2239482578 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8806d070 con 0x5590669c68a0 2024-04-26T07:56:22.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.594+0000 7f8a98813800 1 -- 172.21.15.62:0/2239482578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590669c7c70 con 0x5590669c68a0 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.594+0000 7f89797fa640 1 -- 172.21.15.62:0/2239482578 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a8805dc70 con 0x5590669c68a0 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.594+0000 7f8a98813800 1 -- 172.21.15.62:0/2239482578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590669c8110 con 0x5590669c68a0 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f89797fa640 1 -- 172.21.15.62:0/2239482578 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8a88067070 con 0x5590669c68a0 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f89797fa640 1 --2- 172.21.15.62:0/2239482578 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f896c036e60 0x7f896c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f89797fa640 1 -- 172.21.15.62:0/2239482578 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f8a88090160 con 0x5590669c68a0 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f8a94748640 1 --2- 172.21.15.62:0/2239482578 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f896c036e60 0x7f896c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f8a98813800 1 Processor -- start 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f8a98813800 1 -- start start 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f8a94748640 1 --2- 172.21.15.62:0/2239482578 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f896c036e60 0x7f896c039320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5590669b7170 tx=0x7f8a8c005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f8a98813800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669d8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.595+0000 7f8a98813800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5590669a7270 con 0x5590669d7f30 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8a93746640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669d8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8a93746640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669d8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41134/0 (socket says 172.21.15.62:41134) 2024-04-26T07:56:22.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8a93746640 1 -- 172.21.15.62:0/1214989984 learned_addr learned my addr 172.21.15.62:0/1214989984 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8a93746640 1 -- 172.21.15.62:0/1214989984 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590669d8920 con 0x5590669d7f30 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8a93746640 1 --2- 172.21.15.62:0/1214989984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669d8350 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8a8808e4a0 tx=0x7f8a88067480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08c1f1ffc71c5a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8972ffd640 1 -- 172.21.15.62:0/1214989984 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a8807f020 con 0x5590669d7f30 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8972ffd640 1 -- 172.21.15.62:0/1214989984 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a88067520 con 0x5590669d7f30 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8972ffd640 1 -- 172.21.15.62:0/1214989984 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88067730 con 0x5590669d7f30 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8a98813800 1 -- 172.21.15.62:0/1214989984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 msgr2=0x5590669d8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.596+0000 7f8a98813800 1 --2- 172.21.15.62:0/1214989984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669d8350 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8a8808e4a0 tx=0x7f8a88067480 comp rx=0 tx=0).stop 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 -- 172.21.15.62:0/1214989984 shutdown_connections 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 --2- 172.21.15.62:0/1214989984 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669d8350 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 -- 172.21.15.62:0/1214989984 >> 172.21.15.62:0/1214989984 conn(0x5590669cfe80 msgr2=0x5590669cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 -- 172.21.15.62:0/1214989984 shutdown_connections 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 -- 172.21.15.62:0/1214989984 wait complete. 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 Processor -- start 2024-04-26T07:56:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 -- start start 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a98813800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5590669d9090 con 0x5590669d7f30 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a93746640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a93746640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669df5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41140/0 (socket says 172.21.15.62:41140) 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.597+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 learned_addr learned my addr 172.21.15.62:0/1697427628 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.598+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590669dfae0 con 0x5590669d7f30 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.598+0000 7f8a93746640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669df5a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8a88067f50 tx=0x7f8a8808e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.598+0000 7f89717fa640 1 -- 172.21.15.62:0/1697427628 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88094070 con 0x5590669d7f30 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.598+0000 7f89717fa640 1 -- 172.21.15.62:0/1697427628 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a88072460 con 0x5590669d7f30 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.598+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590669dfd70 con 0x5590669d7f30 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.598+0000 7f89717fa640 1 -- 172.21.15.62:0/1697427628 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88006e90 con 0x5590669d7f30 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.598+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590669e2a20 con 0x5590669d7f30 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.599+0000 7f89717fa640 1 -- 172.21.15.62:0/1697427628 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8a88082020 con 0x5590669d7f30 2024-04-26T07:56:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.599+0000 7f89717fa640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f895c036e60 0x7f895c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.599+0000 7f89717fa640 1 -- 172.21.15.62:0/1697427628 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f8a8809ad70 con 0x5590669d7f30 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.599+0000 7f8a94748640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f895c036e60 0x7f895c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590669eb0a0 0x5590669ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669edcb0 con 0x5590669eb0a0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a94748640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f895c036e60 0x7f895c039320 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5590669b68f0 tx=0x7f8a8c01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a93f47640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590669eb0a0 0x5590669ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a93f47640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590669eb0a0 0x5590669ed560 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 20 realm 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669ee0c0 con 0x5590669eb0a0 2024-04-26T07:56:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.600+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669ee990 con 0x5590669eb0a0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669eed30 con 0x5590669eb0a0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669ef580 con 0x5590669eb0a0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:22.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 20 searching for the correct realm 2024-04-26T07:56:22.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5590669f12f0 0x5590669f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.601+0000 7f8a93746640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5590669f12f0 0x5590669f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.602+0000 7f8a93746640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5590669f12f0 0x5590669f36e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.602+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.602+0000 7f8a93746640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8a88084070 0x7f8a88085890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.602+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a88084070 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.602+0000 7f8a94748640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8a88084070 0x7f8a88085890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.602+0000 7f8a94748640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8a88084070 0x7f8a88085890 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.603+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8c01f070 con 0x7f8a88084070 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.603+0000 7f8a94748640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8a8c031040 0x7f8a8c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.603+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a8c031040 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.603+0000 7f8a93f47640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8a8c031040 0x7f8a8c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.603+0000 7f8a93f47640 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8a8c031040 0x7f8a8c032940 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.604+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.604+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.604+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.604+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.604+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.604+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.604+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.604+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a8c031040 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.605+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.605+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a88084070 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.605+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8c01f070 con 0x7f8a88084070 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.605+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.605+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.605+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.605+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.605+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a8c031040 2024-04-26T07:56:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.606+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.606+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.606+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.606+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a88084070 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.606+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8a8c01f070 con 0x7f8a88084070 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.606+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.606+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.606+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.607+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.607+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a8c031040 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.607+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.607+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.607+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.607+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.607+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.607+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.608+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.608+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.608+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.608+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a8c031040 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.608+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.608+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.608+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.608+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a88084070 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.609+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8c01f070 con 0x7f8a88084070 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.609+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.609+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.609+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a8c031040 2024-04-26T07:56:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.609+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.609+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.610+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.610+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a8c031040 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.610+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.610+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a88084070 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.610+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8c01f070 con 0x7f8a88084070 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.610+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669f12f0 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.610+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.610+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a8c031040 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x5590669eb0a0 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590669f3cf0 con 0x7f8a88084070 2024-04-26T07:56:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a8c01f070 con 0x7f8a88084070 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669eff00 con 0x5590669eb0a0 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.611+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669f07a0 con 0x5590669eb0a0 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669f4170 con 0x5590669eb0a0 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 20 zone default found 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 4 Realm: () 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 20 zonegroup default 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669f41e0 con 0x7f8a8c031040 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669f6000 con 0x5590669f12f0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.612+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.613+0000 7f8a98813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.613+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.613+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669f63d0 con 0x5590669f12f0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.613+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.613+0000 7f8a98813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.613+0000 7f8a98813800 20 started sync module instance, tier type = 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.613+0000 7f8a98813800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.613+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f54a0 con 0x7f8a88084070 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.614+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8c040040 con 0x7f8a88084070 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.614+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94078685370512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f6ce0 con 0x7f8a88084070 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.614+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f7530 con 0x5590669eb0a0 2024-04-26T07:56:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.615+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.615+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94078685375712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f7710 con 0x5590669eb0a0 2024-04-26T07:56:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.615+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f8230 con 0x5590669f12f0 2024-04-26T07:56:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.615+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94078685370512] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8c040040 con 0x7f8a88084070 2024-04-26T07:56:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.616+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94078685375712] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.616+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.616+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94078685379840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f7160 con 0x5590669f12f0 2024-04-26T07:56:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.616+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f8ad0 con 0x7f8a88084070 2024-04-26T07:56:22.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.617+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94078685379840] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.617+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8c040040 con 0x7f8a88084070 2024-04-26T07:56:22.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.617+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94078685382176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f8a40 con 0x7f8a88084070 2024-04-26T07:56:22.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.617+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f9990 con 0x5590669eb0a0 2024-04-26T07:56:22.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.618+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.618+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94078685385952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f9940 con 0x5590669eb0a0 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.618+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fa930 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.619+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94078685382176] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8c040040 con 0x7f8a88084070 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.619+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94078685385952] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.620+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.620+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94078685389824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fa8f0 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.620+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f9ea0 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.621+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(56 notify.6 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.621+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94078685392048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fb580 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.621+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fbdd0 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.621+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94078685389824] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94078685392048] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94078685393104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fb9a0 con 0x7f8a8c031040 2024-04-26T07:56:22.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a98813800 20 add_watcher() i=0 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a98813800 20 add_watcher() i=1 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a98813800 20 add_watcher() i=2 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a98813800 20 add_watcher() i=3 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a98813800 20 add_watcher() i=4 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a98813800 20 add_watcher() i=5 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.622+0000 7f8a98813800 20 add_watcher() i=6 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.623+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94078685393104] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.623+0000 7f8a98813800 20 add_watcher() i=7 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.623+0000 7f8a98813800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.623+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590669feb40 con 0x5590669eb0a0 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.623+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.624+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94078685394160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fbdc0 con 0x5590669eb0a0 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94078685394160] v29'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8949fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a98813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a98813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a98813800 5 note: GC not initialized 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8948fe1640 20 reqs_thread_entry: start 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a98813800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a98813800 20 Filter name: none 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f88c27fc640 20 reqs_thread_entry: start 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a98813800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a98813800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.625+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559066a323a0 con 0x7f8a8c031040 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.626+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.626+0000 7f8a98813800 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.626+0000 7f8a98813800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:22.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.626+0000 7f8a98813800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.626+0000 7f8a98813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.626+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559066a38d10 con 0x7f8a8c031040 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x7f8a8c031040 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8a98813800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8a98813800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8a98813800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94078685644672 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559066a343e0 con 0x5590669eb0a0 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94078685385952 notify 124554051613 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5590669b1920 con 0x5590669eb0a0 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8972ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94078685385952 notifier 4871 bl.length()=666 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8972ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8972ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8972ffd640 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8958003ea0 con 0x5590669eb0a0 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.627+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94078685644672 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.628+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8402d070 con 0x5590669eb0a0 2024-04-26T07:56:22.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.628+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94078685644672 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5590669aec70 con 0x5590669eb0a0 2024-04-26T07:56:22.632 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:22.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.629+0000 7f8949fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.629+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94078685394160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559066a347a0 con 0x5590669eb0a0 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.630+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94078685394160] v29'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a84061040 con 0x5590669eb0a0 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.630+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94078685370512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fb4f0 con 0x7f8a88084070 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.631+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94078685370512] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8c040040 con 0x7f8a88084070 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.631+0000 7f8a98813800 20 remove_watcher() i=0 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.631+0000 7f8a98813800 2 removed watcher, disabling cache 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.631+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94078685375712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fb4f0 con 0x5590669eb0a0 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.632+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94078685375712] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a84061040 con 0x5590669eb0a0 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.632+0000 7f8a98813800 20 remove_watcher() i=1 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.632+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94078685379840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fb4f0 con 0x5590669f12f0 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.633+0000 7f8a93746640 1 -- 172.21.15.62:0/1697427628 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94078685379840] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a88066030 con 0x5590669f12f0 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.633+0000 7f8a98813800 20 remove_watcher() i=2 2024-04-26T07:56:22.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.633+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94078685382176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f7d00 con 0x7f8a88084070 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.634+0000 7f8a94748640 1 -- 172.21.15.62:0/1697427628 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94078685382176] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a8c040040 con 0x7f8a88084070 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.634+0000 7f8a98813800 20 remove_watcher() i=3 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.634+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94078685385952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f8620 con 0x5590669eb0a0 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.635+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94078685385952] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a84061040 con 0x5590669eb0a0 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.635+0000 7f8a98813800 20 remove_watcher() i=4 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.635+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94078685389824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f94e0 con 0x7f8a8c031040 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.637+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94078685389824] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a84061040 con 0x7f8a8c031040 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.637+0000 7f8a98813800 20 remove_watcher() i=5 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.637+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94078685392048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669f8620 con 0x7f8a8c031040 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.638+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94078685392048] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a84061040 con 0x7f8a8c031040 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.638+0000 7f8a98813800 20 remove_watcher() i=6 2024-04-26T07:56:22.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.638+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94078685393104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590669fa400 con 0x7f8a8c031040 2024-04-26T07:56:22.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94078685393104] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a84061040 con 0x7f8a8c031040 2024-04-26T07:56:22.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 20 remove_watcher() i=7 2024-04-26T07:56:22.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8a8c031040 msgr2=0x7f8a8c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f8a8c031040 0x7f8a8c032940 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590669eb0a0 msgr2=0x5590669ed560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590669eb0a0 0x5590669ed560 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8a88084070 msgr2=0x7f8a88085890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f8a88084070 0x7f8a88085890 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5590669f12f0 msgr2=0x5590669f36e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5590669f12f0 0x5590669f36e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f895c036e60 msgr2=0x7f895c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f895c036e60 0x7f895c039320 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5590669b68f0 tx=0x7f8a8c01f000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 msgr2=0x5590669df5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a93f47640 1 -- 172.21.15.62:0/1697427628 reap_dead start 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669df5a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8a88067f50 tx=0x7f8a8808e430 comp rx=0 tx=0).stop 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 shutdown_connections 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/1697427628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669d7f30 0x5590669df5a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 >> 172.21.15.62:0/1697427628 conn(0x5590669cfe80 msgr2=0x5590669cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 shutdown_connections 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/1697427628 wait complete. 2024-04-26T07:56:22.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/2239482578 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f896c036e60 msgr2=0x7f896c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/2239482578 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f896c036e60 0x7f896c039320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5590669b7170 tx=0x7f8a8c005840 comp rx=0 tx=0).stop 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/2239482578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669c68a0 msgr2=0x5590669c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/2239482578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669c68a0 0x5590669c6cc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8a88000c00 tx=0x7f8a88002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/2239482578 shutdown_connections 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/2239482578 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f896c036e60 0x7f896c039320 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 --2- 172.21.15.62:0/2239482578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590669c68a0 0x5590669c6cc0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/2239482578 >> 172.21.15.62:0/2239482578 conn(0x5590669ba940 msgr2=0x5590669bad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/2239482578 shutdown_connections 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.639+0000 7f8a98813800 1 -- 172.21.15.62:0/2239482578 wait complete. 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590668baa70 msgr2=0x5590669b56e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590668baa70 0x5590669b56e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f897c036eb0 msgr2=0x7f897c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f897c036eb0 0x7f897c039370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8a88054000 tx=0x7f8a8804e000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 msgr2=0x5590669ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669ae4a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x5590669a76b0 tx=0x7f8a84000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 shutdown_connections 2024-04-26T07:56:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5590668baa70 0x5590669b56e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f897c036eb0 0x7f897c039370 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 --2- 172.21.15.62:0/575876186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590668b6ac0 0x5590669ae4a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 >> 172.21.15.62:0/575876186 conn(0x5590668b1360 msgr2=0x5590669a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 shutdown_connections 2024-04-26T07:56:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.640+0000 7f8a98813800 1 -- 172.21.15.62:0/575876186 wait complete. 2024-04-26T07:56:22.646 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.646 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.646 ERROR:root:0 2024-04-26T07:56:22.646 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:22.651 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:22.651 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T07:56:22.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T07:56:22.652 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T07:56:22.698 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:22.698 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce0dd36800 1 Processor -- start 2024-04-26T07:56:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce0dd36800 1 -- start start 2024-04-26T07:56:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce0dd36800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ecf1912ae0 0x55ecf1914ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce0dd36800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ecf19154a0 con 0x55ecf190e740 2024-04-26T07:56:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce0dd36800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55ecf17b0e20 con 0x55ecf1912ae0 2024-04-26T07:56:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce092cb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ecf1912ae0 0x55ecf1914ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce092cb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55ecf1912ae0 0x55ecf1914ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41150/0 (socket says 172.21.15.62:41150) 2024-04-26T07:56:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce09acc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55ecf190e740 0x55ecf190eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33244/0 (socket says 172.21.15.62:33244) 2024-04-26T07:56:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce092cb640 1 -- 172.21.15.62:0/3649174589 learned_addr learned my addr 172.21.15.62:0/3649174589 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce092cb640 1 -- 172.21.15.62:0/3649174589 >> v1:172.21.15.1:6789/0 conn(0x55ecf190e740 legacy=0x55ecf190eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.702+0000 7fce092cb640 1 -- 172.21.15.62:0/3649174589 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf19166d0 con 0x55ecf1912ae0 2024-04-26T07:56:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.704+0000 7fce092cb640 1 --2- 172.21.15.62:0/3649174589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1912ae0 0x55ecf1914ed0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fce0000a520 tx=0x7fce0001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32759becc4f211c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.704+0000 7fce08aca640 1 -- 172.21.15.62:0/3649174589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce00057070 con 0x55ecf1912ae0 2024-04-26T07:56:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.704+0000 7fce08aca640 1 -- 172.21.15.62:0/3649174589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce00052570 con 0x55ecf1912ae0 2024-04-26T07:56:22.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.704+0000 7fce08aca640 1 -- 172.21.15.62:0/3649174589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce0004ae60 con 0x55ecf1912ae0 2024-04-26T07:56:22.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.705+0000 7fce0dd36800 1 -- 172.21.15.62:0/3649174589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1912ae0 msgr2=0x55ecf1914ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.705+0000 7fce0dd36800 1 --2- 172.21.15.62:0/3649174589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1912ae0 0x55ecf1914ed0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fce0000a520 tx=0x7fce0001d010 comp rx=0 tx=0).stop 2024-04-26T07:56:22.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.705+0000 7fce0dd36800 1 -- 172.21.15.62:0/3649174589 shutdown_connections 2024-04-26T07:56:22.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.705+0000 7fce0dd36800 1 --2- 172.21.15.62:0/3649174589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1912ae0 0x55ecf1914ed0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.705+0000 7fce0dd36800 1 -- 172.21.15.62:0/3649174589 >> 172.21.15.62:0/3649174589 conn(0x55ecf1909d60 msgr2=0x55ecf190c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.705+0000 7fce0dd36800 1 -- 172.21.15.62:0/3649174589 shutdown_connections 2024-04-26T07:56:22.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.705+0000 7fce0dd36800 1 -- 172.21.15.62:0/3649174589 wait complete. 2024-04-26T07:56:22.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce0dd36800 1 Processor -- start 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce0dd36800 1 -- start start 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce0dd36800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf19ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce0dd36800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1859d00 con 0x55ecf190e740 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce09acc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf19ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce09acc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf19ffcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41162/0 (socket says 172.21.15.62:41162) 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce09acc640 1 -- 172.21.15.62:0/2099353824 learned_addr learned my addr 172.21.15.62:0/2099353824 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce09acc640 1 -- 172.21.15.62:0/2099353824 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf1a00290 con 0x55ecf190e740 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.718+0000 7fce09acc640 1 --2- 172.21.15.62:0/2099353824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf19ffcc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00b230 tx=0x7fcdfc00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10dbe341650496c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fccf7e07640 1 -- 172.21.15.62:0/2099353824 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc00e5c0 con 0x55ecf190e740 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fccf7e07640 1 -- 172.21.15.62:0/2099353824 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc006070 con 0x55ecf190e740 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fccf7e07640 1 -- 172.21.15.62:0/2099353824 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc00e890 con 0x55ecf190e740 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fce0dd36800 1 -- 172.21.15.62:0/2099353824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 msgr2=0x55ecf19ffcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2099353824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf19ffcc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00b230 tx=0x7fcdfc00b6f0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fce0dd36800 1 -- 172.21.15.62:0/2099353824 shutdown_connections 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2099353824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf19ffcc0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fce0dd36800 1 -- 172.21.15.62:0/2099353824 >> 172.21.15.62:0/2099353824 conn(0x55ecf1909d60 msgr2=0x55ecf19fb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fce0dd36800 1 -- 172.21.15.62:0/2099353824 shutdown_connections 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.719+0000 7fce0dd36800 1 -- 172.21.15.62:0/2099353824 wait complete. 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.720+0000 7fce0dd36800 1 Processor -- start 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.720+0000 7fce0dd36800 1 -- start start 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.720+0000 7fce0dd36800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf1a07860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.720+0000 7fce0dd36800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1915970 con 0x55ecf190e740 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.720+0000 7fce09acc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf1a07860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.720+0000 7fce09acc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf1a07860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41170/0 (socket says 172.21.15.62:41170) 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.720+0000 7fce09acc640 1 -- 172.21.15.62:0/2734254653 learned_addr learned my addr 172.21.15.62:0/2734254653 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.720+0000 7fce09acc640 1 -- 172.21.15.62:0/2734254653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf1a07da0 con 0x55ecf190e740 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.721+0000 7fce09acc640 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf1a07860 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc000fd0 tx=0x7fcdfc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.721+0000 7fccf6604640 1 -- 172.21.15.62:0/2734254653 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc00f8d0 con 0x55ecf190e740 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.721+0000 7fccf6604640 1 -- 172.21.15.62:0/2734254653 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc00fa90 con 0x55ecf190e740 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.721+0000 7fccf6604640 1 -- 172.21.15.62:0/2734254653 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc00fdb0 con 0x55ecf190e740 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.721+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecf1a08030 con 0x55ecf190e740 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.721+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf1a0ace0 con 0x55ecf190e740 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.721+0000 7fccf6604640 1 -- 172.21.15.62:0/2734254653 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcdfc017070 con 0x55ecf190e740 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.722+0000 7fccf6604640 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccf0036e60 0x7fccf0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.722+0000 7fccf6604640 1 -- 172.21.15.62:0/2734254653 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fcdfc015020 con 0x55ecf190e740 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.722+0000 7fce092cb640 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccf0036e60 0x7fccf0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.722+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1912ae0 0x55ecf1a0eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.722+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a0efe0 con 0x55ecf1912ae0 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.722+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1912ae0 0x55ecf1a0eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.722+0000 7fce092cb640 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccf0036e60 0x7fccf0039320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fce00054000 tx=0x7fce0004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.722+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1912ae0 0x55ecf1a0eaa0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.723+0000 7fce0a2cd640 1 -- 172.21.15.62:0/2734254653 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce0400a4a0 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.723+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a0c070 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.723+0000 7fce0a2cd640 1 -- 172.21.15.62:0/2734254653 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce0400a4a0 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.723+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a10de0 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.723+0000 7fce0a2cd640 1 -- 172.21.15.62:0/2734254653 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce0400a4a0 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.723+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a10120 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.723+0000 7fce0a2cd640 1 -- 172.21.15.62:0/2734254653 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce0400a4a0 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.723+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a10570 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.724+0000 7fce0a2cd640 1 -- 172.21.15.62:0/2734254653 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce0400a4a0 con 0x55ecf1912ae0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.724+0000 7fce0dd36800 1 Processor -- start 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.724+0000 7fce0dd36800 1 -- start start 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.724+0000 7fce0dd36800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a1fbb0 0x55ecf1a1ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.724+0000 7fce0dd36800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1801170 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.724+0000 7fce092cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a1fbb0 0x55ecf1a1ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.724+0000 7fce092cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a1fbb0 0x55ecf1a1ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41180/0 (socket says 172.21.15.62:41180) 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.724+0000 7fce092cb640 1 -- 172.21.15.62:0/1865456368 learned_addr learned my addr 172.21.15.62:0/1865456368 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.725+0000 7fce092cb640 1 -- 172.21.15.62:0/1865456368 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf1a20510 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.725+0000 7fce092cb640 1 --2- 172.21.15.62:0/1865456368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a1fbb0 0x55ecf1a1ffd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce0004b010 tx=0x7fce00002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.725+0000 7fccef7fe640 1 -- 172.21.15.62:0/1865456368 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce00057040 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.725+0000 7fccef7fe640 1 -- 172.21.15.62:0/1865456368 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0005d900 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.725+0000 7fce0dd36800 1 -- 172.21.15.62:0/1865456368 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecf1a20f80 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.725+0000 7fccef7fe640 1 -- 172.21.15.62:0/1865456368 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce0005dbe0 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.725+0000 7fce0dd36800 1 -- 172.21.15.62:0/1865456368 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf1a21420 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.726+0000 7fccef7fe640 1 -- 172.21.15.62:0/1865456368 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fce00067070 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.726+0000 7fccef7fe640 1 --2- 172.21.15.62:0/1865456368 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fcce4036e60 0x7fcce4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.726+0000 7fccef7fe640 1 -- 172.21.15.62:0/1865456368 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fce0008fee0 con 0x55ecf1a1fbb0 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.726+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/1865456368 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fcce4036e60 0x7fcce4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.726+0000 7fce0dd36800 1 Processor -- start 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.726+0000 7fce0dd36800 1 -- start start 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.726+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/1865456368 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fcce4036e60 0x7fcce4039320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55ecf1a0fc40 tx=0x7fce04005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fce0dd36800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a2d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fce0dd36800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1a00610 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fce092cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a2d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fce092cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a2d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41182/0 (socket says 172.21.15.62:41182) 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fce092cb640 1 -- 172.21.15.62:0/815911555 learned_addr learned my addr 172.21.15.62:0/815911555 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fce092cb640 1 -- 172.21.15.62:0/815911555 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf1a2d7a0 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fce092cb640 1 --2- 172.21.15.62:0/815911555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a2d1d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fce0008e1d0 tx=0x7fce0005b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663b1ca64cc0eb17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fcced7fa640 1 -- 172.21.15.62:0/815911555 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce00070520 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fcced7fa640 1 -- 172.21.15.62:0/815911555 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce00071ca0 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.727+0000 7fcced7fa640 1 -- 172.21.15.62:0/815911555 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce00006380 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 -- 172.21.15.62:0/815911555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 msgr2=0x55ecf1a2d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 --2- 172.21.15.62:0/815911555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a2d1d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fce0008e1d0 tx=0x7fce0005b4b0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 -- 172.21.15.62:0/815911555 shutdown_connections 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 --2- 172.21.15.62:0/815911555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a2d1d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 -- 172.21.15.62:0/815911555 >> 172.21.15.62:0/815911555 conn(0x55ecf1a29110 msgr2=0x55ecf1a27170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 -- 172.21.15.62:0/815911555 shutdown_connections 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 -- 172.21.15.62:0/815911555 wait complete. 2024-04-26T07:56:22.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 Processor -- start 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.728+0000 7fce0dd36800 1 -- start start 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fce0dd36800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a34430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fce0dd36800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1a2df10 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fce092cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fce092cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a34430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41186/0 (socket says 172.21.15.62:41186) 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 learned_addr learned my addr 172.21.15.62:0/1235997935 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf1a34970 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fce092cb640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a34430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fce00006910 tx=0x7fce0008e130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fccdb7fe640 1 -- 172.21.15.62:0/1235997935 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce00099070 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fccdb7fe640 1 -- 172.21.15.62:0/1235997935 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce00071400 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecf1a34c00 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.729+0000 7fccdb7fe640 1 -- 172.21.15.62:0/1235997935 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce000716e0 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.730+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf1a378b0 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.730+0000 7fccdb7fe640 1 -- 172.21.15.62:0/1235997935 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fce0009c070 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.730+0000 7fccdb7fe640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccd4036e60 0x7fccd4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.730+0000 7fccdb7fe640 1 -- 172.21.15.62:0/1235997935 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fce0009fd50 con 0x55ecf1a2cdb0 2024-04-26T07:56:22.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.730+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccd4036e60 0x7fccd4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.731+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccd4036e60 0x7fccd4039320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ecf1a08680 tx=0x7fce0401f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.731+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.731+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1a3ff10 0x55ecf1a423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.731+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a42b20 con 0x55ecf1a3ff10 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.731+0000 7fce09acc640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1a3ff10 0x55ecf1a423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.731+0000 7fce09acc640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1a3ff10 0x55ecf1a423d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 realm 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a42f30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a43800 con 0x55ecf1a3ff10 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a43ba0 con 0x55ecf1a3ff10 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.732+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a443f0 con 0x55ecf1a3ff10 2024-04-26T07:56:22.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.733+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.733+0000 7fce0dd36800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.733+0000 7fce0dd36800 20 searching for the correct realm 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.733+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ecf1a46160 0x55ecf1a48550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.733+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.733+0000 7fce092cb640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ecf1a46160 0x55ecf1a48550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.733+0000 7fce092cb640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ecf1a46160 0x55ecf1a48550 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.733+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.734+0000 7fce092cb640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fce0009e060 0x7fce0005b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.734+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce0009e060 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.734+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fce0009e060 0x7fce0005b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.734+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fce0009e060 0x7fce0005b910 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.734+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0401f070 con 0x7fce0009e060 2024-04-26T07:56:22.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.734+0000 7fce0a2cd640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fce04031040 0x7fce04032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.734+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce04031040 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.734+0000 7fce09acc640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fce04031040 0x7fce04032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.735+0000 7fce09acc640 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fce04031040 0x7fce04032940 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.735+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.735+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.735+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.735+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.736+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.736+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.736+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.736+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce04031040 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.736+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.736+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce0009e060 2024-04-26T07:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.736+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0401f070 con 0x7fce0009e060 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.736+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.737+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.737+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.737+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.737+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce04031040 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.737+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.737+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.737+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.737+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce0009e060 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.738+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce0401f070 con 0x7fce0009e060 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.738+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.738+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.738+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.738+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.738+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce04031040 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.738+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.738+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.739+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.739+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.739+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.739+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.739+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.739+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.739+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.739+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce04031040 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.740+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.740+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.740+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.740+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce0009e060 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.740+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0401f070 con 0x7fce0009e060 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.740+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.740+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.740+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce04031040 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.741+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.741+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.741+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.741+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce04031040 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.741+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.741+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce0009e060 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.741+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0401f070 con 0x7fce0009e060 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.741+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a46160 2024-04-26T07:56:22.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.742+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.742+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce04031040 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.742+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.742+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x55ecf1a3ff10 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48b30 con 0x7fce0009e060 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0401f070 con 0x7fce0009e060 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a44da0 con 0x55ecf1a3ff10 2024-04-26T07:56:22.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a45640 con 0x55ecf1a3ff10 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.743+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a48fb0 con 0x55ecf1a3ff10 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 20 zone default found 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 4 Realm: () 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:22.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 20 zonegroup default 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a49460 con 0x7fce04031040 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4ae40 con 0x55ecf1a46160 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4b270 con 0x55ecf1a46160 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.744+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.745+0000 7fce0dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.745+0000 7fce0dd36800 20 started sync module instance, tier type = 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.745+0000 7fce0dd36800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.745+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4a2d0 con 0x7fce0009e060 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.746+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04040040 con 0x7fce0009e060 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.746+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94476154742464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4bb80 con 0x7fce0009e060 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.746+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4c3d0 con 0x55ecf1a3ff10 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.747+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94476154742464] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04040040 con 0x7fce0009e060 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.747+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.747+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94476154746576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4c060 con 0x55ecf1a3ff10 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.747+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4cb50 con 0x55ecf1a46160 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.748+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94476154746576] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.748+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.748+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94476154750496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4cf40 con 0x55ecf1a46160 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.748+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4d940 con 0x7fce0009e060 2024-04-26T07:56:22.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.749+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94476154750496] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.749+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04040040 con 0x7fce0009e060 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.749+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94476154747632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4dd30 con 0x7fce0009e060 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.749+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4e750 con 0x55ecf1a3ff10 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.750+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.750+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94476154757696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4e710 con 0x55ecf1a3ff10 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.750+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4f700 con 0x7fce04031040 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.750+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94476154747632] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04040040 con 0x7fce0009e060 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.752+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94476154757696] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.752+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.752+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94476154761744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4e8f0 con 0x7fce04031040 2024-04-26T07:56:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.752+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4e8f0 con 0x7fce04031040 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.753+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94476154761744] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.753+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.753+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94476154754128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4fbb0 con 0x7fce04031040 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.753+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a50570 con 0x7fce04031040 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94476154754128] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94476154763008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a50570 con 0x7fce04031040 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce0dd36800 20 add_watcher() i=0 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce0dd36800 20 add_watcher() i=1 2024-04-26T07:56:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce0dd36800 20 add_watcher() i=2 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce0dd36800 20 add_watcher() i=3 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce0dd36800 20 add_watcher() i=4 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce0dd36800 20 add_watcher() i=5 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.754+0000 7fce0dd36800 20 add_watcher() i=6 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.755+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94476154763008] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.755+0000 7fce0dd36800 20 add_watcher() i=7 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.755+0000 7fce0dd36800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.755+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a53990 con 0x55ecf1a3ff10 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.756+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.756+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94476154765968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a50e70 con 0x55ecf1a3ff10 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94476154765968] v29'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fccbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce0dd36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce0dd36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce0dd36800 5 note: GC not initialized 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fccba7fc640 20 reqs_thread_entry: start 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce0dd36800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce0dd36800 20 Filter name: none 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fcc2bfff640 20 reqs_thread_entry: start 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce0dd36800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce0dd36800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.757+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a87160 con 0x7fce04031040 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.758+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.758+0000 7fce0dd36800 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.758+0000 7fce0dd36800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.758+0000 7fce0dd36800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.758+0000 7fce0dd36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.758+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a8dae0 con 0x7fce04031040 2024-04-26T07:56:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v29'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fce0dd36800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fce0dd36800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fce0dd36800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94476155016528 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a89170 con 0x55ecf1a3ff10 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94476154757696 notify 124554051614 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55ecf1a0ace0 con 0x55ecf1a3ff10 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fcced7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 94476154757696 notifier 4878 bl.length()=679 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fcced7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fcced7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fcced7fa640 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fcccc003ea0 con 0x55ecf1a3ff10 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.759+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94476155016528 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.760+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.760+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94476155016528 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ecf1a08030 con 0x55ecf1a3ff10 2024-04-26T07:56:22.768 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.761+0000 7fccbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.761+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94476154765968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a85700 con 0x55ecf1a3ff10 2024-04-26T07:56:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.762+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94476154765968] v29'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.762+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94476154742464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a50260 con 0x7fce0009e060 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.763+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94476154742464] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04040040 con 0x7fce0009e060 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.763+0000 7fce0dd36800 20 remove_watcher() i=0 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.763+0000 7fce0dd36800 2 removed watcher, disabling cache 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.763+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94476154746576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4a6c0 con 0x55ecf1a3ff10 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.764+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94476154746576] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.764+0000 7fce0dd36800 20 remove_watcher() i=1 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.764+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94476154750496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4b6d0 con 0x55ecf1a46160 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.765+0000 7fce092cb640 1 -- 172.21.15.62:0/1235997935 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94476154750496] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0009b030 con 0x55ecf1a46160 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.765+0000 7fce0dd36800 20 remove_watcher() i=2 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.765+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94476154747632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4c620 con 0x7fce0009e060 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.766+0000 7fce0a2cd640 1 -- 172.21.15.62:0/1235997935 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94476154747632] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04040040 con 0x7fce0009e060 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.766+0000 7fce0dd36800 20 remove_watcher() i=3 2024-04-26T07:56:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.766+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94476154757696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a50260 con 0x55ecf1a3ff10 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.767+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94476154757696] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x55ecf1a3ff10 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.767+0000 7fce0dd36800 20 remove_watcher() i=4 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.767+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94476154761744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a50260 con 0x7fce04031040 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.768+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94476154761744] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.768+0000 7fce0dd36800 20 remove_watcher() i=5 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.768+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94476154754128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4f210 con 0x7fce04031040 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.769+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94476154754128] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.770+0000 7fce0dd36800 20 remove_watcher() i=6 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.770+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94476154763008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecf1a4d450 con 0x7fce04031040 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.770+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94476154763008] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdfc02e070 con 0x7fce04031040 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.770+0000 7fce0dd36800 20 remove_watcher() i=7 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fce04031040 msgr2=0x7fce04032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fce04031040 0x7fce04032940 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1a3ff10 msgr2=0x55ecf1a423d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1a3ff10 0x55ecf1a423d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fce0009e060 msgr2=0x7fce0005b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fce0009e060 0x7fce0005b910 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ecf1a46160 msgr2=0x55ecf1a48550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55ecf1a46160 0x55ecf1a48550 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccd4036e60 msgr2=0x7fccd4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccd4036e60 0x7fccd4039320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ecf1a08680 tx=0x7fce0401f000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 msgr2=0x55ecf1a34430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1235997935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a2cdb0 0x55ecf1a34430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fce00006910 tx=0x7fce0008e130 comp rx=0 tx=0).stop 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 reap_dead start 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce09acc640 1 -- 172.21.15.62:0/1235997935 reap_dead start 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 shutdown_connections 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 >> 172.21.15.62:0/1235997935 conn(0x55ecf1a29110 msgr2=0x55ecf1a26770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 shutdown_connections 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1235997935 wait complete. 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1865456368 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fcce4036e60 msgr2=0x7fcce4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1865456368 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fcce4036e60 0x7fcce4039320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55ecf1a0fc40 tx=0x7fce04005840 comp rx=0 tx=0).stop 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1865456368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a1fbb0 msgr2=0x55ecf1a1ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1865456368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a1fbb0 0x55ecf1a1ffd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce0004b010 tx=0x7fce00002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1865456368 shutdown_connections 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1865456368 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fcce4036e60 0x7fcce4039320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 --2- 172.21.15.62:0/1865456368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf1a1fbb0 0x55ecf1a1ffd0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1865456368 >> 172.21.15.62:0/1865456368 conn(0x55ecf1a13c50 msgr2=0x55ecf1a14050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1865456368 shutdown_connections 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.771+0000 7fce0dd36800 1 -- 172.21.15.62:0/1865456368 wait complete. 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1912ae0 msgr2=0x55ecf1a0eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1912ae0 0x55ecf1a0eaa0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccf0036e60 msgr2=0x7fccf0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccf0036e60 0x7fccf0039320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fce00054000 tx=0x7fce0004e000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 msgr2=0x55ecf1a07860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf1a07860 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc000fd0 tx=0x7fcdfc000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 shutdown_connections 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55ecf1912ae0 0x55ecf1a0eaa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fccf0036e60 0x7fccf0039320 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 --2- 172.21.15.62:0/2734254653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ecf190e740 0x55ecf1a07860 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 >> 172.21.15.62:0/2734254653 conn(0x55ecf1909d60 msgr2=0x55ecf19f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 shutdown_connections 2024-04-26T07:56:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.772+0000 7fce0dd36800 1 -- 172.21.15.62:0/2734254653 wait complete. 2024-04-26T07:56:22.778 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.778 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.778 ERROR:root:0 2024-04-26T07:56:22.778 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:22.783 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:22.783 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-26T07:56:22.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-26T07:56:22.784 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-04-26T07:56:22.829 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:22.830 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.833+0000 7fbc3243f800 1 Processor -- start 2024-04-26T07:56:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.833+0000 7fbc3243f800 1 -- start start 2024-04-26T07:56:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.833+0000 7fbc3243f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5639badb8b00 0x5639badc1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.833+0000 7fbc3243f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5639bad2b8b0 con 0x5639badb6fc0 2024-04-26T07:56:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.833+0000 7fbc3243f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5639bac5ae20 con 0x5639badb8b00 2024-04-26T07:56:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.834+0000 7fbc2f73d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5639badb8b00 0x5639badc1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.834+0000 7fbc2f73d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x5639badb8b00 0x5639badc1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41198/0 (socket says 172.21.15.62:41198) 2024-04-26T07:56:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.834+0000 7fbc2ff3e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5639badb6fc0 0x5639badb73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33258/0 (socket says 172.21.15.62:33258) 2024-04-26T07:56:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.834+0000 7fbc2f73d640 1 -- 172.21.15.62:0/2727027469 learned_addr learned my addr 172.21.15.62:0/2727027469 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.834+0000 7fbc2f73d640 1 -- 172.21.15.62:0/2727027469 >> v1:172.21.15.1:6789/0 conn(0x5639badb6fc0 legacy=0x5639badb73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.834+0000 7fbc2ef3c640 1 -- 172.21.15.62:0/2727027469 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743816972 0 0) 0x5639bad2b8b0 con 0x5639badb6fc0 2024-04-26T07:56:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.834+0000 7fbc2f73d640 1 -- 172.21.15.62:0/2727027469 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639bad2ba80 con 0x5639badb8b00 2024-04-26T07:56:22.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.836+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/2727027469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb8b00 0x5639badc1600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400a520 tx=0x7fbc2401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe589b1e5d34517 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.836+0000 7fbc2ef3c640 1 -- 172.21.15.62:0/2727027469 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc24057070 con 0x5639badb8b00 2024-04-26T07:56:22.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.836+0000 7fbc2ef3c640 1 -- 172.21.15.62:0/2727027469 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc24052570 con 0x5639badb8b00 2024-04-26T07:56:22.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.836+0000 7fbc2ef3c640 1 -- 172.21.15.62:0/2727027469 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2404ae60 con 0x5639badb8b00 2024-04-26T07:56:22.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.837+0000 7fbc3243f800 1 -- 172.21.15.62:0/2727027469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb8b00 msgr2=0x5639badc1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.837+0000 7fbc3243f800 1 --2- 172.21.15.62:0/2727027469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb8b00 0x5639badc1600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400a520 tx=0x7fbc2401d010 comp rx=0 tx=0).stop 2024-04-26T07:56:22.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.837+0000 7fbc3243f800 1 -- 172.21.15.62:0/2727027469 shutdown_connections 2024-04-26T07:56:22.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.837+0000 7fbc3243f800 1 --2- 172.21.15.62:0/2727027469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb8b00 0x5639badc1600 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.837+0000 7fbc3243f800 1 -- 172.21.15.62:0/2727027469 >> 172.21.15.62:0/2727027469 conn(0x5639badb2be0 msgr2=0x5639badb5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.837+0000 7fbc3243f800 1 -- 172.21.15.62:0/2727027469 shutdown_connections 2024-04-26T07:56:22.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.837+0000 7fbc3243f800 1 -- 172.21.15.62:0/2727027469 wait complete. 2024-04-26T07:56:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.850+0000 7fbc3243f800 1 Processor -- start 2024-04-26T07:56:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.850+0000 7fbc3243f800 1 -- start start 2024-04-26T07:56:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.850+0000 7fbc3243f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeabca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.850+0000 7fbc3243f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5639bad03d00 con 0x5639badb6fc0 2024-04-26T07:56:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.850+0000 7fbc2ff3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeabca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.850+0000 7fbc2ff3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeabca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41200/0 (socket says 172.21.15.62:41200) 2024-04-26T07:56:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.850+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1701661247 learned_addr learned my addr 172.21.15.62:0/1701661247 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.850+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1701661247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639baeac270 con 0x5639badb6fc0 2024-04-26T07:56:22.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.851+0000 7fbc2ff3e640 1 --2- 172.21.15.62:0/1701661247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeabca0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000b210 tx=0x7fbc2000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b59191f9fb29be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.851+0000 7fbb1de0b640 1 -- 172.21.15.62:0/1701661247 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc20008070 con 0x5639badb6fc0 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.851+0000 7fbb1de0b640 1 -- 172.21.15.62:0/1701661247 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2000d500 con 0x5639badb6fc0 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.851+0000 7fbb1de0b640 1 -- 172.21.15.62:0/1701661247 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2000d840 con 0x5639badb6fc0 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 -- 172.21.15.62:0/1701661247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 msgr2=0x5639baeabca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1701661247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeabca0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000b210 tx=0x7fbc2000b6d0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 -- 172.21.15.62:0/1701661247 shutdown_connections 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1701661247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeabca0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 -- 172.21.15.62:0/1701661247 >> 172.21.15.62:0/1701661247 conn(0x5639badb2be0 msgr2=0x5639baea75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 -- 172.21.15.62:0/1701661247 shutdown_connections 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 -- 172.21.15.62:0/1701661247 wait complete. 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 Processor -- start 2024-04-26T07:56:22.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 -- start start 2024-04-26T07:56:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeb3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc3243f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5639badc1e10 con 0x5639badb6fc0 2024-04-26T07:56:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc2ff3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeb3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.852+0000 7fbc2ff3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeb3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41208/0 (socket says 172.21.15.62:41208) 2024-04-26T07:56:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.853+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/3257732200 learned_addr learned my addr 172.21.15.62:0/3257732200 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.853+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/3257732200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639baeb3d90 con 0x5639badb6fc0 2024-04-26T07:56:22.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.853+0000 7fbc2ff3e640 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeb3850 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000b210 tx=0x7fbc20000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.853+0000 7fbb17fff640 1 -- 172.21.15.62:0/3257732200 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2000f950 con 0x5639badb6fc0 2024-04-26T07:56:22.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.853+0000 7fbb17fff640 1 -- 172.21.15.62:0/3257732200 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2000faf0 con 0x5639badb6fc0 2024-04-26T07:56:22.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.853+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639baeb4020 con 0x5639badb6fc0 2024-04-26T07:56:22.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.853+0000 7fbb17fff640 1 -- 172.21.15.62:0/3257732200 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2000fdd0 con 0x5639badb6fc0 2024-04-26T07:56:22.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.853+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639baeb6cd0 con 0x5639badb6fc0 2024-04-26T07:56:22.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.854+0000 7fbb17fff640 1 -- 172.21.15.62:0/3257732200 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbc20017040 con 0x5639badb6fc0 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.854+0000 7fbb17fff640 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb18036e10 0x7fbb180392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.854+0000 7fbb17fff640 1 -- 172.21.15.62:0/3257732200 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fbc20015020 con 0x5639badb6fc0 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.854+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb18036e10 0x7fbb180392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.854+0000 7fbc3243f800 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639badb8b00 0x5639baebaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.855+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baebb010 con 0x5639badb8b00 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.855+0000 7fbc3073f640 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639badb8b00 0x5639baebaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.855+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb18036e10 0x7fbb180392d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbc24054000 tx=0x7fbc2404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.855+0000 7fbc3073f640 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639badb8b00 0x5639baebaa90 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.855+0000 7fbc3073f640 1 -- 172.21.15.62:0/3257732200 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc2800a4a0 con 0x5639badb8b00 2024-04-26T07:56:22.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.855+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baeb8060 con 0x5639badb8b00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.856+0000 7fbc3073f640 1 -- 172.21.15.62:0/3257732200 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc2800a4a0 con 0x5639badb8b00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.856+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baebce30 con 0x5639badb8b00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.856+0000 7fbc3073f640 1 -- 172.21.15.62:0/3257732200 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc2800a4a0 con 0x5639badb8b00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.856+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baebc170 con 0x5639badb8b00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.856+0000 7fbc3073f640 1 -- 172.21.15.62:0/3257732200 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc2800a4a0 con 0x5639badb8b00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.856+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baebc5c0 con 0x5639badb8b00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.856+0000 7fbc3073f640 1 -- 172.21.15.62:0/3257732200 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc2800a4a0 con 0x5639badb8b00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.857+0000 7fbc3243f800 1 Processor -- start 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.857+0000 7fbc3243f800 1 -- start start 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.857+0000 7fbc3243f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baecbc00 0x5639baecc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.857+0000 7fbc3243f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5639bacab170 con 0x5639baecbc00 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.857+0000 7fbc2f73d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baecbc00 0x5639baecc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.857+0000 7fbc2f73d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baecbc00 0x5639baecc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41214/0 (socket says 172.21.15.62:41214) 2024-04-26T07:56:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.857+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1109066366 learned_addr learned my addr 172.21.15.62:0/1109066366 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.858+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1109066366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639baecc560 con 0x5639baecbc00 2024-04-26T07:56:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.858+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/1109066366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baecbc00 0x5639baecc020 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbc2401d050 tx=0x7fbc24002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.858+0000 7fbb157fa640 1 -- 172.21.15.62:0/1109066366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc24057040 con 0x5639baecbc00 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.858+0000 7fbb157fa640 1 -- 172.21.15.62:0/1109066366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2406d070 con 0x5639baecbc00 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.858+0000 7fbc3243f800 1 -- 172.21.15.62:0/1109066366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639baeccfd0 con 0x5639baecbc00 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.858+0000 7fbb157fa640 1 -- 172.21.15.62:0/1109066366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2405d7c0 con 0x5639baecbc00 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.858+0000 7fbc3243f800 1 -- 172.21.15.62:0/1109066366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639baecd470 con 0x5639baecbc00 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.859+0000 7fbb157fa640 1 -- 172.21.15.62:0/1109066366 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbc24067070 con 0x5639baecbc00 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.859+0000 7fbb157fa640 1 --2- 172.21.15.62:0/1109066366 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb08036e60 0x7fbb08039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.859+0000 7fbb157fa640 1 -- 172.21.15.62:0/1109066366 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fbc2408fe80 con 0x5639baecbc00 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.859+0000 7fbc3073f640 1 --2- 172.21.15.62:0/1109066366 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb08036e60 0x7fbb08039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.859+0000 7fbc3243f800 1 Processor -- start 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.859+0000 7fbc3243f800 1 -- start start 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.859+0000 7fbc3073f640 1 --2- 172.21.15.62:0/1109066366 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb08036e60 0x7fbb08039320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5639baebbc90 tx=0x7fbc28005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbc3243f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baed92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbc3243f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5639baeac5f0 con 0x5639baed8e80 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbc2f73d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baed92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbc2f73d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baed92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41224/0 (socket says 172.21.15.62:41224) 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbc2f73d640 1 -- 172.21.15.62:0/608753015 learned_addr learned my addr 172.21.15.62:0/608753015 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbc2f73d640 1 -- 172.21.15.62:0/608753015 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639baed9870 con 0x5639baed8e80 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/608753015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baed92a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbc24055040 tx=0x7fbc24067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e923d75ebbaf02f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbb0effd640 1 -- 172.21.15.62:0/608753015 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2407f070 con 0x5639baed8e80 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbb0effd640 1 -- 172.21.15.62:0/608753015 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc24072460 con 0x5639baed8e80 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.860+0000 7fbb0effd640 1 -- 172.21.15.62:0/608753015 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc24067360 con 0x5639baed8e80 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 -- 172.21.15.62:0/608753015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 msgr2=0x5639baed92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 --2- 172.21.15.62:0/608753015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baed92a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbc24055040 tx=0x7fbc24067ab0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 -- 172.21.15.62:0/608753015 shutdown_connections 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 --2- 172.21.15.62:0/608753015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baed92a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 -- 172.21.15.62:0/608753015 >> 172.21.15.62:0/608753015 conn(0x5639baed51e0 msgr2=0x5639baed3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 -- 172.21.15.62:0/608753015 shutdown_connections 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 -- 172.21.15.62:0/608753015 wait complete. 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 Processor -- start 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 -- start start 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baee04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.861+0000 7fbc3243f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5639baed9fe0 con 0x5639baed8e80 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbc2f73d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baee04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbc2f73d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baee04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41228/0 (socket says 172.21.15.62:41228) 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 learned_addr learned my addr 172.21.15.62:0/1652396182 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639baee0a00 con 0x5639baed8e80 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baee04c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbc24052d10 tx=0x7fbc2408e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbb0d7fa640 1 -- 172.21.15.62:0/1652396182 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc240067a0 con 0x5639baed8e80 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbb0d7fa640 1 -- 172.21.15.62:0/1652396182 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc24099070 con 0x5639baed8e80 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639baee0c90 con 0x5639baed8e80 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbb0d7fa640 1 -- 172.21.15.62:0/1652396182 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc24006a90 con 0x5639baed8e80 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.862+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639baee3940 con 0x5639baed8e80 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.863+0000 7fbb0d7fa640 1 -- 172.21.15.62:0/1652396182 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbc24092030 con 0x5639baed8e80 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.863+0000 7fbb0d7fa640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbaf8036eb0 0x7fbaf8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.863+0000 7fbb0d7fa640 1 -- 172.21.15.62:0/1652396182 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fbc240860e0 con 0x5639baed8e80 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.863+0000 7fbc3073f640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbaf8036eb0 0x7fbaf8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.864+0000 7fbc3073f640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbaf8036eb0 0x7fbaf8039370 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5639baeb7fb0 tx=0x7fbc2801f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.864+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.864+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639baeec030 0x5639baeee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.864+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baeeec40 con 0x5639baeec030 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.864+0000 7fbc2ff3e640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639baeec030 0x5639baeee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.864+0000 7fbc2ff3e640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639baeec030 0x5639baeee4f0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.864+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.864+0000 7fbc3243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 20 realm 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baeef050 con 0x5639baeec030 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baeef920 con 0x5639baeec030 2024-04-26T07:56:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baeefcc0 con 0x5639baeec030 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.865+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baef0510 con 0x5639baeec030 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.866+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.866+0000 7fbc3243f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.866+0000 7fbc3243f800 20 searching for the correct realm 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.866+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5639baef2280 0x5639baef4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.866+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.866+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5639baef2280 0x5639baef4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.866+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5639baef2280 0x5639baef4670 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.866+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.867+0000 7fbc2f73d640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbc24084070 0x7fbc2409e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.867+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc24084070 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.867+0000 7fbc3073f640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbc24084070 0x7fbc2409e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.867+0000 7fbc3073f640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbc24084070 0x7fbc2409e940 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.867+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2801f070 con 0x7fbc24084070 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.867+0000 7fbc3073f640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbc28031040 0x7fbc28032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.867+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc28031040 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.867+0000 7fbc2ff3e640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbc28031040 0x7fbc28032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.868+0000 7fbc2ff3e640 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbc28031040 0x7fbc28032940 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.868+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.868+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.868+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.868+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.869+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.869+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.869+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.869+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc28031040 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.869+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.869+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc24084070 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.869+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2801f070 con 0x7fbc24084070 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.869+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.870+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.870+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.870+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.870+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc28031040 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.870+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.870+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.870+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.870+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc24084070 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.871+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc2801f070 con 0x7fbc24084070 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.871+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.871+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.871+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.871+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.871+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc28031040 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.872+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.872+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.872+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.872+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.872+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.872+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.872+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.872+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.873+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.873+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc28031040 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.873+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.873+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.873+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.873+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc24084070 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.873+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2801f070 con 0x7fbc24084070 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.873+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.874+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.874+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc28031040 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.874+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.874+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.874+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.874+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc28031040 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.875+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.875+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc24084070 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.875+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2801f070 con 0x7fbc24084070 2024-04-26T07:56:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.875+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baef2280 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.875+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.875+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc28031040 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.875+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.875+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x5639baeec030 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5639baef4c50 con 0x7fbc24084070 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2801f070 con 0x7fbc24084070 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baef0ec0 con 0x5639baeec030 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baef1760 con 0x5639baeec030 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.876+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baef1760 con 0x5639baeec030 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 20 zone default found 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 4 Realm: () 2024-04-26T07:56:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 20 zonegroup default 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baef50d0 con 0x7fbc28031040 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baef6b10 con 0x5639baef2280 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.877+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baef6fe0 con 0x5639baef2280 2024-04-26T07:56:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.878+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.878+0000 7fbc3243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.878+0000 7fbc3243f800 20 started sync module instance, tier type = 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.878+0000 7fbc3243f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.878+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef5f50 con 0x7fbc24084070 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.879+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28040040 con 0x7fbc24084070 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.879+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94805949375296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef78f0 con 0x7fbc24084070 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.879+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef8140 con 0x5639baeec030 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.880+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94805949375296] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28040040 con 0x7fbc24084070 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.880+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.880+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94805949379648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef7dd0 con 0x5639baeec030 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.880+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef88f0 con 0x5639baef2280 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.881+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94805949379648] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.882+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.882+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94805949383616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef8ce0 con 0x5639baef2280 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.882+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef9700 con 0x7fbc24084070 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.883+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94805949383616] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.883+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28040040 con 0x7fbc24084070 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.883+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94805949387248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef9af0 con 0x7fbc24084070 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.883+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefa510 con 0x5639baeec030 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.884+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.884+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94805949390848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefa4d0 con 0x5639baeec030 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.884+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefb4d0 con 0x7fbc28031040 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.884+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94805949387248] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28040040 con 0x7fbc24084070 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.885+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94805949390848] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.885+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.885+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94805949394944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefa6b0 con 0x7fbc28031040 2024-04-26T07:56:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.885+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefbd70 con 0x7fbc28031040 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.886+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94805949394944] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.886+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.886+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94805949380704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefb980 con 0x7fbc28031040 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.886+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefc340 con 0x7fbc28031040 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94805949380704] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94805949399152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefb980 con 0x7fbc28031040 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc3243f800 20 add_watcher() i=0 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc3243f800 20 add_watcher() i=1 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc3243f800 20 add_watcher() i=2 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc3243f800 20 add_watcher() i=3 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc3243f800 20 add_watcher() i=4 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc3243f800 20 add_watcher() i=5 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.887+0000 7fbc3243f800 20 add_watcher() i=6 2024-04-26T07:56:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.888+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94805949399152] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.888+0000 7fbc3243f800 20 add_watcher() i=7 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.888+0000 7fbc3243f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.888+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baeff760 con 0x5639baeec030 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.889+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.889+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94805949396640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefcc60 con 0x5639baeec030 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.890+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94805949396640] v29'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.890+0000 7fbae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.890+0000 7fbc3243f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.890+0000 7fbc3243f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.890+0000 7fbc3243f800 5 note: GC not initialized 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.890+0000 7fbae4fe1640 20 reqs_thread_entry: start 2024-04-26T07:56:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.890+0000 7fbc3243f800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.890+0000 7fbc3243f800 20 Filter name: none 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fba5e7fc640 20 reqs_thread_entry: start 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc3243f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc3243f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baf32f30 con 0x7fbc28031040 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc3243f800 20 rados_obj.operate() r=0 bl.length=503 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc3243f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc3243f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc3243f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.891+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baf39940 con 0x7fbc28031040 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbc3243f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbc3243f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbc3243f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94805949649840 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5639baf35010 con 0x5639baeec030 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94805949390848 notify 124554051615 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5639baeb6cd0 con 0x5639baeec030 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbb0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94805949390848 notifier 4885 bl.length()=636 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbb0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbb0effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94805949649840 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.893+0000 7fbb0effd640 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbaf4003ea0 con 0x5639baeec030 2024-04-26T07:56:22.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.894+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.894+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94805949649840 notify 124554051615 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5639baeb4020 con 0x5639baeec030 2024-04-26T07:56:22.903 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.895+0000 7fbae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.895+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94805949396640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baf35420 con 0x5639baeec030 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.896+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94805949396640] v29'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.896+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94805949375296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefb670 con 0x7fbc24084070 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.897+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94805949375296] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28040040 con 0x7fbc24084070 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.897+0000 7fbc3243f800 20 remove_watcher() i=0 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.897+0000 7fbc3243f800 2 removed watcher, disabling cache 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.897+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94805949379648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef6340 con 0x5639baeec030 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.898+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94805949379648] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.898+0000 7fbc3243f800 20 remove_watcher() i=1 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.898+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94805949383616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef6340 con 0x5639baef2280 2024-04-26T07:56:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.899+0000 7fbc2f73d640 1 -- 172.21.15.62:0/1652396182 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94805949383616] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc24081030 con 0x5639baef2280 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.899+0000 7fbc3243f800 20 remove_watcher() i=2 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.899+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94805949387248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef83c0 con 0x7fbc24084070 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.900+0000 7fbc3073f640 1 -- 172.21.15.62:0/1652396182 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94805949387248] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28040040 con 0x7fbc24084070 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.900+0000 7fbc3243f800 20 remove_watcher() i=3 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.900+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94805949390848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef91f0 con 0x5639baeec030 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.901+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94805949390848] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x5639baeec030 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.901+0000 7fbc3243f800 20 remove_watcher() i=4 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.901+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94805949394944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef83c0 con 0x7fbc28031040 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.902+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94805949394944] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.902+0000 7fbc3243f800 20 remove_watcher() i=5 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.902+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94805949380704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baefb000 con 0x7fbc28031040 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.904+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94805949380704] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.904+0000 7fbc3243f800 20 remove_watcher() i=6 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.904+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94805949399152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5639baef83c0 con 0x7fbc28031040 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94805949399152] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2002d070 con 0x7fbc28031040 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 20 remove_watcher() i=7 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbc28031040 msgr2=0x7fbc28032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7fbc28031040 0x7fbc28032940 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639baeec030 msgr2=0x5639baeee4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639baeec030 0x5639baeee4f0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbc24084070 msgr2=0x7fbc2409e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7fbc24084070 0x7fbc2409e940 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5639baef2280 msgr2=0x5639baef4670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x5639baef2280 0x5639baef4670 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbaf8036eb0 msgr2=0x7fbaf8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbaf8036eb0 0x7fbaf8039370 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5639baeb7fb0 tx=0x7fbc2801f000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc2ff3e640 1 -- 172.21.15.62:0/1652396182 reap_dead start 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 msgr2=0x5639baee04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baee04c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbc24052d10 tx=0x7fbc2408e150 comp rx=0 tx=0).stop 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 shutdown_connections 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1652396182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baed8e80 0x5639baee04c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 >> 172.21.15.62:0/1652396182 conn(0x5639baed51e0 msgr2=0x5639baed2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 shutdown_connections 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.905+0000 7fbc3243f800 1 -- 172.21.15.62:0/1652396182 wait complete. 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/1109066366 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb08036e60 msgr2=0x7fbb08039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1109066366 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb08036e60 0x7fbb08039320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5639baebbc90 tx=0x7fbc28005840 comp rx=0 tx=0).stop 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/1109066366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baecbc00 msgr2=0x5639baecc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1109066366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baecbc00 0x5639baecc020 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbc2401d050 tx=0x7fbc24002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/1109066366 shutdown_connections 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1109066366 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb08036e60 0x7fbb08039320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/1109066366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639baecbc00 0x5639baecc020 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/1109066366 >> 172.21.15.62:0/1109066366 conn(0x5639baebfca0 msgr2=0x5639baec00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/1109066366 shutdown_connections 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/1109066366 wait complete. 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639badb8b00 msgr2=0x5639baebaa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639badb8b00 0x5639baebaa90 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb18036e10 msgr2=0x7fbb180392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb18036e10 0x7fbb180392d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbc24054000 tx=0x7fbc2404e000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 msgr2=0x5639baeb3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeb3850 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000b210 tx=0x7fbc20000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 shutdown_connections 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5639badb8b00 0x5639baebaa90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fbb18036e10 0x7fbb180392d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 --2- 172.21.15.62:0/3257732200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5639badb6fc0 0x5639baeb3850 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 >> 172.21.15.62:0/3257732200 conn(0x5639badb2be0 msgr2=0x5639baea5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 shutdown_connections 2024-04-26T07:56:22.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.906+0000 7fbc3243f800 1 -- 172.21.15.62:0/3257732200 wait complete. 2024-04-26T07:56:22.915 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.915 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:22.915 ERROR:root:0 2024-04-26T07:56:22.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T07:56:22.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T07:56:22.915 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-04-26T07:56:22.962 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:22.962 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:22.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.965+0000 7f67a272d800 1 Processor -- start 2024-04-26T07:56:22.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.965+0000 7f67a272d800 1 -- start start 2024-04-26T07:56:22.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f67a272d800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a12e516130 0x55a12e5146e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f67a272d800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a12e5150d0 con 0x55a12e514c20 2024-04-26T07:56:22.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f67a272d800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55a12e442e20 con 0x55a12e516130 2024-04-26T07:56:22.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f679e378640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a12e516130 0x55a12e5146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f679e378640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55a12e516130 0x55a12e5146e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41234/0 (socket says 172.21.15.62:41234) 2024-04-26T07:56:22.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f679e378640 1 -- 172.21.15.62:0/1486988288 learned_addr learned my addr 172.21.15.62:0/1486988288 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f679db77640 1 --1- 172.21.15.62:0/1486988288 >> v1:172.21.15.1:6789/0 conn(0x55a12e514c20 0x55a12e5a85f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33274/0 (socket says 172.21.15.62:33274) 2024-04-26T07:56:22.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f679e378640 1 -- 172.21.15.62:0/1486988288 >> v1:172.21.15.1:6789/0 conn(0x55a12e514c20 legacy=0x55a12e5a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.966+0000 7f679e378640 1 -- 172.21.15.62:0/1486988288 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12e5152a0 con 0x55a12e516130 2024-04-26T07:56:22.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.968+0000 7f679e378640 1 --2- 172.21.15.62:0/1486988288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e516130 0x55a12e5146e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6790005fd0 tx=0x7f679001cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c619a5cfe346782b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.968+0000 7f679d376640 1 -- 172.21.15.62:0/1486988288 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790052540 con 0x55a12e516130 2024-04-26T07:56:22.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.968+0000 7f679d376640 1 -- 172.21.15.62:0/1486988288 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679004e070 con 0x55a12e516130 2024-04-26T07:56:22.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.968+0000 7f679d376640 1 -- 172.21.15.62:0/1486988288 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790052850 con 0x55a12e516130 2024-04-26T07:56:22.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.969+0000 7f67a272d800 1 -- 172.21.15.62:0/1486988288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e516130 msgr2=0x55a12e5146e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.969+0000 7f67a272d800 1 --2- 172.21.15.62:0/1486988288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e516130 0x55a12e5146e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6790005fd0 tx=0x7f679001cd80 comp rx=0 tx=0).stop 2024-04-26T07:56:22.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.969+0000 7f67a272d800 1 -- 172.21.15.62:0/1486988288 shutdown_connections 2024-04-26T07:56:22.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.969+0000 7f67a272d800 1 --2- 172.21.15.62:0/1486988288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e516130 0x55a12e5146e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.969+0000 7f67a272d800 1 -- 172.21.15.62:0/1486988288 >> 172.21.15.62:0/1486988288 conn(0x55a12e59bd60 msgr2=0x55a12e59e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.969+0000 7f67a272d800 1 -- 172.21.15.62:0/1486988288 shutdown_connections 2024-04-26T07:56:22.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.969+0000 7f67a272d800 1 -- 172.21.15.62:0/1486988288 wait complete. 2024-04-26T07:56:22.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.982+0000 7f67a272d800 1 Processor -- start 2024-04-26T07:56:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.982+0000 7f67a272d800 1 -- start start 2024-04-26T07:56:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.982+0000 7f67a272d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e693f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.982+0000 7f67a272d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a12e4ebd00 con 0x55a12e514c20 2024-04-26T07:56:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.982+0000 7f679e378640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e693f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.982+0000 7f679e378640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e693f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41244/0 (socket says 172.21.15.62:41244) 2024-04-26T07:56:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.982+0000 7f679e378640 1 -- 172.21.15.62:0/2406042891 learned_addr learned my addr 172.21.15.62:0/2406042891 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.983+0000 7f679e378640 1 -- 172.21.15.62:0/2406042891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12e694550 con 0x55a12e514c20 2024-04-26T07:56:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.983+0000 7f679e378640 1 --2- 172.21.15.62:0/2406042891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e693f80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f679000a190 tx=0x7f679004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279bbb16a3c143ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.983+0000 7f668c608640 1 -- 172.21.15.62:0/2406042891 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790052410 con 0x55a12e514c20 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.983+0000 7f668c608640 1 -- 172.21.15.62:0/2406042891 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6790062070 con 0x55a12e514c20 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.983+0000 7f668c608640 1 -- 172.21.15.62:0/2406042891 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790052700 con 0x55a12e514c20 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 -- 172.21.15.62:0/2406042891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 msgr2=0x55a12e693f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 --2- 172.21.15.62:0/2406042891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e693f80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f679000a190 tx=0x7f679004c000 comp rx=0 tx=0).stop 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 -- 172.21.15.62:0/2406042891 shutdown_connections 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 --2- 172.21.15.62:0/2406042891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e693f80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 -- 172.21.15.62:0/2406042891 >> 172.21.15.62:0/2406042891 conn(0x55a12e59bd60 msgr2=0x55a12e68f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 -- 172.21.15.62:0/2406042891 shutdown_connections 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 -- 172.21.15.62:0/2406042891 wait complete. 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 Processor -- start 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 -- start start 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e69b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f67a272d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a12e5abf90 con 0x55a12e514c20 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f679e378640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e69b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f679e378640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e69b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41248/0 (socket says 172.21.15.62:41248) 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.984+0000 7f679e378640 1 -- 172.21.15.62:0/720464184 learned_addr learned my addr 172.21.15.62:0/720464184 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.985+0000 7f679e378640 1 -- 172.21.15.62:0/720464184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12e69bef0 con 0x55a12e514c20 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.985+0000 7f679e378640 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e69b9b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f679005f040 tx=0x7f6790003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.985+0000 7f668ae05640 1 -- 172.21.15.62:0/720464184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679005d630 con 0x55a12e514c20 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.985+0000 7f668ae05640 1 -- 172.21.15.62:0/720464184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6790058040 con 0x55a12e514c20 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.985+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a12e69c180 con 0x55a12e514c20 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.985+0000 7f668ae05640 1 -- 172.21.15.62:0/720464184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679005d920 con 0x55a12e514c20 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.985+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12e69ee30 con 0x55a12e514c20 2024-04-26T07:56:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.986+0000 7f668ae05640 1 -- 172.21.15.62:0/720464184 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6790050070 con 0x55a12e514c20 2024-04-26T07:56:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.986+0000 7f668ae05640 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6684036eb0 0x7f6684039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.986+0000 7f668ae05640 1 -- 172.21.15.62:0/720464184 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f679008ec70 con 0x55a12e514c20 2024-04-26T07:56:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.986+0000 7f679db77640 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6684036eb0 0x7f6684039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.986+0000 7f67a272d800 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e516130 0x55a12e6a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.986+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6a31c0 con 0x55a12e516130 2024-04-26T07:56:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.986+0000 7f679eb79640 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e516130 0x55a12e6a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:22.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.987+0000 7f679db77640 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6684036eb0 0x7f6684039370 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6788000f60 tx=0x7f6788001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:22.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.987+0000 7f679eb79640 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e516130 0x55a12e6a2bf0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.987+0000 7f679eb79640 1 -- 172.21.15.62:0/720464184 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67980083e0 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.987+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6a01a0 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.987+0000 7f679eb79640 1 -- 172.21.15.62:0/720464184 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67980083e0 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.987+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6a5010 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.988+0000 7f679eb79640 1 -- 172.21.15.62:0/720464184 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f67980083e0 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.988+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6a4350 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.988+0000 7f679eb79640 1 -- 172.21.15.62:0/720464184 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67980083e0 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.988+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6a4740 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.988+0000 7f679eb79640 1 -- 172.21.15.62:0/720464184 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67980083e0 con 0x55a12e516130 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.989+0000 7f67a272d800 1 Processor -- start 2024-04-26T07:56:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.989+0000 7f67a272d800 1 -- start start 2024-04-26T07:56:23.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.989+0000 7f67a272d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6b3ec0 0x55a12e6b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.989+0000 7f67a272d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a12e493170 con 0x55a12e6b3ec0 2024-04-26T07:56:23.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.989+0000 7f679db77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6b3ec0 0x55a12e6b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.989+0000 7f679db77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6b3ec0 0x55a12e6b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41258/0 (socket says 172.21.15.62:41258) 2024-04-26T07:56:23.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.989+0000 7f679db77640 1 -- 172.21.15.62:0/2942248154 learned_addr learned my addr 172.21.15.62:0/2942248154 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.989+0000 7f679db77640 1 -- 172.21.15.62:0/2942248154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12e6b4820 con 0x55a12e6b3ec0 2024-04-26T07:56:23.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.990+0000 7f679db77640 1 --2- 172.21.15.62:0/2942248154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6b3ec0 0x55a12e6b42e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6788001ed0 tx=0x7f678800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.990+0000 7f6683fff640 1 -- 172.21.15.62:0/2942248154 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6788022070 con 0x55a12e6b3ec0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.990+0000 7f6683fff640 1 -- 172.21.15.62:0/2942248154 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678800d520 con 0x55a12e6b3ec0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.990+0000 7f67a272d800 1 -- 172.21.15.62:0/2942248154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a12e6b5150 con 0x55a12e6b3ec0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.990+0000 7f6683fff640 1 -- 172.21.15.62:0/2942248154 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678800d800 con 0x55a12e6b3ec0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.990+0000 7f67a272d800 1 -- 172.21.15.62:0/2942248154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12e6b5650 con 0x55a12e6b3ec0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f6683fff640 1 -- 172.21.15.62:0/2942248154 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6788025070 con 0x55a12e6b3ec0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f6683fff640 1 --2- 172.21.15.62:0/2942248154 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6678036f20 0x7f66780393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f6683fff640 1 -- 172.21.15.62:0/2942248154 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f678804e3e0 con 0x55a12e6b3ec0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f679eb79640 1 --2- 172.21.15.62:0/2942248154 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6678036f20 0x7f66780393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f67a272d800 1 Processor -- start 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f67a272d800 1 -- start start 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f679eb79640 1 --2- 172.21.15.62:0/2942248154 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6678036f20 0x7f66780393e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55a12e6a3e70 tx=0x7f6798000f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f67a272d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.991+0000 7f67a272d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a12e694810 con 0x55a12e6c1120 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.992+0000 7f679db77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.992+0000 7f679db77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41268/0 (socket says 172.21.15.62:41268) 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.992+0000 7f679db77640 1 -- 172.21.15.62:0/2296203757 learned_addr learned my addr 172.21.15.62:0/2296203757 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.992+0000 7f679db77640 1 -- 172.21.15.62:0/2296203757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12e6c1b10 con 0x55a12e6c1120 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.992+0000 7f679db77640 1 --2- 172.21.15.62:0/2296203757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c1540 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f678800eee0 tx=0x7f6788024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7a817b9faf66f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.992+0000 7f6681ffb640 1 -- 172.21.15.62:0/2296203757 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6788026730 con 0x55a12e6c1120 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.992+0000 7f6681ffb640 1 -- 172.21.15.62:0/2296203757 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678804b1d0 con 0x55a12e6c1120 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.992+0000 7f6681ffb640 1 -- 172.21.15.62:0/2296203757 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880268d0 con 0x55a12e6c1120 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 -- 172.21.15.62:0/2296203757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 msgr2=0x55a12e6c1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 --2- 172.21.15.62:0/2296203757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c1540 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f678800eee0 tx=0x7f6788024740 comp rx=0 tx=0).stop 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 -- 172.21.15.62:0/2296203757 shutdown_connections 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 --2- 172.21.15.62:0/2296203757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c1540 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 -- 172.21.15.62:0/2296203757 >> 172.21.15.62:0/2296203757 conn(0x55a12e6bd480 msgr2=0x55a12e6bb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 -- 172.21.15.62:0/2296203757 shutdown_connections 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 -- 172.21.15.62:0/2296203757 wait complete. 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 Processor -- start 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 -- start start 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f67a272d800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a12e6c2280 con 0x55a12e6c1120 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f679db77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f679db77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41272/0 (socket says 172.21.15.62:41272) 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.993+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 learned_addr learned my addr 172.21.15.62:0/787299337 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.994+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12e6c8d90 con 0x55a12e6c1120 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.994+0000 7f679db77640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c8850 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6788024a50 tx=0x7f678804c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.994+0000 7f666ffff640 1 -- 172.21.15.62:0/787299337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678802f070 con 0x55a12e6c1120 2024-04-26T07:56:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.994+0000 7f666ffff640 1 -- 172.21.15.62:0/787299337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678804b380 con 0x55a12e6c1120 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.994+0000 7f666ffff640 1 -- 172.21.15.62:0/787299337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6788025360 con 0x55a12e6c1120 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.994+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a12e6c8d90 con 0x55a12e6c1120 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.994+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12e6c8d90 con 0x55a12e6c1120 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.995+0000 7f666ffff640 1 -- 172.21.15.62:0/787299337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f678803cd10 con 0x55a12e6c1120 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.995+0000 7f666ffff640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6668036eb0 0x7f6668039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.995+0000 7f666ffff640 1 -- 172.21.15.62:0/787299337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f678801f080 con 0x55a12e6c1120 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.995+0000 7f679eb79640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6668036eb0 0x7f6668039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.995+0000 7f679eb79640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6668036eb0 0x7f6668039370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f679800f010 tx=0x7f679800c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e6d3f80 0x55a12e6d6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6d6b90 con 0x55a12e6d3f80 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f679e378640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e6d3f80 0x55a12e6d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f679e378640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e6d3f80 0x55a12e6d6440 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 20 realm 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6d6fa0 con 0x55a12e6d3f80 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.996+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6d7870 con 0x55a12e6d3f80 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6d7c10 con 0x55a12e6d3f80 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6d8460 con 0x55a12e6d3f80 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 20 searching for the correct realm 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a12e6da1d0 0x55a12e6dc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.997+0000 7f679db77640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a12e6da1d0 0x55a12e6dc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.998+0000 7f679db77640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a12e6da1d0 0x55a12e6dc5c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.998+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.998+0000 7f679db77640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f678801ac20 0x7f6788010070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.998+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f678801ac20 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.998+0000 7f679eb79640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f678801ac20 0x7f6788010070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.998+0000 7f679eb79640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f678801ac20 0x7f6788010070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.999+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.999+0000 7f679eb79640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f6798019040 0x7f6798019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.999+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f6798019040 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.999+0000 7f679e378640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f6798019040 0x7f6798019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:22.999+0000 7f679e378640 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f6798019040 0x7f6798019930 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.000+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.000+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.000+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.000+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.000+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.000+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.000+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.000+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f6798019040 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.001+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.001+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f678801ac20 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.001+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.001+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.001+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.001+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.001+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.001+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f6798019040 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.002+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.002+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.002+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.002+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f678801ac20 2024-04-26T07:56:23.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.002+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.002+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.002+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.002+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.003+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.003+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f6798019040 2024-04-26T07:56:23.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.003+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.003+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.003+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.003+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.003+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.003+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.004+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.004+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.004+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.004+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f6798019040 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.004+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.004+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.005+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.005+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f678801ac20 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.005+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.005+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.005+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.005+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f6798019040 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.006+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.006+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.006+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.006+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f6798019040 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.006+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.006+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f678801ac20 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.006+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.006+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6da1d0 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.007+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.007+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f6798019040 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.007+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.007+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x55a12e6d3f80 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.007+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.007+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dcb80 con 0x7f678801ac20 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6d8e10 con 0x55a12e6d3f80 2024-04-26T07:56:23.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6d96b0 con 0x55a12e6d3f80 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.008+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6d96b0 con 0x55a12e6d3f80 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 20 zone default found 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 4 Realm: () 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:23.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 20 zonegroup default 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dd000 con 0x7f6798019040 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dea40 con 0x55a12e6da1d0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.009+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.010+0000 7f67a272d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.010+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.010+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6def10 con 0x55a12e6da1d0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.010+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.010+0000 7f67a272d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.010+0000 7f67a272d800 20 started sync module instance, tier type = 2024-04-26T07:56:23.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.010+0000 7f67a272d800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:23.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.010+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dde80 con 0x7f678801ac20 2024-04-26T07:56:23.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.011+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.011+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94150757049248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dde80 con 0x7f678801ac20 2024-04-26T07:56:23.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.011+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6df9d0 con 0x55a12e6d3f80 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.012+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.012+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94150757053664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6df980 con 0x55a12e6d3f80 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.012+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e0970 con 0x55a12e6da1d0 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.012+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94150757049248] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.013+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94150757053664] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.013+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.013+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94150757057600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6dfdc0 con 0x55a12e6da1d0 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.013+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e1210 con 0x7f678801ac20 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.015+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94150757057600] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.015+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.015+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94150757059936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e1180 con 0x7f678801ac20 2024-04-26T07:56:23.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.015+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e20d0 con 0x55a12e6d3f80 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.016+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.016+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94150757063712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e24f0 con 0x55a12e6d3f80 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.016+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e2ff0 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.016+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94150757059936] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.017+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94150757063712] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.017+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.017+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94150757067488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e2040 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.017+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e3890 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.018+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(56 notify.6 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.018+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94150757069328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e3ae0 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.018+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e3ae0 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.018+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94150757067488] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(58 notify.7 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94150757069328] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94150757062144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e3ff0 con 0x7f6798019040 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f67a272d800 20 add_watcher() i=0 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f67a272d800 20 add_watcher() i=1 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f67a272d800 20 add_watcher() i=2 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f67a272d800 20 add_watcher() i=3 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f67a272d800 20 add_watcher() i=4 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f67a272d800 20 add_watcher() i=5 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.019+0000 7f67a272d800 20 add_watcher() i=6 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.020+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94150757062144] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.020+0000 7f67a272d800 20 add_watcher() i=7 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.020+0000 7f67a272d800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.020+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e74d0 con 0x55a12e6d3f80 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.021+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.021+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94150757072880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e4960 con 0x55a12e6d3f80 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.022+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94150757072880] v29'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.022+0000 7f6654fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.022+0000 7f67a272d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.022+0000 7f67a272d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.022+0000 7f67a272d800 5 note: GC not initialized 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.022+0000 7f65cf7fe640 20 reqs_thread_entry: start 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.023+0000 7f67a272d800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.023+0000 7f67a272d800 20 Filter name: none 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.023+0000 7f65cd7fa640 20 reqs_thread_entry: start 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.023+0000 7f67a272d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.023+0000 7f67a272d800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.023+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e71aac0 con 0x7f6798019040 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.024+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.024+0000 7f67a272d800 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T07:56:23.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.024+0000 7f67a272d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.024+0000 7f67a272d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.024+0000 7f67a272d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.024+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e7210d0 con 0x7f6798019040 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f67a272d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f67a272d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f67a272d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94150757321536 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a12e71c7e0 con 0x55a12e6d3f80 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94150757063712 notify 124554051616 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55a12e69ee30 con 0x55a12e6d3f80 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f6681ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051616 cookie 94150757063712 notifier 4892 bl.length()=666 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f6681ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:23.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f6681ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f6681ffb640 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6664003ea0 con 0x55a12e6d3f80 2024-04-26T07:56:23.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94150757321536 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.026+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94150757321536 notify 124554051616 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a12e69c180 con 0x55a12e6d3f80 2024-04-26T07:56:23.038 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.027+0000 7f6654fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.028+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94150757072880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e719060 con 0x55a12e6d3f80 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.029+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94150757072880] v29'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.029+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94150757049248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e3ff0 con 0x7f678801ac20 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.031+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94150757049248] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.031+0000 7f67a272d800 20 remove_watcher() i=0 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.031+0000 7f67a272d800 2 removed watcher, disabling cache 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.031+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94150757053664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e3ff0 con 0x55a12e6d3f80 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.032+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94150757053664] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.032+0000 7f67a272d800 20 remove_watcher() i=1 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.032+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94150757057600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6df4e0 con 0x55a12e6da1d0 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.033+0000 7f679db77640 1 -- 172.21.15.62:0/787299337 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94150757057600] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6788024030 con 0x55a12e6da1d0 2024-04-26T07:56:23.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.033+0000 7f67a272d800 20 remove_watcher() i=2 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.033+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94150757059936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e3ff0 con 0x7f678801ac20 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.034+0000 7f679eb79640 1 -- 172.21.15.62:0/787299337 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94150757059936] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679802f040 con 0x7f678801ac20 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.034+0000 7f67a272d800 20 remove_watcher() i=3 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.034+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94150757063712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e0440 con 0x55a12e6d3f80 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.035+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94150757063712] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x55a12e6d3f80 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.035+0000 7f67a272d800 20 remove_watcher() i=4 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.035+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94150757067488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e0d60 con 0x7f6798019040 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.037+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94150757067488] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.037+0000 7f67a272d800 20 remove_watcher() i=5 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.037+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94150757069328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e3ff0 con 0x7f6798019040 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.038+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94150757069328] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.038+0000 7f67a272d800 20 remove_watcher() i=6 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.038+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94150757062144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a12e6e1c20 con 0x7f6798019040 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94150757062144] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790077020 con 0x7f6798019040 2024-04-26T07:56:23.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 20 remove_watcher() i=7 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f6798019040 msgr2=0x7f6798019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f6798019040 0x7f6798019930 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e6d3f80 msgr2=0x55a12e6d6440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e6d3f80 0x55a12e6d6440 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f678801ac20 msgr2=0x7f6788010070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f678801ac20 0x7f6788010070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a12e6da1d0 msgr2=0x55a12e6dc5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55a12e6da1d0 0x55a12e6dc5c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6668036eb0 msgr2=0x7f6668039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6668036eb0 0x7f6668039370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f679800f010 tx=0x7f679800c040 comp rx=0 tx=0).stop 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f679e378640 1 -- 172.21.15.62:0/787299337 reap_dead start 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 msgr2=0x55a12e6c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c8850 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6788024a50 tx=0x7f678804c6b0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 shutdown_connections 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 --2- 172.21.15.62:0/787299337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6c1120 0x55a12e6c8850 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 >> 172.21.15.62:0/787299337 conn(0x55a12e6bd480 msgr2=0x55a12e6baae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 shutdown_connections 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.039+0000 7f67a272d800 1 -- 172.21.15.62:0/787299337 wait complete. 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/2942248154 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6678036f20 msgr2=0x7f66780393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/2942248154 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6678036f20 0x7f66780393e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55a12e6a3e70 tx=0x7f6798000f90 comp rx=0 tx=0).stop 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/2942248154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6b3ec0 msgr2=0x55a12e6b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/2942248154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6b3ec0 0x55a12e6b42e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6788001ed0 tx=0x7f678800ea00 comp rx=0 tx=0).stop 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/2942248154 shutdown_connections 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/2942248154 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6678036f20 0x7f66780393e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/2942248154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e6b3ec0 0x55a12e6b42e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/2942248154 >> 172.21.15.62:0/2942248154 conn(0x55a12e6a7ec0 msgr2=0x55a12e6a82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/2942248154 shutdown_connections 2024-04-26T07:56:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/2942248154 wait complete. 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e516130 msgr2=0x55a12e6a2bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e516130 0x55a12e6a2bf0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6684036eb0 msgr2=0x7f6684039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6684036eb0 0x7f6684039370 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6788000f60 tx=0x7f6788001370 comp rx=0 tx=0).stop 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 msgr2=0x55a12e69b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e69b9b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f679005f040 tx=0x7f6790003330 comp rx=0 tx=0).stop 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 shutdown_connections 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55a12e516130 0x55a12e6a2bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f6684036eb0 0x7f6684039370 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 --2- 172.21.15.62:0/720464184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a12e514c20 0x55a12e69b9b0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 >> 172.21.15.62:0/720464184 conn(0x55a12e59bd60 msgr2=0x55a12e68e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 shutdown_connections 2024-04-26T07:56:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.040+0000 7f67a272d800 1 -- 172.21.15.62:0/720464184 wait complete. 2024-04-26T07:56:23.049 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:23.050 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:23.050 ERROR:root:0 2024-04-26T07:56:23.050 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.055 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000ac99fe0431823763-00662b5e27-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:56:23.056 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T07:56:23.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T07:56:23.056 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-04-26T07:56:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00bf534800 1 Processor -- start 2024-04-26T07:56:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00bf534800 1 -- start start 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00bf534800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x555c29843960 0x555c29843d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00bf534800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c298443b0 con 0x555c298469a0 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00bf534800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x555c296e7e20 con 0x555c29843960 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00bb2cc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x555c29843960 0x555c29843d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00bb2cc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x555c29843960 0x555c29843d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41282/0 (socket says 172.21.15.62:41282) 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00baacb640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x555c298469a0 0x555c29846e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33280/0 (socket says 172.21.15.62:33280) 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.106+0000 7f00bb2cc640 1 -- 172.21.15.62:0/319841826 learned_addr learned my addr 172.21.15.62:0/319841826 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.107+0000 7f00bb2cc640 1 -- 172.21.15.62:0/319841826 >> v1:172.21.15.1:6789/0 conn(0x555c298469a0 legacy=0x555c29846e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.107+0000 7f00bb2cc640 1 -- 172.21.15.62:0/319841826 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c29847560 con 0x555c29843960 2024-04-26T07:56:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.107+0000 7f00ba2ca640 1 -- 172.21.15.62:0/319841826 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014870727 0 0) 0x555c298443b0 con 0x555c298469a0 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.108+0000 7f00bb2cc640 1 --2- 172.21.15.62:0/319841826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29843d80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00a520 tx=0x7f00ac01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b251f43f7bafdcf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00ba2ca640 1 -- 172.21.15.62:0/319841826 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac057070 con 0x555c29843960 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00ba2ca640 1 -- 172.21.15.62:0/319841826 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac052570 con 0x555c29843960 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00ba2ca640 1 -- 172.21.15.62:0/319841826 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac052870 con 0x555c29843960 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00bf534800 1 -- 172.21.15.62:0/319841826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 msgr2=0x555c29843d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00bf534800 1 --2- 172.21.15.62:0/319841826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29843d80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00a520 tx=0x7f00ac01d010 comp rx=0 tx=0).stop 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00bf534800 1 -- 172.21.15.62:0/319841826 shutdown_connections 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00bf534800 1 --2- 172.21.15.62:0/319841826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29843d80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00bf534800 1 -- 172.21.15.62:0/319841826 >> 172.21.15.62:0/319841826 conn(0x555c2983f360 msgr2=0x555c29841780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00bf534800 1 -- 172.21.15.62:0/319841826 shutdown_connections 2024-04-26T07:56:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.109+0000 7f00bf534800 1 -- 172.21.15.62:0/319841826 wait complete. 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.122+0000 7f00bf534800 1 Processor -- start 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.122+0000 7f00bf534800 1 -- start start 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.122+0000 7f00bf534800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c298462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.122+0000 7f00bf534800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c29790d00 con 0x555c29843960 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.122+0000 7f00bb2cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c298462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.122+0000 7f00bb2cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c298462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41292/0 (socket says 172.21.15.62:41292) 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.122+0000 7f00bb2cc640 1 -- 172.21.15.62:0/495150531 learned_addr learned my addr 172.21.15.62:0/495150531 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.123+0000 7f00bb2cc640 1 -- 172.21.15.62:0/495150531 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c298448a0 con 0x555c29843960 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.123+0000 7f00bb2cc640 1 --2- 172.21.15.62:0/495150531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c298462e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f00ac055040 tx=0x7f00ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca8c9c5a80e1811 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.123+0000 7effa960a640 1 -- 172.21.15.62:0/495150531 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac062070 con 0x555c29843960 2024-04-26T07:56:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.123+0000 7effa960a640 1 -- 172.21.15.62:0/495150531 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac052850 con 0x555c29843960 2024-04-26T07:56:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.123+0000 7effa960a640 1 -- 172.21.15.62:0/495150531 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac057040 con 0x555c29843960 2024-04-26T07:56:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 -- 172.21.15.62:0/495150531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 msgr2=0x555c298462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 --2- 172.21.15.62:0/495150531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c298462e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f00ac055040 tx=0x7f00ac04c000 comp rx=0 tx=0).stop 2024-04-26T07:56:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 -- 172.21.15.62:0/495150531 shutdown_connections 2024-04-26T07:56:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 --2- 172.21.15.62:0/495150531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c298462e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 -- 172.21.15.62:0/495150531 >> 172.21.15.62:0/495150531 conn(0x555c2983f360 msgr2=0x555c29932480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 -- 172.21.15.62:0/495150531 shutdown_connections 2024-04-26T07:56:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 -- 172.21.15.62:0/495150531 wait complete. 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 Processor -- start 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 -- start start 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29940760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bf534800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c2984ee10 con 0x555c29843960 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bb2cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29940760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bb2cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29940760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41300/0 (socket says 172.21.15.62:41300) 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.124+0000 7f00bb2cc640 1 -- 172.21.15.62:0/4233273149 learned_addr learned my addr 172.21.15.62:0/4233273149 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.125+0000 7f00bb2cc640 1 -- 172.21.15.62:0/4233273149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c29940ca0 con 0x555c29843960 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.125+0000 7f00bb2cc640 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29940760 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f00ac005400 tx=0x7f00ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.125+0000 7effa7e07640 1 -- 172.21.15.62:0/4233273149 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac057050 con 0x555c29843960 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.125+0000 7effa7e07640 1 -- 172.21.15.62:0/4233273149 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac067660 con 0x555c29843960 2024-04-26T07:56:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.125+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c29940f30 con 0x555c29843960 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.125+0000 7effa7e07640 1 -- 172.21.15.62:0/4233273149 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac062040 con 0x555c29843960 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.125+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c29943be0 con 0x555c29843960 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.126+0000 7effa7e07640 1 -- 172.21.15.62:0/4233273149 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f00ac067960 con 0x555c29843960 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.126+0000 7effa7e07640 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7effa0036e60 0x7effa0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.126+0000 7effa7e07640 1 -- 172.21.15.62:0/4233273149 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f00ac08ec10 con 0x555c29843960 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.126+0000 7f00baacb640 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7effa0036e60 0x7effa0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.126+0000 7f00bf534800 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c298469a0 0x555c299479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.126+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c29947ee0 con 0x555c298469a0 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.126+0000 7f00bbacd640 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c298469a0 0x555c299479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.126+0000 7f00baacb640 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7effa0036e60 0x7effa0039320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f00b0000c00 tx=0x7f00b00013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.127+0000 7f00bbacd640 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c298469a0 0x555c299479a0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.127+0000 7f00bbacd640 1 -- 172.21.15.62:0/4233273149 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b400a4a0 con 0x555c298469a0 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.127+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c29944f50 con 0x555c298469a0 2024-04-26T07:56:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.127+0000 7f00bbacd640 1 -- 172.21.15.62:0/4233273149 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b400a4a0 con 0x555c298469a0 2024-04-26T07:56:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.127+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c29949cc0 con 0x555c298469a0 2024-04-26T07:56:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.127+0000 7f00bbacd640 1 -- 172.21.15.62:0/4233273149 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00b400a4a0 con 0x555c298469a0 2024-04-26T07:56:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.127+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c29949000 con 0x555c298469a0 2024-04-26T07:56:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.128+0000 7f00bbacd640 1 -- 172.21.15.62:0/4233273149 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b400a4a0 con 0x555c298469a0 2024-04-26T07:56:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.128+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c29949420 con 0x555c298469a0 2024-04-26T07:56:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.128+0000 7f00bbacd640 1 -- 172.21.15.62:0/4233273149 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f00b400a4a0 con 0x555c298469a0 2024-04-26T07:56:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.128+0000 7f00bf534800 1 Processor -- start 2024-04-26T07:56:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.128+0000 7f00bf534800 1 -- start start 2024-04-26T07:56:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.129+0000 7f00bf534800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29958ad0 0x555c29958ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.129+0000 7f00bf534800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c29738170 con 0x555c29958ad0 2024-04-26T07:56:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.129+0000 7f00baacb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29958ad0 0x555c29958ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.129+0000 7f00baacb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29958ad0 0x555c29958ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41304/0 (socket says 172.21.15.62:41304) 2024-04-26T07:56:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.129+0000 7f00baacb640 1 -- 172.21.15.62:0/763748417 learned_addr learned my addr 172.21.15.62:0/763748417 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.129+0000 7f00baacb640 1 -- 172.21.15.62:0/763748417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c29959430 con 0x555c29958ad0 2024-04-26T07:56:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.129+0000 7f00baacb640 1 --2- 172.21.15.62:0/763748417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29958ad0 0x555c29958ef0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f00b000e610 tx=0x7f00b000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.130+0000 7effa5602640 1 -- 172.21.15.62:0/763748417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0022070 con 0x555c29958ad0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.130+0000 7effa5602640 1 -- 172.21.15.62:0/763748417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0009050 con 0x555c29958ad0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.130+0000 7f00bf534800 1 -- 172.21.15.62:0/763748417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c29959ea0 con 0x555c29958ad0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.130+0000 7effa5602640 1 -- 172.21.15.62:0/763748417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b000d500 con 0x555c29958ad0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.130+0000 7f00bf534800 1 -- 172.21.15.62:0/763748417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c2995a3a0 con 0x555c29958ad0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7effa5602640 1 -- 172.21.15.62:0/763748417 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f00b0025070 con 0x555c29958ad0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7effa5602640 1 --2- 172.21.15.62:0/763748417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94036e60 0x7eff94039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7effa5602640 1 -- 172.21.15.62:0/763748417 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f00b004e260 con 0x555c29958ad0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7f00bbacd640 1 --2- 172.21.15.62:0/763748417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94036e60 0x7eff94039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7f00bf534800 1 Processor -- start 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7f00bf534800 1 -- start start 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7f00bbacd640 1 --2- 172.21.15.62:0/763748417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94036e60 0x7eff94039320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x555c299493a0 tx=0x7f00b4005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7f00bf534800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c29966300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.131+0000 7f00bf534800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c29844b60 con 0x555c29965f00 2024-04-26T07:56:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.132+0000 7f00baacb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c29966300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.132+0000 7f00baacb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c29966300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41310/0 (socket says 172.21.15.62:41310) 2024-04-26T07:56:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.132+0000 7f00baacb640 1 -- 172.21.15.62:0/4134346222 learned_addr learned my addr 172.21.15.62:0/4134346222 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.132+0000 7f00baacb640 1 -- 172.21.15.62:0/4134346222 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c299668d0 con 0x555c29965f00 2024-04-26T07:56:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.132+0000 7f00baacb640 1 --2- 172.21.15.62:0/4134346222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c29966300 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f00b004c5d0 tx=0x7f00b0026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54943aa44d14a77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.132+0000 7eff9effd640 1 -- 172.21.15.62:0/4134346222 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b003c980 con 0x555c29965f00 2024-04-26T07:56:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.132+0000 7eff9effd640 1 -- 172.21.15.62:0/4134346222 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b004b170 con 0x555c29965f00 2024-04-26T07:56:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.132+0000 7eff9effd640 1 -- 172.21.15.62:0/4134346222 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0040aa0 con 0x555c29965f00 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 -- 172.21.15.62:0/4134346222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 msgr2=0x555c29966300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 --2- 172.21.15.62:0/4134346222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c29966300 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f00b004c5d0 tx=0x7f00b0026680 comp rx=0 tx=0).stop 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 -- 172.21.15.62:0/4134346222 shutdown_connections 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 --2- 172.21.15.62:0/4134346222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c29966300 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 -- 172.21.15.62:0/4134346222 >> 172.21.15.62:0/4134346222 conn(0x555c299621d0 msgr2=0x555c29960230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 -- 172.21.15.62:0/4134346222 shutdown_connections 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 -- 172.21.15.62:0/4134346222 wait complete. 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 Processor -- start 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 -- start start 2024-04-26T07:56:23.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c2996d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00bf534800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c29967080 con 0x555c29965f00 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00baacb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c2996d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00baacb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c2996d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41312/0 (socket says 172.21.15.62:41312) 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.133+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 learned_addr learned my addr 172.21.15.62:0/3974758417 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.134+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c2996da00 con 0x555c29965f00 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.134+0000 7f00baacb640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c2996d4c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f00b000ee30 tx=0x7f00b004c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.134+0000 7eff9d7fa640 1 -- 172.21.15.62:0/3974758417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0025360 con 0x555c29965f00 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.134+0000 7eff9d7fa640 1 -- 172.21.15.62:0/3974758417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0025500 con 0x555c29965f00 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.134+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c2996dc90 con 0x555c29965f00 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.134+0000 7eff9d7fa640 1 -- 172.21.15.62:0/3974758417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00256b0 con 0x555c29965f00 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.134+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c2996dc90 con 0x555c29965f00 2024-04-26T07:56:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.135+0000 7eff9d7fa640 1 -- 172.21.15.62:0/3974758417 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f00b003b3a0 con 0x555c29965f00 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.135+0000 7eff9d7fa640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff84036eb0 0x7eff84039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.135+0000 7eff9d7fa640 1 -- 172.21.15.62:0/3974758417 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f00b0034d00 con 0x555c29965f00 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.135+0000 7f00bbacd640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff84036eb0 0x7eff84039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.135+0000 7f00bbacd640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff84036eb0 0x7eff84039370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x555c29948b20 tx=0x7f00b401f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.135+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c29978da0 0x555c2997b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2997b9b0 con 0x555c29978da0 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bb2cc640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c29978da0 0x555c2997b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bb2cc640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c29978da0 0x555c2997b260 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00ac064070 con 0x555c29978da0 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 20 realm 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2997bdc0 con 0x555c29978da0 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00ac064070 con 0x555c29978da0 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.136+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2997c690 con 0x555c29978da0 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00ac064070 con 0x555c29978da0 2024-04-26T07:56:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2997ca30 con 0x555c29978da0 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00ac064070 con 0x555c29978da0 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2997d280 con 0x555c29978da0 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00ac064070 con 0x555c29978da0 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 20 searching for the correct realm 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x555c2997eff0 0x555c299813e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.137+0000 7f00baacb640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x555c2997eff0 0x555c299813e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.138+0000 7f00baacb640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x555c2997eff0 0x555c299813e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.138+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.138+0000 7f00baacb640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f00b0027060 0x7f00b002c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.138+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b0027060 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.138+0000 7f00bbacd640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f00b0027060 0x7f00b002c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.138+0000 7f00bbacd640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f00b0027060 0x7f00b002c960 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.139+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b401f070 con 0x7f00b0027060 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.139+0000 7f00bbacd640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f00b4031040 0x7f00b4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.139+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b4031040 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.139+0000 7f00bb2cc640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f00b4031040 0x7f00b4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.139+0000 7f00bb2cc640 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f00b4031040 0x7f00b4032940 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.140+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac064070 con 0x7f00b4031040 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.140+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.140+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac064070 con 0x555c29978da0 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.140+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.140+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f00ac064070 con 0x555c29978da0 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.140+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.140+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.140+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b4031040 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.141+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.141+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b0027060 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.141+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b401f070 con 0x7f00b0027060 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.141+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.141+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.141+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.141+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.141+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b4031040 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b0027060 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f00b401f070 con 0x7f00b0027060 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.142+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b4031040 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.143+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.144+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.144+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b4031040 2024-04-26T07:56:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.144+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.144+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.144+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.144+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b0027060 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.145+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b401f070 con 0x7f00b0027060 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.145+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.145+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.145+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b4031040 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.145+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.145+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.146+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.146+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b4031040 2024-04-26T07:56:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.146+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.146+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b0027060 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.146+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b401f070 con 0x7f00b0027060 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.146+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c2997eff0 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.146+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.146+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b4031040 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x555c29978da0 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c299819c0 con 0x7f00b0027060 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b401f070 con 0x7f00b0027060 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2997dc30 con 0x555c29978da0 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.147+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2997e4d0 con 0x555c29978da0 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2997e4d0 con 0x555c29978da0 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 20 zone default found 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 4 Realm: () 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 20 zonegroup default 2024-04-26T07:56:23.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c29981e40 con 0x7f00b4031040 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.148+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c299838a0 con 0x555c2997eff0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00bf534800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c29983da0 con 0x555c2997eff0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00bf534800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00bf534800 20 started sync module instance, tier type = 2024-04-26T07:56:23.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00bf534800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.149+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29982cc0 con 0x7f00b0027060 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.150+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4040040 con 0x7f00b0027060 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.150+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93854323191984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29982920 con 0x7f00b0027060 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.150+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29984cd0 con 0x555c29978da0 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.151+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93854323191984] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4040040 con 0x7f00b0027060 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.152+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.152+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93854323196416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29984cd0 con 0x555c29978da0 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.152+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c299856f0 con 0x555c2997eff0 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.153+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 93854323196416] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.153+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.153+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93854323197984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29984c40 con 0x555c2997eff0 2024-04-26T07:56:23.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.153+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c299865b0 con 0x7f00b0027060 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.154+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93854323197984] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.154+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4040040 con 0x7f00b0027060 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.154+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93854323204352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c299869d0 con 0x7f00b0027060 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.154+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29987390 con 0x555c29978da0 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.155+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.155+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93854323207904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c299877b0 con 0x555c29978da0 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.155+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c299882a0 con 0x7f00b4031040 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.155+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93854323204352] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4040040 con 0x7f00b0027060 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.156+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 93854323207904] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.156+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.156+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93854323211632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29987300 con 0x7f00b4031040 2024-04-26T07:56:23.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.156+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29988b40 con 0x7f00b4031040 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.157+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93854323211632] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.158+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.158+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93854323205408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29987300 con 0x7f00b4031040 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.158+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29989160 con 0x7f00b4031040 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.158+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93854323205408] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93854323213840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29989160 con 0x7f00b4031040 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bf534800 20 add_watcher() i=0 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bf534800 20 add_watcher() i=1 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bf534800 20 add_watcher() i=2 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bf534800 20 add_watcher() i=3 2024-04-26T07:56:23.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bf534800 20 add_watcher() i=4 2024-04-26T07:56:23.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bf534800 20 add_watcher() i=5 2024-04-26T07:56:23.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.159+0000 7f00bf534800 20 add_watcher() i=6 2024-04-26T07:56:23.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.160+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93854323213840] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.160+0000 7f00bf534800 20 add_watcher() i=7 2024-04-26T07:56:23.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.160+0000 7f00bf534800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:23.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.160+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c2998c470 con 0x555c29978da0 2024-04-26T07:56:23.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.160+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.160+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93854323215904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c299896f0 con 0x555c29978da0 2024-04-26T07:56:23.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.161+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93854323215904] v29'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.161+0000 7eff71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:23.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.161+0000 7f00bf534800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:23.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.161+0000 7f00bf534800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.161+0000 7f00bf534800 5 note: GC not initialized 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.162+0000 7eff70fe1640 20 reqs_thread_entry: start 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.162+0000 7f00bf534800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.162+0000 7f00bf534800 20 Filter name: none 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.162+0000 7efeea7fc640 20 reqs_thread_entry: start 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.162+0000 7f00bf534800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.162+0000 7f00bf534800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.162+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c299bfce0 con 0x7f00b4031040 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.163+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.163+0000 7f00bf534800 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.163+0000 7f00bf534800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:23.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.163+0000 7f00bf534800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.163+0000 7f00bf534800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.163+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c299c6630 con 0x7f00b4031040 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7f00bf534800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7f00bf534800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7f00bf534800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93854323466400 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c299c1d20 con 0x555c29978da0 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 93854323207904 notify 124554051617 ret 0) ==== 678+0+0 (crc 0 0 0) 0x555c29943be0 con 0x555c29978da0 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7eff9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051617 cookie 93854323207904 notifier 4899 bl.length()=636 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7eff9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7eff9effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 93854323466400 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.164+0000 7eff9effd640 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7eff80003ea0 con 0x555c29978da0 2024-04-26T07:56:23.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.165+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== watch-notify(notify_complete (2) cookie 93854323466400 notify 124554051617 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c29940f30 con 0x555c29978da0 2024-04-26T07:56:23.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.165+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.181 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:23.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.166+0000 7eff71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:23.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.166+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93854323215904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c299c2130 con 0x555c29978da0 2024-04-26T07:56:23.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.167+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93854323215904] v29'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.167+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93854323191984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29988e20 con 0x7f00b0027060 2024-04-26T07:56:23.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.168+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93854323191984] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4040040 con 0x7f00b0027060 2024-04-26T07:56:23.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.168+0000 7f00bf534800 20 remove_watcher() i=0 2024-04-26T07:56:23.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.168+0000 7f00bf534800 2 removed watcher, disabling cache 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.168+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93854323196416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29988e20 con 0x555c29978da0 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.169+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93854323196416] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.169+0000 7f00bf534800 20 remove_watcher() i=1 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.169+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93854323197984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29984200 con 0x555c2997eff0 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.170+0000 7f00baacb640 1 -- 172.21.15.62:0/3974758417 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93854323197984] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0024030 con 0x555c2997eff0 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.170+0000 7f00bf534800 20 remove_watcher() i=2 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.170+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93854323204352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29988e20 con 0x7f00b0027060 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.171+0000 7f00bbacd640 1 -- 172.21.15.62:0/3974758417 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93854323204352] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4040040 con 0x7f00b0027060 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.171+0000 7f00bf534800 20 remove_watcher() i=3 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.171+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93854323207904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29984820 con 0x555c29978da0 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.172+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93854323207904] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x555c29978da0 2024-04-26T07:56:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.172+0000 7f00bf534800 20 remove_watcher() i=4 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.172+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93854323211632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29986100 con 0x7f00b4031040 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.173+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93854323211632] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.173+0000 7f00bf534800 20 remove_watcher() i=5 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.173+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93854323205408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29988e20 con 0x7f00b4031040 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.174+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93854323205408] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.174+0000 7f00bf534800 20 remove_watcher() i=6 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.174+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93854323213840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c29986ee0 con 0x7f00b4031040 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93854323213840] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac095040 con 0x7f00b4031040 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 20 remove_watcher() i=7 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f00b4031040 msgr2=0x7f00b4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f00b4031040 0x7f00b4032940 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c29978da0 msgr2=0x555c2997b260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c29978da0 0x555c2997b260 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f00b0027060 msgr2=0x7f00b002c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f00b0027060 0x7f00b002c960 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x555c2997eff0 msgr2=0x555c299813e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x555c2997eff0 0x555c299813e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff84036eb0 msgr2=0x7eff84039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff84036eb0 0x7eff84039370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x555c29948b20 tx=0x7f00b401f000 comp rx=0 tx=0).stop 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 msgr2=0x555c2996d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c2996d4c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f00b000ee30 tx=0x7f00b004c530 comp rx=0 tx=0).stop 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.175+0000 7f00bb2cc640 1 -- 172.21.15.62:0/3974758417 reap_dead start 2024-04-26T07:56:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 shutdown_connections 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 --2- 172.21.15.62:0/3974758417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29965f00 0x555c2996d4c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 >> 172.21.15.62:0/3974758417 conn(0x555c299621d0 msgr2=0x555c2995f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 shutdown_connections 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/3974758417 wait complete. 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/763748417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94036e60 msgr2=0x7eff94039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 --2- 172.21.15.62:0/763748417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94036e60 0x7eff94039320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x555c299493a0 tx=0x7f00b4005840 comp rx=0 tx=0).stop 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/763748417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29958ad0 msgr2=0x555c29958ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 --2- 172.21.15.62:0/763748417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29958ad0 0x555c29958ef0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f00b000e610 tx=0x7f00b000ff90 comp rx=0 tx=0).stop 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/763748417 shutdown_connections 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 --2- 172.21.15.62:0/763748417 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7eff94036e60 0x7eff94039320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 --2- 172.21.15.62:0/763748417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29958ad0 0x555c29958ef0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/763748417 >> 172.21.15.62:0/763748417 conn(0x555c2994cb70 msgr2=0x555c2994cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/763748417 shutdown_connections 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/763748417 wait complete. 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c298469a0 msgr2=0x555c299479a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c298469a0 0x555c299479a0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7effa0036e60 msgr2=0x7effa0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7effa0036e60 0x7effa0039320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f00b0000c00 tx=0x7f00b00013b0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 msgr2=0x555c29940760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.176+0000 7f00bf534800 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29940760 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f00ac005400 tx=0x7f00ac002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.177+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 shutdown_connections 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.177+0000 7f00bf534800 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x555c298469a0 0x555c299479a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.177+0000 7f00bf534800 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7effa0036e60 0x7effa0039320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.177+0000 7f00bf534800 1 --2- 172.21.15.62:0/4233273149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c29843960 0x555c29940760 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.177+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 >> 172.21.15.62:0/4233273149 conn(0x555c2983f360 msgr2=0x555c298450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.177+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 shutdown_connections 2024-04-26T07:56:23.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.177+0000 7f00bf534800 1 -- 172.21.15.62:0/4233273149 wait complete. 2024-04-26T07:56:23.193 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:23.193 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:23.193 ERROR:root:0 2024-04-26T07:56:23.193 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T07:56:23.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T07:56:23.194 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d8940800 1 Processor -- start 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d8940800 1 -- start start 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d8940800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f65c327bd0 0x55f65c329fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d8940800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f65c32a500 con 0x55f65c321960 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d8940800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55f65c1c5e20 con 0x55f65c327bd0 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d5c3e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f65c327bd0 0x55f65c329fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d643f640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55f65c321960 0x55f65c321d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33292/0 (socket says 172.21.15.62:33292) 2024-04-26T07:56:23.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d5c3e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55f65c327bd0 0x55f65c329fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41320/0 (socket says 172.21.15.62:41320) 2024-04-26T07:56:23.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.245+0000 7ff0d643f640 1 -- 172.21.15.62:0/899438621 learned_addr learned my addr 172.21.15.62:0/899438621 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:23.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.246+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/899438621 >> v1:172.21.15.1:6789/0 conn(0x55f65c321960 legacy=0x55f65c321d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.246+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/899438621 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65c32b710 con 0x55f65c327bd0 2024-04-26T07:56:23.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.246+0000 7ff0d543d640 1 -- 172.21.15.62:0/899438621 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902648072 0 0) 0x55f65c32a500 con 0x55f65c321960 2024-04-26T07:56:23.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/899438621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c327bd0 0x55f65c329fc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00a470 tx=0x7ff0cc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5205ccffad955b16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d543d640 1 -- 172.21.15.62:0/899438621 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc057070 con 0x55f65c327bd0 2024-04-26T07:56:23.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d543d640 1 -- 172.21.15.62:0/899438621 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc052570 con 0x55f65c327bd0 2024-04-26T07:56:23.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d543d640 1 -- 172.21.15.62:0/899438621 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc052870 con 0x55f65c327bd0 2024-04-26T07:56:23.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d8940800 1 -- 172.21.15.62:0/899438621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c327bd0 msgr2=0x55f65c329fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d8940800 1 --2- 172.21.15.62:0/899438621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c327bd0 0x55f65c329fc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00a470 tx=0x7ff0cc01ce90 comp rx=0 tx=0).stop 2024-04-26T07:56:23.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d8940800 1 -- 172.21.15.62:0/899438621 shutdown_connections 2024-04-26T07:56:23.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d8940800 1 --2- 172.21.15.62:0/899438621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c327bd0 0x55f65c329fc0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d8940800 1 -- 172.21.15.62:0/899438621 >> 172.21.15.62:0/899438621 conn(0x55f65c31d360 msgr2=0x55f65c31f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d8940800 1 -- 172.21.15.62:0/899438621 shutdown_connections 2024-04-26T07:56:23.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.248+0000 7ff0d8940800 1 -- 172.21.15.62:0/899438621 wait complete. 2024-04-26T07:56:23.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.261+0000 7ff0d8940800 1 Processor -- start 2024-04-26T07:56:23.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.261+0000 7ff0d8940800 1 -- start start 2024-04-26T07:56:23.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.261+0000 7ff0d8940800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c414a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.261+0000 7ff0d8940800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f65c26ed00 con 0x55f65c321960 2024-04-26T07:56:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.262+0000 7ff0d643f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c414a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.262+0000 7ff0d643f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c414a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41324/0 (socket says 172.21.15.62:41324) 2024-04-26T07:56:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.262+0000 7ff0d643f640 1 -- 172.21.15.62:0/1082655471 learned_addr learned my addr 172.21.15.62:0/1082655471 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.262+0000 7ff0d643f640 1 -- 172.21.15.62:0/1082655471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65c415020 con 0x55f65c321960 2024-04-26T07:56:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.262+0000 7ff0d643f640 1 --2- 172.21.15.62:0/1082655471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c414a50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800b240 tx=0x7ff0c800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb731dbe97832a46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.262+0000 7fefc4608640 1 -- 172.21.15.62:0/1082655471 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c8008070 con 0x55f65c321960 2024-04-26T07:56:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.262+0000 7fefc4608640 1 -- 172.21.15.62:0/1082655471 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c800d500 con 0x55f65c321960 2024-04-26T07:56:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.262+0000 7fefc4608640 1 -- 172.21.15.62:0/1082655471 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c800d860 con 0x55f65c321960 2024-04-26T07:56:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 -- 172.21.15.62:0/1082655471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 msgr2=0x55f65c414a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 --2- 172.21.15.62:0/1082655471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c414a50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800b240 tx=0x7ff0c800b700 comp rx=0 tx=0).stop 2024-04-26T07:56:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 -- 172.21.15.62:0/1082655471 shutdown_connections 2024-04-26T07:56:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 --2- 172.21.15.62:0/1082655471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c414a50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 -- 172.21.15.62:0/1082655471 >> 172.21.15.62:0/1082655471 conn(0x55f65c31d360 msgr2=0x55f65c410370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 -- 172.21.15.62:0/1082655471 shutdown_connections 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 -- 172.21.15.62:0/1082655471 wait complete. 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 Processor -- start 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 -- start start 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c3242c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.263+0000 7ff0d8940800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f65c32a9d0 con 0x55f65c321960 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7ff0d643f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c3242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7ff0d643f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c3242c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41328/0 (socket says 172.21.15.62:41328) 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7ff0d643f640 1 -- 172.21.15.62:0/361424221 learned_addr learned my addr 172.21.15.62:0/361424221 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7ff0d643f640 1 -- 172.21.15.62:0/361424221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65c3229b0 con 0x55f65c321960 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7ff0d643f640 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c3242c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55f65c4157e0 tx=0x7ff0c8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7fefc2e05640 1 -- 172.21.15.62:0/361424221 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c8019870 con 0x55f65c321960 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7fefc2e05640 1 -- 172.21.15.62:0/361424221 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c8019a10 con 0x55f65c321960 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7fefc2e05640 1 -- 172.21.15.62:0/361424221 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c8019d30 con 0x55f65c321960 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f65c322c40 con 0x55f65c321960 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.264+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65c323160 con 0x55f65c321960 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.265+0000 7fefc2e05640 1 -- 172.21.15.62:0/361424221 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff0c8017040 con 0x55f65c321960 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.265+0000 7fefc2e05640 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefbc036e60 0x7fefbc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.265+0000 7fefc2e05640 1 -- 172.21.15.62:0/361424221 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff0c8015020 con 0x55f65c321960 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.265+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefbc036e60 0x7fefbc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.266+0000 7ff0d8940800 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c327bd0 0x55f65c425ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.266+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c426000 con 0x55f65c327bd0 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.266+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c327bd0 0x55f65c425ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.266+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefbc036e60 0x7fefbc039320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc054000 tx=0x7ff0cc04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.266+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c327bd0 0x55f65c425ac0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.266+0000 7ff0d6c40640 1 -- 172.21.15.62:0/361424221 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0d000a4a0 con 0x55f65c327bd0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.266+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c3234f0 con 0x55f65c327bd0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.267+0000 7ff0d6c40640 1 -- 172.21.15.62:0/361424221 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0d000a4a0 con 0x55f65c327bd0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.267+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c427e40 con 0x55f65c327bd0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.267+0000 7ff0d6c40640 1 -- 172.21.15.62:0/361424221 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0d000a4a0 con 0x55f65c327bd0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.267+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c427180 con 0x55f65c327bd0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.267+0000 7ff0d6c40640 1 -- 172.21.15.62:0/361424221 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0d000a4a0 con 0x55f65c327bd0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.267+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c427520 con 0x55f65c327bd0 2024-04-26T07:56:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.268+0000 7ff0d6c40640 1 -- 172.21.15.62:0/361424221 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0d000a4a0 con 0x55f65c327bd0 2024-04-26T07:56:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.268+0000 7ff0d8940800 1 Processor -- start 2024-04-26T07:56:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.268+0000 7ff0d8940800 1 -- start start 2024-04-26T07:56:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.268+0000 7ff0d8940800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c436bf0 0x55f65c437010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.268+0000 7ff0d8940800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f65c216170 con 0x55f65c436bf0 2024-04-26T07:56:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.268+0000 7ff0d5c3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c436bf0 0x55f65c437010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.268+0000 7ff0d5c3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c436bf0 0x55f65c437010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41342/0 (socket says 172.21.15.62:41342) 2024-04-26T07:56:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.268+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/2063968409 learned_addr learned my addr 172.21.15.62:0/2063968409 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.269+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/2063968409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65c437550 con 0x55f65c436bf0 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.269+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/2063968409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c436bf0 0x55f65c437010 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000c00 tx=0x7ff0cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.269+0000 7fefbbfff640 1 -- 172.21.15.62:0/2063968409 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc057040 con 0x55f65c436bf0 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.269+0000 7fefbbfff640 1 -- 172.21.15.62:0/2063968409 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc06d070 con 0x55f65c436bf0 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.269+0000 7ff0d8940800 1 -- 172.21.15.62:0/2063968409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f65c437fc0 con 0x55f65c436bf0 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.269+0000 7fefbbfff640 1 -- 172.21.15.62:0/2063968409 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc05ea70 con 0x55f65c436bf0 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.269+0000 7ff0d8940800 1 -- 172.21.15.62:0/2063968409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65c438460 con 0x55f65c436bf0 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.270+0000 7fefbbfff640 1 -- 172.21.15.62:0/2063968409 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff0cc067070 con 0x55f65c436bf0 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.270+0000 7fefbbfff640 1 --2- 172.21.15.62:0/2063968409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefb0036e60 0x7fefb0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.270+0000 7fefbbfff640 1 -- 172.21.15.62:0/2063968409 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff0cc0903c0 con 0x55f65c436bf0 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.270+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/2063968409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefb0036e60 0x7fefb0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.270+0000 7ff0d8940800 1 Processor -- start 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.270+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/2063968409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefb0036e60 0x7fefb0039320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55f65c426ca0 tx=0x7ff0d0005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.270+0000 7ff0d8940800 1 -- start start 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.270+0000 7ff0d8940800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c444290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7ff0d8940800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f65c4153a0 con 0x55f65c443e70 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7ff0d5c3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c444290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7ff0d5c3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c444290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41354/0 (socket says 172.21.15.62:41354) 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/2896386971 learned_addr learned my addr 172.21.15.62:0/2896386971 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/2896386971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65c444860 con 0x55f65c443e70 2024-04-26T07:56:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/2896386971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c444290 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc08e700 tx=0x7ff0cc072d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94c28e748f5b8cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7fefb9ffb640 1 -- 172.21.15.62:0/2896386971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc081070 con 0x55f65c443e70 2024-04-26T07:56:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7fefb9ffb640 1 -- 172.21.15.62:0/2896386971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc006380 con 0x55f65c443e70 2024-04-26T07:56:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.271+0000 7fefb9ffb640 1 -- 172.21.15.62:0/2896386971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc08d130 con 0x55f65c443e70 2024-04-26T07:56:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 -- 172.21.15.62:0/2896386971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 msgr2=0x55f65c444290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 --2- 172.21.15.62:0/2896386971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c444290 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc08e700 tx=0x7ff0cc072d00 comp rx=0 tx=0).stop 2024-04-26T07:56:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 -- 172.21.15.62:0/2896386971 shutdown_connections 2024-04-26T07:56:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 --2- 172.21.15.62:0/2896386971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c444290 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 -- 172.21.15.62:0/2896386971 >> 172.21.15.62:0/2896386971 conn(0x55f65c4401d0 msgr2=0x55f65c43e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 -- 172.21.15.62:0/2896386971 shutdown_connections 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 -- 172.21.15.62:0/2896386971 wait complete. 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 Processor -- start 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 -- start start 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c44b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d8940800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f65c444fd0 con 0x55f65c443e70 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.272+0000 7ff0d5c3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c44b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7ff0d5c3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c44b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41360/0 (socket says 172.21.15.62:41360) 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 learned_addr learned my addr 172.21.15.62:0/337445698 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65c44b9f0 con 0x55f65c443e70 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c44b4b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc08e700 tx=0x7ff0cc08e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7fefa7fff640 1 -- 172.21.15.62:0/337445698 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc081050 con 0x55f65c443e70 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7fefa7fff640 1 -- 172.21.15.62:0/337445698 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc082040 con 0x55f65c443e70 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f65c44bc80 con 0x55f65c443e70 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7fefa7fff640 1 -- 172.21.15.62:0/337445698 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc08c040 con 0x55f65c443e70 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.273+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65c44e930 con 0x55f65c443e70 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.274+0000 7fefa7fff640 1 -- 172.21.15.62:0/337445698 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff0cc006b90 con 0x55f65c443e70 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.274+0000 7fefa7fff640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefa0036e10 0x7fefa00392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.274+0000 7fefa7fff640 1 -- 172.21.15.62:0/337445698 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff0cc092350 con 0x55f65c443e70 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.274+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefa0036e10 0x7fefa00392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefa0036e10 0x7fefa00392d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55f65c323440 tx=0x7ff0d001f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c456fa0 0x55f65c459460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c459bb0 con 0x55f65c456fa0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d643f640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c456fa0 0x55f65c459460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d643f640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c456fa0 0x55f65c459460 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d8940800 20 realm 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.275+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c459fc0 con 0x55f65c456fa0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45a890 con 0x55f65c456fa0 2024-04-26T07:56:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45ac30 con 0x55f65c456fa0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.276+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45b480 con 0x55f65c456fa0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d8940800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d8940800 20 searching for the correct realm 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f65c45d1f0 0x55f65c45f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f65c45d1f0 0x55f65c45f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f65c45d1f0 0x55f65c45f5e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d5c3e640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff0cc099400 0x7ff0cc04c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.277+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0cc099400 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.278+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff0cc099400 0x7ff0cc04c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.278+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff0cc099400 0x7ff0cc04c0e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.278+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d001f070 con 0x7ff0cc099400 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.278+0000 7ff0d6c40640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff0d0031040 0x7ff0d0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.278+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0d0031040 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.278+0000 7ff0d643f640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff0d0031040 0x7ff0d0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.279+0000 7ff0d643f640 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff0d0031040 0x7ff0d0032940 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.279+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.279+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.279+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.279+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.279+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.279+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.280+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.280+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0d0031040 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.280+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.280+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0cc099400 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.280+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d001f070 con 0x7ff0cc099400 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.280+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.280+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.280+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.281+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.281+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0d0031040 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.281+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.281+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.282+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.282+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0cc099400 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.282+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0d001f070 con 0x7ff0cc099400 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.282+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.282+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.282+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.282+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.282+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0d0031040 2024-04-26T07:56:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.283+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.283+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.283+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.283+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.283+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.283+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.283+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.283+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.284+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.284+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0d0031040 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.284+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.284+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.284+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.284+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0cc099400 2024-04-26T07:56:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.284+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d001f070 con 0x7ff0cc099400 2024-04-26T07:56:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.284+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.285+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.285+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0d0031040 2024-04-26T07:56:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.285+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.285+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.285+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.285+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0d0031040 2024-04-26T07:56:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.285+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.285+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0cc099400 2024-04-26T07:56:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.286+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d001f070 con 0x7ff0cc099400 2024-04-26T07:56:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.286+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c45d1f0 2024-04-26T07:56:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.286+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.286+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0d0031040 2024-04-26T07:56:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.286+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.286+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x55f65c456fa0 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45fc10 con 0x7ff0cc099400 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d001f070 con 0x7ff0cc099400 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45bdd0 con 0x55f65c456fa0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45c670 con 0x55f65c456fa0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.287+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c45c670 con 0x55f65c456fa0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 20 zone default found 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 4 Realm: () 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 20 zonegroup default 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c460090 con 0x7ff0d0031040 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c461aa0 con 0x55f65c45d1f0 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.288+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c461f70 con 0x55f65c45d1f0 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.289+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.289+0000 7ff0d8940800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.289+0000 7ff0d8940800 20 started sync module instance, tier type = 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.289+0000 7ff0d8940800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.289+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c460f10 con 0x7ff0cc099400 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.290+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d0040040 con 0x7ff0cc099400 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.290+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94516598412032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c462880 con 0x7ff0cc099400 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.290+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c4630d0 con 0x55f65c456fa0 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.291+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94516598412032] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d0040040 con 0x7ff0cc099400 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.291+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.291+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94516598416336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c462da0 con 0x55f65c456fa0 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.291+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c463860 con 0x55f65c45d1f0 2024-04-26T07:56:23.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.292+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.292+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94516598416336] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.292+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94516598420272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c464100 con 0x55f65c45d1f0 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.292+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c464690 con 0x7ff0cc099400 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.293+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94516598420272] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.294+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d0040040 con 0x7ff0cc099400 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.294+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94516598422608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c464a80 con 0x7ff0cc099400 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.294+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c4654a0 con 0x55f65c456fa0 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.295+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.295+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94516598427536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c465460 con 0x55f65c456fa0 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.295+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c466440 con 0x7ff0d0031040 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.295+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94516598422608] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d0040040 con 0x7ff0cc099400 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.296+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94516598427536] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.296+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.296+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94516598417392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c465f90 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.296+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c466d10 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.297+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(56 notify.6 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.297+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94516598433104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c466e20 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.297+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c467820 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.297+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94516598417392] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94516598433104] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94516598429248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c466970 con 0x7ff0d0031040 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d8940800 20 add_watcher() i=0 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d8940800 20 add_watcher() i=1 2024-04-26T07:56:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d8940800 20 add_watcher() i=2 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d8940800 20 add_watcher() i=3 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d8940800 20 add_watcher() i=4 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d8940800 20 add_watcher() i=5 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.298+0000 7ff0d8940800 20 add_watcher() i=6 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.299+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94516598429248] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.299+0000 7ff0d8940800 20 add_watcher() i=7 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.299+0000 7ff0d8940800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.299+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c466970 con 0x55f65c456fa0 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.299+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.299+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94516598436656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c468070 con 0x55f65c456fa0 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.300+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94516598436656] v29'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.300+0000 7fef8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.300+0000 7ff0d8940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.300+0000 7ff0d8940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.300+0000 7ff0d8940800 5 note: GC not initialized 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.301+0000 7fef077fe640 20 reqs_thread_entry: start 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.301+0000 7ff0d8940800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.301+0000 7ff0d8940800 20 Filter name: none 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.301+0000 7fef057fa640 20 reqs_thread_entry: start 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.301+0000 7ff0d8940800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.301+0000 7ff0d8940800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.301+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c49dee0 con 0x7ff0d0031040 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.302+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.302+0000 7ff0d8940800 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.302+0000 7ff0d8940800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:23.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.302+0000 7ff0d8940800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.302+0000 7ff0d8940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.302+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c4a44e0 con 0x7ff0d0031040 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v29'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7ff0d8940800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7ff0d8940800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7ff0d8940800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94516598685520 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f65c49fbd0 con 0x55f65c456fa0 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94516598427536 notify 124554051618 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55f65c323160 con 0x55f65c456fa0 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7fefb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051618 cookie 94516598427536 notifier 4906 bl.length()=649 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7fefb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7fefb9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94516598685520 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.303+0000 7fefb9ffb640 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fef9c003ea0 con 0x55f65c456fa0 2024-04-26T07:56:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.304+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.304+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94516598685520 notify 124554051618 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f65c322c40 con 0x55f65c456fa0 2024-04-26T07:56:23.314 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.305+0000 7fef8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.305+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94516598436656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c4a0390 con 0x55f65c456fa0 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.306+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94516598436656] v29'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.306+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94516598412032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c4a0390 con 0x7ff0cc099400 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.307+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94516598412032] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d0040040 con 0x7ff0cc099400 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.307+0000 7ff0d8940800 20 remove_watcher() i=0 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.307+0000 7ff0d8940800 2 removed watcher, disabling cache 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.307+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94516598416336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c4a0390 con 0x55f65c456fa0 2024-04-26T07:56:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.308+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94516598416336] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.308+0000 7ff0d8940800 20 remove_watcher() i=1 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.308+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94516598420272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c4a0390 con 0x55f65c45d1f0 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.309+0000 7ff0d5c3e640 1 -- 172.21.15.62:0/337445698 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94516598420272] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0cc084070 con 0x55f65c45d1f0 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.309+0000 7ff0d8940800 20 remove_watcher() i=2 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.309+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94516598422608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c461300 con 0x7ff0cc099400 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.310+0000 7ff0d6c40640 1 -- 172.21.15.62:0/337445698 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94516598422608] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d0040040 con 0x7ff0cc099400 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.310+0000 7ff0d8940800 20 remove_watcher() i=3 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.310+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94516598427536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c4623d0 con 0x55f65c456fa0 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.311+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94516598427536] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x55f65c456fa0 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.311+0000 7ff0d8940800 20 remove_watcher() i=4 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.311+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94516598417392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c463330 con 0x7ff0d0031040 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.312+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94516598417392] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.312+0000 7ff0d8940800 20 remove_watcher() i=5 2024-04-26T07:56:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.312+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94516598433104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c463c50 con 0x7ff0d0031040 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.313+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94516598433104] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.313+0000 7ff0d8940800 20 remove_watcher() i=6 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.313+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94516598429248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f65c461300 con 0x7ff0d0031040 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94516598429248] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c802d070 con 0x7ff0d0031040 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 20 remove_watcher() i=7 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff0d0031040 msgr2=0x7ff0d0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff0d0031040 0x7ff0d0032940 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c456fa0 msgr2=0x55f65c459460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c456fa0 0x55f65c459460 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff0cc099400 msgr2=0x7ff0cc04c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff0cc099400 0x7ff0cc04c0e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f65c45d1f0 msgr2=0x55f65c45f5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55f65c45d1f0 0x55f65c45f5e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefa0036e10 msgr2=0x7fefa00392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefa0036e10 0x7fefa00392d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55f65c323440 tx=0x7ff0d001f000 comp rx=0 tx=0).stop 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d643f640 1 -- 172.21.15.62:0/337445698 reap_dead start 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 msgr2=0x55f65c44b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c44b4b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc08e700 tx=0x7ff0cc08e690 comp rx=0 tx=0).stop 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 shutdown_connections 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 --2- 172.21.15.62:0/337445698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c443e70 0x55f65c44b4b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 >> 172.21.15.62:0/337445698 conn(0x55f65c4401d0 msgr2=0x55f65c43d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 shutdown_connections 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/337445698 wait complete. 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/2063968409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefb0036e60 msgr2=0x7fefb0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 --2- 172.21.15.62:0/2063968409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefb0036e60 0x7fefb0039320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55f65c426ca0 tx=0x7ff0d0005840 comp rx=0 tx=0).stop 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.314+0000 7ff0d8940800 1 -- 172.21.15.62:0/2063968409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c436bf0 msgr2=0x55f65c437010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/2063968409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c436bf0 0x55f65c437010 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000c00 tx=0x7ff0cc002fb0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/2063968409 shutdown_connections 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/2063968409 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefb0036e60 0x7fefb0039320 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/2063968409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c436bf0 0x55f65c437010 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/2063968409 >> 172.21.15.62:0/2063968409 conn(0x55f65c42ac90 msgr2=0x55f65c42b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/2063968409 shutdown_connections 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/2063968409 wait complete. 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c327bd0 msgr2=0x55f65c425ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c327bd0 0x55f65c425ac0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefbc036e60 msgr2=0x7fefbc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefbc036e60 0x7fefbc039320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc054000 tx=0x7ff0cc04e000 comp rx=0 tx=0).stop 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 msgr2=0x55f65c3242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c3242c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55f65c4157e0 tx=0x7ff0c8000ed0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 shutdown_connections 2024-04-26T07:56:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55f65c327bd0 0x55f65c425ac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fefbc036e60 0x7fefbc039320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 --2- 172.21.15.62:0/361424221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f65c321960 0x55f65c3242c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 >> 172.21.15.62:0/361424221 conn(0x55f65c31d360 msgr2=0x55f65c40ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 shutdown_connections 2024-04-26T07:56:23.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.315+0000 7ff0d8940800 1 -- 172.21.15.62:0/361424221 wait complete. 2024-04-26T07:56:23.325 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:23.325 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:23.325 ERROR:root:0 2024-04-26T07:56:23.325 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T07:56:23.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T07:56:23.325 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T07:56:23.372 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:56:23.372 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:56:23.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.375+0000 7f7bb631f800 1 Processor -- start 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb631f800 1 -- start start 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb631f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x55d0a8b59110 0x55d0a8b5b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb631f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d0a8b5f550 con 0x55d0a8b5ba40 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb631f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x55d0a89fae20 con 0x55d0a8b59110 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb17e6640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x55d0a8b5ba40 0x55d0a8b5de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:33308/0 (socket says 172.21.15.62:33308) 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb17e6640 1 -- 172.21.15.62:0/1630775347 learned_addr learned my addr 172.21.15.62:0/1630775347 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb1fe7640 1 --2- 172.21.15.62:0/1630775347 >> v2:172.21.15.1:3300/0 conn(0x55d0a8b59110 0x55d0a8b5b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb0fe5640 1 -- 172.21.15.62:0/1630775347 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694831748 0 0) 0x55d0a8b5f550 con 0x55d0a8b5ba40 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb0fe5640 1 -- 172.21.15.62:0/1630775347 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b9c001e10 con 0x55d0a8b5ba40 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/1630775347 >> v1:172.21.15.1:6789/0 conn(0x55d0a8b5ba40 legacy=0x55d0a8b5de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.376+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/1630775347 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a8b60730 con 0x55d0a8b59110 2024-04-26T07:56:23.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.378+0000 7f7bb1fe7640 1 --2- 172.21.15.62:0/1630775347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b5b500 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400a470 tx=0x7f7ba401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa3ba27fb98b1ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.378+0000 7f7bb0fe5640 1 -- 172.21.15.62:0/1630775347 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba4057070 con 0x55d0a8b59110 2024-04-26T07:56:23.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.378+0000 7f7bb0fe5640 1 -- 172.21.15.62:0/1630775347 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba4052570 con 0x55d0a8b59110 2024-04-26T07:56:23.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.378+0000 7f7bb0fe5640 1 -- 172.21.15.62:0/1630775347 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba4052850 con 0x55d0a8b59110 2024-04-26T07:56:23.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.379+0000 7f7bb631f800 1 -- 172.21.15.62:0/1630775347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 msgr2=0x55d0a8b5b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.379+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1630775347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b5b500 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400a470 tx=0x7f7ba401cdb0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.379+0000 7f7bb631f800 1 -- 172.21.15.62:0/1630775347 shutdown_connections 2024-04-26T07:56:23.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.379+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1630775347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b5b500 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.379+0000 7f7bb631f800 1 -- 172.21.15.62:0/1630775347 >> 172.21.15.62:0/1630775347 conn(0x55d0a8b52be0 msgr2=0x55d0a8b55000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.379+0000 7f7bb631f800 1 -- 172.21.15.62:0/1630775347 shutdown_connections 2024-04-26T07:56:23.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.379+0000 7f7bb631f800 1 -- 172.21.15.62:0/1630775347 wait complete. 2024-04-26T07:56:23.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.391+0000 7f7bb631f800 1 Processor -- start 2024-04-26T07:56:23.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.391+0000 7f7bb631f800 1 -- start start 2024-04-26T07:56:23.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.392+0000 7f7bb631f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b58a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.392+0000 7f7bb631f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0a8aa3d00 con 0x55d0a8b59110 2024-04-26T07:56:23.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.392+0000 7f7bb1fe7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b58a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.392+0000 7f7bb1fe7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b58a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41374/0 (socket says 172.21.15.62:41374) 2024-04-26T07:56:23.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.392+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/4217701225 learned_addr learned my addr 172.21.15.62:0/4217701225 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.392+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/4217701225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a8b57010 con 0x55d0a8b59110 2024-04-26T07:56:23.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.392+0000 7f7bb1fe7640 1 --2- 172.21.15.62:0/4217701225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b58a50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4055040 tx=0x7f7ba404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5395af7fc3dc07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7a9fe07640 1 -- 172.21.15.62:0/4217701225 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba4057040 con 0x55d0a8b59110 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7a9fe07640 1 -- 172.21.15.62:0/4217701225 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba4052950 con 0x55d0a8b59110 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7a9fe07640 1 -- 172.21.15.62:0/4217701225 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba4052c70 con 0x55d0a8b59110 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7bb631f800 1 -- 172.21.15.62:0/4217701225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 msgr2=0x55d0a8b58a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7bb631f800 1 --2- 172.21.15.62:0/4217701225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b58a50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4055040 tx=0x7f7ba404c000 comp rx=0 tx=0).stop 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7bb631f800 1 -- 172.21.15.62:0/4217701225 shutdown_connections 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7bb631f800 1 --2- 172.21.15.62:0/4217701225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8b58a50 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7bb631f800 1 -- 172.21.15.62:0/4217701225 >> 172.21.15.62:0/4217701225 conn(0x55d0a8b52be0 msgr2=0x55d0a8c453a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7bb631f800 1 -- 172.21.15.62:0/4217701225 shutdown_connections 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.393+0000 7f7bb631f800 1 -- 172.21.15.62:0/4217701225 wait complete. 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.394+0000 7f7bb631f800 1 Processor -- start 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.394+0000 7f7bb631f800 1 -- start start 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.394+0000 7f7bb631f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8c53730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.394+0000 7f7bb631f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0a8b5f9c0 con 0x55d0a8b59110 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.394+0000 7f7bb1fe7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8c53730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.394+0000 7f7bb1fe7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8c53730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41386/0 (socket says 172.21.15.62:41386) 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.394+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/1609053832 learned_addr learned my addr 172.21.15.62:0/1609053832 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.395+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/1609053832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a8c53c70 con 0x55d0a8b59110 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.395+0000 7f7bb1fe7640 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8c53730 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4055040 tx=0x7f7ba4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.395+0000 7f7a9e604640 1 -- 172.21.15.62:0/1609053832 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba4073070 con 0x55d0a8b59110 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.395+0000 7f7a9e604640 1 -- 172.21.15.62:0/1609053832 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba405d7a0 con 0x55d0a8b59110 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.395+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0a8c53f00 con 0x55d0a8b59110 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.395+0000 7f7a9e604640 1 -- 172.21.15.62:0/1609053832 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba4057070 con 0x55d0a8b59110 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.395+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a8c56bb0 con 0x55d0a8b59110 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7a9e604640 1 -- 172.21.15.62:0/1609053832 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7ba4076070 con 0x55d0a8b59110 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7a9e604640 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a98036e60 0x7f7a98039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7a9e604640 1 -- 172.21.15.62:0/1609053832 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f7ba408e660 con 0x55d0a8b59110 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7bb17e6640 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a98036e60 0x7f7a98039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8b5ba40 0x55d0a8c5a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c5aeb0 con 0x55d0a8b5ba40 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8b5ba40 0x55d0a8c5a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7bb17e6640 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a98036e60 0x7f7a98039320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000f60 tx=0x7f7ba80010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.396+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8b5ba40 0x55d0a8c5a970 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.397+0000 7f7bb27e8640 1 -- 172.21.15.62:0/1609053832 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bac00a4a0 con 0x55d0a8b5ba40 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.397+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c57f20 con 0x55d0a8b5ba40 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.397+0000 7f7bb27e8640 1 -- 172.21.15.62:0/1609053832 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7bac00a4a0 con 0x55d0a8b5ba40 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.397+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c5ccd0 con 0x55d0a8b5ba40 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.398+0000 7f7bb27e8640 1 -- 172.21.15.62:0/1609053832 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7bac00a4a0 con 0x55d0a8b5ba40 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.398+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c5c010 con 0x55d0a8b5ba40 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.398+0000 7f7bb27e8640 1 -- 172.21.15.62:0/1609053832 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7bac00a4a0 con 0x55d0a8b5ba40 2024-04-26T07:56:23.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.398+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c5c430 con 0x55d0a8b5ba40 2024-04-26T07:56:23.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.398+0000 7f7bb27e8640 1 -- 172.21.15.62:0/1609053832 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7bac00a4a0 con 0x55d0a8b5ba40 2024-04-26T07:56:23.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.398+0000 7f7bb631f800 1 Processor -- start 2024-04-26T07:56:23.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.399+0000 7f7bb631f800 1 -- start start 2024-04-26T07:56:23.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.399+0000 7f7bb631f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c6bb40 0x55d0a8c6bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.399+0000 7f7bb631f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0a8a4b170 con 0x55d0a8c6bb40 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.399+0000 7f7bb17e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c6bb40 0x55d0a8c6bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.399+0000 7f7bb17e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c6bb40 0x55d0a8c6bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41400/0 (socket says 172.21.15.62:41400) 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.399+0000 7f7bb17e6640 1 -- 172.21.15.62:0/1864607683 learned_addr learned my addr 172.21.15.62:0/1864607683 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.399+0000 7f7bb17e6640 1 -- 172.21.15.62:0/1864607683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a8c6c4a0 con 0x55d0a8c6bb40 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.399+0000 7f7bb17e6640 1 --2- 172.21.15.62:0/1864607683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c6bb40 0x55d0a8c6bf60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800bec0 tx=0x7f7ba800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.400+0000 7f7a977fe640 1 -- 172.21.15.62:0/1864607683 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba801b550 con 0x55d0a8c6bb40 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.400+0000 7f7a977fe640 1 -- 172.21.15.62:0/1864607683 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba801b6f0 con 0x55d0a8c6bb40 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.400+0000 7f7a977fe640 1 -- 172.21.15.62:0/1864607683 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba801ba10 con 0x55d0a8c6bb40 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.400+0000 7f7bb631f800 1 -- 172.21.15.62:0/1864607683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0a8c6cf10 con 0x55d0a8c6bb40 2024-04-26T07:56:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.400+0000 7f7bb631f800 1 -- 172.21.15.62:0/1864607683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a8c6d410 con 0x55d0a8c6bb40 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.400+0000 7f7a977fe640 1 -- 172.21.15.62:0/1864607683 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7ba8023020 con 0x55d0a8c6bb40 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.400+0000 7f7a977fe640 1 --2- 172.21.15.62:0/1864607683 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a8c036e60 0x7f7a8c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7a977fe640 1 -- 172.21.15.62:0/1864607683 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f7ba8021020 con 0x55d0a8c6bb40 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/1864607683 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a8c036e60 0x7f7a8c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb631f800 1 Processor -- start 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb631f800 1 -- start start 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/1864607683 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a8c036e60 0x7f7a8c039320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55d0a8c5b320 tx=0x7f7bac005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb631f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c792a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb631f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0a8b572d0 con 0x55d0a8c78e80 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb17e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c792a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb17e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c792a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41410/0 (socket says 172.21.15.62:41410) 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb17e6640 1 -- 172.21.15.62:0/718356113 learned_addr learned my addr 172.21.15.62:0/718356113 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.401+0000 7f7bb17e6640 1 -- 172.21.15.62:0/718356113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a8c79870 con 0x55d0a8c78e80 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7bb17e6640 1 --2- 172.21.15.62:0/718356113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c792a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c010 tx=0x7f7ba8025ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4453686c6ef561 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7a957fa640 1 -- 172.21.15.62:0/718356113 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8046070 con 0x55d0a8c78e80 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7a957fa640 1 -- 172.21.15.62:0/718356113 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba8025590 con 0x55d0a8c78e80 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7a957fa640 1 -- 172.21.15.62:0/718356113 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba801bc40 con 0x55d0a8c78e80 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7bb631f800 1 -- 172.21.15.62:0/718356113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 msgr2=0x55d0a8c792a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7bb631f800 1 --2- 172.21.15.62:0/718356113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c792a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c010 tx=0x7f7ba8025ae0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7bb631f800 1 -- 172.21.15.62:0/718356113 shutdown_connections 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7bb631f800 1 --2- 172.21.15.62:0/718356113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c792a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7bb631f800 1 -- 172.21.15.62:0/718356113 >> 172.21.15.62:0/718356113 conn(0x55d0a8c751e0 msgr2=0x55d0a8c73240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7bb631f800 1 -- 172.21.15.62:0/718356113 shutdown_connections 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.402+0000 7f7bb631f800 1 -- 172.21.15.62:0/718356113 wait complete. 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb631f800 1 Processor -- start 2024-04-26T07:56:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb631f800 1 -- start start 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb631f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c80520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb631f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d0a8c79fe0 con 0x55d0a8c78e80 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb17e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c80520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb17e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c80520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:41424/0 (socket says 172.21.15.62:41424) 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 learned_addr learned my addr 172.21.15.62:0/3608856503 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a8c80a60 con 0x55d0a8c78e80 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.403+0000 7f7bb17e6640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c80520 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7ba801afd0 tx=0x7f7ba804d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.404+0000 7f7a837fe640 1 -- 172.21.15.62:0/3608856503 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8035020 con 0x55d0a8c78e80 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.404+0000 7f7a837fe640 1 -- 172.21.15.62:0/3608856503 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba800cc60 con 0x55d0a8c78e80 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.404+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0a8c80cf0 con 0x55d0a8c78e80 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.404+0000 7f7a837fe640 1 -- 172.21.15.62:0/3608856503 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8041070 con 0x55d0a8c78e80 2024-04-26T07:56:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.404+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a8c80cf0 con 0x55d0a8c78e80 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.404+0000 7f7a837fe640 1 -- 172.21.15.62:0/3608856503 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7ba8038020 con 0x55d0a8c78e80 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.404+0000 7f7a837fe640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a7c036e60 0x7f7a7c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.405+0000 7f7a837fe640 1 -- 172.21.15.62:0/3608856503 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f7ba8053d20 con 0x55d0a8c78e80 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.405+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a7c036e60 0x7f7a7c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.405+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a7c036e60 0x7f7a7c039320 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55d0a8c5b350 tx=0x7f7bac01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.405+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.405+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8c8bea0 0x55d0a8c8e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.405+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c8eab0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.405+0000 7f7bb1fe7640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8c8bea0 0x55d0a8c8e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb1fe7640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8c8bea0 0x55d0a8c8e360 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 20 realm 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c8eec0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c8f790 con 0x55d0a8c8bea0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.406+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c8fb30 con 0x55d0a8c8bea0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb631f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c90380 con 0x55d0a8c8bea0 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb631f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb631f800 20 searching for the correct realm 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d0a8c920f0 0x55d0a8c944e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb17e6640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d0a8c920f0 0x55d0a8c944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.407+0000 7f7bb17e6640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d0a8c920f0 0x55d0a8c944e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.408+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.408+0000 7f7bb17e6640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7ba8052030 0x7f7ba80289c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.408+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7ba8052030 2024-04-26T07:56:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.408+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7ba8052030 0x7f7ba80289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.408+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7ba8052030 0x7f7ba80289c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.408+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bac01f070 con 0x7f7ba8052030 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.409+0000 7f7bb27e8640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7bac031040 0x7f7bac032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.409+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7bac031040 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.409+0000 7f7bb1fe7640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7bac031040 0x7f7bac032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.409+0000 7f7bb1fe7640 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7bac031040 0x7f7bac032940 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.409+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.409+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.410+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.410+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.410+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.410+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.410+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.410+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7bac031040 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.410+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.410+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7ba8052030 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.411+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bac01f070 con 0x7f7ba8052030 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.411+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.411+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.411+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.411+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.411+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7bac031040 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.411+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.411+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.412+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.412+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7ba8052030 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.412+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7bac01f070 con 0x7f7ba8052030 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.412+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.412+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.412+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.412+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.412+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7bac031040 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.413+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.413+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.413+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.413+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.413+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.413+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.413+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.413+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.414+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.414+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7bac031040 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.414+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.414+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.414+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.414+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7ba8052030 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.415+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bac01f070 con 0x7f7ba8052030 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.415+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.415+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.415+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7bac031040 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.415+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.415+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.416+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.416+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7bac031040 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.416+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.416+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7ba8052030 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.416+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bac01f070 con 0x7f7ba8052030 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.416+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c920f0 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.416+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.416+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7bac031040 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94ac0 con 0x7f7ba8052030 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bac01f070 con 0x7f7ba8052030 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c90d00 con 0x55d0a8c8bea0 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.417+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c915a0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c915a0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 20 zone default found 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 4 Realm: () 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:56:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 20 zonegroup default 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c94f40 con 0x7f7bac031040 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.418+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c96950 con 0x55d0a8c920f0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c96e60 con 0x55d0a8c920f0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb631f800 20 started sync module instance, tier type = 2024-04-26T07:56:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb631f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.419+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c95dc0 con 0x7f7ba8052030 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.420+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bac040040 con 0x7f7ba8052030 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.420+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94354673328560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c97770 con 0x7f7ba8052030 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.420+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c97fc0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.421+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.421+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94354673334128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c98160 con 0x55d0a8c8bea0 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.421+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c98c60 con 0x55d0a8c920f0 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.421+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94354673328560] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bac040040 con 0x7f7ba8052030 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.422+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94354673334128] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.423+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.423+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94354673338192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c97bd0 con 0x55d0a8c920f0 2024-04-26T07:56:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.423+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c99530 con 0x7f7ba8052030 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.424+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94354673338192] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.424+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bac040040 con 0x7f7ba8052030 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.424+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94354673340544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c994a0 con 0x7f7ba8052030 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.424+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9a3f0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.425+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.425+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94354673344320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9a360 con 0x55d0a8c8bea0 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.425+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9b350 con 0x7f7bac031040 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.425+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94354673340544] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bac040040 con 0x7f7ba8052030 2024-04-26T07:56:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.426+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94354673344320] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.426+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.426+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94354673342752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9b350 con 0x7f7bac031040 2024-04-26T07:56:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.426+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9a8c0 con 0x7f7bac031040 2024-04-26T07:56:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.427+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(56 notify.6 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.427+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94354673350464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9a8c0 con 0x7f7bac031040 2024-04-26T07:56:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.427+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9c730 con 0x7f7bac031040 2024-04-26T07:56:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.428+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(58 notify.7 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.428+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94354673353216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9cba0 con 0x7f7bac031040 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.428+0000 7f7bb631f800 20 add_watcher() i=0 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.428+0000 7f7bb631f800 20 add_watcher() i=1 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.428+0000 7f7bb631f800 20 add_watcher() i=2 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.428+0000 7f7bb631f800 20 add_watcher() i=3 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.428+0000 7f7bb631f800 20 add_watcher() i=4 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.429+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94354673353216] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94354673342752] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb631f800 20 add_watcher() i=5 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94354673350464] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb631f800 20 add_watcher() i=6 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb631f800 20 add_watcher() i=7 2024-04-26T07:56:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb631f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9c6f0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.430+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94354673348144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c9c6f0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.431+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94354673348144] v29'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.431+0000 7f7a637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.431+0000 7f7bb631f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.431+0000 7f7bb631f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.431+0000 7f7bb631f800 5 note: GC not initialized 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.432+0000 7f7a627fc640 20 reqs_thread_entry: start 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.432+0000 7f7bb631f800 20 init_complete bucket index max shards: 11 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.432+0000 7f7bb631f800 20 Filter name: none 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.432+0000 7f79d3fff640 20 reqs_thread_entry: start 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.432+0000 7f7bb631f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T07:56:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.432+0000 7f7bb631f800 20 rados->read ofs=0 len=0 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.432+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8cd2dc0 con 0x7f7bac031040 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.433+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.433+0000 7f7bb631f800 20 rados_obj.operate() r=0 bl.length=473 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.433+0000 7f7bb631f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.433+0000 7f7bb631f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.433+0000 7f7bb631f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.433+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8cd96e0 con 0x7f7bac031040 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.434+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v29'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.434+0000 7f7bb631f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.434+0000 7f7bb631f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.434+0000 7f7bb631f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.434+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94354673602896 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8cd4dd0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.435+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== watch-notify(notify (1) cookie 94354673344320 notify 124554051619 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55d0a8c56bb0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.435+0000 7f7a957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051619 cookie 94354673344320 notifier 4913 bl.length()=649 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.435+0000 7f7a957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.435+0000 7f7a957fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.435+0000 7f7a957fa640 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7a74003ea0 con 0x55d0a8c8bea0 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.435+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(64 notify.4 [notify cookie 94354673602896 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.435+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.435+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== watch-notify(notify_complete (2) cookie 94354673602896 notify 124554051619 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d0a8c53f00 con 0x55d0a8c8bea0 2024-04-26T07:56:23.447 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T07:56:21.531639Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T07:56:21.531625Z","tags":[],"group_ids":[]} 2024-04-26T07:56:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.436+0000 7f7a637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:56:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.436+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94354673348144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8cd5590 con 0x55d0a8c8bea0 2024-04-26T07:56:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.437+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94354673348144] v29'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.437+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94354673328560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8cd5590 con 0x7f7ba8052030 2024-04-26T07:56:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.438+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94354673328560] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bac040040 con 0x7f7ba8052030 2024-04-26T07:56:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.438+0000 7f7bb631f800 20 remove_watcher() i=0 2024-04-26T07:56:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.438+0000 7f7bb631f800 2 removed watcher, disabling cache 2024-04-26T07:56:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.438+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94354673334128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8cd5590 con 0x55d0a8c8bea0 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.439+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94354673334128] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.439+0000 7f7bb631f800 20 remove_watcher() i=1 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.439+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94354673338192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8cd5590 con 0x55d0a8c920f0 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.440+0000 7f7bb17e6640 1 -- 172.21.15.62:0/3608856503 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94354673338192] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba805b040 con 0x55d0a8c920f0 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.440+0000 7f7bb631f800 20 remove_watcher() i=2 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.440+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94354673340544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c961b0 con 0x7f7ba8052030 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.441+0000 7f7bb27e8640 1 -- 172.21.15.62:0/3608856503 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94354673340544] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bac040040 con 0x7f7ba8052030 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.441+0000 7f7bb631f800 20 remove_watcher() i=3 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.441+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94354673344320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c98750 con 0x55d0a8c8bea0 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.442+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94354673344320] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x55d0a8c8bea0 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.442+0000 7f7bb631f800 20 remove_watcher() i=4 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.442+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94354673342752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c99080 con 0x7f7bac031040 2024-04-26T07:56:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.443+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94354673342752] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.443+0000 7f7bb631f800 20 remove_watcher() i=5 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.443+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94354673350464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c961b0 con 0x7f7bac031040 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.444+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94354673350464] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.444+0000 7f7bb631f800 20 remove_watcher() i=6 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.444+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94354673353216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d0a8c99f40 con 0x7f7bac031040 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94354673353216] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba4075030 con 0x7f7bac031040 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 20 remove_watcher() i=7 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7bac031040 msgr2=0x7f7bac032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7bac031040 0x7f7bac032940 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8c8bea0 msgr2=0x55d0a8c8e360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8c8bea0 0x55d0a8c8e360 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7ba8052030 msgr2=0x7f7ba80289c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f7ba8052030 0x7f7ba80289c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d0a8c920f0 msgr2=0x55d0a8c944e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x55d0a8c920f0 0x55d0a8c944e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a7c036e60 msgr2=0x7f7a7c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a7c036e60 0x7f7a7c039320 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55d0a8c5b350 tx=0x7f7bac01f000 comp rx=0 tx=0).stop 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 msgr2=0x55d0a8c80520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb1fe7640 1 -- 172.21.15.62:0/3608856503 reap_dead start 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c80520 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7ba801afd0 tx=0x7f7ba804d400 comp rx=0 tx=0).stop 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 shutdown_connections 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 --2- 172.21.15.62:0/3608856503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c78e80 0x55d0a8c80520 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.445+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 >> 172.21.15.62:0/3608856503 conn(0x55d0a8c751e0 msgr2=0x55d0a8c72840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 shutdown_connections 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/3608856503 wait complete. 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1864607683 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a8c036e60 msgr2=0x7f7a8c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1864607683 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a8c036e60 0x7f7a8c039320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55d0a8c5b320 tx=0x7f7bac005840 comp rx=0 tx=0).stop 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1864607683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c6bb40 msgr2=0x55d0a8c6bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1864607683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c6bb40 0x55d0a8c6bf60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800bec0 tx=0x7f7ba800d7a0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1864607683 shutdown_connections 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1864607683 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a8c036e60 0x7f7a8c039320 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1864607683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8c6bb40 0x55d0a8c6bf60 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1864607683 >> 172.21.15.62:0/1864607683 conn(0x55d0a8c5fbe0 msgr2=0x55d0a8c5ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1864607683 shutdown_connections 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1864607683 wait complete. 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8b5ba40 msgr2=0x55d0a8c5a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8b5ba40 0x55d0a8c5a970 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a98036e60 msgr2=0x7f7a98039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a98036e60 0x7f7a98039320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000f60 tx=0x7f7ba80010a0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 msgr2=0x55d0a8c53730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8c53730 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4055040 tx=0x7f7ba4003020 comp rx=0 tx=0).stop 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 shutdown_connections 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55d0a8b5ba40 0x55d0a8c5a970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7a98036e60 0x7f7a98039320 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 --2- 172.21.15.62:0/1609053832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d0a8b59110 0x55d0a8c53730 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.446+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 >> 172.21.15.62:0/1609053832 conn(0x55d0a8b52be0 msgr2=0x55d0a8b57830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.447+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 shutdown_connections 2024-04-26T07:56:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:56:23.447+0000 7f7bb631f800 1 -- 172.21.15.62:0/1609053832 wait complete. 2024-04-26T07:56:23.457 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:23.458 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T07:56:21.531639Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T07:56:21.531625Z', 'tags': [], 'group_ids': []} 2024-04-26T07:56:23.458 ERROR:root:0 2024-04-26T07:56:23.458 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-26T07:56:23.465 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.470 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.470 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-26T07:56:23.477 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.477 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.483 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-04-26T07:56:23.493 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-04-26T07:56:23.493 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.497 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.497 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-04-26T07:56:23.504 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.504 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.508 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.508 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-04-26T07:56:23.517 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-04-26T07:56:23.517 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.522 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.522 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-04-26T07:56:23.530 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-04-26T07:56:23.530 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.534 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.535 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-04-26T07:56:23.542 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.543 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.547 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.547 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-04-26T07:56:23.554 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.554 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.558 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.559 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-04-26T07:56:23.566 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.566 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.570 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.575 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T07:56:23.576 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-26T07:56:23.582 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T07:56:23.596 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-26T07:56:23.601 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-04-26T07:56:23.602 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T07:56:23.607 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T07:56:23.594797Z', 'creation_time': '2024-04-26T07:56:23.591730Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T07:56:23.607 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-26T07:56:23.612 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T07:56:23.594797Z', 'creation_time': '2024-04-26T07:56:23.591730Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-26T07:56:23.618 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T07:56:23.622 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T07:56:23.594797Z', 'creation_time': '2024-04-26T07:56:23.591730Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T07:56:23.623 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-04-26T07:56:23.627 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000003fee73367fe2f620-00662b5e27-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:56:23.631 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-04-26T07:56:23.638 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-04-26T07:56:23.647 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:56:23.655 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11'} 2024-04-26T07:56:23.665 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.711 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11'} 2024-04-26T07:56:23.722 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.722 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-04-26T07:56:23.732 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.739 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-04-26T07:56:23.746 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:56:23.747 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T07:56:23.752 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '76158cff-5435-4eb7-bdd8-fb93108eac49', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11', 'marker': '8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T07:56:23.721385Z', 'creation_time': '2024-04-26T07:56:23.591730Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T07:57:23.804 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-04-26T07:57:23.824 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:57:23.826 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-04-26T07:57:23.842 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:57:23.842 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-26T07:57:23.847 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:57:23.848 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-04-26T07:57:23.852 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:57:23.853 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-04-26T07:57:23.857 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:57:23.857 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-04-26T07:57:23.862 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:57:23.862 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-04-26T07:57:23.867 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-26T07:00:00.000000Z', 'epoch': 1714114800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-26T07:57:23.867 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-04-26T07:57:23.874 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:57:23.874 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-26T07:57:23.878 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-04-26T07:57:23.878 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-26T07:57:23.887 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:57:23.892 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-26T07:57:23.900 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:57:24.170 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-26T07:57:24.175 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000002e2a9ac325833804-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.271 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-26T07:57:24.276 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-26T07:57:24.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-26T07:57:24.286 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-26T07:57:24.403 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-04-26T07:57:24.445 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:57:24.445 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-26T07:57:24.452 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-04-26T07:57:24.452 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-26T07:57:24.459 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T07:57:24.468 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-26T07:57:24.473 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000bc1dd51ba4afbc3e-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.492 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-04-26T07:57:24.524 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:57:24.524 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T07:57:24.528 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000089f000e5afd7889-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.529 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-04-26T07:57:24.533 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'ed2f0749-350f-459a-96bf-130a296577eb'}]}} 2024-04-26T07:57:24.533 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-04-26T07:57:24.544 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T07:57:24.544 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-26T07:57:24.548 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T07:57:24.549 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-04-26T07:57:24.553 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000f3ce2e17fb336727-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.553 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-04-26T07:57:24.557 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000004946416621c76b3d-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.569 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-26T07:57:24.573 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T07:57:24.574 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-04-26T07:57:24.578 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000fa3c36e4a582e002-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.578 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-04-26T07:57:24.582 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000eff9745884a8b35e-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.582 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-04-26T07:57:24.588 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T07:57:24.588 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-04-26T07:57:24.592 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000d7b0b239c44aa07f-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.592 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-04-26T07:57:24.596 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000466b8f4a656b9837-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.596 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-04-26T07:57:24.601 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000099f4ca95446f792d-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.601 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-04-26T07:57:24.604 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000049ab83b48ffac1d6-00662b5e64-4221-default', 'HostId': '4221-default-default'} 2024-04-26T07:57:24.605 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-04-26T07:57:24.614 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:57:24.614 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-26T07:57:24.619 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-04-26T07:57:24.619 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-04-26T07:57:24.625 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:57:24.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-26T07:57:24.629 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-04-26T07:57:24.630 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-04-26T07:57:24.636 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T07:57:24.641 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-26T07:57:24.652 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-26T07:57:24.652 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:57:24.653 INFO:tasks.rgw.client.0.smithi062.stdout:2024-04-26T07:57:24.656+0000 7f6bc2e42640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 34621) UID: 0 2024-04-26T07:57:24.653 INFO:tasks.rgw.client.0.smithi062.stdout:2024-04-26T07:57:24.656+0000 7f6bc8722880 -1 shutting down 2024-04-26T07:57:26.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-26T07:57:30.753 INFO:tasks.rgw.client.0:Stopped 2024-04-26T07:57:30.754 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-26T07:57:30.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/vault-root-token 2024-04-26T07:57:30.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-26T07:57:30.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-26T07:57:30.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-26T07:57:30.913 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-26T07:57:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-26T07:57:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T07:57:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.005+0000 7ff45663f800 1 Processor -- start 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.005+0000 7ff45663f800 1 -- start start 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.005+0000 7ff45663f800 1 --2- >> v2:172.21.15.1:3300/0 conn(0x558370436580 0x5583704369a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.005+0000 7ff45663f800 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558370437020 con 0x5583704377e0 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.005+0000 7ff45663f800 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x5583702d9e20 con 0x558370436580 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.006+0000 7ff45413e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x558370436580 0x5583704369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.006+0000 7ff45393d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x5583704377e0 0x558370437c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.62:50434/0 (socket says 172.21.15.62:50434) 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.006+0000 7ff45393d640 1 -- 172.21.15.62:0/2054505306 learned_addr learned my addr 172.21.15.62:0/2054505306 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.006+0000 7ff45413e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x558370436580 0x5583704369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:37710/0 (socket says 172.21.15.62:37710) 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.006+0000 7ff45313c640 1 -- 172.21.15.62:0/2054505306 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374181211 0 0) 0x558370437020 con 0x5583704377e0 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.006+0000 7ff45313c640 1 -- 172.21.15.62:0/2054505306 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff43c004020 con 0x5583704377e0 2024-04-26T07:57:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.006+0000 7ff45413e640 1 -- 172.21.15.62:0/2054505306 >> v1:172.21.15.1:6789/0 conn(0x5583704377e0 legacy=0x558370437c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.006+0000 7ff45413e640 1 -- 172.21.15.62:0/2054505306 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583704383a0 con 0x558370436580 2024-04-26T07:57:31.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.008+0000 7ff45413e640 1 --2- 172.21.15.62:0/2054505306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x5583704369a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff44400a470 tx=0x7ff44401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53357afe6b672504 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.008+0000 7ff45313c640 1 -- 172.21.15.62:0/2054505306 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff444057070 con 0x558370436580 2024-04-26T07:57:31.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.008+0000 7ff45313c640 1 -- 172.21.15.62:0/2054505306 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44404abd0 con 0x558370436580 2024-04-26T07:57:31.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.008+0000 7ff45313c640 1 -- 172.21.15.62:0/2054505306 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff444052440 con 0x558370436580 2024-04-26T07:57:31.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.009+0000 7ff45663f800 1 -- 172.21.15.62:0/2054505306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 msgr2=0x5583704369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.009+0000 7ff45663f800 1 --2- 172.21.15.62:0/2054505306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x5583704369a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff44400a470 tx=0x7ff44401cdb0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.009+0000 7ff45663f800 1 -- 172.21.15.62:0/2054505306 shutdown_connections 2024-04-26T07:57:31.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.009+0000 7ff45663f800 1 --2- 172.21.15.62:0/2054505306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x5583704369a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.009+0000 7ff45663f800 1 -- 172.21.15.62:0/2054505306 >> 172.21.15.62:0/2054505306 conn(0x558370431ba0 msgr2=0x558370433fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.009+0000 7ff45663f800 1 -- 172.21.15.62:0/2054505306 shutdown_connections 2024-04-26T07:57:31.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.009+0000 7ff45663f800 1 -- 172.21.15.62:0/2054505306 wait complete. 2024-04-26T07:57:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.025+0000 7ff45663f800 1 Processor -- start 2024-04-26T07:57:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.025+0000 7ff45663f800 1 -- start start 2024-04-26T07:57:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.025+0000 7ff45663f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x55837052aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.025+0000 7ff45663f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558370382cd0 con 0x558370436580 2024-04-26T07:57:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.025+0000 7ff45413e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x55837052aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.025+0000 7ff45413e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x55837052aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:37718/0 (socket says 172.21.15.62:37718) 2024-04-26T07:57:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.025+0000 7ff45413e640 1 -- 172.21.15.62:0/1433492694 learned_addr learned my addr 172.21.15.62:0/1433492694 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:57:31.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.026+0000 7ff45413e640 1 -- 172.21.15.62:0/1433492694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837052b480 con 0x558370436580 2024-04-26T07:57:31.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.026+0000 7ff45413e640 1 --2- 172.21.15.62:0/1433492694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x55837052aeb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff444000c00 tx=0x7ff44404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec1ad045f86a82f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.026+0000 7ff34260c640 1 -- 172.21.15.62:0/1433492694 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff444057040 con 0x558370436580 2024-04-26T07:57:31.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.026+0000 7ff34260c640 1 -- 172.21.15.62:0/1433492694 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff444063070 con 0x558370436580 2024-04-26T07:57:31.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.026+0000 7ff34260c640 1 -- 172.21.15.62:0/1433492694 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff444052760 con 0x558370436580 2024-04-26T07:57:31.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.027+0000 7ff45663f800 1 -- 172.21.15.62:0/1433492694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 msgr2=0x55837052aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.027+0000 7ff45663f800 1 --2- 172.21.15.62:0/1433492694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x55837052aeb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff444000c00 tx=0x7ff44404c000 comp rx=0 tx=0).stop 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.027+0000 7ff45663f800 1 -- 172.21.15.62:0/1433492694 shutdown_connections 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.027+0000 7ff45663f800 1 --2- 172.21.15.62:0/1433492694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x55837052aeb0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.027+0000 7ff45663f800 1 -- 172.21.15.62:0/1433492694 >> 172.21.15.62:0/1433492694 conn(0x558370431ba0 msgr2=0x5583705223c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.027+0000 7ff45663f800 1 -- 172.21.15.62:0/1433492694 shutdown_connections 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.027+0000 7ff45663f800 1 -- 172.21.15.62:0/1433492694 wait complete. 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.027+0000 7ff45663f800 1 Processor -- start 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.028+0000 7ff45663f800 1 -- start start 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.028+0000 7ff45663f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x558370532990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.028+0000 7ff45663f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5583703a9d80 con 0x558370436580 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.028+0000 7ff45413e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x558370532990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.028+0000 7ff45413e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x558370532990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:37728/0 (socket says 172.21.15.62:37728) 2024-04-26T07:57:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.028+0000 7ff45413e640 1 -- 172.21.15.62:0/768891396 learned_addr learned my addr 172.21.15.62:0/768891396 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:57:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.029+0000 7ff45413e640 1 -- 172.21.15.62:0/768891396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558370532ed0 con 0x558370436580 2024-04-26T07:57:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.029+0000 7ff45413e640 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x558370532990 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff44401baa0 tx=0x7ff444002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.029+0000 7ff340e09640 1 -- 172.21.15.62:0/768891396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44406d070 con 0x558370436580 2024-04-26T07:57:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.029+0000 7ff340e09640 1 -- 172.21.15.62:0/768891396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff444052c70 con 0x558370436580 2024-04-26T07:57:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.029+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558370533160 con 0x558370436580 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.029+0000 7ff340e09640 1 -- 172.21.15.62:0/768891396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff444057050 con 0x558370436580 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.029+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558370535dc0 con 0x558370436580 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.030+0000 7ff340e09640 1 -- 172.21.15.62:0/768891396 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff444070070 con 0x558370436580 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.030+0000 7ff340e09640 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff33c036eb0 0x7ff33c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.030+0000 7ff340e09640 1 -- 172.21.15.62:0/768891396 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff44408e300 con 0x558370436580 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.030+0000 7ff45393d640 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff33c036eb0 0x7ff33c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.030+0000 7ff45663f800 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5583704377e0 0x558370539b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.031+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837053a100 con 0x5583704377e0 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.031+0000 7ff45493f640 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5583704377e0 0x558370539b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.031+0000 7ff45393d640 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff33c036eb0 0x7ff33c039370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff448000f60 tx=0x7ff4480010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.031+0000 7ff45493f640 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5583704377e0 0x558370539b80 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.031+0000 7ff45493f640 1 -- 172.21.15.62:0/768891396 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff44c00a4a0 con 0x5583704377e0 2024-04-26T07:57:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.031+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558370537130 con 0x5583704377e0 2024-04-26T07:57:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.032+0000 7ff45493f640 1 -- 172.21.15.62:0/768891396 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff44c00a4a0 con 0x5583704377e0 2024-04-26T07:57:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.032+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837053bee0 con 0x5583704377e0 2024-04-26T07:57:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.032+0000 7ff45493f640 1 -- 172.21.15.62:0/768891396 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff44c00a4a0 con 0x5583704377e0 2024-04-26T07:57:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.032+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837053b220 con 0x5583704377e0 2024-04-26T07:57:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.032+0000 7ff45493f640 1 -- 172.21.15.62:0/768891396 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff44c00a4a0 con 0x5583704377e0 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.033+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837053b670 con 0x5583704377e0 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.033+0000 7ff45493f640 1 -- 172.21.15.62:0/768891396 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff44c00a4a0 con 0x5583704377e0 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.033+0000 7ff45663f800 1 Processor -- start 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.033+0000 7ff45663f800 1 -- start start 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.033+0000 7ff45663f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55837054acb0 0x55837054b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.033+0000 7ff45663f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55837032a170 con 0x55837054acb0 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff45393d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55837054acb0 0x55837054b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff45393d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55837054acb0 0x55837054b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:37730/0 (socket says 172.21.15.62:37730) 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff45393d640 1 -- 172.21.15.62:0/3641939725 learned_addr learned my addr 172.21.15.62:0/3641939725 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff45393d640 1 -- 172.21.15.62:0/3641939725 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837054b610 con 0x55837054acb0 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff45393d640 1 --2- 172.21.15.62:0/3641939725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55837054acb0 0x55837054b0d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff44800bec0 tx=0x7ff44800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff339ffb640 1 -- 172.21.15.62:0/3641939725 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44801b550 con 0x55837054acb0 2024-04-26T07:57:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff339ffb640 1 -- 172.21.15.62:0/3641939725 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44801b6f0 con 0x55837054acb0 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff45663f800 1 -- 172.21.15.62:0/3641939725 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55837054c080 con 0x55837054acb0 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff339ffb640 1 -- 172.21.15.62:0/3641939725 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44801ba10 con 0x55837054acb0 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.034+0000 7ff45663f800 1 -- 172.21.15.62:0/3641939725 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837054c580 con 0x55837054acb0 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.035+0000 7ff339ffb640 1 -- 172.21.15.62:0/3641939725 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff448023020 con 0x55837054acb0 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.035+0000 7ff339ffb640 1 --2- 172.21.15.62:0/3641939725 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff32c036e60 0x7ff32c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.035+0000 7ff339ffb640 1 -- 172.21.15.62:0/3641939725 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff448021020 con 0x55837054acb0 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45493f640 1 --2- 172.21.15.62:0/3641939725 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff32c036e60 0x7ff32c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45663f800 1 Processor -- start 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45493f640 1 --2- 172.21.15.62:0/3641939725 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff32c036e60 0x7ff32c039320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55837053ad40 tx=0x7ff44c005840 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45663f800 1 -- start start 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45663f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x558370558410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45663f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55837052b740 con 0x558370557ff0 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45393d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x558370558410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45393d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x558370558410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:37732/0 (socket says 172.21.15.62:37732) 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.036+0000 7ff45393d640 1 -- 172.21.15.62:0/73612417 learned_addr learned my addr 172.21.15.62:0/73612417 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.037+0000 7ff45393d640 1 -- 172.21.15.62:0/73612417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583705589e0 con 0x558370557ff0 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.037+0000 7ff45393d640 1 --2- 172.21.15.62:0/73612417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x558370558410 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c010 tx=0x7ff448024990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdf4750da0ad8bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.037+0000 7ff32b7fe640 1 -- 172.21.15.62:0/73612417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44804c110 con 0x558370557ff0 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.037+0000 7ff32b7fe640 1 -- 172.21.15.62:0/73612417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff448024cb0 con 0x558370557ff0 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.037+0000 7ff32b7fe640 1 -- 172.21.15.62:0/73612417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff448025410 con 0x558370557ff0 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.037+0000 7ff45663f800 1 -- 172.21.15.62:0/73612417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 msgr2=0x558370558410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.037+0000 7ff45663f800 1 --2- 172.21.15.62:0/73612417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x558370558410 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c010 tx=0x7ff448024990 comp rx=0 tx=0).stop 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 -- 172.21.15.62:0/73612417 shutdown_connections 2024-04-26T07:57:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 --2- 172.21.15.62:0/73612417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x558370558410 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 -- 172.21.15.62:0/73612417 >> 172.21.15.62:0/73612417 conn(0x558370554350 msgr2=0x5583705523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 -- 172.21.15.62:0/73612417 shutdown_connections 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 -- 172.21.15.62:0/73612417 wait complete. 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 Processor -- start 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 -- start start 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x55837055f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45663f800 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558370559150 con 0x558370557ff0 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45393d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x55837055f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45393d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x55837055f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.62:37738/0 (socket says 172.21.15.62:37738) 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.038+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 learned_addr learned my addr 172.21.15.62:0/664076719 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.039+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837055fbd0 con 0x558370557ff0 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.039+0000 7ff45393d640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x55837055f690 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff4480249d0 tx=0x7ff44804d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.039+0000 7ff329ffb640 1 -- 172.21.15.62:0/664076719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff448034070 con 0x558370557ff0 2024-04-26T07:57:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.039+0000 7ff329ffb640 1 -- 172.21.15.62:0/664076719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44800cc60 con 0x558370557ff0 2024-04-26T07:57:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.039+0000 7ff329ffb640 1 -- 172.21.15.62:0/664076719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff44804c110 con 0x558370557ff0 2024-04-26T07:57:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.039+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55837055fbd0 con 0x558370557ff0 2024-04-26T07:57:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.039+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837055fbd0 con 0x558370557ff0 2024-04-26T07:57:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.040+0000 7ff329ffb640 1 -- 172.21.15.62:0/664076719 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff448037070 con 0x558370557ff0 2024-04-26T07:57:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.040+0000 7ff329ffb640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff31c036eb0 0x7ff31c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.040+0000 7ff329ffb640 1 -- 172.21.15.62:0/664076719 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff448046030 con 0x558370557ff0 2024-04-26T07:57:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.040+0000 7ff45493f640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff31c036eb0 0x7ff31c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.041+0000 7ff45493f640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff31c036eb0 0x7ff31c039370 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5583705370a0 tx=0x7ff44c01f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.041+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.041+0000 7ff45663f800 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55837056ada0 0x55837056d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.041+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837056d9b0 con 0x55837056ada0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.041+0000 7ff45413e640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55837056ada0 0x55837056d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.041+0000 7ff45413e640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55837056ada0 0x55837056d260 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 realm 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837056ddc0 con 0x55837056ada0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:57:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837056e690 con 0x55837056ada0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837056ea30 con 0x55837056ada0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.042+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:5 5.14 5:2b94366e:::zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837056f280 con 0x55837056ada0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.043+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 5 ==== osd_op_reply(5 zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.043+0000 7ff45663f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.043+0000 7ff45663f800 20 searching for the correct realm 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.043+0000 7ff45663f800 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558370570ff0 0x5583705733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.043+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.043+0000 7ff45393d640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558370570ff0 0x5583705733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.043+0000 7ff45393d640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558370570ff0 0x5583705733e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.044+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.044+0000 7ff45393d640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff448039070 0x7ff44803ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.044+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff448039070 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.044+0000 7ff45493f640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff448039070 0x7ff44803ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.044+0000 7ff45493f640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff448039070 0x7ff44803ca30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.044+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44c01f070 con 0x7ff448039070 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.044+0000 7ff45493f640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff44c031040 0x7ff44c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.044+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff44c031040 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.045+0000 7ff45413e640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff44c031040 0x7ff44c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.045+0000 7ff45413e640 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff44c031040 0x7ff44c032940 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.045+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.045+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.046+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.046+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.046+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.046+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.046+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 8 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.046+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff44c031040 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.046+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.046+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff448039070 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.047+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44c01f070 con 0x7ff448039070 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.047+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.047+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.047+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.047+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 9 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.047+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff44c031040 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.048+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.048+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.048+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 10 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.048+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff448039070 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.048+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff44c01f070 con 0x7ff448039070 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.048+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.048+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.048+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.049+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.049+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff44c031040 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.049+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.049+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.049+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.049+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.050+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.050+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.050+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 11 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.050+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.050+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 12 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.050+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff44c031040 2024-04-26T07:57:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.050+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.051+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.051+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.051+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff448039070 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.051+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44c01f070 con 0x7ff448039070 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.051+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.051+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.051+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff44c031040 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.052+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=82b] v29'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.052+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.052+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.052+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff44c031040 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.052+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.052+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff448039070 2024-04-26T07:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.053+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44c01f070 con 0x7ff448039070 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.053+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x558370570ff0 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.053+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.053+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff44c031040 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.053+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 8 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.053+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x55837056ada0 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.053+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 14 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.053+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5583705739f0 con 0x7ff448039070 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff44c01f070 con 0x7ff448039070 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 RGWRados::pool_iterate: got zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 RGWRados::pool_iterate: got zone_info.8d767a7c-31da-4ded-9764-3a9d16d1fab7 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T07:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 RGWRados::pool_iterate: got period_config.default 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837056fc00 con 0x55837056ada0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705704a0 con 0x55837056ada0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.054+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:40 5.4 5:20121a8f:::zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705704a0 con 0x55837056ada0 2024-04-26T07:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 17 ==== osd_op_reply(40 zonegroup_info.76158cff-5435-4eb7-bdd8-fb93108eac49 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 20 zone default found 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 4 Realm: () 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 4 ZoneGroup: default (76158cff-5435-4eb7-bdd8-fb93108eac49) 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 4 Zone: default (8d767a7c-31da-4ded-9764-3a9d16d1fab7) 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 20 zonegroup default 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558370573e70 con 0x7ff44c031040 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 20 rados_obj.operate() r=0 bl.length=187 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558370575d00 con 0x558370570ff0 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 20 rados->read ofs=0 len=0 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.055+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705760a0 con 0x558370570ff0 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.056+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.056+0000 7ff45663f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.056+0000 7ff45663f800 20 started sync module instance, tier type = 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.056+0000 7ff45663f800 20 started zone id=8d767a7c-31da-4ded-9764-3a9d16d1fab7 (name=default) with tier type = 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.056+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370575140 con 0x7ff448039070 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.057+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 7 ==== osd_op_reply(44 notify.0 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.057+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023013846160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370576440 con 0x7ff448039070 2024-04-26T07:57:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.057+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370576cd0 con 0x55837056ada0 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.058+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94023013846160] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.058+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 18 ==== osd_op_reply(46 notify.1 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.058+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94023013848416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705768f0 con 0x55837056ada0 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.058+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705776e0 con 0x558370570ff0 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.059+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 19 ==== osd_op_reply(47 notify.1 [watch watch cookie 94023013848416] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.060+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 12 ==== osd_op_reply(48 notify.2 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.060+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94023013852224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370576860 con 0x558370570ff0 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.060+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705783e0 con 0x7ff448039070 2024-04-26T07:57:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.061+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 9 ==== osd_op_reply(50 notify.3 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.061+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94023013859664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370578c80 con 0x7ff448039070 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.061+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370579780 con 0x55837056ada0 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.061+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94023013852224] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.062+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94023013859664] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.062+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 20 ==== osd_op_reply(52 notify.4 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.062+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94023013864048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705787d0 con 0x55837056ada0 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.062+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55837057a050 con 0x7ff44c031040 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.064+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 21 ==== osd_op_reply(53 notify.4 [watch watch cookie 94023013864048] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.064+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 10 ==== osd_op_reply(54 notify.5 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.064+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94023013857920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705787d0 con 0x7ff44c031040 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.064+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55837057a690 con 0x7ff44c031040 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.065+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94023013857920] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.065+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 12 ==== osd_op_reply(56 notify.6 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.065+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94023013867936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55837057a690 con 0x7ff44c031040 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.065+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55837057b050 con 0x7ff44c031040 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94023013867936] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 14 ==== osd_op_reply(58 notify.7 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94023013866320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55837057b050 con 0x7ff44c031040 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45663f800 20 add_watcher() i=0 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45663f800 20 add_watcher() i=1 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45663f800 20 add_watcher() i=2 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45663f800 20 add_watcher() i=3 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45663f800 20 add_watcher() i=4 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45663f800 20 add_watcher() i=5 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.066+0000 7ff45663f800 20 add_watcher() i=6 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.067+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94023013866320] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.067+0000 7ff45663f800 20 add_watcher() i=7 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.067+0000 7ff45663f800 2 all 8 watchers are set, enabling cache 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.067+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55837057e4b0 con 0x55837056ada0 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.068+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 22 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.068+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94023013870960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55837057b9d0 con 0x55837056ada0 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.069+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 23 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94023013870960] v29'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.069+0000 7ff30afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.069+0000 7ff45663f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.069+0000 7ff45663f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.069+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587160 con 0x55837056ada0 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.070+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 24 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.070+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587810 con 0x7ff44c031040 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.071+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.071+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587810 con 0x558370570ff0 2024-04-26T07:57:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.072+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.072+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587bb0 con 0x55837056ada0 2024-04-26T07:57:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.074+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 25 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.074+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587bb0 con 0x7ff448039070 2024-04-26T07:57:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.075+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.075+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587ff0 con 0x558370570ff0 2024-04-26T07:57:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.076+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.076+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587ff0 con 0x55837056ada0 2024-04-26T07:57:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.077+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 26 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.077+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587ff0 con 0x7ff44c031040 2024-04-26T07:57:31.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.078+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.079+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370587ff0 con 0x7ff448039070 2024-04-26T07:57:31.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.080+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.080+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370588640 con 0x558370570ff0 2024-04-26T07:57:31.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.081+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.081+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370588640 con 0x7ff448039070 2024-04-26T07:57:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.082+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.082+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370588bb0 con 0x7ff44c031040 2024-04-26T07:57:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.083+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.083+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370588bb0 con 0x7ff448039070 2024-04-26T07:57:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.084+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.084+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x7ff44c031040 2024-04-26T07:57:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.085+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'65 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.085+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x55837056ada0 2024-04-26T07:57:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.086+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 27 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.086+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.088+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'78 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.088+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x7ff448039070 2024-04-26T07:57:31.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.089+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.089+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.090+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.090+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x55837056ada0 2024-04-26T07:57:31.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.091+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.091+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x55837056ada0 2024-04-26T07:57:31.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.092+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 29 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.092+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.094+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'79 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.094+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x7ff448039070 2024-04-26T07:57:31.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.095+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.095+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.096+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.096+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.097+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.097+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.097+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.097+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.098+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'57 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.098+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x7ff44c031040 2024-04-26T07:57:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.100+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.100+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.101+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.101+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x7ff44c031040 2024-04-26T07:57:31.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.103+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.103+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x558370570ff0 2024-04-26T07:57:31.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.104+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'80 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.104+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x7ff44c031040 2024-04-26T07:57:31.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.105+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'66 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.105+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370589060 con 0x7ff448039070 2024-04-26T07:57:31.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.106+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.107+0000 7ff309fdb640 20 reqs_thread_entry: start 2024-04-26T07:57:31.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.107+0000 7ff45663f800 20 init_complete bucket index max shards: 11 2024-04-26T07:57:31.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.107+0000 7ff45663f800 20 Filter name: none 2024-04-26T07:57:31.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.107+0000 7ff27b7fe640 20 reqs_thread_entry: start 2024-04-26T07:57:31.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.107+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-26T07:57:31.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.107+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:94 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff448039070 2024-04-26T07:57:31.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.108+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 18 ==== osd_op_reply(94 gc.21 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.108+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:95 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff448039070 2024-04-26T07:57:31.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.108+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 19 ==== osd_op_reply(95 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b43e0 con 0x7ff448039070 2024-04-26T07:57:31.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 20 ==== osd_op_reply(96 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff448039070 2024-04-26T07:57:31.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 21 ==== osd_op_reply(97 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff448039070 2024-04-26T07:57:31.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 22 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.109+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:99 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff448039070 2024-04-26T07:57:31.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.110+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 23 ==== osd_op_reply(99 gc.21 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.110+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-26T07:57:31.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.110+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.111+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 26 ==== osd_op_reply(100 gc.22 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.111+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.112+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 27 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.112+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.112+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:102 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b43e0 con 0x558370570ff0 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.112+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 28 ==== osd_op_reply(102 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.112+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:103 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.112+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 29 ==== osd_op_reply(103 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.112+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.112+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:104 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.113+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 30 ==== osd_op_reply(104 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.113+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.113+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:105 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.114+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 31 ==== osd_op_reply(105 gc.22 [call] v29'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.114+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-26T07:57:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.114+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:106 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 32 ==== osd_op_reply(106 gc.23 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:107 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 33 ==== osd_op_reply(107 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:108 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b43e0 con 0x558370570ff0 2024-04-26T07:57:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 34 ==== osd_op_reply(108 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:109 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 35 ==== osd_op_reply(109 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.115+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:110 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.116+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 36 ==== osd_op_reply(110 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.116+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.116+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:111 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.117+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 37 ==== osd_op_reply(111 gc.23 [call] v29'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.117+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.117+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:112 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 38 ==== osd_op_reply(112 gc.24 [call] v29'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:113 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 39 ==== osd_op_reply(113 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:114 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b43e0 con 0x558370570ff0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 40 ==== osd_op_reply(114 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:115 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 41 ==== osd_op_reply(115 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.118+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:116 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.119+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 42 ==== osd_op_reply(116 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.119+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.119+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:117 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.119+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 43 ==== osd_op_reply(117 gc.24 [call] v29'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.119+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-26T07:57:31.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.119+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:118 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.120+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 44 ==== osd_op_reply(118 gc.25 [call] v29'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:119 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 45 ==== osd_op_reply(119 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:120 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b43e0 con 0x558370570ff0 2024-04-26T07:57:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 46 ==== osd_op_reply(120 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:121 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 47 ==== osd_op_reply(121 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.121+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:122 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.122+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 48 ==== osd_op_reply(122 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.122+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.122+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:123 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.123+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 49 ==== osd_op_reply(123 gc.25 [call] v29'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.123+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-26T07:57:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.123+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:124 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff44c031040 2024-04-26T07:57:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.124+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 23 ==== osd_op_reply(124 gc.26 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.124+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:125 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff44c031040 2024-04-26T07:57:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.124+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 24 ==== osd_op_reply(125 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.124+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.124+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:126 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b43e0 con 0x7ff44c031040 2024-04-26T07:57:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.125+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 25 ==== osd_op_reply(126 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.125+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:127 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff44c031040 2024-04-26T07:57:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.125+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 26 ==== osd_op_reply(127 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.125+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.125+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:128 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff44c031040 2024-04-26T07:57:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.125+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 27 ==== osd_op_reply(128 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.125+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.126+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:129 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x7ff44c031040 2024-04-26T07:57:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.127+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 28 ==== osd_op_reply(129 gc.26 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.127+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-26T07:57:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.127+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:130 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 50 ==== osd_op_reply(130 gc.27 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:131 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 51 ==== osd_op_reply(131 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:132 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b43e0 con 0x558370570ff0 2024-04-26T07:57:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 52 ==== osd_op_reply(132 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:133 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 53 ==== osd_op_reply(133 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.128+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:134 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b53f0 con 0x558370570ff0 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 54 ==== osd_op_reply(134 gc.27 [call out=1715b] v0'0 uv35 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 20 garbage collection: RGWGC::process iterating over entry tag='8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.8297924620289150278', time=2024-04-26T07:57:39.173678+0000, chain.objs.size()=7 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_1 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:135 3.13s0 3:cbdf8715:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b36d0 con 0x558370570ff0 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_2 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:136 3.0s0 3:000dc66b:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b86c0 con 0x7ff44c031040 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_3 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:137 3.8s0 3:101dea12:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705baf30 con 0x558370570ff0 2024-04-26T07:57:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_4 2024-04-26T07:57:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:138 3.2bs0 3:d44ac9b1:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705bd7a0 con 0x55837056ada0 2024-04-26T07:57:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_5 2024-04-26T07:57:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:139 3.2as0 3:544b8b1a:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705c0010 con 0x55837056ada0 2024-04-26T07:57:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_6 2024-04-26T07:57:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:140 3.23s0 3:c7d51acc:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705c2880 con 0x7ff44c031040 2024-04-26T07:57:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_7 2024-04-26T07:57:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.129+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:141 3.1s0 3:83cd4d59:::8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705c0010 con 0x7ff44c031040 2024-04-26T07:57:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.131+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 29 ==== osd_op_reply(141 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_7 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.131+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 55 ==== osd_op_reply(135 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_1 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.131+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 30 ==== osd_op_reply(139 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_5 [call] v29'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.131+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 30 ==== osd_op_reply(136 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_2 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.132+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 31 ==== osd_op_reply(140 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_6 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.133+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 56 ==== osd_op_reply(137 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_3 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.134+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 31 ==== osd_op_reply(138 8d767a7c-31da-4ded-9764-3a9d16d1fab7.4221.11__shadow_.lB_ZBvlyI4CnTndNzp8x9loclmId0kh_4 [call] v29'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.134+0000 7ff45663f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-26T07:57:31.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.134+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:142 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x558370570ff0 2024-04-26T07:57:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.136+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 57 ==== osd_op_reply(142 gc.27 [call] v29'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.136+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:143 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x558370570ff0 2024-04-26T07:57:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.139+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 58 ==== osd_op_reply(143 gc.27 [call] v29'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.139+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-26T07:57:31.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.139+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:144 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x7ff44c031040 2024-04-26T07:57:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.140+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 32 ==== osd_op_reply(144 gc.28 [call] v29'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.140+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:145 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x7ff44c031040 2024-04-26T07:57:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.141+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 33 ==== osd_op_reply(145 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.141+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.141+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:146 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b9a40 con 0x7ff44c031040 2024-04-26T07:57:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.141+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 34 ==== osd_op_reply(146 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.141+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:147 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x7ff44c031040 2024-04-26T07:57:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.141+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 35 ==== osd_op_reply(147 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.141+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.141+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:148 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x7ff44c031040 2024-04-26T07:57:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.142+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 36 ==== osd_op_reply(148 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.142+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.142+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:149 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x7ff44c031040 2024-04-26T07:57:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.143+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 37 ==== osd_op_reply(149 gc.28 [call] v29'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.143+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-26T07:57:31.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.143+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:150 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x558370570ff0 2024-04-26T07:57:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.144+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 59 ==== osd_op_reply(150 gc.29 [call] v29'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.144+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:151 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x558370570ff0 2024-04-26T07:57:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.144+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 60 ==== osd_op_reply(151 gc.29 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.144+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.144+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:152 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b9a40 con 0x558370570ff0 2024-04-26T07:57:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.144+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 61 ==== osd_op_reply(152 gc.29 [call out=24b] v0'0 uv81 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.144+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:153 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705baa50 con 0x558370570ff0 2024-04-26T07:57:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.145+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 62 ==== osd_op_reply(153 gc.29 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.145+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.145+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:154 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.145+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 63 ==== osd_op_reply(154 gc.29 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.145+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.145+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:155 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.146+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 64 ==== osd_op_reply(155 gc.29 [call] v29'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.146+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-26T07:57:31.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.146+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:156 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.147+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 38 ==== osd_op_reply(156 gc.30 [call] v29'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.147+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:157 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 39 ==== osd_op_reply(157 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:158 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b9a40 con 0x7ff44c031040 2024-04-26T07:57:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 40 ==== osd_op_reply(158 gc.30 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:159 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 41 ==== osd_op_reply(159 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:160 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 42 ==== osd_op_reply(160 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.148+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:161 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.149+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 43 ==== osd_op_reply(161 gc.30 [call] v29'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.149+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-26T07:57:31.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.149+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:162 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 24 ==== osd_op_reply(162 gc.31 [call] v29'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:163 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 25 ==== osd_op_reply(163 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:164 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b9a40 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 26 ==== osd_op_reply(164 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:165 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 27 ==== osd_op_reply(165 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.151+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:166 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.152+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 28 ==== osd_op_reply(166 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.152+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.152+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:167 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.153+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 29 ==== osd_op_reply(167 gc.31 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.153+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-26T07:57:31.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.153+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:168 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.154+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 32 ==== osd_op_reply(168 gc.0 [call] v29'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.154+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:169 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.154+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 33 ==== osd_op_reply(169 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.154+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.154+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:170 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.154+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 34 ==== osd_op_reply(170 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.154+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:171 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.155+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 35 ==== osd_op_reply(171 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.155+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.155+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:172 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.155+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 36 ==== osd_op_reply(172 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.155+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.155+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:173 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.156+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 37 ==== osd_op_reply(173 gc.0 [call] v29'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.156+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-26T07:57:31.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.156+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:174 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.157+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 44 ==== osd_op_reply(174 gc.1 [call] v29'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.157+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:175 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 45 ==== osd_op_reply(175 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:176 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 46 ==== osd_op_reply(176 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:177 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 47 ==== osd_op_reply(177 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:178 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 48 ==== osd_op_reply(178 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.158+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:179 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.159+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 49 ==== osd_op_reply(179 gc.1 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.159+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-26T07:57:31.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.159+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:180 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.160+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 65 ==== osd_op_reply(180 gc.2 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.160+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:181 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 66 ==== osd_op_reply(181 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:182 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 67 ==== osd_op_reply(182 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:183 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 68 ==== osd_op_reply(183 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:184 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 69 ==== osd_op_reply(184 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.161+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:185 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.162+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 70 ==== osd_op_reply(185 gc.2 [call] v29'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.163+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-26T07:57:31.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.163+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:186 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 38 ==== osd_op_reply(186 gc.3 [call] v29'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:187 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 39 ==== osd_op_reply(187 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:188 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 40 ==== osd_op_reply(188 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:189 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 41 ==== osd_op_reply(189 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.164+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:190 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.165+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 42 ==== osd_op_reply(190 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.165+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.165+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:191 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.166+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 43 ==== osd_op_reply(191 gc.3 [call] v29'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.166+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-26T07:57:31.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.166+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:192 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.167+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 30 ==== osd_op_reply(192 gc.4 [call] v29'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.167+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:193 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.167+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 31 ==== osd_op_reply(193 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.167+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.167+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:194 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.167+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 32 ==== osd_op_reply(194 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.167+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:195 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.168+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 33 ==== osd_op_reply(195 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.168+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.168+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:196 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.168+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 34 ==== osd_op_reply(196 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.168+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.168+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:197 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.169+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 35 ==== osd_op_reply(197 gc.4 [call] v29'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.169+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-26T07:57:31.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.169+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:198 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 71 ==== osd_op_reply(198 gc.5 [call] v29'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:199 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 72 ==== osd_op_reply(199 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:200 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 73 ==== osd_op_reply(200 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:201 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 74 ==== osd_op_reply(201 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.170+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:202 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.171+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 75 ==== osd_op_reply(202 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.171+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.171+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:203 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.172+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 76 ==== osd_op_reply(203 gc.5 [call] v29'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.172+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-26T07:57:31.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.172+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:204 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 44 ==== osd_op_reply(204 gc.6 [call] v29'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:205 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 45 ==== osd_op_reply(205 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:206 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 46 ==== osd_op_reply(206 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:207 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 47 ==== osd_op_reply(207 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.175+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:208 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.176+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 48 ==== osd_op_reply(208 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.176+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.176+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:209 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.177+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 49 ==== osd_op_reply(209 gc.6 [call] v29'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.177+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-26T07:57:31.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.177+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:210 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.178+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 50 ==== osd_op_reply(210 gc.7 [call] v29'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.178+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:211 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.178+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 51 ==== osd_op_reply(211 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.178+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.178+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:212 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.178+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 52 ==== osd_op_reply(212 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.178+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:213 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.179+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 53 ==== osd_op_reply(213 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.179+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.179+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:214 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.179+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 54 ==== osd_op_reply(214 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.179+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.179+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:215 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.180+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 55 ==== osd_op_reply(215 gc.7 [call] v29'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.180+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-26T07:57:31.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.180+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:216 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.181+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 36 ==== osd_op_reply(216 gc.8 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.181+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:217 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.181+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 37 ==== osd_op_reply(217 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.181+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.181+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:218 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.181+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 38 ==== osd_op_reply(218 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.181+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:219 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.182+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 39 ==== osd_op_reply(219 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.182+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.182+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:220 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.182+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 40 ==== osd_op_reply(220 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.182+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.182+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:221 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.183+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 41 ==== osd_op_reply(221 gc.8 [call] v29'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.183+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-26T07:57:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.183+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:222 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.184+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 77 ==== osd_op_reply(222 gc.9 [call] v29'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.184+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:223 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 78 ==== osd_op_reply(223 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:224 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 79 ==== osd_op_reply(224 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:225 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 80 ==== osd_op_reply(225 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:226 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 81 ==== osd_op_reply(226 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.185+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:227 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.186+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 82 ==== osd_op_reply(227 gc.9 [call] v29'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.186+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-26T07:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.186+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:228 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.187+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 42 ==== osd_op_reply(228 gc.10 [call] v29'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.187+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:229 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 43 ==== osd_op_reply(229 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:230 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b9a40 con 0x7ff448039070 2024-04-26T07:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 44 ==== osd_op_reply(230 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:231 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 45 ==== osd_op_reply(231 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:232 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 46 ==== osd_op_reply(232 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.188+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:233 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.189+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 47 ==== osd_op_reply(233 gc.10 [call] v29'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.190+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-26T07:57:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.190+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:234 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.191+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 56 ==== osd_op_reply(234 gc.11 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.191+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:235 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.191+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 57 ==== osd_op_reply(235 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.191+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.191+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:236 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b9a40 con 0x7ff44c031040 2024-04-26T07:57:31.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.191+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 58 ==== osd_op_reply(236 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.191+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:237 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.192+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 59 ==== osd_op_reply(237 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.192+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.192+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:238 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.192+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 60 ==== osd_op_reply(238 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.192+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.192+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:239 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.193+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 61 ==== osd_op_reply(239 gc.11 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.193+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-26T07:57:31.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.193+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:240 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.194+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 48 ==== osd_op_reply(240 gc.12 [call] v29'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.194+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:241 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 49 ==== osd_op_reply(241 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:242 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b9a40 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 50 ==== osd_op_reply(242 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:243 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 51 ==== osd_op_reply(243 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:244 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 52 ==== osd_op_reply(244 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.195+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:245 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.196+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 53 ==== osd_op_reply(245 gc.12 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.196+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-26T07:57:31.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.196+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:246 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.198+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 62 ==== osd_op_reply(246 gc.13 [call] v29'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.198+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:247 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.198+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 63 ==== osd_op_reply(247 gc.13 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.198+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.198+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:248 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.199+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 64 ==== osd_op_reply(248 gc.13 [call out=24b] v0'0 uv69 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.199+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:249 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.199+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 65 ==== osd_op_reply(249 gc.13 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.199+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.199+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:250 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.199+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 66 ==== osd_op_reply(250 gc.13 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.199+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.199+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:251 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff44c031040 2024-04-26T07:57:31.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.200+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 67 ==== osd_op_reply(251 gc.13 [call] v29'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.200+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-26T07:57:31.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.200+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:252 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.201+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 50 ==== osd_op_reply(252 gc.14 [call] v29'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.201+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:253 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 51 ==== osd_op_reply(253 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:254 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 52 ==== osd_op_reply(254 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:255 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 53 ==== osd_op_reply(255 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:256 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 54 ==== osd_op_reply(256 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.202+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:257 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.203+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 55 ==== osd_op_reply(257 gc.14 [call] v29'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.203+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-26T07:57:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.203+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:258 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.204+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 83 ==== osd_op_reply(258 gc.15 [call] v29'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.204+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:259 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.205+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 84 ==== osd_op_reply(259 gc.15 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.205+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.205+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:260 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.205+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 85 ==== osd_op_reply(260 gc.15 [call out=24b] v0'0 uv83 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.205+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:261 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.205+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 86 ==== osd_op_reply(261 gc.15 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.205+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.205+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:262 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.206+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 87 ==== osd_op_reply(262 gc.15 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.206+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.206+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:263 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.207+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 88 ==== osd_op_reply(263 gc.15 [call] v29'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.207+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-26T07:57:31.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.207+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:264 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.208+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 54 ==== osd_op_reply(264 gc.16 [call] v29'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.208+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:265 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.208+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 55 ==== osd_op_reply(265 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.208+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.208+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:266 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.209+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 56 ==== osd_op_reply(266 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.209+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:267 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.209+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 57 ==== osd_op_reply(267 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.209+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.209+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:268 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.209+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 58 ==== osd_op_reply(268 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.209+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.209+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:269 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x7ff448039070 2024-04-26T07:57:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.210+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 59 ==== osd_op_reply(269 gc.16 [call] v29'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.210+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-26T07:57:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.210+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:270 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.211+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 89 ==== osd_op_reply(270 gc.17 [call] v29'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.211+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:271 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.211+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 90 ==== osd_op_reply(271 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.211+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.211+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:272 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.212+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 91 ==== osd_op_reply(272 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.212+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:273 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.212+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 92 ==== osd_op_reply(273 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.212+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.212+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:274 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.212+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 93 ==== osd_op_reply(274 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.212+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.212+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:275 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.213+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 94 ==== osd_op_reply(275 gc.17 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.213+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-26T07:57:31.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.213+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:276 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 56 ==== osd_op_reply(276 gc.18 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:277 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 57 ==== osd_op_reply(277 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:278 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 58 ==== osd_op_reply(278 gc.18 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:279 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 59 ==== osd_op_reply(279 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.215+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:280 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.216+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 60 ==== osd_op_reply(280 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.216+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.216+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:281 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.217+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 61 ==== osd_op_reply(281 gc.18 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.217+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-26T07:57:31.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.217+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:282 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.218+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 62 ==== osd_op_reply(282 gc.19 [call] v29'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.218+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:283 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.218+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 63 ==== osd_op_reply(283 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.218+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.218+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:284 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.218+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 64 ==== osd_op_reply(284 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.218+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:285 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.219+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 65 ==== osd_op_reply(285 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.219+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.219+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:286 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.219+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 66 ==== osd_op_reply(286 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.219+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.219+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:287 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x55837056ada0 2024-04-26T07:57:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.220+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 67 ==== osd_op_reply(287 gc.19 [call] v29'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.220+0000 7ff45663f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-26T07:57:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.220+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:288 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.221+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 95 ==== osd_op_reply(288 gc.20 [call] v29'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.221+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:289 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.221+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 96 ==== osd_op_reply(289 gc.20 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.221+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.221+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:290 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.222+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 97 ==== osd_op_reply(290 gc.20 [call out=24b] v0'0 uv85 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.222+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:291 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.222+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 98 ==== osd_op_reply(291 gc.20 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.222+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T07:57:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.222+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:292 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.222+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 99 ==== osd_op_reply(292 gc.20 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.222+0000 7ff45663f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T07:57:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.222+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:293 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b30c0 con 0x558370570ff0 2024-04-26T07:57:31.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.223+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 100 ==== osd_op_reply(293 gc.20 [call] v29'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.224+0000 7ff30afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T07:57:31.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.224+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94023013870960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5583705b2910 con 0x55837056ada0 2024-04-26T07:57:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.225+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94023013870960] v29'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.225+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94023013846160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55837057ad40 con 0x7ff448039070 2024-04-26T07:57:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.227+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 60 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94023013846160] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.227+0000 7ff45663f800 20 remove_watcher() i=0 2024-04-26T07:57:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.227+0000 7ff45663f800 2 removed watcher, disabling cache 2024-04-26T07:57:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.227+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94023013848416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370574c90 con 0x55837056ada0 2024-04-26T07:57:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.228+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94023013848416] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.228+0000 7ff45663f800 20 remove_watcher() i=1 2024-04-26T07:57:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.228+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94023013852224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370574c90 con 0x558370570ff0 2024-04-26T07:57:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.229+0000 7ff45393d640 1 -- 172.21.15.62:0/664076719 <== osd.3 v2:172.21.15.62:6816/1472283839 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94023013852224] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44805b040 con 0x558370570ff0 2024-04-26T07:57:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.229+0000 7ff45663f800 20 remove_watcher() i=2 2024-04-26T07:57:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.229+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94023013859664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370576440 con 0x7ff448039070 2024-04-26T07:57:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.230+0000 7ff45493f640 1 -- 172.21.15.62:0/664076719 <== osd.2 v2:172.21.15.62:6808/1138534927 61 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94023013859664] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff44c040040 con 0x7ff448039070 2024-04-26T07:57:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.230+0000 7ff45663f800 20 remove_watcher() i=3 2024-04-26T07:57:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.230+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94023013864048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370574c90 con 0x55837056ada0 2024-04-26T07:57:31.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.231+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.1 v2:172.21.15.62:6800/1888558046 70 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94023013864048] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x55837056ada0 2024-04-26T07:57:31.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.231+0000 7ff45663f800 20 remove_watcher() i=4 2024-04-26T07:57:31.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.231+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94023013857920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370576440 con 0x7ff44c031040 2024-04-26T07:57:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.233+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94023013857920] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.233+0000 7ff45663f800 20 remove_watcher() i=5 2024-04-26T07:57:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.233+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94023013867936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370579270 con 0x7ff44c031040 2024-04-26T07:57:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.234+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94023013867936] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.234+0000 7ff45663f800 20 remove_watcher() i=6 2024-04-26T07:57:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.234+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94023013866320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558370574c90 con 0x7ff44c031040 2024-04-26T07:57:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 <== osd.0 v2:172.21.15.1:6800/3827982423 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94023013866320] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff444079070 con 0x7ff44c031040 2024-04-26T07:57:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 20 remove_watcher() i=7 2024-04-26T07:57:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff44c031040 msgr2=0x7ff44c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7ff44c031040 0x7ff44c032940 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55837056ada0 msgr2=0x55837056d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x55837056ada0 0x55837056d260 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff448039070 msgr2=0x7ff44803ca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7ff448039070 0x7ff44803ca30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558370570ff0 msgr2=0x5583705733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x558370570ff0 0x5583705733e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff31c036eb0 msgr2=0x7ff31c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff31c036eb0 0x7ff31c039370 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5583705370a0 tx=0x7ff44c01f000 comp rx=0 tx=0).stop 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 msgr2=0x55837055f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 --2- 172.21.15.62:0/664076719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370557ff0 0x55837055f690 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff4480249d0 tx=0x7ff44804d430 comp rx=0 tx=0).stop 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45413e640 1 -- 172.21.15.62:0/664076719 reap_dead start 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 shutdown_connections 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 >> 172.21.15.62:0/664076719 conn(0x558370554350 msgr2=0x5583705519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 shutdown_connections 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.235+0000 7ff45663f800 1 -- 172.21.15.62:0/664076719 wait complete. 2024-04-26T07:57:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/3641939725 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff32c036e60 msgr2=0x7ff32c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/3641939725 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff32c036e60 0x7ff32c039320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55837053ad40 tx=0x7ff44c005840 comp rx=0 tx=0).stop 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/3641939725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55837054acb0 msgr2=0x55837054b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/3641939725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55837054acb0 0x55837054b0d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff44800bec0 tx=0x7ff44800d7a0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/3641939725 shutdown_connections 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/3641939725 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff32c036e60 0x7ff32c039320 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/3641939725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55837054acb0 0x55837054b0d0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/3641939725 >> 172.21.15.62:0/3641939725 conn(0x55837053ed50 msgr2=0x55837053f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/3641939725 shutdown_connections 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/3641939725 wait complete. 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5583704377e0 msgr2=0x558370539b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5583704377e0 0x558370539b80 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff33c036eb0 msgr2=0x7ff33c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff33c036eb0 0x7ff33c039370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff448000f60 tx=0x7ff4480010a0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 msgr2=0x558370532990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x558370532990 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff44401baa0 tx=0x7ff444002fb0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 shutdown_connections 2024-04-26T07:57:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x5583704377e0 0x558370539b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff33c036eb0 0x7ff33c039370 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 --2- 172.21.15.62:0/768891396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558370436580 0x558370532990 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 >> 172.21.15.62:0/768891396 conn(0x558370431ba0 msgr2=0x558370520bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 shutdown_connections 2024-04-26T07:57:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-26T07:57:31.236+0000 7ff45663f800 1 -- 172.21.15.62:0/768891396 wait complete. 2024-04-26T07:57:31.241 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T07:57:31.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T07:57:31.251 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:57:31.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.360+0000 7f9c7571e640 1 Processor -- start 2024-04-26T07:57:31.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.360+0000 7f9c7571e640 1 -- start start 2024-04-26T07:57:31.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c7571e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c7012c370 0x7f9c701340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c7571e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c7009a780 con 0x7f9c7012b880 2024-04-26T07:57:31.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c7571e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f9c7009a9c0 con 0x7f9c7012c370 2024-04-26T07:57:31.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c6e7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c7012c370 0x7f9c701340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c6effd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9c7012b880 0x7f9c7012bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46434/0 (socket says 172.21.15.1:46434) 2024-04-26T07:57:31.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c6effd640 1 -- 172.21.15.1:0/3869635143 learned_addr learned my addr 172.21.15.1:0/3869635143 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:31.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c6e7fc640 1 -- 172.21.15.1:0/3869635143 >> v1:172.21.15.1:6789/0 conn(0x7f9c7012b880 legacy=0x7f9c7012bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c6dffb640 1 -- 172.21.15.1:0/3869635143 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434016390 0 0) 0x7f9c68001110 con 0x7f9c7012b880 2024-04-26T07:57:31.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.361+0000 7f9c6e7fc640 1 -- 172.21.15.1:0/3869635143 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7009b750 con 0x7f9c7012c370 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.362+0000 7f9c6e7fc640 1 --2- 172.21.15.1:0/3869635143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012c370 0x7f9c701340a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009720 tx=0x7f9c5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e57bd7c4b5576a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.362+0000 7f9c6dffb640 1 -- 172.21.15.1:0/3869635143 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c58035020 con 0x7f9c7012c370 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.362+0000 7f9c6dffb640 1 -- 172.21.15.1:0/3869635143 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c58031760 con 0x7f9c7012c370 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.362+0000 7f9c6dffb640 1 -- 172.21.15.1:0/3869635143 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c58031a60 con 0x7f9c7012c370 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.362+0000 7f9c7571e640 1 -- 172.21.15.1:0/3869635143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012c370 msgr2=0x7f9c701340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.362+0000 7f9c7571e640 1 --2- 172.21.15.1:0/3869635143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012c370 0x7f9c701340a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009720 tx=0x7f9c5802b8d0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.362+0000 7f9c7571e640 1 -- 172.21.15.1:0/3869635143 shutdown_connections 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.362+0000 7f9c7571e640 1 --2- 172.21.15.1:0/3869635143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012c370 0x7f9c701340a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.363+0000 7f9c7571e640 1 -- 172.21.15.1:0/3869635143 >> 172.21.15.1:0/3869635143 conn(0x7f9c700a1700 msgr2=0x7f9c700a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.363+0000 7f9c7571e640 1 -- 172.21.15.1:0/3869635143 shutdown_connections 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.363+0000 7f9c7571e640 1 -- 172.21.15.1:0/3869635143 wait complete. 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.363+0000 7f9c7571e640 1 Processor -- start 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c7571e640 1 -- start start 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c7571e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012b880 0x7f9c701c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c7571e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70134760 con 0x7f9c7012b880 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c6effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012b880 0x7f9c701c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c6effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012b880 0x7f9c701c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35812/0 (socket says 172.21.15.1:35812) 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c6effd640 1 -- 172.21.15.1:0/869470168 learned_addr learned my addr 172.21.15.1:0/869470168 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c6effd640 1 -- 172.21.15.1:0/869470168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c70133660 con 0x7f9c7012b880 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c6effd640 1 --2- 172.21.15.1:0/869470168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012b880 0x7f9c701c3a80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800c700 tx=0x7f9c6800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.364+0000 7f9c677fe640 1 -- 172.21.15.1:0/869470168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c68018070 con 0x7f9c7012b880 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.365+0000 7f9c677fe640 1 -- 172.21.15.1:0/869470168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c680070d0 con 0x7f9c7012b880 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.365+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7006d160 con 0x7f9c7012b880 2024-04-26T07:57:31.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.365+0000 7f9c677fe640 1 -- 172.21.15.1:0/869470168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c680073f0 con 0x7f9c7012b880 2024-04-26T07:57:31.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.365+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7006d9b0 con 0x7f9c7012b880 2024-04-26T07:57:31.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.365+0000 7f9c677fe640 1 -- 172.21.15.1:0/869470168 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9c6801b070 con 0x7f9c7012b880 2024-04-26T07:57:31.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.366+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c7006dcf0 con 0x7f9c7012b880 2024-04-26T07:57:31.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.366+0000 7f9c677fe640 1 --2- 172.21.15.1:0/869470168 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9c500385c0 0x7f9c5003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.366+0000 7f9c677fe640 1 -- 172.21.15.1:0/869470168 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f9c6804b440 con 0x7f9c7012b880 2024-04-26T07:57:31.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.366+0000 7f9c6e7fc640 1 --2- 172.21.15.1:0/869470168 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9c500385c0 0x7f9c5003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.366+0000 7f9c6e7fc640 1 --2- 172.21.15.1:0/869470168 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9c500385c0 0x7f9c5003aa80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9c58036000 tx=0x7f9c58008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.371+0000 7f9c677fe640 1 -- 172.21.15.1:0/869470168 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c7006dcf0 con 0x7f9c7012b880 2024-04-26T07:57:31.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.553+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c70134590 con 0x7f9c500385c0 2024-04-26T07:57:31.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.570+0000 7f9c677fe640 1 -- 172.21.15.1:0/869470168 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665701 (secure 0 0 0) 0x7f9c70134590 con 0x7f9c500385c0 2024-04-26T07:57:31.575 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:57:31.582 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:57:31.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9c500385c0 msgr2=0x7f9c5003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 --2- 172.21.15.1:0/869470168 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9c500385c0 0x7f9c5003aa80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9c58036000 tx=0x7f9c58008030 comp rx=0 tx=0).stop 2024-04-26T07:57:31.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012b880 msgr2=0x7f9c701c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 --2- 172.21.15.1:0/869470168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012b880 0x7f9c701c3a80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800c700 tx=0x7f9c6800cbc0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 shutdown_connections 2024-04-26T07:57:31.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 --2- 172.21.15.1:0/869470168 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f9c500385c0 0x7f9c5003aa80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 --2- 172.21.15.1:0/869470168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c7012b880 0x7f9c701c3a80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 >> 172.21.15.1:0/869470168 conn(0x7f9c700a1700 msgr2=0x7f9c7012e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 shutdown_connections 2024-04-26T07:57:31.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.575+0000 7f9c7571e640 1 -- 172.21.15.1:0/869470168 wait complete. 2024-04-26T07:57:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-04-26T07:57:30.868555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4887,"num_read_kb":4464,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177748,"kb_used_data":40564,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309612,"statfs":{"total":386547056640,"available":386365042688,"internally_reserved":0,"allocated":41537536,"data_stored":40441298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003453"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.633565+0000","last_change":"2024-04-26T07:54:15.021756+0000","last_active":"2024-04-26T07:56:23.633565+0000","last_peered":"2024-04-26T07:56:23.633565+0000","last_clean":"2024-04-26T07:56:23.633565+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:56:23.633565+0000","last_undegraded":"2024-04-26T07:56:23.633565+0000","last_fullsized":"2024-04-26T07:56:23.633565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895004+0000","last_change":"2024-04-26T07:54:17.007567+0000","last_active":"2024-04-26T07:56:49.895004+0000","last_peered":"2024-04-26T07:56:49.895004+0000","last_clean":"2024-04-26T07:56:49.895004+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:56:49.895004+0000","last_undegraded":"2024-04-26T07:56:49.895004+0000","last_fullsized":"2024-04-26T07:56:49.895004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050522+0000","last_change":"2024-04-26T07:54:15.008962+0000","last_active":"2024-04-26T07:55:02.050522+0000","last_peered":"2024-04-26T07:55:02.050522+0000","last_clean":"2024-04-26T07:55:02.050522+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:55:02.050522+0000","last_undegraded":"2024-04-26T07:55:02.050522+0000","last_fullsized":"2024-04-26T07:55:02.050522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.209457+0000","last_change":"2024-04-26T07:54:17.015486+0000","last_active":"2024-04-26T07:57:24.209457+0000","last_peered":"2024-04-26T07:57:24.209457+0000","last_clean":"2024-04-26T07:57:24.209457+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:57:24.209457+0000","last_undegraded":"2024-04-26T07:57:24.209457+0000","last_fullsized":"2024-04-26T07:57:24.209457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:22.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049119+0000","last_change":"2024-04-26T07:54:15.026276+0000","last_active":"2024-04-26T07:55:02.049119+0000","last_peered":"2024-04-26T07:55:02.049119+0000","last_clean":"2024-04-26T07:55:02.049119+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:55:02.049119+0000","last_undegraded":"2024-04-26T07:55:02.049119+0000","last_fullsized":"2024-04-26T07:55:02.049119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:33.771147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511438+0000","last_change":"2024-04-26T07:54:17.018611+0000","last_active":"2024-04-26T07:57:24.511438+0000","last_peered":"2024-04-26T07:57:24.511438+0000","last_clean":"2024-04-26T07:57:24.511438+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:24.511438+0000","last_undegraded":"2024-04-26T07:57:24.511438+0000","last_fullsized":"2024-04-26T07:57:24.511438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:15.151809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054671+0000","last_change":"2024-04-26T07:54:15.020803+0000","last_active":"2024-04-26T07:55:02.054671+0000","last_peered":"2024-04-26T07:55:02.054671+0000","last_clean":"2024-04-26T07:55:02.054671+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:55:02.054671+0000","last_undegraded":"2024-04-26T07:55:02.054671+0000","last_fullsized":"2024-04-26T07:55:02.054671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047930+0000","last_change":"2024-04-26T07:54:17.011187+0000","last_active":"2024-04-26T07:55:02.047930+0000","last_peered":"2024-04-26T07:55:02.047930+0000","last_clean":"2024-04-26T07:55:02.047930+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:55:02.047930+0000","last_undegraded":"2024-04-26T07:55:02.047930+0000","last_fullsized":"2024-04-26T07:55:02.047930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:47.382429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047464+0000","last_change":"2024-04-26T07:54:15.025367+0000","last_active":"2024-04-26T07:55:02.047464+0000","last_peered":"2024-04-26T07:55:02.047464+0000","last_clean":"2024-04-26T07:55:02.047464+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:55:02.047464+0000","last_undegraded":"2024-04-26T07:55:02.047464+0000","last_fullsized":"2024-04-26T07:55:02.047464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:02.114318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511501+0000","last_change":"2024-04-26T07:54:17.001492+0000","last_active":"2024-04-26T07:57:24.511501+0000","last_peered":"2024-04-26T07:57:24.511501+0000","last_clean":"2024-04-26T07:57:24.511501+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:57:24.511501+0000","last_undegraded":"2024-04-26T07:57:24.511501+0000","last_fullsized":"2024-04-26T07:57:24.511501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:09.013983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.506545+0000","last_change":"2024-04-26T07:54:15.019896+0000","last_active":"2024-04-26T07:57:24.506545+0000","last_peered":"2024-04-26T07:57:24.506545+0000","last_clean":"2024-04-26T07:57:24.506545+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:57:24.506545+0000","last_undegraded":"2024-04-26T07:57:24.506545+0000","last_fullsized":"2024-04-26T07:57:24.506545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:42.204889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511288+0000","last_change":"2024-04-26T07:54:17.018051+0000","last_active":"2024-04-26T07:57:24.511288+0000","last_peered":"2024-04-26T07:57:24.511288+0000","last_clean":"2024-04-26T07:57:24.511288+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:24.511288+0000","last_undegraded":"2024-04-26T07:57:24.511288+0000","last_fullsized":"2024-04-26T07:57:24.511288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:26.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.170249+0000","last_change":"2024-04-26T07:54:15.021920+0000","last_active":"2024-04-26T07:57:24.170249+0000","last_peered":"2024-04-26T07:57:24.170249+0000","last_clean":"2024-04-26T07:57:24.170249+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:57:24.170249+0000","last_undegraded":"2024-04-26T07:57:24.170249+0000","last_fullsized":"2024-04-26T07:57:24.170249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:35.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.615508+0000","last_change":"2024-04-26T07:54:17.016378+0000","last_active":"2024-04-26T07:56:20.615508+0000","last_peered":"2024-04-26T07:56:20.615508+0000","last_clean":"2024-04-26T07:56:20.615508+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:56:20.615508+0000","last_undegraded":"2024-04-26T07:56:20.615508+0000","last_fullsized":"2024-04-26T07:56:20.615508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047579+0000","last_change":"2024-04-26T07:54:15.008904+0000","last_active":"2024-04-26T07:55:02.047579+0000","last_peered":"2024-04-26T07:55:02.047579+0000","last_clean":"2024-04-26T07:55:02.047579+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:55:02.047579+0000","last_undegraded":"2024-04-26T07:55:02.047579+0000","last_fullsized":"2024-04-26T07:55:02.047579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207539+0000","last_change":"2024-04-26T07:54:17.011542+0000","last_active":"2024-04-26T07:57:24.207539+0000","last_peered":"2024-04-26T07:57:24.207539+0000","last_clean":"2024-04-26T07:57:24.207539+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:57:24.207539+0000","last_undegraded":"2024-04-26T07:57:24.207539+0000","last_fullsized":"2024-04-26T07:57:24.207539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143674+0000","last_change":"2024-04-26T07:54:17.018794+0000","last_active":"2024-04-26T07:55:40.143674+0000","last_peered":"2024-04-26T07:55:40.143674+0000","last_clean":"2024-04-26T07:55:40.143674+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:55:40.143674+0000","last_undegraded":"2024-04-26T07:55:40.143674+0000","last_fullsized":"2024-04-26T07:55:40.143674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:25.624134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054524+0000","last_change":"2024-04-26T07:54:15.020059+0000","last_active":"2024-04-26T07:55:02.054524+0000","last_peered":"2024-04-26T07:55:02.054524+0000","last_clean":"2024-04-26T07:55:02.054524+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:55:02.054524+0000","last_undegraded":"2024-04-26T07:55:02.054524+0000","last_fullsized":"2024-04-26T07:55:02.054524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.614746+0000","last_change":"2024-04-26T07:54:17.007162+0000","last_active":"2024-04-26T07:56:20.614746+0000","last_peered":"2024-04-26T07:56:20.614746+0000","last_clean":"2024-04-26T07:56:20.614746+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:56:20.614746+0000","last_undegraded":"2024-04-26T07:56:20.614746+0000","last_fullsized":"2024-04-26T07:56:20.614746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057735+0000","last_change":"2024-04-26T07:54:15.023259+0000","last_active":"2024-04-26T07:55:02.057735+0000","last_peered":"2024-04-26T07:55:02.057735+0000","last_clean":"2024-04-26T07:55:02.057735+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:55:02.057735+0000","last_undegraded":"2024-04-26T07:55:02.057735+0000","last_fullsized":"2024-04-26T07:55:02.057735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.295581+0000","last_change":"2024-04-26T07:54:17.016377+0000","last_active":"2024-04-26T07:57:24.295581+0000","last_peered":"2024-04-26T07:57:24.295581+0000","last_clean":"2024-04-26T07:57:24.295581+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:24.295581+0000","last_undegraded":"2024-04-26T07:57:24.295581+0000","last_fullsized":"2024-04-26T07:57:24.295581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:20.487011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048878+0000","last_change":"2024-04-26T07:54:15.017989+0000","last_active":"2024-04-26T07:55:02.048878+0000","last_peered":"2024-04-26T07:55:02.048878+0000","last_clean":"2024-04-26T07:55:02.048878+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:55:02.048878+0000","last_undegraded":"2024-04-26T07:55:02.048878+0000","last_fullsized":"2024-04-26T07:55:02.048878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.215781+0000","last_change":"2024-04-26T07:54:17.011769+0000","last_active":"2024-04-26T07:57:24.215781+0000","last_peered":"2024-04-26T07:57:24.215781+0000","last_clean":"2024-04-26T07:57:24.215781+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:57:24.215781+0000","last_undegraded":"2024-04-26T07:57:24.215781+0000","last_fullsized":"2024-04-26T07:57:24.215781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055070+0000","last_change":"2024-04-26T07:54:15.017753+0000","last_active":"2024-04-26T07:55:02.055070+0000","last_peered":"2024-04-26T07:55:02.055070+0000","last_clean":"2024-04-26T07:55:02.055070+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:55:02.055070+0000","last_undegraded":"2024-04-26T07:55:02.055070+0000","last_fullsized":"2024-04-26T07:55:02.055070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143749+0000","last_change":"2024-04-26T07:54:17.012327+0000","last_active":"2024-04-26T07:55:40.143749+0000","last_peered":"2024-04-26T07:55:40.143749+0000","last_clean":"2024-04-26T07:55:40.143749+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:55:40.143749+0000","last_undegraded":"2024-04-26T07:55:40.143749+0000","last_fullsized":"2024-04-26T07:55:40.143749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049152+0000","last_change":"2024-04-26T07:54:15.008684+0000","last_active":"2024-04-26T07:55:02.049152+0000","last_peered":"2024-04-26T07:55:02.049152+0000","last_clean":"2024-04-26T07:55:02.049152+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:55:02.049152+0000","last_undegraded":"2024-04-26T07:55:02.049152+0000","last_fullsized":"2024-04-26T07:55:02.049152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511606+0000","last_change":"2024-04-26T07:54:16.998745+0000","last_active":"2024-04-26T07:57:24.511606+0000","last_peered":"2024-04-26T07:57:24.511606+0000","last_clean":"2024-04-26T07:57:24.511606+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:57:24.511606+0000","last_undegraded":"2024-04-26T07:57:24.511606+0000","last_fullsized":"2024-04-26T07:57:24.511606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:13.730381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047329+0000","last_change":"2024-04-26T07:54:15.017883+0000","last_active":"2024-04-26T07:55:02.047329+0000","last_peered":"2024-04-26T07:55:02.047329+0000","last_clean":"2024-04-26T07:55:02.047329+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:55:02.047329+0000","last_undegraded":"2024-04-26T07:55:02.047329+0000","last_fullsized":"2024-04-26T07:55:02.047329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:44.995414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.463089+0000","last_change":"2024-04-26T07:54:25.037823+0000","last_active":"2024-04-26T07:57:24.463089+0000","last_peered":"2024-04-26T07:57:24.463089+0000","last_clean":"2024-04-26T07:57:24.463089+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:57:24.463089+0000","last_undegraded":"2024-04-26T07:57:24.463089+0000","last_fullsized":"2024-04-26T07:57:24.463089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.012082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'13","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489530+0000","last_change":"2024-04-26T07:54:17.010298+0000","last_active":"2024-04-26T07:57:24.489530+0000","last_peered":"2024-04-26T07:57:24.489530+0000","last_clean":"2024-04-26T07:57:24.489530+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:57:24.489530+0000","last_undegraded":"2024-04-26T07:57:24.489530+0000","last_fullsized":"2024-04-26T07:57:24.489530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:38.486309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892998+0000","last_change":"2024-04-26T07:54:15.028485+0000","last_active":"2024-04-26T07:56:34.892998+0000","last_peered":"2024-04-26T07:56:34.892998+0000","last_clean":"2024-04-26T07:56:34.892998+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:56:34.892998+0000","last_undegraded":"2024-04-26T07:56:34.892998+0000","last_fullsized":"2024-04-26T07:56:34.892998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:43.230145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047546+0000","last_change":"2024-04-26T07:54:19.013097+0000","last_active":"2024-04-26T07:55:02.047546+0000","last_peered":"2024-04-26T07:55:02.047546+0000","last_clean":"2024-04-26T07:55:02.047546+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:55:02.047546+0000","last_undegraded":"2024-04-26T07:55:02.047546+0000","last_fullsized":"2024-04-26T07:55:02.047546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:06.684753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.351988+0000","last_change":"2024-04-26T07:54:21.023071+0000","last_active":"2024-04-26T07:56:22.351988+0000","last_peered":"2024-04-26T07:56:22.351988+0000","last_clean":"2024-04-26T07:56:22.351988+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:56:22.351988+0000","last_undegraded":"2024-04-26T07:56:22.351988+0000","last_fullsized":"2024-04-26T07:56:22.351988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:31.663330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054306+0000","last_change":"2024-04-26T07:54:23.030948+0000","last_active":"2024-04-26T07:55:02.054306+0000","last_peered":"2024-04-26T07:55:02.054306+0000","last_clean":"2024-04-26T07:55:02.054306+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:55:02.054306+0000","last_undegraded":"2024-04-26T07:55:02.054306+0000","last_fullsized":"2024-04-26T07:55:02.054306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:09.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.570875+0000","last_change":"2024-04-26T07:54:25.029434+0000","last_active":"2024-04-26T07:57:24.570875+0000","last_peered":"2024-04-26T07:57:24.570875+0000","last_clean":"2024-04-26T07:57:24.570875+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:24.570875+0000","last_undegraded":"2024-04-26T07:57:24.570875+0000","last_fullsized":"2024-04-26T07:57:24.570875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:48.982630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.301766+0000","last_change":"2024-04-26T07:54:17.010194+0000","last_active":"2024-04-26T07:57:24.301766+0000","last_peered":"2024-04-26T07:57:24.301766+0000","last_clean":"2024-04-26T07:57:24.301766+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:57:24.301766+0000","last_undegraded":"2024-04-26T07:57:24.301766+0000","last_fullsized":"2024-04-26T07:57:24.301766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.230278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053713+0000","last_change":"2024-04-26T07:54:15.018699+0000","last_active":"2024-04-26T07:55:02.053713+0000","last_peered":"2024-04-26T07:55:02.053713+0000","last_clean":"2024-04-26T07:55:02.053713+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:55:02.053713+0000","last_undegraded":"2024-04-26T07:55:02.053713+0000","last_fullsized":"2024-04-26T07:55:02.053713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:44.643100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'4","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.408334+0000","last_change":"2024-04-26T07:55:02.067003+0000","last_active":"2024-04-26T07:56:23.408334+0000","last_peered":"2024-04-26T07:56:23.408334+0000","last_clean":"2024-04-26T07:56:23.408334+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:56:23.408334+0000","last_undegraded":"2024-04-26T07:56:23.408334+0000","last_fullsized":"2024-04-26T07:56:23.408334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:29.656543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"27'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053400+0000","last_change":"2024-04-26T07:54:21.015968+0000","last_active":"2024-04-26T07:55:02.053400+0000","last_peered":"2024-04-26T07:55:02.053400+0000","last_clean":"2024-04-26T07:55:02.053400+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:55:02.053400+0000","last_undegraded":"2024-04-26T07:55:02.053400+0000","last_fullsized":"2024-04-26T07:55:02.053400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:13.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050187+0000","last_change":"2024-04-26T07:54:23.035869+0000","last_active":"2024-04-26T07:55:02.050187+0000","last_peered":"2024-04-26T07:55:02.050187+0000","last_clean":"2024-04-26T07:55:02.050187+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:55:02.050187+0000","last_undegraded":"2024-04-26T07:55:02.050187+0000","last_fullsized":"2024-04-26T07:55:02.050187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:57.195185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047465+0000","last_change":"2024-04-26T07:54:25.027104+0000","last_active":"2024-04-26T07:55:02.047465+0000","last_peered":"2024-04-26T07:55:02.047465+0000","last_clean":"2024-04-26T07:55:02.047465+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:55:02.047465+0000","last_undegraded":"2024-04-26T07:55:02.047465+0000","last_fullsized":"2024-04-26T07:55:02.047465+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:04.495335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:04.879358+0000","last_change":"2024-04-26T07:55:02.065992+0000","last_active":"2024-04-26T07:55:04.879358+0000","last_peered":"2024-04-26T07:55:04.879358+0000","last_clean":"2024-04-26T07:55:04.879358+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:55:04.879358+0000","last_undegraded":"2024-04-26T07:55:04.879358+0000","last_fullsized":"2024-04-26T07:55:04.879358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:09.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045977+0000","last_change":"2024-04-26T07:54:15.028375+0000","last_active":"2024-04-26T07:55:02.045977+0000","last_peered":"2024-04-26T07:55:02.045977+0000","last_clean":"2024-04-26T07:55:02.045977+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:55:02.045977+0000","last_undegraded":"2024-04-26T07:55:02.045977+0000","last_fullsized":"2024-04-26T07:55:02.045977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:32.915801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050812+0000","last_change":"2024-04-26T07:54:19.014182+0000","last_active":"2024-04-26T07:55:02.050812+0000","last_peered":"2024-04-26T07:55:02.050812+0000","last_clean":"2024-04-26T07:55:02.050812+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:55:02.050812+0000","last_undegraded":"2024-04-26T07:55:02.050812+0000","last_fullsized":"2024-04-26T07:55:02.050812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:14.365835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.145043+0000","last_change":"2024-04-26T07:54:21.024658+0000","last_active":"2024-04-26T07:55:40.145043+0000","last_peered":"2024-04-26T07:55:40.145043+0000","last_clean":"2024-04-26T07:55:40.145043+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:55:40.145043+0000","last_undegraded":"2024-04-26T07:55:40.145043+0000","last_fullsized":"2024-04-26T07:55:40.145043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:25.233916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":385,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.630004+0000","last_change":"2024-04-26T07:54:23.036180+0000","last_active":"2024-04-26T07:57:24.630004+0000","last_peered":"2024-04-26T07:57:24.630004+0000","last_clean":"2024-04-26T07:57:24.630004+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:57:24.630004+0000","last_undegraded":"2024-04-26T07:57:24.630004+0000","last_fullsized":"2024-04-26T07:57:24.630004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:08.558861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053408+0000","last_change":"2024-04-26T07:54:25.027799+0000","last_active":"2024-04-26T07:55:02.053408+0000","last_peered":"2024-04-26T07:55:02.053408+0000","last_clean":"2024-04-26T07:55:02.053408+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:55:02.053408+0000","last_undegraded":"2024-04-26T07:55:02.053408+0000","last_fullsized":"2024-04-26T07:55:02.053408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:35.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438362+0000","last_change":"2024-04-26T07:54:17.006664+0000","last_active":"2024-04-26T07:57:24.438362+0000","last_peered":"2024-04-26T07:57:24.438362+0000","last_clean":"2024-04-26T07:57:24.438362+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:57:24.438362+0000","last_undegraded":"2024-04-26T07:57:24.438362+0000","last_fullsized":"2024-04-26T07:57:24.438362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049744+0000","last_change":"2024-04-26T07:54:15.020158+0000","last_active":"2024-04-26T07:55:02.049744+0000","last_peered":"2024-04-26T07:55:02.049744+0000","last_clean":"2024-04-26T07:55:02.049744+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:55:02.049744+0000","last_undegraded":"2024-04-26T07:55:02.049744+0000","last_fullsized":"2024-04-26T07:55:02.049744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:33.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.060242+0000","last_change":"2024-04-26T07:55:02.059077+0000","last_active":"2024-04-26T07:55:02.060242+0000","last_peered":"2024-04-26T07:55:02.060242+0000","last_clean":"2024-04-26T07:55:02.060242+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:55:02.060242+0000","last_undegraded":"2024-04-26T07:55:02.060242+0000","last_fullsized":"2024-04-26T07:55:02.060242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:20.105862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.346496+0000","last_change":"2024-04-26T07:54:21.022437+0000","last_active":"2024-04-26T07:56:22.346496+0000","last_peered":"2024-04-26T07:56:22.346496+0000","last_clean":"2024-04-26T07:56:22.346496+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:56:22.346496+0000","last_undegraded":"2024-04-26T07:56:22.346496+0000","last_fullsized":"2024-04-26T07:56:22.346496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:43.415554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.514862+0000","last_change":"2024-04-26T07:54:23.029180+0000","last_active":"2024-04-26T07:57:24.514862+0000","last_peered":"2024-04-26T07:57:24.514862+0000","last_clean":"2024-04-26T07:57:24.514862+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:24.514862+0000","last_undegraded":"2024-04-26T07:57:24.514862+0000","last_fullsized":"2024-04-26T07:57:24.514862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:27.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892086+0000","last_change":"2024-04-26T07:54:17.018068+0000","last_active":"2024-04-26T07:56:29.892086+0000","last_peered":"2024-04-26T07:56:29.892086+0000","last_clean":"2024-04-26T07:56:29.892086+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:56:29.892086+0000","last_undegraded":"2024-04-26T07:56:29.892086+0000","last_fullsized":"2024-04-26T07:56:29.892086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:46.004871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.058116+0000","last_change":"2024-04-26T07:54:15.021552+0000","last_active":"2024-04-26T07:55:02.058116+0000","last_peered":"2024-04-26T07:55:02.058116+0000","last_clean":"2024-04-26T07:55:02.058116+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:55:02.058116+0000","last_undegraded":"2024-04-26T07:55:02.058116+0000","last_fullsized":"2024-04-26T07:55:02.058116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048189+0000","last_change":"2024-04-26T07:54:19.017311+0000","last_active":"2024-04-26T07:55:02.048189+0000","last_peered":"2024-04-26T07:55:02.048189+0000","last_clean":"2024-04-26T07:55:02.048189+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:55:02.048189+0000","last_undegraded":"2024-04-26T07:55:02.048189+0000","last_fullsized":"2024-04-26T07:55:02.048189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:28.216267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.356414+0000","last_change":"2024-04-26T07:54:21.017174+0000","last_active":"2024-04-26T07:56:22.356414+0000","last_peered":"2024-04-26T07:56:22.356414+0000","last_clean":"2024-04-26T07:56:22.356414+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:56:22.356414+0000","last_undegraded":"2024-04-26T07:56:22.356414+0000","last_fullsized":"2024-04-26T07:56:22.356414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:32.852893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048871+0000","last_change":"2024-04-26T07:54:23.028206+0000","last_active":"2024-04-26T07:55:02.048871+0000","last_peered":"2024-04-26T07:55:02.048871+0000","last_clean":"2024-04-26T07:55:02.048871+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:55:02.048871+0000","last_undegraded":"2024-04-26T07:55:02.048871+0000","last_fullsized":"2024-04-26T07:55:02.048871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:39.298078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.965189+0000","last_change":"2024-04-26T07:54:25.038132+0000","last_active":"2024-04-26T07:55:39.965189+0000","last_peered":"2024-04-26T07:55:39.965189+0000","last_clean":"2024-04-26T07:55:39.965189+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:55:39.965189+0000","last_undegraded":"2024-04-26T07:55:39.965189+0000","last_fullsized":"2024-04-26T07:55:39.965189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:39.692413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511248+0000","last_change":"2024-04-26T07:54:16.999342+0000","last_active":"2024-04-26T07:57:24.511248+0000","last_peered":"2024-04-26T07:57:24.511248+0000","last_clean":"2024-04-26T07:57:24.511248+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:57:24.511248+0000","last_undegraded":"2024-04-26T07:57:24.511248+0000","last_fullsized":"2024-04-26T07:57:24.511248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:50.720873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055973+0000","last_change":"2024-04-26T07:54:15.021572+0000","last_active":"2024-04-26T07:55:02.055973+0000","last_peered":"2024-04-26T07:55:02.055973+0000","last_clean":"2024-04-26T07:55:02.055973+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:55:02.055973+0000","last_undegraded":"2024-04-26T07:55:02.055973+0000","last_fullsized":"2024-04-26T07:55:02.055973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047802+0000","last_change":"2024-04-26T07:54:19.014010+0000","last_active":"2024-04-26T07:55:02.047802+0000","last_peered":"2024-04-26T07:55:02.047802+0000","last_clean":"2024-04-26T07:55:02.047802+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:55:02.047802+0000","last_undegraded":"2024-04-26T07:55:02.047802+0000","last_fullsized":"2024-04-26T07:55:02.047802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:51.749121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893869+0000","last_change":"2024-04-26T07:54:21.021470+0000","last_active":"2024-04-26T07:56:39.893869+0000","last_peered":"2024-04-26T07:56:39.893869+0000","last_clean":"2024-04-26T07:56:39.893869+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:56:39.893869+0000","last_undegraded":"2024-04-26T07:56:39.893869+0000","last_fullsized":"2024-04-26T07:56:39.893869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.505241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047573+0000","last_change":"2024-04-26T07:54:23.028229+0000","last_active":"2024-04-26T07:55:02.047573+0000","last_peered":"2024-04-26T07:55:02.047573+0000","last_clean":"2024-04-26T07:55:02.047573+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:55:02.047573+0000","last_undegraded":"2024-04-26T07:55:02.047573+0000","last_fullsized":"2024-04-26T07:55:02.047573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:37.685058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:34.432492+0000","last_change":"2024-04-26T07:54:25.031077+0000","last_active":"2024-04-26T07:55:34.432492+0000","last_peered":"2024-04-26T07:55:34.432492+0000","last_clean":"2024-04-26T07:55:34.432492+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:55:34.432492+0000","last_undegraded":"2024-04-26T07:55:34.432492+0000","last_fullsized":"2024-04-26T07:55:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:53.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891503+0000","last_change":"2024-04-26T07:54:17.015501+0000","last_active":"2024-04-26T07:56:29.891503+0000","last_peered":"2024-04-26T07:56:29.891503+0000","last_clean":"2024-04-26T07:56:29.891503+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:56:29.891503+0000","last_undegraded":"2024-04-26T07:56:29.891503+0000","last_fullsized":"2024-04-26T07:56:29.891503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:45.257757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048885+0000","last_change":"2024-04-26T07:54:15.026188+0000","last_active":"2024-04-26T07:55:02.048885+0000","last_peered":"2024-04-26T07:55:02.048885+0000","last_clean":"2024-04-26T07:55:02.048885+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:55:02.048885+0000","last_undegraded":"2024-04-26T07:55:02.048885+0000","last_fullsized":"2024-04-26T07:55:02.048885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:34.359927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049912+0000","last_change":"2024-04-26T07:54:19.014021+0000","last_active":"2024-04-26T07:55:02.049912+0000","last_peered":"2024-04-26T07:55:02.049912+0000","last_clean":"2024-04-26T07:55:02.049912+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:55:02.049912+0000","last_undegraded":"2024-04-26T07:55:02.049912+0000","last_fullsized":"2024-04-26T07:55:02.049912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:28.216267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.358572+0000","last_change":"2024-04-26T07:54:21.021799+0000","last_active":"2024-04-26T07:56:22.358572+0000","last_peered":"2024-04-26T07:56:22.358572+0000","last_clean":"2024-04-26T07:56:22.358572+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:56:22.358572+0000","last_undegraded":"2024-04-26T07:56:22.358572+0000","last_fullsized":"2024-04-26T07:56:22.358572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:22.358993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":348,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.641002+0000","last_change":"2024-04-26T07:54:23.023487+0000","last_active":"2024-04-26T07:57:24.641002+0000","last_peered":"2024-04-26T07:57:24.641002+0000","last_clean":"2024-04-26T07:57:24.641002+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:24.641002+0000","last_undegraded":"2024-04-26T07:57:24.641002+0000","last_fullsized":"2024-04-26T07:57:24.641002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.968900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049165+0000","last_change":"2024-04-26T07:54:25.030802+0000","last_active":"2024-04-26T07:55:02.049165+0000","last_peered":"2024-04-26T07:55:02.049165+0000","last_clean":"2024-04-26T07:55:02.049165+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:55:02.049165+0000","last_undegraded":"2024-04-26T07:55:02.049165+0000","last_fullsized":"2024-04-26T07:55:02.049165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:55.721790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'7","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.488370+0000","last_change":"2024-04-26T07:54:17.003162+0000","last_active":"2024-04-26T07:57:24.488370+0000","last_peered":"2024-04-26T07:57:24.488370+0000","last_clean":"2024-04-26T07:57:24.488370+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:24.488370+0000","last_undegraded":"2024-04-26T07:57:24.488370+0000","last_fullsized":"2024-04-26T07:57:24.488370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:24.843992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047648+0000","last_change":"2024-04-26T07:54:15.029358+0000","last_active":"2024-04-26T07:55:02.047648+0000","last_peered":"2024-04-26T07:55:02.047648+0000","last_clean":"2024-04-26T07:55:02.047648+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:55:02.047648+0000","last_undegraded":"2024-04-26T07:55:02.047648+0000","last_fullsized":"2024-04-26T07:55:02.047648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.653945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048162+0000","last_change":"2024-04-26T07:54:19.011909+0000","last_active":"2024-04-26T07:55:02.048162+0000","last_peered":"2024-04-26T07:55:02.048162+0000","last_clean":"2024-04-26T07:55:02.048162+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:55:02.048162+0000","last_undegraded":"2024-04-26T07:55:02.048162+0000","last_fullsized":"2024-04-26T07:55:02.048162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:27.746901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'55","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.806242+0000","last_change":"2024-04-26T07:54:21.021179+0000","last_active":"2024-04-26T07:56:23.806242+0000","last_peered":"2024-04-26T07:56:23.806242+0000","last_clean":"2024-04-26T07:56:23.806242+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:56:23.806242+0000","last_undegraded":"2024-04-26T07:56:23.806242+0000","last_fullsized":"2024-04-26T07:56:23.806242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:42.295311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047462+0000","last_change":"2024-04-26T07:54:23.025278+0000","last_active":"2024-04-26T07:55:02.047462+0000","last_peered":"2024-04-26T07:55:02.047462+0000","last_clean":"2024-04-26T07:55:02.047462+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:55:02.047462+0000","last_undegraded":"2024-04-26T07:55:02.047462+0000","last_fullsized":"2024-04-26T07:55:02.047462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:56.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.615064+0000","last_change":"2024-04-26T07:54:25.034316+0000","last_active":"2024-04-26T07:57:24.615064+0000","last_peered":"2024-04-26T07:57:24.615064+0000","last_clean":"2024-04-26T07:57:24.615064+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:57:24.615064+0000","last_undegraded":"2024-04-26T07:57:24.615064+0000","last_fullsized":"2024-04-26T07:57:24.615064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:26.372578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053141+0000","last_change":"2024-04-26T07:54:17.013013+0000","last_active":"2024-04-26T07:55:02.053141+0000","last_peered":"2024-04-26T07:55:02.053141+0000","last_clean":"2024-04-26T07:55:02.053141+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:55:02.053141+0000","last_undegraded":"2024-04-26T07:55:02.053141+0000","last_fullsized":"2024-04-26T07:55:02.053141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:20.449523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048743+0000","last_change":"2024-04-26T07:54:15.001977+0000","last_active":"2024-04-26T07:55:02.048743+0000","last_peered":"2024-04-26T07:55:02.048743+0000","last_clean":"2024-04-26T07:55:02.048743+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:55:02.048743+0000","last_undegraded":"2024-04-26T07:55:02.048743+0000","last_fullsized":"2024-04-26T07:55:02.048743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055480+0000","last_change":"2024-04-26T07:54:19.016120+0000","last_active":"2024-04-26T07:55:02.055480+0000","last_peered":"2024-04-26T07:55:02.055480+0000","last_clean":"2024-04-26T07:55:02.055480+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:55:02.055480+0000","last_undegraded":"2024-04-26T07:55:02.055480+0000","last_fullsized":"2024-04-26T07:55:02.055480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:50.686377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.340595+0000","last_change":"2024-04-26T07:54:21.015734+0000","last_active":"2024-04-26T07:56:22.340595+0000","last_peered":"2024-04-26T07:56:22.340595+0000","last_clean":"2024-04-26T07:56:22.340595+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:56:22.340595+0000","last_undegraded":"2024-04-26T07:56:22.340595+0000","last_fullsized":"2024-04-26T07:56:22.340595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:01.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051951+0000","last_change":"2024-04-26T07:54:23.029968+0000","last_active":"2024-04-26T07:55:02.051951+0000","last_peered":"2024-04-26T07:55:02.051951+0000","last_clean":"2024-04-26T07:55:02.051951+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:55:02.051951+0000","last_undegraded":"2024-04-26T07:55:02.051951+0000","last_fullsized":"2024-04-26T07:55:02.051951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:29:48.620441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891158+0000","last_change":"2024-04-26T07:54:25.037903+0000","last_active":"2024-04-26T07:56:24.891158+0000","last_peered":"2024-04-26T07:56:24.891158+0000","last_clean":"2024-04-26T07:56:24.891158+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:56:24.891158+0000","last_undegraded":"2024-04-26T07:56:24.891158+0000","last_fullsized":"2024-04-26T07:56:24.891158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:45.549253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489138+0000","last_change":"2024-04-26T07:54:17.018272+0000","last_active":"2024-04-26T07:57:24.489138+0000","last_peered":"2024-04-26T07:57:24.489138+0000","last_clean":"2024-04-26T07:57:24.489138+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:24.489138+0000","last_undegraded":"2024-04-26T07:57:24.489138+0000","last_fullsized":"2024-04-26T07:57:24.489138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.173859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047922+0000","last_change":"2024-04-26T07:54:15.023312+0000","last_active":"2024-04-26T07:55:02.047922+0000","last_peered":"2024-04-26T07:55:02.047922+0000","last_clean":"2024-04-26T07:55:02.047922+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:55:02.047922+0000","last_undegraded":"2024-04-26T07:55:02.047922+0000","last_fullsized":"2024-04-26T07:55:02.047922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:10.760572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048541+0000","last_change":"2024-04-26T07:54:19.013889+0000","last_active":"2024-04-26T07:55:02.048541+0000","last_peered":"2024-04-26T07:55:02.048541+0000","last_clean":"2024-04-26T07:55:02.048541+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:55:02.048541+0000","last_undegraded":"2024-04-26T07:55:02.048541+0000","last_fullsized":"2024-04-26T07:55:02.048541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:58.450108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.366970+0000","last_change":"2024-04-26T07:54:21.019300+0000","last_active":"2024-04-26T07:56:22.366970+0000","last_peered":"2024-04-26T07:56:22.366970+0000","last_clean":"2024-04-26T07:56:22.366970+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:56:22.366970+0000","last_undegraded":"2024-04-26T07:56:22.366970+0000","last_fullsized":"2024-04-26T07:56:22.366970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:16.372622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.619110+0000","last_change":"2024-04-26T07:54:23.029786+0000","last_active":"2024-04-26T07:57:24.619110+0000","last_peered":"2024-04-26T07:57:24.619110+0000","last_clean":"2024-04-26T07:57:24.619110+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:24.619110+0000","last_undegraded":"2024-04-26T07:57:24.619110+0000","last_fullsized":"2024-04-26T07:57:24.619110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:18.250538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'12","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885862+0000","last_change":"2024-04-26T07:54:25.029180+0000","last_active":"2024-04-26T07:56:29.885862+0000","last_peered":"2024-04-26T07:56:29.885862+0000","last_clean":"2024-04-26T07:56:29.885862+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:56:29.885862+0000","last_undegraded":"2024-04-26T07:56:29.885862+0000","last_fullsized":"2024-04-26T07:56:29.885862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:48.649422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057608+0000","last_change":"2024-04-26T07:54:17.015565+0000","last_active":"2024-04-26T07:55:02.057608+0000","last_peered":"2024-04-26T07:55:02.057608+0000","last_clean":"2024-04-26T07:55:02.057608+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:55:02.057608+0000","last_undegraded":"2024-04-26T07:55:02.057608+0000","last_fullsized":"2024-04-26T07:55:02.057608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048756+0000","last_change":"2024-04-26T07:54:15.028460+0000","last_active":"2024-04-26T07:55:02.048756+0000","last_peered":"2024-04-26T07:55:02.048756+0000","last_clean":"2024-04-26T07:55:02.048756+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:55:02.048756+0000","last_undegraded":"2024-04-26T07:55:02.048756+0000","last_fullsized":"2024-04-26T07:55:02.048756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:52.128712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.419198+0000","last_change":"2024-04-26T07:55:02.064457+0000","last_active":"2024-04-26T07:56:23.419198+0000","last_peered":"2024-04-26T07:56:23.419198+0000","last_clean":"2024-04-26T07:56:23.419198+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:56:23.419198+0000","last_undegraded":"2024-04-26T07:56:23.419198+0000","last_fullsized":"2024-04-26T07:56:23.419198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:52.346497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048343+0000","last_change":"2024-04-26T07:54:21.021896+0000","last_active":"2024-04-26T07:55:02.048343+0000","last_peered":"2024-04-26T07:55:02.048343+0000","last_clean":"2024-04-26T07:55:02.048343+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:55:02.048343+0000","last_undegraded":"2024-04-26T07:55:02.048343+0000","last_fullsized":"2024-04-26T07:55:02.048343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:54.353284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":465,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.573063+0000","last_change":"2024-04-26T07:54:23.024560+0000","last_active":"2024-04-26T07:57:24.573063+0000","last_peered":"2024-04-26T07:57:24.573063+0000","last_clean":"2024-04-26T07:57:24.573063+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:24.573063+0000","last_undegraded":"2024-04-26T07:57:24.573063+0000","last_fullsized":"2024-04-26T07:57:24.573063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:34.060931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.569763+0000","last_change":"2024-04-26T07:54:25.024615+0000","last_active":"2024-04-26T07:56:23.569763+0000","last_peered":"2024-04-26T07:56:23.569763+0000","last_clean":"2024-04-26T07:56:23.569763+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:56:23.569763+0000","last_undegraded":"2024-04-26T07:56:23.569763+0000","last_fullsized":"2024-04-26T07:56:23.569763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:33.156602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054935+0000","last_change":"2024-04-26T07:54:17.004296+0000","last_active":"2024-04-26T07:55:02.054935+0000","last_peered":"2024-04-26T07:55:02.054935+0000","last_clean":"2024-04-26T07:55:02.054935+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:55:02.054935+0000","last_undegraded":"2024-04-26T07:55:02.054935+0000","last_fullsized":"2024-04-26T07:55:02.054935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:58.770481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891219+0000","last_change":"2024-04-26T07:54:15.030153+0000","last_active":"2024-04-26T07:56:24.891219+0000","last_peered":"2024-04-26T07:56:24.891219+0000","last_clean":"2024-04-26T07:56:24.891219+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:56:24.891219+0000","last_undegraded":"2024-04-26T07:56:24.891219+0000","last_fullsized":"2024-04-26T07:56:24.891219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:22.836554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050562+0000","last_change":"2024-04-26T07:54:19.013153+0000","last_active":"2024-04-26T07:55:02.050562+0000","last_peered":"2024-04-26T07:55:02.050562+0000","last_clean":"2024-04-26T07:55:02.050562+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:55:02.050562+0000","last_undegraded":"2024-04-26T07:55:02.050562+0000","last_fullsized":"2024-04-26T07:55:02.050562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:53.488291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'40","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.353272+0000","last_change":"2024-04-26T07:54:21.017142+0000","last_active":"2024-04-26T07:56:22.353272+0000","last_peered":"2024-04-26T07:56:22.353272+0000","last_clean":"2024-04-26T07:56:22.353272+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:56:22.353272+0000","last_undegraded":"2024-04-26T07:56:22.353272+0000","last_fullsized":"2024-04-26T07:56:22.353272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:59.032052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":52,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055503+0000","last_change":"2024-04-26T07:54:23.031702+0000","last_active":"2024-04-26T07:55:02.055503+0000","last_peered":"2024-04-26T07:55:02.055503+0000","last_clean":"2024-04-26T07:55:02.055503+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:55:02.055503+0000","last_undegraded":"2024-04-26T07:55:02.055503+0000","last_fullsized":"2024-04-26T07:55:02.055503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:01.038281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.546403+0000","last_change":"2024-04-26T07:54:25.025544+0000","last_active":"2024-04-26T07:57:24.546403+0000","last_peered":"2024-04-26T07:57:24.546403+0000","last_clean":"2024-04-26T07:57:24.546403+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:24.546403+0000","last_undegraded":"2024-04-26T07:57:24.546403+0000","last_fullsized":"2024-04-26T07:57:24.546403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:27.858716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438506+0000","last_change":"2024-04-26T07:54:17.016804+0000","last_active":"2024-04-26T07:57:24.438506+0000","last_peered":"2024-04-26T07:57:24.438506+0000","last_clean":"2024-04-26T07:57:24.438506+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:57:24.438506+0000","last_undegraded":"2024-04-26T07:57:24.438506+0000","last_fullsized":"2024-04-26T07:57:24.438506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:57.906958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047957+0000","last_change":"2024-04-26T07:54:06.676207+0000","last_active":"2024-04-26T07:55:02.047957+0000","last_peered":"2024-04-26T07:55:02.047957+0000","last_clean":"2024-04-26T07:55:02.047957+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:55:02.047957+0000","last_undegraded":"2024-04-26T07:55:02.047957+0000","last_fullsized":"2024-04-26T07:55:02.047957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047634+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:55:02.047634+0000","last_peered":"2024-04-26T07:55:02.047634+0000","last_clean":"2024-04-26T07:55:02.047634+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:55:02.047634+0000","last_undegraded":"2024-04-26T07:55:02.047634+0000","last_fullsized":"2024-04-26T07:55:02.047634+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:36.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046885+0000","last_change":"2024-04-26T07:54:15.028934+0000","last_active":"2024-04-26T07:55:02.046885+0000","last_peered":"2024-04-26T07:55:02.046885+0000","last_clean":"2024-04-26T07:55:02.046885+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:55:02.046885+0000","last_undegraded":"2024-04-26T07:55:02.046885+0000","last_fullsized":"2024-04-26T07:55:02.046885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:08.381931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.419477+0000","last_change":"2024-04-26T07:54:19.011625+0000","last_active":"2024-04-26T07:56:23.419477+0000","last_peered":"2024-04-26T07:56:23.419477+0000","last_clean":"2024-04-26T07:56:23.419477+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:56:23.419477+0000","last_undegraded":"2024-04-26T07:56:23.419477+0000","last_fullsized":"2024-04-26T07:56:23.419477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:48.012115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'77","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893142+0000","last_change":"2024-04-26T07:54:21.020941+0000","last_active":"2024-04-26T07:56:34.893142+0000","last_peered":"2024-04-26T07:56:34.893142+0000","last_clean":"2024-04-26T07:56:34.893142+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:56:34.893142+0000","last_undegraded":"2024-04-26T07:56:34.893142+0000","last_fullsized":"2024-04-26T07:56:34.893142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:36.877690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049318+0000","last_change":"2024-04-26T07:54:23.021938+0000","last_active":"2024-04-26T07:55:02.049318+0000","last_peered":"2024-04-26T07:55:02.049318+0000","last_clean":"2024-04-26T07:55:02.049318+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:55:02.049318+0000","last_undegraded":"2024-04-26T07:55:02.049318+0000","last_fullsized":"2024-04-26T07:55:02.049318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:19.361863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.522146+0000","last_change":"2024-04-26T07:54:25.027148+0000","last_active":"2024-04-26T07:57:24.522146+0000","last_peered":"2024-04-26T07:57:24.522146+0000","last_clean":"2024-04-26T07:57:24.522146+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:57:24.522146+0000","last_undegraded":"2024-04-26T07:57:24.522146+0000","last_fullsized":"2024-04-26T07:57:24.522146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.915380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.208184+0000","last_change":"2024-04-26T07:54:17.013632+0000","last_active":"2024-04-26T07:57:24.208184+0000","last_peered":"2024-04-26T07:57:24.208184+0000","last_clean":"2024-04-26T07:57:24.208184+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:57:24.208184+0000","last_undegraded":"2024-04-26T07:57:24.208184+0000","last_fullsized":"2024-04-26T07:57:24.208184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:52.619357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046001+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:55:02.046001+0000","last_peered":"2024-04-26T07:55:02.046001+0000","last_clean":"2024-04-26T07:55:02.046001+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:55:02.046001+0000","last_undegraded":"2024-04-26T07:55:02.046001+0000","last_fullsized":"2024-04-26T07:55:02.046001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:57.072237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884280+0000","last_change":"2024-04-26T07:54:15.007057+0000","last_active":"2024-04-26T07:56:19.884280+0000","last_peered":"2024-04-26T07:56:19.884280+0000","last_clean":"2024-04-26T07:56:19.884280+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:56:19.884280+0000","last_undegraded":"2024-04-26T07:56:19.884280+0000","last_fullsized":"2024-04-26T07:56:19.884280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052936+0000","last_change":"2024-04-26T07:54:19.013958+0000","last_active":"2024-04-26T07:55:02.052936+0000","last_peered":"2024-04-26T07:55:02.052936+0000","last_clean":"2024-04-26T07:55:02.052936+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:55:02.052936+0000","last_undegraded":"2024-04-26T07:55:02.052936+0000","last_fullsized":"2024-04-26T07:55:02.052936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:39:03.143675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094742+0000","last_change":"2024-04-26T07:54:21.024668+0000","last_active":"2024-04-26T07:57:24.094742+0000","last_peered":"2024-04-26T07:57:24.094742+0000","last_clean":"2024-04-26T07:57:24.094742+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:24.094742+0000","last_undegraded":"2024-04-26T07:57:24.094742+0000","last_fullsized":"2024-04-26T07:57:24.094742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:16.244309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047364+0000","last_change":"2024-04-26T07:54:23.030052+0000","last_active":"2024-04-26T07:55:02.047364+0000","last_peered":"2024-04-26T07:55:02.047364+0000","last_clean":"2024-04-26T07:55:02.047364+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:55:02.047364+0000","last_undegraded":"2024-04-26T07:55:02.047364+0000","last_fullsized":"2024-04-26T07:55:02.047364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:01.995533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.470476+0000","last_change":"2024-04-26T07:54:25.030964+0000","last_active":"2024-04-26T07:57:24.470476+0000","last_peered":"2024-04-26T07:57:24.470476+0000","last_clean":"2024-04-26T07:57:24.470476+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:57:24.470476+0000","last_undegraded":"2024-04-26T07:57:24.470476+0000","last_fullsized":"2024-04-26T07:57:24.470476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:48.649422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.614234+0000","last_change":"2024-04-26T07:54:17.006840+0000","last_active":"2024-04-26T07:56:20.614234+0000","last_peered":"2024-04-26T07:56:20.614234+0000","last_clean":"2024-04-26T07:56:20.614234+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:56:20.614234+0000","last_undegraded":"2024-04-26T07:56:20.614234+0000","last_fullsized":"2024-04-26T07:56:20.614234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:09.013983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051901+0000","last_change":"2024-04-26T07:54:06.674967+0000","last_active":"2024-04-26T07:55:02.051901+0000","last_peered":"2024-04-26T07:55:02.051901+0000","last_clean":"2024-04-26T07:55:02.051901+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:55:02.051901+0000","last_undegraded":"2024-04-26T07:55:02.051901+0000","last_fullsized":"2024-04-26T07:55:02.051901+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883517+0000","last_change":"2024-04-26T07:54:15.008990+0000","last_active":"2024-04-26T07:56:14.883517+0000","last_peered":"2024-04-26T07:56:14.883517+0000","last_clean":"2024-04-26T07:56:14.883517+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:56:14.883517+0000","last_undegraded":"2024-04-26T07:56:14.883517+0000","last_fullsized":"2024-04-26T07:56:14.883517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056195+0000","last_change":"2024-04-26T07:54:19.010006+0000","last_active":"2024-04-26T07:55:02.056195+0000","last_peered":"2024-04-26T07:55:02.056195+0000","last_clean":"2024-04-26T07:55:02.056195+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:55:02.056195+0000","last_undegraded":"2024-04-26T07:55:02.056195+0000","last_fullsized":"2024-04-26T07:55:02.056195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:34.544464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094944+0000","last_change":"2024-04-26T07:54:21.019871+0000","last_active":"2024-04-26T07:57:24.094944+0000","last_peered":"2024-04-26T07:57:24.094944+0000","last_clean":"2024-04-26T07:57:24.094944+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:24.094944+0000","last_undegraded":"2024-04-26T07:57:24.094944+0000","last_fullsized":"2024-04-26T07:57:24.094944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:35.816402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049650+0000","last_change":"2024-04-26T07:54:23.023485+0000","last_active":"2024-04-26T07:55:02.049650+0000","last_peered":"2024-04-26T07:55:02.049650+0000","last_clean":"2024-04-26T07:55:02.049650+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:55:02.049650+0000","last_undegraded":"2024-04-26T07:55:02.049650+0000","last_fullsized":"2024-04-26T07:55:02.049650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:57.501307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.611531+0000","last_change":"2024-04-26T07:54:25.038740+0000","last_active":"2024-04-26T07:56:20.611531+0000","last_peered":"2024-04-26T07:56:20.611531+0000","last_clean":"2024-04-26T07:56:20.611531+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:56:20.611531+0000","last_undegraded":"2024-04-26T07:56:20.611531+0000","last_fullsized":"2024-04-26T07:56:20.611531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:57.808739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804102+0000","last_change":"2024-04-26T07:54:17.009576+0000","last_active":"2024-04-26T07:56:23.804102+0000","last_peered":"2024-04-26T07:56:23.804102+0000","last_clean":"2024-04-26T07:56:23.804102+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:56:23.804102+0000","last_undegraded":"2024-04-26T07:56:23.804102+0000","last_fullsized":"2024-04-26T07:56:23.804102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:20.449523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046393+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:55:02.046393+0000","last_peered":"2024-04-26T07:55:02.046393+0000","last_clean":"2024-04-26T07:55:02.046393+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:55:02.046393+0000","last_undegraded":"2024-04-26T07:55:02.046393+0000","last_fullsized":"2024-04-26T07:55:02.046393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:23.138091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054115+0000","last_change":"2024-04-26T07:54:15.006773+0000","last_active":"2024-04-26T07:55:02.054115+0000","last_peered":"2024-04-26T07:55:02.054115+0000","last_clean":"2024-04-26T07:55:02.054115+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:55:02.054115+0000","last_undegraded":"2024-04-26T07:55:02.054115+0000","last_fullsized":"2024-04-26T07:55:02.054115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049086+0000","last_change":"2024-04-26T07:54:19.014648+0000","last_active":"2024-04-26T07:55:02.049086+0000","last_peered":"2024-04-26T07:55:02.049086+0000","last_clean":"2024-04-26T07:55:02.049086+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:55:02.049086+0000","last_undegraded":"2024-04-26T07:55:02.049086+0000","last_fullsized":"2024-04-26T07:55:02.049086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:58.767016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.817648+0000","last_change":"2024-04-26T07:54:21.022796+0000","last_active":"2024-04-26T07:57:23.817648+0000","last_peered":"2024-04-26T07:57:23.817648+0000","last_clean":"2024-04-26T07:57:23.817648+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:57:23.817648+0000","last_undegraded":"2024-04-26T07:57:23.817648+0000","last_fullsized":"2024-04-26T07:57:23.817648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:24.141025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052195+0000","last_change":"2024-04-26T07:54:23.030753+0000","last_active":"2024-04-26T07:55:02.052195+0000","last_peered":"2024-04-26T07:55:02.052195+0000","last_clean":"2024-04-26T07:55:02.052195+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:55:02.052195+0000","last_undegraded":"2024-04-26T07:55:02.052195+0000","last_fullsized":"2024-04-26T07:55:02.052195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:10.717730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.546061+0000","last_change":"2024-04-26T07:54:25.038410+0000","last_active":"2024-04-26T07:56:23.546061+0000","last_peered":"2024-04-26T07:56:23.546061+0000","last_clean":"2024-04-26T07:56:23.546061+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:56:23.546061+0000","last_undegraded":"2024-04-26T07:56:23.546061+0000","last_fullsized":"2024-04-26T07:56:23.546061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:04.495335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804171+0000","last_change":"2024-04-26T07:54:17.011145+0000","last_active":"2024-04-26T07:56:23.804171+0000","last_peered":"2024-04-26T07:56:23.804171+0000","last_clean":"2024-04-26T07:56:23.804171+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:56:23.804171+0000","last_undegraded":"2024-04-26T07:56:23.804171+0000","last_fullsized":"2024-04-26T07:56:23.804171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:59.206585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054154+0000","last_change":"2024-04-26T07:54:15.004789+0000","last_active":"2024-04-26T07:55:02.054154+0000","last_peered":"2024-04-26T07:55:02.054154+0000","last_clean":"2024-04-26T07:55:02.054154+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:55:02.054154+0000","last_undegraded":"2024-04-26T07:55:02.054154+0000","last_fullsized":"2024-04-26T07:55:02.054154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049045+0000","last_change":"2024-04-26T07:54:06.676454+0000","last_active":"2024-04-26T07:55:02.049045+0000","last_peered":"2024-04-26T07:55:02.049045+0000","last_clean":"2024-04-26T07:55:02.049045+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:55:02.049045+0000","last_undegraded":"2024-04-26T07:55:02.049045+0000","last_fullsized":"2024-04-26T07:55:02.049045+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:01.265695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885217+0000","last_change":"2024-04-26T07:54:19.010150+0000","last_active":"2024-04-26T07:56:24.885217+0000","last_peered":"2024-04-26T07:56:24.885217+0000","last_clean":"2024-04-26T07:56:24.885217+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:56:24.885217+0000","last_undegraded":"2024-04-26T07:56:24.885217+0000","last_fullsized":"2024-04-26T07:56:24.885217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:41.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'64","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885138+0000","last_change":"2024-04-26T07:54:21.021222+0000","last_active":"2024-04-26T07:56:24.885138+0000","last_peered":"2024-04-26T07:56:24.885138+0000","last_clean":"2024-04-26T07:56:24.885138+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:56:24.885138+0000","last_undegraded":"2024-04-26T07:56:24.885138+0000","last_fullsized":"2024-04-26T07:56:24.885138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:30.470262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052555+0000","last_change":"2024-04-26T07:54:23.026937+0000","last_active":"2024-04-26T07:55:02.052555+0000","last_peered":"2024-04-26T07:55:02.052555+0000","last_clean":"2024-04-26T07:55:02.052555+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:55:02.052555+0000","last_undegraded":"2024-04-26T07:55:02.052555+0000","last_fullsized":"2024-04-26T07:55:02.052555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:48.973375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.735948+0000","last_change":"2024-04-26T07:54:25.024577+0000","last_active":"2024-04-26T07:56:23.735948+0000","last_peered":"2024-04-26T07:56:23.735948+0000","last_clean":"2024-04-26T07:56:23.735948+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:56:23.735948+0000","last_undegraded":"2024-04-26T07:56:23.735948+0000","last_fullsized":"2024-04-26T07:56:23.735948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:36.834541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294896+0000","last_change":"2024-04-26T07:55:02.058346+0000","last_active":"2024-04-26T07:57:24.294896+0000","last_peered":"2024-04-26T07:57:24.294896+0000","last_clean":"2024-04-26T07:57:24.294896+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:57:24.294896+0000","last_undegraded":"2024-04-26T07:57:24.294896+0000","last_fullsized":"2024-04-26T07:57:24.294896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:32.409505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049780+0000","last_change":"2024-04-26T07:54:15.005472+0000","last_active":"2024-04-26T07:55:02.049780+0000","last_peered":"2024-04-26T07:55:02.049780+0000","last_clean":"2024-04-26T07:55:02.049780+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:55:02.049780+0000","last_undegraded":"2024-04-26T07:55:02.049780+0000","last_fullsized":"2024-04-26T07:55:02.049780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:49.044298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048351+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:55:02.048351+0000","last_peered":"2024-04-26T07:55:02.048351+0000","last_clean":"2024-04-26T07:55:02.048351+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:55:02.048351+0000","last_undegraded":"2024-04-26T07:55:02.048351+0000","last_fullsized":"2024-04-26T07:55:02.048351+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:41.674149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046277+0000","last_change":"2024-04-26T07:54:19.009597+0000","last_active":"2024-04-26T07:55:02.046277+0000","last_peered":"2024-04-26T07:55:02.046277+0000","last_clean":"2024-04-26T07:55:02.046277+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:55:02.046277+0000","last_undegraded":"2024-04-26T07:55:02.046277+0000","last_fullsized":"2024-04-26T07:55:02.046277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:05.707431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049592+0000","last_change":"2024-04-26T07:54:21.022427+0000","last_active":"2024-04-26T07:55:02.049592+0000","last_peered":"2024-04-26T07:55:02.049592+0000","last_clean":"2024-04-26T07:55:02.049592+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:55:02.049592+0000","last_undegraded":"2024-04-26T07:55:02.049592+0000","last_fullsized":"2024-04-26T07:55:02.049592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:56.633388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":355,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094511+0000","last_change":"2024-04-26T07:54:23.024550+0000","last_active":"2024-04-26T07:57:24.094511+0000","last_peered":"2024-04-26T07:57:24.094511+0000","last_clean":"2024-04-26T07:57:24.094511+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:24.094511+0000","last_undegraded":"2024-04-26T07:57:24.094511+0000","last_fullsized":"2024-04-26T07:57:24.094511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:37.685058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.225376+0000","last_change":"2024-04-26T07:54:25.036034+0000","last_active":"2024-04-26T07:57:24.225376+0000","last_peered":"2024-04-26T07:57:24.225376+0000","last_clean":"2024-04-26T07:57:24.225376+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:57:24.225376+0000","last_undegraded":"2024-04-26T07:57:24.225376+0000","last_fullsized":"2024-04-26T07:57:24.225376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:45.968753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.295712+0000","last_change":"2024-04-26T07:54:17.017609+0000","last_active":"2024-04-26T07:57:24.295712+0000","last_peered":"2024-04-26T07:57:24.295712+0000","last_clean":"2024-04-26T07:57:24.295712+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:57:24.295712+0000","last_undegraded":"2024-04-26T07:57:24.295712+0000","last_fullsized":"2024-04-26T07:57:24.295712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:21.219885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052681+0000","last_change":"2024-04-26T07:54:15.023916+0000","last_active":"2024-04-26T07:55:02.052681+0000","last_peered":"2024-04-26T07:55:02.052681+0000","last_clean":"2024-04-26T07:55:02.052681+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:55:02.052681+0000","last_undegraded":"2024-04-26T07:55:02.052681+0000","last_fullsized":"2024-04-26T07:55:02.052681+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:40.137824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049650+0000","last_change":"2024-04-26T07:54:06.676954+0000","last_active":"2024-04-26T07:55:02.049650+0000","last_peered":"2024-04-26T07:55:02.049650+0000","last_clean":"2024-04-26T07:55:02.049650+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:55:02.049650+0000","last_undegraded":"2024-04-26T07:55:02.049650+0000","last_fullsized":"2024-04-26T07:55:02.049650+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:47.328942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048912+0000","last_change":"2024-04-26T07:54:19.015515+0000","last_active":"2024-04-26T07:55:02.048912+0000","last_peered":"2024-04-26T07:55:02.048912+0000","last_clean":"2024-04-26T07:55:02.048912+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:55:02.048912+0000","last_undegraded":"2024-04-26T07:55:02.048912+0000","last_fullsized":"2024-04-26T07:55:02.048912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:23.204322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047680+0000","last_change":"2024-04-26T07:54:21.023142+0000","last_active":"2024-04-26T07:55:02.047680+0000","last_peered":"2024-04-26T07:55:02.047680+0000","last_clean":"2024-04-26T07:55:02.047680+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:55:02.047680+0000","last_undegraded":"2024-04-26T07:55:02.047680+0000","last_fullsized":"2024-04-26T07:55:02.047680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:36.423536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.615719+0000","last_change":"2024-04-26T07:54:23.028166+0000","last_active":"2024-04-26T07:57:24.615719+0000","last_peered":"2024-04-26T07:57:24.615719+0000","last_clean":"2024-04-26T07:57:24.615719+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:24.615719+0000","last_undegraded":"2024-04-26T07:57:24.615719+0000","last_fullsized":"2024-04-26T07:57:24.615719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:34.060931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052901+0000","last_change":"2024-04-26T07:54:25.036997+0000","last_active":"2024-04-26T07:55:02.052901+0000","last_peered":"2024-04-26T07:55:02.052901+0000","last_clean":"2024-04-26T07:55:02.052901+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:55:02.052901+0000","last_undegraded":"2024-04-26T07:55:02.052901+0000","last_fullsized":"2024-04-26T07:55:02.052901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:14.259642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.482999+0000","last_change":"2024-04-26T07:54:17.009702+0000","last_active":"2024-04-26T07:57:24.482999+0000","last_peered":"2024-04-26T07:57:24.482999+0000","last_clean":"2024-04-26T07:57:24.482999+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:57:24.482999+0000","last_undegraded":"2024-04-26T07:57:24.482999+0000","last_fullsized":"2024-04-26T07:57:24.482999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.581557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.189286+0000","last_change":"2024-04-26T07:54:15.009811+0000","last_active":"2024-04-26T07:57:24.189286+0000","last_peered":"2024-04-26T07:57:24.189286+0000","last_clean":"2024-04-26T07:57:24.189286+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:57:24.189286+0000","last_undegraded":"2024-04-26T07:57:24.189286+0000","last_fullsized":"2024-04-26T07:57:24.189286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052128+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:55:02.052128+0000","last_peered":"2024-04-26T07:55:02.052128+0000","last_clean":"2024-04-26T07:55:02.052128+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:55:02.052128+0000","last_undegraded":"2024-04-26T07:55:02.052128+0000","last_fullsized":"2024-04-26T07:55:02.052128+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:13.205208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049055+0000","last_change":"2024-04-26T07:54:19.010329+0000","last_active":"2024-04-26T07:55:02.049055+0000","last_peered":"2024-04-26T07:55:02.049055+0000","last_clean":"2024-04-26T07:55:02.049055+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:55:02.049055+0000","last_undegraded":"2024-04-26T07:55:02.049055+0000","last_fullsized":"2024-04-26T07:55:02.049055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.285062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.350957+0000","last_change":"2024-04-26T07:54:21.022808+0000","last_active":"2024-04-26T07:56:22.350957+0000","last_peered":"2024-04-26T07:56:22.350957+0000","last_clean":"2024-04-26T07:56:22.350957+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:56:22.350957+0000","last_undegraded":"2024-04-26T07:56:22.350957+0000","last_fullsized":"2024-04-26T07:56:22.350957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:50.018902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048378+0000","last_change":"2024-04-26T07:54:23.024114+0000","last_active":"2024-04-26T07:55:02.048378+0000","last_peered":"2024-04-26T07:55:02.048378+0000","last_clean":"2024-04-26T07:55:02.048378+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:55:02.048378+0000","last_undegraded":"2024-04-26T07:55:02.048378+0000","last_fullsized":"2024-04-26T07:55:02.048378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:09.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057538+0000","last_change":"2024-04-26T07:54:25.027810+0000","last_active":"2024-04-26T07:55:02.057538+0000","last_peered":"2024-04-26T07:55:02.057538+0000","last_clean":"2024-04-26T07:55:02.057538+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:55:02.057538+0000","last_undegraded":"2024-04-26T07:55:02.057538+0000","last_fullsized":"2024-04-26T07:55:02.057538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:48.976255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056320+0000","last_change":"2024-04-26T07:54:25.026977+0000","last_active":"2024-04-26T07:55:02.056320+0000","last_peered":"2024-04-26T07:55:02.056320+0000","last_clean":"2024-04-26T07:55:02.056320+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:55:02.056320+0000","last_undegraded":"2024-04-26T07:55:02.056320+0000","last_fullsized":"2024-04-26T07:55:02.056320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:58.871659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.483744+0000","last_change":"2024-04-26T07:54:17.012273+0000","last_active":"2024-04-26T07:57:24.483744+0000","last_peered":"2024-04-26T07:57:24.483744+0000","last_clean":"2024-04-26T07:57:24.483744+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:57:24.483744+0000","last_undegraded":"2024-04-26T07:57:24.483744+0000","last_fullsized":"2024-04-26T07:57:24.483744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:05.420036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047619+0000","last_change":"2024-04-26T07:54:15.030451+0000","last_active":"2024-04-26T07:55:02.047619+0000","last_peered":"2024-04-26T07:55:02.047619+0000","last_clean":"2024-04-26T07:55:02.047619+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:55:02.047619+0000","last_undegraded":"2024-04-26T07:55:02.047619+0000","last_fullsized":"2024-04-26T07:55:02.047619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:06.194881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051614+0000","last_change":"2024-04-26T07:54:19.011757+0000","last_active":"2024-04-26T07:55:02.051614+0000","last_peered":"2024-04-26T07:55:02.051614+0000","last_clean":"2024-04-26T07:55:02.051614+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:55:02.051614+0000","last_undegraded":"2024-04-26T07:55:02.051614+0000","last_fullsized":"2024-04-26T07:55:02.051614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:49.389674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.357538+0000","last_change":"2024-04-26T07:54:21.019609+0000","last_active":"2024-04-26T07:56:22.357538+0000","last_peered":"2024-04-26T07:56:22.357538+0000","last_clean":"2024-04-26T07:56:22.357538+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:56:22.357538+0000","last_undegraded":"2024-04-26T07:56:22.357538+0000","last_fullsized":"2024-04-26T07:56:22.357538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:33:50.119690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047082+0000","last_change":"2024-04-26T07:54:23.032745+0000","last_active":"2024-04-26T07:55:02.047082+0000","last_peered":"2024-04-26T07:55:02.047082+0000","last_clean":"2024-04-26T07:55:02.047082+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:55:02.047082+0000","last_undegraded":"2024-04-26T07:55:02.047082+0000","last_fullsized":"2024-04-26T07:55:02.047082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:08.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.068854+0000","last_change":"2024-04-26T07:54:25.036781+0000","last_active":"2024-04-26T07:56:22.068854+0000","last_peered":"2024-04-26T07:56:22.068854+0000","last_clean":"2024-04-26T07:56:22.068854+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:56:22.068854+0000","last_undegraded":"2024-04-26T07:56:22.068854+0000","last_fullsized":"2024-04-26T07:56:22.068854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:57.686455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511454+0000","last_change":"2024-04-26T07:54:17.011329+0000","last_active":"2024-04-26T07:57:24.511454+0000","last_peered":"2024-04-26T07:57:24.511454+0000","last_clean":"2024-04-26T07:57:24.511454+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:24.511454+0000","last_undegraded":"2024-04-26T07:57:24.511454+0000","last_fullsized":"2024-04-26T07:57:24.511454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:23:51.477720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055095+0000","last_change":"2024-04-26T07:54:15.016903+0000","last_active":"2024-04-26T07:55:02.055095+0000","last_peered":"2024-04-26T07:55:02.055095+0000","last_clean":"2024-04-26T07:55:02.055095+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:55:02.055095+0000","last_undegraded":"2024-04-26T07:55:02.055095+0000","last_fullsized":"2024-04-26T07:55:02.055095+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048423+0000","last_change":"2024-04-26T07:54:19.009331+0000","last_active":"2024-04-26T07:55:02.048423+0000","last_peered":"2024-04-26T07:55:02.048423+0000","last_clean":"2024-04-26T07:55:02.048423+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:55:02.048423+0000","last_undegraded":"2024-04-26T07:55:02.048423+0000","last_fullsized":"2024-04-26T07:55:02.048423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:15.348847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.822696+0000","last_change":"2024-04-26T07:54:21.017937+0000","last_active":"2024-04-26T07:57:23.822696+0000","last_peered":"2024-04-26T07:57:23.822696+0000","last_clean":"2024-04-26T07:57:23.822696+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:23.822696+0000","last_undegraded":"2024-04-26T07:57:23.822696+0000","last_fullsized":"2024-04-26T07:57:23.822696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:26.134595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052140+0000","last_change":"2024-04-26T07:54:23.031660+0000","last_active":"2024-04-26T07:55:02.052140+0000","last_peered":"2024-04-26T07:55:02.052140+0000","last_clean":"2024-04-26T07:55:02.052140+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:55:02.052140+0000","last_undegraded":"2024-04-26T07:55:02.052140+0000","last_fullsized":"2024-04-26T07:55:02.052140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:21.172069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048627+0000","last_change":"2024-04-26T07:54:25.029345+0000","last_active":"2024-04-26T07:55:02.048627+0000","last_peered":"2024-04-26T07:55:02.048627+0000","last_clean":"2024-04-26T07:55:02.048627+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:55:02.048627+0000","last_undegraded":"2024-04-26T07:55:02.048627+0000","last_fullsized":"2024-04-26T07:55:02.048627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:30.573662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'5","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.488888+0000","last_change":"2024-04-26T07:55:02.054995+0000","last_active":"2024-04-26T07:57:24.488888+0000","last_peered":"2024-04-26T07:57:24.488888+0000","last_clean":"2024-04-26T07:57:24.488888+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:57:24.488888+0000","last_undegraded":"2024-04-26T07:57:24.488888+0000","last_fullsized":"2024-04-26T07:57:24.488888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:16:17.485859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056320+0000","last_change":"2024-04-26T07:54:15.021860+0000","last_active":"2024-04-26T07:55:02.056320+0000","last_peered":"2024-04-26T07:55:02.056320+0000","last_clean":"2024-04-26T07:55:02.056320+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:55:02.056320+0000","last_undegraded":"2024-04-26T07:55:02.056320+0000","last_fullsized":"2024-04-26T07:55:02.056320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:49.044298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051003+0000","last_change":"2024-04-26T07:54:19.014096+0000","last_active":"2024-04-26T07:55:02.051003+0000","last_peered":"2024-04-26T07:55:02.051003+0000","last_clean":"2024-04-26T07:55:02.051003+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:55:02.051003+0000","last_undegraded":"2024-04-26T07:55:02.051003+0000","last_fullsized":"2024-04-26T07:55:02.051003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:15.068431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.883027+0000","last_change":"2024-04-26T07:54:21.019068+0000","last_active":"2024-04-26T07:57:23.883027+0000","last_peered":"2024-04-26T07:57:23.883027+0000","last_clean":"2024-04-26T07:57:23.883027+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:23.883027+0000","last_undegraded":"2024-04-26T07:57:23.883027+0000","last_fullsized":"2024-04-26T07:57:23.883027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:42.500340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048368+0000","last_change":"2024-04-26T07:54:23.024354+0000","last_active":"2024-04-26T07:55:02.048368+0000","last_peered":"2024-04-26T07:55:02.048368+0000","last_clean":"2024-04-26T07:55:02.048368+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:55:02.048368+0000","last_undegraded":"2024-04-26T07:55:02.048368+0000","last_fullsized":"2024-04-26T07:55:02.048368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.968900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049310+0000","last_change":"2024-04-26T07:54:25.040358+0000","last_active":"2024-04-26T07:55:02.049310+0000","last_peered":"2024-04-26T07:55:02.049310+0000","last_clean":"2024-04-26T07:55:02.049310+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:55:02.049310+0000","last_undegraded":"2024-04-26T07:55:02.049310+0000","last_fullsized":"2024-04-26T07:55:02.049310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:35.575840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'7","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489597+0000","last_change":"2024-04-26T07:54:17.017717+0000","last_active":"2024-04-26T07:57:24.489597+0000","last_peered":"2024-04-26T07:57:24.489597+0000","last_clean":"2024-04-26T07:57:24.489597+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:57:24.489597+0000","last_undegraded":"2024-04-26T07:57:24.489597+0000","last_fullsized":"2024-04-26T07:57:24.489597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:28.838862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054198+0000","last_change":"2024-04-26T07:54:15.016622+0000","last_active":"2024-04-26T07:55:02.054198+0000","last_peered":"2024-04-26T07:55:02.054198+0000","last_clean":"2024-04-26T07:55:02.054198+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:55:02.054198+0000","last_undegraded":"2024-04-26T07:55:02.054198+0000","last_fullsized":"2024-04-26T07:55:02.054198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045982+0000","last_change":"2024-04-26T07:54:19.014674+0000","last_active":"2024-04-26T07:55:02.045982+0000","last_peered":"2024-04-26T07:55:02.045982+0000","last_clean":"2024-04-26T07:55:02.045982+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:55:02.045982+0000","last_undegraded":"2024-04-26T07:55:02.045982+0000","last_fullsized":"2024-04-26T07:55:02.045982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.182169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894113+0000","last_change":"2024-04-26T07:54:21.019559+0000","last_active":"2024-04-26T07:56:44.894113+0000","last_peered":"2024-04-26T07:56:44.894113+0000","last_clean":"2024-04-26T07:56:44.894113+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:56:44.894113+0000","last_undegraded":"2024-04-26T07:56:44.894113+0000","last_fullsized":"2024-04-26T07:56:44.894113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:30.223054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053654+0000","last_change":"2024-04-26T07:54:23.027939+0000","last_active":"2024-04-26T07:55:02.053654+0000","last_peered":"2024-04-26T07:55:02.053654+0000","last_clean":"2024-04-26T07:55:02.053654+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:55:02.053654+0000","last_undegraded":"2024-04-26T07:55:02.053654+0000","last_fullsized":"2024-04-26T07:55:02.053654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:30.224134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207208+0000","last_change":"2024-04-26T07:54:17.009497+0000","last_active":"2024-04-26T07:57:24.207208+0000","last_peered":"2024-04-26T07:57:24.207208+0000","last_clean":"2024-04-26T07:57:24.207208+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:57:24.207208+0000","last_undegraded":"2024-04-26T07:57:24.207208+0000","last_fullsized":"2024-04-26T07:57:24.207208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:55.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046088+0000","last_change":"2024-04-26T07:54:15.030594+0000","last_active":"2024-04-26T07:55:02.046088+0000","last_peered":"2024-04-26T07:55:02.046088+0000","last_clean":"2024-04-26T07:55:02.046088+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:55:02.046088+0000","last_undegraded":"2024-04-26T07:55:02.046088+0000","last_fullsized":"2024-04-26T07:55:02.046088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:29.574119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050906+0000","last_change":"2024-04-26T07:54:19.014571+0000","last_active":"2024-04-26T07:55:02.050906+0000","last_peered":"2024-04-26T07:55:02.050906+0000","last_clean":"2024-04-26T07:55:02.050906+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:55:02.050906+0000","last_undegraded":"2024-04-26T07:55:02.050906+0000","last_fullsized":"2024-04-26T07:55:02.050906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:33.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.363588+0000","last_change":"2024-04-26T07:54:21.020615+0000","last_active":"2024-04-26T07:56:22.363588+0000","last_peered":"2024-04-26T07:56:22.363588+0000","last_clean":"2024-04-26T07:56:22.363588+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:56:22.363588+0000","last_undegraded":"2024-04-26T07:56:22.363588+0000","last_fullsized":"2024-04-26T07:56:22.363588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:19.165840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054281+0000","last_change":"2024-04-26T07:54:23.028286+0000","last_active":"2024-04-26T07:55:02.054281+0000","last_peered":"2024-04-26T07:55:02.054281+0000","last_clean":"2024-04-26T07:55:02.054281+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:55:02.054281+0000","last_undegraded":"2024-04-26T07:55:02.054281+0000","last_fullsized":"2024-04-26T07:55:02.054281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:21.669790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.799225+0000","last_change":"2024-04-26T07:54:25.029358+0000","last_active":"2024-04-26T07:56:23.799225+0000","last_peered":"2024-04-26T07:56:23.799225+0000","last_clean":"2024-04-26T07:56:23.799225+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:56:23.799225+0000","last_undegraded":"2024-04-26T07:56:23.799225+0000","last_fullsized":"2024-04-26T07:56:23.799225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:53.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050746+0000","last_change":"2024-04-26T07:54:17.006732+0000","last_active":"2024-04-26T07:55:02.050746+0000","last_peered":"2024-04-26T07:55:02.050746+0000","last_clean":"2024-04-26T07:55:02.050746+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:55:02.050746+0000","last_undegraded":"2024-04-26T07:55:02.050746+0000","last_fullsized":"2024-04-26T07:55:02.050746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:50.720873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048000+0000","last_change":"2024-04-26T07:54:15.016457+0000","last_active":"2024-04-26T07:55:02.048000+0000","last_peered":"2024-04-26T07:55:02.048000+0000","last_clean":"2024-04-26T07:55:02.048000+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:55:02.048000+0000","last_undegraded":"2024-04-26T07:55:02.048000+0000","last_fullsized":"2024-04-26T07:55:02.048000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:34.137578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.058106+0000","last_change":"2024-04-26T07:54:19.010468+0000","last_active":"2024-04-26T07:55:02.058106+0000","last_peered":"2024-04-26T07:55:02.058106+0000","last_clean":"2024-04-26T07:55:02.058106+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:55:02.058106+0000","last_undegraded":"2024-04-26T07:55:02.058106+0000","last_fullsized":"2024-04-26T07:55:02.058106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:00.247411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.343549+0000","last_change":"2024-04-26T07:54:21.021362+0000","last_active":"2024-04-26T07:56:22.343549+0000","last_peered":"2024-04-26T07:56:22.343549+0000","last_clean":"2024-04-26T07:56:22.343549+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:56:22.343549+0000","last_undegraded":"2024-04-26T07:56:22.343549+0000","last_fullsized":"2024-04-26T07:56:22.343549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:01.562210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048176+0000","last_change":"2024-04-26T07:54:23.033211+0000","last_active":"2024-04-26T07:55:02.048176+0000","last_peered":"2024-04-26T07:55:02.048176+0000","last_clean":"2024-04-26T07:55:02.048176+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:55:02.048176+0000","last_undegraded":"2024-04-26T07:55:02.048176+0000","last_fullsized":"2024-04-26T07:55:02.048176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:56.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046065+0000","last_change":"2024-04-26T07:54:25.040148+0000","last_active":"2024-04-26T07:55:02.046065+0000","last_peered":"2024-04-26T07:55:02.046065+0000","last_clean":"2024-04-26T07:55:02.046065+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:55:02.046065+0000","last_undegraded":"2024-04-26T07:55:02.046065+0000","last_fullsized":"2024-04-26T07:55:02.046065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:26.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.135910+0000","last_change":"2024-04-26T07:55:02.061611+0000","last_active":"2024-04-26T07:55:40.135910+0000","last_peered":"2024-04-26T07:55:40.135910+0000","last_clean":"2024-04-26T07:55:40.135910+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:55:40.135910+0000","last_undegraded":"2024-04-26T07:55:40.135910+0000","last_fullsized":"2024-04-26T07:55:40.135910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.609944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048558+0000","last_change":"2024-04-26T07:54:15.009041+0000","last_active":"2024-04-26T07:55:02.048558+0000","last_peered":"2024-04-26T07:55:02.048558+0000","last_clean":"2024-04-26T07:55:02.048558+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:55:02.048558+0000","last_undegraded":"2024-04-26T07:55:02.048558+0000","last_fullsized":"2024-04-26T07:55:02.048558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054642+0000","last_change":"2024-04-26T07:54:19.006121+0000","last_active":"2024-04-26T07:55:02.054642+0000","last_peered":"2024-04-26T07:55:02.054642+0000","last_clean":"2024-04-26T07:55:02.054642+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:55:02.054642+0000","last_undegraded":"2024-04-26T07:55:02.054642+0000","last_fullsized":"2024-04-26T07:55:02.054642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:46.405445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.361578+0000","last_change":"2024-04-26T07:54:21.021334+0000","last_active":"2024-04-26T07:56:22.361578+0000","last_peered":"2024-04-26T07:56:22.361578+0000","last_clean":"2024-04-26T07:56:22.361578+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:56:22.361578+0000","last_undegraded":"2024-04-26T07:56:22.361578+0000","last_fullsized":"2024-04-26T07:56:22.361578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:46.967145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049254+0000","last_change":"2024-04-26T07:54:23.035770+0000","last_active":"2024-04-26T07:55:02.049254+0000","last_peered":"2024-04-26T07:55:02.049254+0000","last_clean":"2024-04-26T07:55:02.049254+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:55:02.049254+0000","last_undegraded":"2024-04-26T07:55:02.049254+0000","last_fullsized":"2024-04-26T07:55:02.049254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:10.697769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.797401+0000","last_change":"2024-04-26T07:54:25.039740+0000","last_active":"2024-04-26T07:56:23.797401+0000","last_peered":"2024-04-26T07:56:23.797401+0000","last_clean":"2024-04-26T07:56:23.797401+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:56:23.797401+0000","last_undegraded":"2024-04-26T07:56:23.797401+0000","last_fullsized":"2024-04-26T07:56:23.797401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:43.196570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294830+0000","last_change":"2024-04-26T07:54:17.009954+0000","last_active":"2024-04-26T07:57:24.294830+0000","last_peered":"2024-04-26T07:57:24.294830+0000","last_clean":"2024-04-26T07:57:24.294830+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:57:24.294830+0000","last_undegraded":"2024-04-26T07:57:24.294830+0000","last_fullsized":"2024-04-26T07:57:24.294830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:38.661383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.421082+0000","last_change":"2024-04-26T07:54:15.028318+0000","last_active":"2024-04-26T07:57:24.421082+0000","last_peered":"2024-04-26T07:57:24.421082+0000","last_clean":"2024-04-26T07:57:24.421082+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:57:24.421082+0000","last_undegraded":"2024-04-26T07:57:24.421082+0000","last_fullsized":"2024-04-26T07:57:24.421082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:14.941698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051548+0000","last_change":"2024-04-26T07:54:19.011607+0000","last_active":"2024-04-26T07:55:02.051548+0000","last_peered":"2024-04-26T07:55:02.051548+0000","last_clean":"2024-04-26T07:55:02.051548+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:55:02.051548+0000","last_undegraded":"2024-04-26T07:55:02.051548+0000","last_fullsized":"2024-04-26T07:55:02.051548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:48.273952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050383+0000","last_change":"2024-04-26T07:54:21.024776+0000","last_active":"2024-04-26T07:55:02.050383+0000","last_peered":"2024-04-26T07:55:02.050383+0000","last_clean":"2024-04-26T07:55:02.050383+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:55:02.050383+0000","last_undegraded":"2024-04-26T07:55:02.050383+0000","last_fullsized":"2024-04-26T07:55:02.050383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:11.648384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.516448+0000","last_change":"2024-04-26T07:54:23.031565+0000","last_active":"2024-04-26T07:57:24.516448+0000","last_peered":"2024-04-26T07:57:24.516448+0000","last_clean":"2024-04-26T07:57:24.516448+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:24.516448+0000","last_undegraded":"2024-04-26T07:57:24.516448+0000","last_fullsized":"2024-04-26T07:57:24.516448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:58.639617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.140553+0000","last_change":"2024-04-26T07:54:25.037610+0000","last_active":"2024-04-26T07:55:40.140553+0000","last_peered":"2024-04-26T07:55:40.140553+0000","last_clean":"2024-04-26T07:55:40.140553+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:55:40.140553+0000","last_undegraded":"2024-04-26T07:55:40.140553+0000","last_fullsized":"2024-04-26T07:55:40.140553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:53.664483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.957760+0000","last_change":"2024-04-26T07:54:17.009270+0000","last_active":"2024-04-26T07:55:39.957760+0000","last_peered":"2024-04-26T07:55:39.957760+0000","last_clean":"2024-04-26T07:55:39.957760+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:55:39.957760+0000","last_undegraded":"2024-04-26T07:55:39.957760+0000","last_fullsized":"2024-04-26T07:55:39.957760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.947552+0000","last_change":"2024-04-26T07:54:15.017919+0000","last_active":"2024-04-26T07:55:39.947552+0000","last_peered":"2024-04-26T07:55:39.947552+0000","last_clean":"2024-04-26T07:55:39.947552+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:55:39.947552+0000","last_undegraded":"2024-04-26T07:55:39.947552+0000","last_fullsized":"2024-04-26T07:55:39.947552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049929+0000","last_change":"2024-04-26T07:54:19.012254+0000","last_active":"2024-04-26T07:55:02.049929+0000","last_peered":"2024-04-26T07:55:02.049929+0000","last_clean":"2024-04-26T07:55:02.049929+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:55:02.049929+0000","last_undegraded":"2024-04-26T07:55:02.049929+0000","last_fullsized":"2024-04-26T07:55:02.049929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:27.631378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.334158+0000","last_change":"2024-04-26T07:54:21.016502+0000","last_active":"2024-04-26T07:56:22.334158+0000","last_peered":"2024-04-26T07:56:22.334158+0000","last_clean":"2024-04-26T07:56:22.334158+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:56:22.334158+0000","last_undegraded":"2024-04-26T07:56:22.334158+0000","last_fullsized":"2024-04-26T07:56:22.334158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:19.663560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047166+0000","last_change":"2024-04-26T07:54:23.020772+0000","last_active":"2024-04-26T07:55:02.047166+0000","last_peered":"2024-04-26T07:55:02.047166+0000","last_clean":"2024-04-26T07:55:02.047166+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:55:02.047166+0000","last_undegraded":"2024-04-26T07:55:02.047166+0000","last_fullsized":"2024-04-26T07:55:02.047166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:33.445518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054643+0000","last_change":"2024-04-26T07:54:25.030663+0000","last_active":"2024-04-26T07:55:02.054643+0000","last_peered":"2024-04-26T07:55:02.054643+0000","last_clean":"2024-04-26T07:55:02.054643+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:55:02.054643+0000","last_undegraded":"2024-04-26T07:55:02.054643+0000","last_fullsized":"2024-04-26T07:55:02.054643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:30.573662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'18","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567445+0000","last_change":"2024-04-26T07:54:17.006502+0000","last_active":"2024-04-26T07:57:24.567445+0000","last_peered":"2024-04-26T07:57:24.567445+0000","last_clean":"2024-04-26T07:57:24.567445+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:24.567445+0000","last_undegraded":"2024-04-26T07:57:24.567445+0000","last_fullsized":"2024-04-26T07:57:24.567445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:10.389370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.660248+0000","last_change":"2024-04-26T07:54:15.028304+0000","last_active":"2024-04-26T07:56:23.660248+0000","last_peered":"2024-04-26T07:56:23.660248+0000","last_clean":"2024-04-26T07:56:23.660248+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:56:23.660248+0000","last_undegraded":"2024-04-26T07:56:23.660248+0000","last_fullsized":"2024-04-26T07:56:23.660248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:40.508331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054707+0000","last_change":"2024-04-26T07:54:19.016077+0000","last_active":"2024-04-26T07:55:02.054707+0000","last_peered":"2024-04-26T07:55:02.054707+0000","last_clean":"2024-04-26T07:55:02.054707+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:55:02.054707+0000","last_undegraded":"2024-04-26T07:55:02.054707+0000","last_fullsized":"2024-04-26T07:55:02.054707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.777725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.335268+0000","last_change":"2024-04-26T07:54:21.021321+0000","last_active":"2024-04-26T07:56:22.335268+0000","last_peered":"2024-04-26T07:56:22.335268+0000","last_clean":"2024-04-26T07:56:22.335268+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:56:22.335268+0000","last_undegraded":"2024-04-26T07:56:22.335268+0000","last_fullsized":"2024-04-26T07:56:22.335268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:07.791597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045753+0000","last_change":"2024-04-26T07:54:23.035765+0000","last_active":"2024-04-26T07:55:02.045753+0000","last_peered":"2024-04-26T07:55:02.045753+0000","last_clean":"2024-04-26T07:55:02.045753+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:55:02.045753+0000","last_undegraded":"2024-04-26T07:55:02.045753+0000","last_fullsized":"2024-04-26T07:55:02.045753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:37.356445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.484896+0000","last_change":"2024-04-26T07:54:25.035955+0000","last_active":"2024-04-26T07:57:24.484896+0000","last_peered":"2024-04-26T07:57:24.484896+0000","last_clean":"2024-04-26T07:57:24.484896+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:57:24.484896+0000","last_undegraded":"2024-04-26T07:57:24.484896+0000","last_fullsized":"2024-04-26T07:57:24.484896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:17.547313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.483578+0000","last_change":"2024-04-26T07:54:17.010362+0000","last_active":"2024-04-26T07:57:24.483578+0000","last_peered":"2024-04-26T07:57:24.483578+0000","last_clean":"2024-04-26T07:57:24.483578+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:57:24.483578+0000","last_undegraded":"2024-04-26T07:57:24.483578+0000","last_fullsized":"2024-04-26T07:57:24.483578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:03.777566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050470+0000","last_change":"2024-04-26T07:54:15.009093+0000","last_active":"2024-04-26T07:55:02.050470+0000","last_peered":"2024-04-26T07:55:02.050470+0000","last_clean":"2024-04-26T07:55:02.050470+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:55:02.050470+0000","last_undegraded":"2024-04-26T07:55:02.050470+0000","last_fullsized":"2024-04-26T07:55:02.050470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:42.204889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052220+0000","last_change":"2024-04-26T07:54:19.010756+0000","last_active":"2024-04-26T07:55:02.052220+0000","last_peered":"2024-04-26T07:55:02.052220+0000","last_clean":"2024-04-26T07:55:02.052220+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:55:02.052220+0000","last_undegraded":"2024-04-26T07:55:02.052220+0000","last_fullsized":"2024-04-26T07:55:02.052220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.227129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.359469+0000","last_change":"2024-04-26T07:54:21.020800+0000","last_active":"2024-04-26T07:56:22.359469+0000","last_peered":"2024-04-26T07:56:22.359469+0000","last_clean":"2024-04-26T07:56:22.359469+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:56:22.359469+0000","last_undegraded":"2024-04-26T07:56:22.359469+0000","last_fullsized":"2024-04-26T07:56:22.359469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:26.613231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046306+0000","last_change":"2024-04-26T07:54:23.036351+0000","last_active":"2024-04-26T07:55:02.046306+0000","last_peered":"2024-04-26T07:55:02.046306+0000","last_clean":"2024-04-26T07:55:02.046306+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:55:02.046306+0000","last_undegraded":"2024-04-26T07:55:02.046306+0000","last_fullsized":"2024-04-26T07:55:02.046306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:41.433119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.902253+0000","last_change":"2024-04-26T07:54:25.039985+0000","last_active":"2024-04-26T07:57:23.902253+0000","last_peered":"2024-04-26T07:57:23.902253+0000","last_clean":"2024-04-26T07:57:23.902253+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:57:23.902253+0000","last_undegraded":"2024-04-26T07:57:23.902253+0000","last_fullsized":"2024-04-26T07:57:23.902253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:59.311879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050871+0000","last_change":"2024-04-26T07:54:17.003817+0000","last_active":"2024-04-26T07:55:02.050871+0000","last_peered":"2024-04-26T07:55:02.050871+0000","last_clean":"2024-04-26T07:55:02.050871+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:55:02.050871+0000","last_undegraded":"2024-04-26T07:55:02.050871+0000","last_fullsized":"2024-04-26T07:55:02.050871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:28:51.342246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054411+0000","last_change":"2024-04-26T07:54:15.019611+0000","last_active":"2024-04-26T07:55:02.054411+0000","last_peered":"2024-04-26T07:55:02.054411+0000","last_clean":"2024-04-26T07:55:02.054411+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:55:02.054411+0000","last_undegraded":"2024-04-26T07:55:02.054411+0000","last_fullsized":"2024-04-26T07:55:02.054411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:21.027132+0000","last_change":"2024-04-26T07:54:19.017393+0000","last_active":"2024-04-26T07:56:21.027132+0000","last_peered":"2024-04-26T07:56:21.027132+0000","last_clean":"2024-04-26T07:56:21.027132+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:56:21.027132+0000","last_undegraded":"2024-04-26T07:56:21.027132+0000","last_fullsized":"2024-04-26T07:56:21.027132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:30.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'33","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.841717+0000","last_change":"2024-04-26T07:54:21.021890+0000","last_active":"2024-04-26T07:57:23.841717+0000","last_peered":"2024-04-26T07:57:23.841717+0000","last_clean":"2024-04-26T07:57:23.841717+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:57:23.841717+0000","last_undegraded":"2024-04-26T07:57:23.841717+0000","last_fullsized":"2024-04-26T07:57:23.841717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:56.471143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048221+0000","last_change":"2024-04-26T07:54:23.021881+0000","last_active":"2024-04-26T07:55:02.048221+0000","last_peered":"2024-04-26T07:55:02.048221+0000","last_clean":"2024-04-26T07:55:02.048221+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:55:02.048221+0000","last_undegraded":"2024-04-26T07:55:02.048221+0000","last_fullsized":"2024-04-26T07:55:02.048221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:57.195185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.371916+0000","last_change":"2024-04-26T07:54:25.040953+0000","last_active":"2024-04-26T07:56:22.371916+0000","last_peered":"2024-04-26T07:56:22.371916+0000","last_clean":"2024-04-26T07:56:22.371916+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:56:22.371916+0000","last_undegraded":"2024-04-26T07:56:22.371916+0000","last_fullsized":"2024-04-26T07:56:22.371916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:37.200888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.803805+0000","last_change":"2024-04-26T07:54:17.004457+0000","last_active":"2024-04-26T07:56:23.803805+0000","last_peered":"2024-04-26T07:56:23.803805+0000","last_clean":"2024-04-26T07:56:23.803805+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:56:23.803805+0000","last_undegraded":"2024-04-26T07:56:23.803805+0000","last_fullsized":"2024-04-26T07:56:23.803805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:27:58.240167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050573+0000","last_change":"2024-04-26T07:54:15.022353+0000","last_active":"2024-04-26T07:55:02.050573+0000","last_peered":"2024-04-26T07:55:02.050573+0000","last_clean":"2024-04-26T07:55:02.050573+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:55:02.050573+0000","last_undegraded":"2024-04-26T07:55:02.050573+0000","last_fullsized":"2024-04-26T07:55:02.050573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050768+0000","last_change":"2024-04-26T07:54:17.015322+0000","last_active":"2024-04-26T07:55:02.050768+0000","last_peered":"2024-04-26T07:55:02.050768+0000","last_clean":"2024-04-26T07:55:02.050768+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:55:02.050768+0000","last_undegraded":"2024-04-26T07:55:02.050768+0000","last_fullsized":"2024-04-26T07:55:02.050768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:08.202320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.423953+0000","last_change":"2024-04-26T07:54:15.001522+0000","last_active":"2024-04-26T07:57:24.423953+0000","last_peered":"2024-04-26T07:57:24.423953+0000","last_clean":"2024-04-26T07:57:24.423953+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:57:24.423953+0000","last_undegraded":"2024-04-26T07:57:24.423953+0000","last_fullsized":"2024-04-26T07:57:24.423953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048458+0000","last_change":"2024-04-26T07:54:17.010190+0000","last_active":"2024-04-26T07:55:02.048458+0000","last_peered":"2024-04-26T07:55:02.048458+0000","last_clean":"2024-04-26T07:55:02.048458+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:55:02.048458+0000","last_undegraded":"2024-04-26T07:55:02.048458+0000","last_fullsized":"2024-04-26T07:55:02.048458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:24.203874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046564+0000","last_change":"2024-04-26T07:54:15.025512+0000","last_active":"2024-04-26T07:55:02.046564+0000","last_peered":"2024-04-26T07:55:02.046564+0000","last_clean":"2024-04-26T07:55:02.046564+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:55:02.046564+0000","last_undegraded":"2024-04-26T07:55:02.046564+0000","last_fullsized":"2024-04-26T07:55:02.046564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:43.250319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143581+0000","last_change":"2024-04-26T07:54:17.009848+0000","last_active":"2024-04-26T07:55:40.143581+0000","last_peered":"2024-04-26T07:55:40.143581+0000","last_clean":"2024-04-26T07:55:40.143581+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:55:40.143581+0000","last_undegraded":"2024-04-26T07:55:40.143581+0000","last_fullsized":"2024-04-26T07:55:40.143581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884316+0000","last_change":"2024-04-26T07:54:15.005595+0000","last_active":"2024-04-26T07:56:19.884316+0000","last_peered":"2024-04-26T07:56:19.884316+0000","last_clean":"2024-04-26T07:56:19.884316+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:56:19.884316+0000","last_undegraded":"2024-04-26T07:56:19.884316+0000","last_fullsized":"2024-04-26T07:56:19.884316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.613906+0000","last_change":"2024-04-26T07:54:16.999767+0000","last_active":"2024-04-26T07:56:20.613906+0000","last_peered":"2024-04-26T07:56:20.613906+0000","last_clean":"2024-04-26T07:56:20.613906+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:56:20.613906+0000","last_undegraded":"2024-04-26T07:56:20.613906+0000","last_fullsized":"2024-04-26T07:56:20.613906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.777807+0000","last_change":"2024-04-26T07:54:15.003280+0000","last_active":"2024-04-26T07:56:23.777807+0000","last_peered":"2024-04-26T07:56:23.777807+0000","last_clean":"2024-04-26T07:56:23.777807+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:56:23.777807+0000","last_undegraded":"2024-04-26T07:56:23.777807+0000","last_fullsized":"2024-04-26T07:56:23.777807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511668+0000","last_change":"2024-04-26T07:54:17.003908+0000","last_active":"2024-04-26T07:57:24.511668+0000","last_peered":"2024-04-26T07:57:24.511668+0000","last_clean":"2024-04-26T07:57:24.511668+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:57:24.511668+0000","last_undegraded":"2024-04-26T07:57:24.511668+0000","last_fullsized":"2024-04-26T07:57:24.511668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:48.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048401+0000","last_change":"2024-04-26T07:54:15.017747+0000","last_active":"2024-04-26T07:55:02.048401+0000","last_peered":"2024-04-26T07:55:02.048401+0000","last_clean":"2024-04-26T07:55:02.048401+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:55:02.048401+0000","last_undegraded":"2024-04-26T07:55:02.048401+0000","last_fullsized":"2024-04-26T07:55:02.048401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518610+0000","last_change":"2024-04-26T07:54:17.006648+0000","last_active":"2024-04-26T07:57:24.518610+0000","last_peered":"2024-04-26T07:57:24.518610+0000","last_clean":"2024-04-26T07:57:24.518610+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:57:24.518610+0000","last_undegraded":"2024-04-26T07:57:24.518610+0000","last_fullsized":"2024-04-26T07:57:24.518610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:05.420036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056521+0000","last_change":"2024-04-26T07:54:15.022184+0000","last_active":"2024-04-26T07:55:02.056521+0000","last_peered":"2024-04-26T07:55:02.056521+0000","last_clean":"2024-04-26T07:55:02.056521+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:55:02.056521+0000","last_undegraded":"2024-04-26T07:55:02.056521+0000","last_fullsized":"2024-04-26T07:55:02.056521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294965+0000","last_change":"2024-04-26T07:54:16.999609+0000","last_active":"2024-04-26T07:57:24.294965+0000","last_peered":"2024-04-26T07:57:24.294965+0000","last_clean":"2024-04-26T07:57:24.294965+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:57:24.294965+0000","last_undegraded":"2024-04-26T07:57:24.294965+0000","last_fullsized":"2024-04-26T07:57:24.294965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049858+0000","last_change":"2024-04-26T07:54:15.005424+0000","last_active":"2024-04-26T07:55:02.049858+0000","last_peered":"2024-04-26T07:55:02.049858+0000","last_clean":"2024-04-26T07:55:02.049858+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:55:02.049858+0000","last_undegraded":"2024-04-26T07:55:02.049858+0000","last_fullsized":"2024-04-26T07:55:02.049858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:44.643100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.444923+0000","last_change":"2024-04-26T07:54:17.006417+0000","last_active":"2024-04-26T07:57:24.444923+0000","last_peered":"2024-04-26T07:57:24.444923+0000","last_clean":"2024-04-26T07:57:24.444923+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:57:24.444923+0000","last_undegraded":"2024-04-26T07:57:24.444923+0000","last_fullsized":"2024-04-26T07:57:24.444923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:32.537219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046690+0000","last_change":"2024-04-26T07:54:15.029863+0000","last_active":"2024-04-26T07:55:02.046690+0000","last_peered":"2024-04-26T07:55:02.046690+0000","last_clean":"2024-04-26T07:55:02.046690+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:55:02.046690+0000","last_undegraded":"2024-04-26T07:55:02.046690+0000","last_fullsized":"2024-04-26T07:55:02.046690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.237116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049233+0000","last_change":"2024-04-26T07:54:17.018186+0000","last_active":"2024-04-26T07:55:02.049233+0000","last_peered":"2024-04-26T07:55:02.049233+0000","last_clean":"2024-04-26T07:55:02.049233+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:55:02.049233+0000","last_undegraded":"2024-04-26T07:55:02.049233+0000","last_fullsized":"2024-04-26T07:55:02.049233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:42.953114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048139+0000","last_change":"2024-04-26T07:54:15.007396+0000","last_active":"2024-04-26T07:55:02.048139+0000","last_peered":"2024-04-26T07:55:02.048139+0000","last_clean":"2024-04-26T07:55:02.048139+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:55:02.048139+0000","last_undegraded":"2024-04-26T07:55:02.048139+0000","last_fullsized":"2024-04-26T07:55:02.048139+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.957894+0000","last_change":"2024-04-26T07:54:17.011327+0000","last_active":"2024-04-26T07:55:39.957894+0000","last_peered":"2024-04-26T07:55:39.957894+0000","last_clean":"2024-04-26T07:55:39.957894+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:55:39.957894+0000","last_undegraded":"2024-04-26T07:55:39.957894+0000","last_fullsized":"2024-04-26T07:55:39.957894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.428008+0000","last_change":"2024-04-26T07:54:15.017542+0000","last_active":"2024-04-26T07:57:24.428008+0000","last_peered":"2024-04-26T07:57:24.428008+0000","last_clean":"2024-04-26T07:57:24.428008+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:57:24.428008+0000","last_undegraded":"2024-04-26T07:57:24.428008+0000","last_fullsized":"2024-04-26T07:57:24.428008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:07.237734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438319+0000","last_change":"2024-04-26T07:54:17.003159+0000","last_active":"2024-04-26T07:57:24.438319+0000","last_peered":"2024-04-26T07:57:24.438319+0000","last_clean":"2024-04-26T07:57:24.438319+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:57:24.438319+0000","last_undegraded":"2024-04-26T07:57:24.438319+0000","last_fullsized":"2024-04-26T07:57:24.438319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:44.398201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.417790+0000","last_change":"2024-04-26T07:54:15.008754+0000","last_active":"2024-04-26T07:57:24.417790+0000","last_peered":"2024-04-26T07:57:24.417790+0000","last_clean":"2024-04-26T07:57:24.417790+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:57:24.417790+0000","last_undegraded":"2024-04-26T07:57:24.417790+0000","last_fullsized":"2024-04-26T07:57:24.417790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207862+0000","last_change":"2024-04-26T07:54:17.009514+0000","last_active":"2024-04-26T07:57:24.207862+0000","last_peered":"2024-04-26T07:57:24.207862+0000","last_clean":"2024-04-26T07:57:24.207862+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:57:24.207862+0000","last_undegraded":"2024-04-26T07:57:24.207862+0000","last_fullsized":"2024-04-26T07:57:24.207862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:08.202320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.431092+0000","last_change":"2024-04-26T07:54:15.022986+0000","last_active":"2024-04-26T07:57:24.431092+0000","last_peered":"2024-04-26T07:57:24.431092+0000","last_clean":"2024-04-26T07:57:24.431092+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:57:24.431092+0000","last_undegraded":"2024-04-26T07:57:24.431092+0000","last_fullsized":"2024-04-26T07:57:24.431092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:48.713435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511353+0000","last_change":"2024-04-26T07:54:17.007792+0000","last_active":"2024-04-26T07:57:24.511353+0000","last_peered":"2024-04-26T07:57:24.511353+0000","last_clean":"2024-04-26T07:57:24.511353+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:57:24.511353+0000","last_undegraded":"2024-04-26T07:57:24.511353+0000","last_fullsized":"2024-04-26T07:57:24.511353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:13.061187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048771+0000","last_change":"2024-04-26T07:54:15.026508+0000","last_active":"2024-04-26T07:55:02.048771+0000","last_peered":"2024-04-26T07:55:02.048771+0000","last_clean":"2024-04-26T07:55:02.048771+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:55:02.048771+0000","last_undegraded":"2024-04-26T07:55:02.048771+0000","last_fullsized":"2024-04-26T07:55:02.048771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.940423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804054+0000","last_change":"2024-04-26T07:54:17.016231+0000","last_active":"2024-04-26T07:56:23.804054+0000","last_peered":"2024-04-26T07:56:23.804054+0000","last_clean":"2024-04-26T07:56:23.804054+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:56:23.804054+0000","last_undegraded":"2024-04-26T07:56:23.804054+0000","last_fullsized":"2024-04-26T07:56:23.804054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.266707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057701+0000","last_change":"2024-04-26T07:54:15.022552+0000","last_active":"2024-04-26T07:55:02.057701+0000","last_peered":"2024-04-26T07:55:02.057701+0000","last_clean":"2024-04-26T07:55:02.057701+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:55:02.057701+0000","last_undegraded":"2024-04-26T07:55:02.057701+0000","last_fullsized":"2024-04-26T07:55:02.057701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143346+0000","last_change":"2024-04-26T07:54:17.000134+0000","last_active":"2024-04-26T07:55:40.143346+0000","last_peered":"2024-04-26T07:55:40.143346+0000","last_clean":"2024-04-26T07:55:40.143346+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:55:40.143346+0000","last_undegraded":"2024-04-26T07:55:40.143346+0000","last_fullsized":"2024-04-26T07:55:40.143346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052235+0000","last_change":"2024-04-26T07:54:15.025822+0000","last_active":"2024-04-26T07:55:02.052235+0000","last_peered":"2024-04-26T07:55:02.052235+0000","last_clean":"2024-04-26T07:55:02.052235+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:55:02.052235+0000","last_undegraded":"2024-04-26T07:55:02.052235+0000","last_fullsized":"2024-04-26T07:55:02.052235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:03.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047156+0000","last_change":"2024-04-26T07:54:15.029803+0000","last_active":"2024-04-26T07:55:02.047156+0000","last_peered":"2024-04-26T07:55:02.047156+0000","last_clean":"2024-04-26T07:55:02.047156+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:55:02.047156+0000","last_undegraded":"2024-04-26T07:55:02.047156+0000","last_fullsized":"2024-04-26T07:55:02.047156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:28:49.334808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511260+0000","last_change":"2024-04-26T07:54:17.001393+0000","last_active":"2024-04-26T07:57:24.511260+0000","last_peered":"2024-04-26T07:57:24.511260+0000","last_clean":"2024-04-26T07:57:24.511260+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:57:24.511260+0000","last_undegraded":"2024-04-26T07:57:24.511260+0000","last_fullsized":"2024-04-26T07:57:24.511260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:13.730381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048048+0000","last_change":"2024-04-26T07:54:15.007421+0000","last_active":"2024-04-26T07:55:02.048048+0000","last_peered":"2024-04-26T07:55:02.048048+0000","last_clean":"2024-04-26T07:55:02.048048+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:55:02.048048+0000","last_undegraded":"2024-04-26T07:55:02.048048+0000","last_fullsized":"2024-04-26T07:55:02.048048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511321+0000","last_change":"2024-04-26T07:54:17.002953+0000","last_active":"2024-04-26T07:57:24.511321+0000","last_peered":"2024-04-26T07:57:24.511321+0000","last_clean":"2024-04-26T07:57:24.511321+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:57:24.511321+0000","last_undegraded":"2024-04-26T07:57:24.511321+0000","last_fullsized":"2024-04-26T07:57:24.511321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42228,"kb_used_data":6892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329612,"statfs":{"total":96636764160,"available":96593522688,"internally_reserved":0,"allocated":7057408,"data_stored":6751956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705707,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48896,"kb_used_data":13560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322944,"statfs":{"total":96636764160,"available":96586694656,"internally_reserved":0,"allocated":13885440,"data_stored":13632181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48600,"kb_used_data":13264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323240,"statfs":{"total":96636764160,"available":96586997760,"internally_reserved":0,"allocated":13582336,"data_stored":13307988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38024,"kb_used_data":6848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333816,"statfs":{"total":96636764160,"available":96597827584,"internally_reserved":0,"allocated":7012352,"data_stored":6749173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:57:31.597 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:57:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.726+0000 7f79964d1640 1 Processor -- start 2024-04-26T07:57:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.726+0000 7f79964d1640 1 -- start start 2024-04-26T07:57:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.726+0000 7f79964d1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f799012d680 0x7f7990131d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.726+0000 7f79964d1640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7990096c10 con 0x7f799012c9e0 2024-04-26T07:57:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.726+0000 7f79964d1640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f7990096de0 con 0x7f799012d680 2024-04-26T07:57:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.727+0000 7f798f7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f799012d680 0x7f7990131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.727+0000 7f798ffff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f799012c9e0 0x7f799012cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46448/0 (socket says 172.21.15.1:46448) 2024-04-26T07:57:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.727+0000 7f798ffff640 1 -- 172.21.15.1:0/4223022315 learned_addr learned my addr 172.21.15.1:0/4223022315 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:31.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.727+0000 7f798f7fe640 1 -- 172.21.15.1:0/4223022315 >> v1:172.21.15.1:6789/0 conn(0x7f799012c9e0 legacy=0x7f799012cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.727+0000 7f798f7fe640 1 -- 172.21.15.1:0/4223022315 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7990096510 con 0x7f799012d680 2024-04-26T07:57:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f798f7fe640 1 --2- 172.21.15.1:0/4223022315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012d680 0x7f7990131d60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7980009720 tx=0x7f798002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6fb0693d9270ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f798effd640 1 -- 172.21.15.1:0/4223022315 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79800316d0 con 0x7f799012d680 2024-04-26T07:57:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f798effd640 1 -- 172.21.15.1:0/4223022315 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7980037070 con 0x7f799012d680 2024-04-26T07:57:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f798effd640 1 -- 172.21.15.1:0/4223022315 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79800319c0 con 0x7f799012d680 2024-04-26T07:57:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f79964d1640 1 -- 172.21.15.1:0/4223022315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012d680 msgr2=0x7f7990131d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f79964d1640 1 --2- 172.21.15.1:0/4223022315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012d680 0x7f7990131d60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7980009720 tx=0x7f798002b840 comp rx=0 tx=0).stop 2024-04-26T07:57:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f79964d1640 1 -- 172.21.15.1:0/4223022315 shutdown_connections 2024-04-26T07:57:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f79964d1640 1 --2- 172.21.15.1:0/4223022315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012d680 0x7f7990131d60 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f79964d1640 1 -- 172.21.15.1:0/4223022315 >> 172.21.15.1:0/4223022315 conn(0x7f799009add0 msgr2=0x7f799009b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f79964d1640 1 -- 172.21.15.1:0/4223022315 shutdown_connections 2024-04-26T07:57:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.728+0000 7f79964d1640 1 -- 172.21.15.1:0/4223022315 wait complete. 2024-04-26T07:57:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.729+0000 7f79964d1640 1 Processor -- start 2024-04-26T07:57:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.729+0000 7f79964d1640 1 -- start start 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f79964d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012c9e0 0x7f7990070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f79964d1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f79901324b0 con 0x7f799012c9e0 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f798ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012c9e0 0x7f7990070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f798ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012c9e0 0x7f7990070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35824/0 (socket says 172.21.15.1:35824) 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f798ffff640 1 -- 172.21.15.1:0/3641217740 learned_addr learned my addr 172.21.15.1:0/3641217740 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f798ffff640 1 -- 172.21.15.1:0/3641217740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79901228d0 con 0x7f799012c9e0 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f798ffff640 1 --2- 172.21.15.1:0/3641217740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012c9e0 0x7f7990070520 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f797800c380 tx=0x7f797800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f798cff9640 1 -- 172.21.15.1:0/3641217740 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7978005c10 con 0x7f799012c9e0 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f798cff9640 1 -- 172.21.15.1:0/3641217740 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7978005db0 con 0x7f799012c9e0 2024-04-26T07:57:31.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79900715d0 con 0x7f799012c9e0 2024-04-26T07:57:31.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f798cff9640 1 -- 172.21.15.1:0/3641217740 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7978004930 con 0x7f799012c9e0 2024-04-26T07:57:31.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.730+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7990072690 con 0x7f799012c9e0 2024-04-26T07:57:31.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.731+0000 7f798cff9640 1 -- 172.21.15.1:0/3641217740 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f797801a020 con 0x7f799012c9e0 2024-04-26T07:57:31.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.731+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79900636f0 con 0x7f799012c9e0 2024-04-26T07:57:31.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.731+0000 7f798cff9640 1 --2- 172.21.15.1:0/3641217740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7970038570 0x7f797003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:31.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.732+0000 7f798cff9640 1 -- 172.21.15.1:0/3641217740 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f797804b8f0 con 0x7f799012c9e0 2024-04-26T07:57:31.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.732+0000 7f798f7fe640 1 --2- 172.21.15.1:0/3641217740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7970038570 0x7f797003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:31.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.732+0000 7f798f7fe640 1 --2- 172.21.15.1:0/3641217740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7970038570 0x7f797003aa30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7980036000 tx=0x7f7980008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:31.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.736+0000 7f798cff9640 1 -- 172.21.15.1:0/3641217740 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f79780127f0 con 0x7f799012c9e0 2024-04-26T07:57:31.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.916+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f799006b6f0 con 0x7f7970038570 2024-04-26T07:57:31.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.932+0000 7f798cff9640 1 -- 172.21.15.1:0/3641217740 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665701 (secure 0 0 0) 0x7f799006b6f0 con 0x7f7970038570 2024-04-26T07:57:31.935 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:57:31.941 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7970038570 msgr2=0x7f797003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 --2- 172.21.15.1:0/3641217740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7970038570 0x7f797003aa30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7980036000 tx=0x7f7980008030 comp rx=0 tx=0).stop 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012c9e0 msgr2=0x7f7990070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 --2- 172.21.15.1:0/3641217740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012c9e0 0x7f7990070520 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f797800c380 tx=0x7f797800c840 comp rx=0 tx=0).stop 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 shutdown_connections 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 --2- 172.21.15.1:0/3641217740 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7970038570 0x7f797003aa30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 --2- 172.21.15.1:0/3641217740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f799012c9e0 0x7f7990070520 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 >> 172.21.15.1:0/3641217740 conn(0x7f799009add0 msgr2=0x7f79900978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 shutdown_connections 2024-04-26T07:57:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:31.936+0000 7f79964d1640 1 -- 172.21.15.1:0/3641217740 wait complete. 2024-04-26T07:57:31.945 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-04-26T07:57:30.868555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4887,"num_read_kb":4464,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177748,"kb_used_data":40564,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309612,"statfs":{"total":386547056640,"available":386365042688,"internally_reserved":0,"allocated":41537536,"data_stored":40441298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003453"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.633565+0000","last_change":"2024-04-26T07:54:15.021756+0000","last_active":"2024-04-26T07:56:23.633565+0000","last_peered":"2024-04-26T07:56:23.633565+0000","last_clean":"2024-04-26T07:56:23.633565+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:56:23.633565+0000","last_undegraded":"2024-04-26T07:56:23.633565+0000","last_fullsized":"2024-04-26T07:56:23.633565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895004+0000","last_change":"2024-04-26T07:54:17.007567+0000","last_active":"2024-04-26T07:56:49.895004+0000","last_peered":"2024-04-26T07:56:49.895004+0000","last_clean":"2024-04-26T07:56:49.895004+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:56:49.895004+0000","last_undegraded":"2024-04-26T07:56:49.895004+0000","last_fullsized":"2024-04-26T07:56:49.895004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050522+0000","last_change":"2024-04-26T07:54:15.008962+0000","last_active":"2024-04-26T07:55:02.050522+0000","last_peered":"2024-04-26T07:55:02.050522+0000","last_clean":"2024-04-26T07:55:02.050522+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:55:02.050522+0000","last_undegraded":"2024-04-26T07:55:02.050522+0000","last_fullsized":"2024-04-26T07:55:02.050522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.209457+0000","last_change":"2024-04-26T07:54:17.015486+0000","last_active":"2024-04-26T07:57:24.209457+0000","last_peered":"2024-04-26T07:57:24.209457+0000","last_clean":"2024-04-26T07:57:24.209457+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:57:24.209457+0000","last_undegraded":"2024-04-26T07:57:24.209457+0000","last_fullsized":"2024-04-26T07:57:24.209457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:22.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049119+0000","last_change":"2024-04-26T07:54:15.026276+0000","last_active":"2024-04-26T07:55:02.049119+0000","last_peered":"2024-04-26T07:55:02.049119+0000","last_clean":"2024-04-26T07:55:02.049119+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:55:02.049119+0000","last_undegraded":"2024-04-26T07:55:02.049119+0000","last_fullsized":"2024-04-26T07:55:02.049119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:33.771147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511438+0000","last_change":"2024-04-26T07:54:17.018611+0000","last_active":"2024-04-26T07:57:24.511438+0000","last_peered":"2024-04-26T07:57:24.511438+0000","last_clean":"2024-04-26T07:57:24.511438+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:24.511438+0000","last_undegraded":"2024-04-26T07:57:24.511438+0000","last_fullsized":"2024-04-26T07:57:24.511438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:15.151809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054671+0000","last_change":"2024-04-26T07:54:15.020803+0000","last_active":"2024-04-26T07:55:02.054671+0000","last_peered":"2024-04-26T07:55:02.054671+0000","last_clean":"2024-04-26T07:55:02.054671+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:55:02.054671+0000","last_undegraded":"2024-04-26T07:55:02.054671+0000","last_fullsized":"2024-04-26T07:55:02.054671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047930+0000","last_change":"2024-04-26T07:54:17.011187+0000","last_active":"2024-04-26T07:55:02.047930+0000","last_peered":"2024-04-26T07:55:02.047930+0000","last_clean":"2024-04-26T07:55:02.047930+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:55:02.047930+0000","last_undegraded":"2024-04-26T07:55:02.047930+0000","last_fullsized":"2024-04-26T07:55:02.047930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:47.382429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047464+0000","last_change":"2024-04-26T07:54:15.025367+0000","last_active":"2024-04-26T07:55:02.047464+0000","last_peered":"2024-04-26T07:55:02.047464+0000","last_clean":"2024-04-26T07:55:02.047464+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:55:02.047464+0000","last_undegraded":"2024-04-26T07:55:02.047464+0000","last_fullsized":"2024-04-26T07:55:02.047464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:02.114318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511501+0000","last_change":"2024-04-26T07:54:17.001492+0000","last_active":"2024-04-26T07:57:24.511501+0000","last_peered":"2024-04-26T07:57:24.511501+0000","last_clean":"2024-04-26T07:57:24.511501+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:57:24.511501+0000","last_undegraded":"2024-04-26T07:57:24.511501+0000","last_fullsized":"2024-04-26T07:57:24.511501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:09.013983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.506545+0000","last_change":"2024-04-26T07:54:15.019896+0000","last_active":"2024-04-26T07:57:24.506545+0000","last_peered":"2024-04-26T07:57:24.506545+0000","last_clean":"2024-04-26T07:57:24.506545+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:57:24.506545+0000","last_undegraded":"2024-04-26T07:57:24.506545+0000","last_fullsized":"2024-04-26T07:57:24.506545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:42.204889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511288+0000","last_change":"2024-04-26T07:54:17.018051+0000","last_active":"2024-04-26T07:57:24.511288+0000","last_peered":"2024-04-26T07:57:24.511288+0000","last_clean":"2024-04-26T07:57:24.511288+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:24.511288+0000","last_undegraded":"2024-04-26T07:57:24.511288+0000","last_fullsized":"2024-04-26T07:57:24.511288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:26.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.170249+0000","last_change":"2024-04-26T07:54:15.021920+0000","last_active":"2024-04-26T07:57:24.170249+0000","last_peered":"2024-04-26T07:57:24.170249+0000","last_clean":"2024-04-26T07:57:24.170249+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:57:24.170249+0000","last_undegraded":"2024-04-26T07:57:24.170249+0000","last_fullsized":"2024-04-26T07:57:24.170249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:35.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.615508+0000","last_change":"2024-04-26T07:54:17.016378+0000","last_active":"2024-04-26T07:56:20.615508+0000","last_peered":"2024-04-26T07:56:20.615508+0000","last_clean":"2024-04-26T07:56:20.615508+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:56:20.615508+0000","last_undegraded":"2024-04-26T07:56:20.615508+0000","last_fullsized":"2024-04-26T07:56:20.615508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047579+0000","last_change":"2024-04-26T07:54:15.008904+0000","last_active":"2024-04-26T07:55:02.047579+0000","last_peered":"2024-04-26T07:55:02.047579+0000","last_clean":"2024-04-26T07:55:02.047579+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:55:02.047579+0000","last_undegraded":"2024-04-26T07:55:02.047579+0000","last_fullsized":"2024-04-26T07:55:02.047579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207539+0000","last_change":"2024-04-26T07:54:17.011542+0000","last_active":"2024-04-26T07:57:24.207539+0000","last_peered":"2024-04-26T07:57:24.207539+0000","last_clean":"2024-04-26T07:57:24.207539+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:57:24.207539+0000","last_undegraded":"2024-04-26T07:57:24.207539+0000","last_fullsized":"2024-04-26T07:57:24.207539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143674+0000","last_change":"2024-04-26T07:54:17.018794+0000","last_active":"2024-04-26T07:55:40.143674+0000","last_peered":"2024-04-26T07:55:40.143674+0000","last_clean":"2024-04-26T07:55:40.143674+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:55:40.143674+0000","last_undegraded":"2024-04-26T07:55:40.143674+0000","last_fullsized":"2024-04-26T07:55:40.143674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:25.624134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054524+0000","last_change":"2024-04-26T07:54:15.020059+0000","last_active":"2024-04-26T07:55:02.054524+0000","last_peered":"2024-04-26T07:55:02.054524+0000","last_clean":"2024-04-26T07:55:02.054524+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:55:02.054524+0000","last_undegraded":"2024-04-26T07:55:02.054524+0000","last_fullsized":"2024-04-26T07:55:02.054524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.614746+0000","last_change":"2024-04-26T07:54:17.007162+0000","last_active":"2024-04-26T07:56:20.614746+0000","last_peered":"2024-04-26T07:56:20.614746+0000","last_clean":"2024-04-26T07:56:20.614746+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:56:20.614746+0000","last_undegraded":"2024-04-26T07:56:20.614746+0000","last_fullsized":"2024-04-26T07:56:20.614746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057735+0000","last_change":"2024-04-26T07:54:15.023259+0000","last_active":"2024-04-26T07:55:02.057735+0000","last_peered":"2024-04-26T07:55:02.057735+0000","last_clean":"2024-04-26T07:55:02.057735+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:55:02.057735+0000","last_undegraded":"2024-04-26T07:55:02.057735+0000","last_fullsized":"2024-04-26T07:55:02.057735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.295581+0000","last_change":"2024-04-26T07:54:17.016377+0000","last_active":"2024-04-26T07:57:24.295581+0000","last_peered":"2024-04-26T07:57:24.295581+0000","last_clean":"2024-04-26T07:57:24.295581+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:24.295581+0000","last_undegraded":"2024-04-26T07:57:24.295581+0000","last_fullsized":"2024-04-26T07:57:24.295581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:20.487011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048878+0000","last_change":"2024-04-26T07:54:15.017989+0000","last_active":"2024-04-26T07:55:02.048878+0000","last_peered":"2024-04-26T07:55:02.048878+0000","last_clean":"2024-04-26T07:55:02.048878+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:55:02.048878+0000","last_undegraded":"2024-04-26T07:55:02.048878+0000","last_fullsized":"2024-04-26T07:55:02.048878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.215781+0000","last_change":"2024-04-26T07:54:17.011769+0000","last_active":"2024-04-26T07:57:24.215781+0000","last_peered":"2024-04-26T07:57:24.215781+0000","last_clean":"2024-04-26T07:57:24.215781+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:57:24.215781+0000","last_undegraded":"2024-04-26T07:57:24.215781+0000","last_fullsized":"2024-04-26T07:57:24.215781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055070+0000","last_change":"2024-04-26T07:54:15.017753+0000","last_active":"2024-04-26T07:55:02.055070+0000","last_peered":"2024-04-26T07:55:02.055070+0000","last_clean":"2024-04-26T07:55:02.055070+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:55:02.055070+0000","last_undegraded":"2024-04-26T07:55:02.055070+0000","last_fullsized":"2024-04-26T07:55:02.055070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143749+0000","last_change":"2024-04-26T07:54:17.012327+0000","last_active":"2024-04-26T07:55:40.143749+0000","last_peered":"2024-04-26T07:55:40.143749+0000","last_clean":"2024-04-26T07:55:40.143749+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:55:40.143749+0000","last_undegraded":"2024-04-26T07:55:40.143749+0000","last_fullsized":"2024-04-26T07:55:40.143749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049152+0000","last_change":"2024-04-26T07:54:15.008684+0000","last_active":"2024-04-26T07:55:02.049152+0000","last_peered":"2024-04-26T07:55:02.049152+0000","last_clean":"2024-04-26T07:55:02.049152+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:55:02.049152+0000","last_undegraded":"2024-04-26T07:55:02.049152+0000","last_fullsized":"2024-04-26T07:55:02.049152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511606+0000","last_change":"2024-04-26T07:54:16.998745+0000","last_active":"2024-04-26T07:57:24.511606+0000","last_peered":"2024-04-26T07:57:24.511606+0000","last_clean":"2024-04-26T07:57:24.511606+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:57:24.511606+0000","last_undegraded":"2024-04-26T07:57:24.511606+0000","last_fullsized":"2024-04-26T07:57:24.511606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:13.730381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047329+0000","last_change":"2024-04-26T07:54:15.017883+0000","last_active":"2024-04-26T07:55:02.047329+0000","last_peered":"2024-04-26T07:55:02.047329+0000","last_clean":"2024-04-26T07:55:02.047329+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:55:02.047329+0000","last_undegraded":"2024-04-26T07:55:02.047329+0000","last_fullsized":"2024-04-26T07:55:02.047329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:44.995414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.463089+0000","last_change":"2024-04-26T07:54:25.037823+0000","last_active":"2024-04-26T07:57:24.463089+0000","last_peered":"2024-04-26T07:57:24.463089+0000","last_clean":"2024-04-26T07:57:24.463089+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:57:24.463089+0000","last_undegraded":"2024-04-26T07:57:24.463089+0000","last_fullsized":"2024-04-26T07:57:24.463089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.012082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'13","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489530+0000","last_change":"2024-04-26T07:54:17.010298+0000","last_active":"2024-04-26T07:57:24.489530+0000","last_peered":"2024-04-26T07:57:24.489530+0000","last_clean":"2024-04-26T07:57:24.489530+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:57:24.489530+0000","last_undegraded":"2024-04-26T07:57:24.489530+0000","last_fullsized":"2024-04-26T07:57:24.489530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:38.486309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892998+0000","last_change":"2024-04-26T07:54:15.028485+0000","last_active":"2024-04-26T07:56:34.892998+0000","last_peered":"2024-04-26T07:56:34.892998+0000","last_clean":"2024-04-26T07:56:34.892998+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:56:34.892998+0000","last_undegraded":"2024-04-26T07:56:34.892998+0000","last_fullsized":"2024-04-26T07:56:34.892998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:43.230145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047546+0000","last_change":"2024-04-26T07:54:19.013097+0000","last_active":"2024-04-26T07:55:02.047546+0000","last_peered":"2024-04-26T07:55:02.047546+0000","last_clean":"2024-04-26T07:55:02.047546+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:55:02.047546+0000","last_undegraded":"2024-04-26T07:55:02.047546+0000","last_fullsized":"2024-04-26T07:55:02.047546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:06.684753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.351988+0000","last_change":"2024-04-26T07:54:21.023071+0000","last_active":"2024-04-26T07:56:22.351988+0000","last_peered":"2024-04-26T07:56:22.351988+0000","last_clean":"2024-04-26T07:56:22.351988+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:56:22.351988+0000","last_undegraded":"2024-04-26T07:56:22.351988+0000","last_fullsized":"2024-04-26T07:56:22.351988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:31.663330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054306+0000","last_change":"2024-04-26T07:54:23.030948+0000","last_active":"2024-04-26T07:55:02.054306+0000","last_peered":"2024-04-26T07:55:02.054306+0000","last_clean":"2024-04-26T07:55:02.054306+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:55:02.054306+0000","last_undegraded":"2024-04-26T07:55:02.054306+0000","last_fullsized":"2024-04-26T07:55:02.054306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:09.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.570875+0000","last_change":"2024-04-26T07:54:25.029434+0000","last_active":"2024-04-26T07:57:24.570875+0000","last_peered":"2024-04-26T07:57:24.570875+0000","last_clean":"2024-04-26T07:57:24.570875+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:24.570875+0000","last_undegraded":"2024-04-26T07:57:24.570875+0000","last_fullsized":"2024-04-26T07:57:24.570875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:48.982630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.301766+0000","last_change":"2024-04-26T07:54:17.010194+0000","last_active":"2024-04-26T07:57:24.301766+0000","last_peered":"2024-04-26T07:57:24.301766+0000","last_clean":"2024-04-26T07:57:24.301766+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:57:24.301766+0000","last_undegraded":"2024-04-26T07:57:24.301766+0000","last_fullsized":"2024-04-26T07:57:24.301766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.230278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053713+0000","last_change":"2024-04-26T07:54:15.018699+0000","last_active":"2024-04-26T07:55:02.053713+0000","last_peered":"2024-04-26T07:55:02.053713+0000","last_clean":"2024-04-26T07:55:02.053713+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:55:02.053713+0000","last_undegraded":"2024-04-26T07:55:02.053713+0000","last_fullsized":"2024-04-26T07:55:02.053713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:44.643100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'4","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.408334+0000","last_change":"2024-04-26T07:55:02.067003+0000","last_active":"2024-04-26T07:56:23.408334+0000","last_peered":"2024-04-26T07:56:23.408334+0000","last_clean":"2024-04-26T07:56:23.408334+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:56:23.408334+0000","last_undegraded":"2024-04-26T07:56:23.408334+0000","last_fullsized":"2024-04-26T07:56:23.408334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:29.656543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"27'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053400+0000","last_change":"2024-04-26T07:54:21.015968+0000","last_active":"2024-04-26T07:55:02.053400+0000","last_peered":"2024-04-26T07:55:02.053400+0000","last_clean":"2024-04-26T07:55:02.053400+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:55:02.053400+0000","last_undegraded":"2024-04-26T07:55:02.053400+0000","last_fullsized":"2024-04-26T07:55:02.053400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:13.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050187+0000","last_change":"2024-04-26T07:54:23.035869+0000","last_active":"2024-04-26T07:55:02.050187+0000","last_peered":"2024-04-26T07:55:02.050187+0000","last_clean":"2024-04-26T07:55:02.050187+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:55:02.050187+0000","last_undegraded":"2024-04-26T07:55:02.050187+0000","last_fullsized":"2024-04-26T07:55:02.050187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:57.195185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047465+0000","last_change":"2024-04-26T07:54:25.027104+0000","last_active":"2024-04-26T07:55:02.047465+0000","last_peered":"2024-04-26T07:55:02.047465+0000","last_clean":"2024-04-26T07:55:02.047465+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:55:02.047465+0000","last_undegraded":"2024-04-26T07:55:02.047465+0000","last_fullsized":"2024-04-26T07:55:02.047465+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:04.495335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:04.879358+0000","last_change":"2024-04-26T07:55:02.065992+0000","last_active":"2024-04-26T07:55:04.879358+0000","last_peered":"2024-04-26T07:55:04.879358+0000","last_clean":"2024-04-26T07:55:04.879358+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:55:04.879358+0000","last_undegraded":"2024-04-26T07:55:04.879358+0000","last_fullsized":"2024-04-26T07:55:04.879358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:09.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045977+0000","last_change":"2024-04-26T07:54:15.028375+0000","last_active":"2024-04-26T07:55:02.045977+0000","last_peered":"2024-04-26T07:55:02.045977+0000","last_clean":"2024-04-26T07:55:02.045977+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:55:02.045977+0000","last_undegraded":"2024-04-26T07:55:02.045977+0000","last_fullsized":"2024-04-26T07:55:02.045977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:32.915801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050812+0000","last_change":"2024-04-26T07:54:19.014182+0000","last_active":"2024-04-26T07:55:02.050812+0000","last_peered":"2024-04-26T07:55:02.050812+0000","last_clean":"2024-04-26T07:55:02.050812+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:55:02.050812+0000","last_undegraded":"2024-04-26T07:55:02.050812+0000","last_fullsized":"2024-04-26T07:55:02.050812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:14.365835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.145043+0000","last_change":"2024-04-26T07:54:21.024658+0000","last_active":"2024-04-26T07:55:40.145043+0000","last_peered":"2024-04-26T07:55:40.145043+0000","last_clean":"2024-04-26T07:55:40.145043+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:55:40.145043+0000","last_undegraded":"2024-04-26T07:55:40.145043+0000","last_fullsized":"2024-04-26T07:55:40.145043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:25.233916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":385,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.630004+0000","last_change":"2024-04-26T07:54:23.036180+0000","last_active":"2024-04-26T07:57:24.630004+0000","last_peered":"2024-04-26T07:57:24.630004+0000","last_clean":"2024-04-26T07:57:24.630004+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:57:24.630004+0000","last_undegraded":"2024-04-26T07:57:24.630004+0000","last_fullsized":"2024-04-26T07:57:24.630004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:08.558861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053408+0000","last_change":"2024-04-26T07:54:25.027799+0000","last_active":"2024-04-26T07:55:02.053408+0000","last_peered":"2024-04-26T07:55:02.053408+0000","last_clean":"2024-04-26T07:55:02.053408+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:55:02.053408+0000","last_undegraded":"2024-04-26T07:55:02.053408+0000","last_fullsized":"2024-04-26T07:55:02.053408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:35.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438362+0000","last_change":"2024-04-26T07:54:17.006664+0000","last_active":"2024-04-26T07:57:24.438362+0000","last_peered":"2024-04-26T07:57:24.438362+0000","last_clean":"2024-04-26T07:57:24.438362+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:57:24.438362+0000","last_undegraded":"2024-04-26T07:57:24.438362+0000","last_fullsized":"2024-04-26T07:57:24.438362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049744+0000","last_change":"2024-04-26T07:54:15.020158+0000","last_active":"2024-04-26T07:55:02.049744+0000","last_peered":"2024-04-26T07:55:02.049744+0000","last_clean":"2024-04-26T07:55:02.049744+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:55:02.049744+0000","last_undegraded":"2024-04-26T07:55:02.049744+0000","last_fullsized":"2024-04-26T07:55:02.049744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:33.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.060242+0000","last_change":"2024-04-26T07:55:02.059077+0000","last_active":"2024-04-26T07:55:02.060242+0000","last_peered":"2024-04-26T07:55:02.060242+0000","last_clean":"2024-04-26T07:55:02.060242+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:55:02.060242+0000","last_undegraded":"2024-04-26T07:55:02.060242+0000","last_fullsized":"2024-04-26T07:55:02.060242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:20.105862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.346496+0000","last_change":"2024-04-26T07:54:21.022437+0000","last_active":"2024-04-26T07:56:22.346496+0000","last_peered":"2024-04-26T07:56:22.346496+0000","last_clean":"2024-04-26T07:56:22.346496+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:56:22.346496+0000","last_undegraded":"2024-04-26T07:56:22.346496+0000","last_fullsized":"2024-04-26T07:56:22.346496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:43.415554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.514862+0000","last_change":"2024-04-26T07:54:23.029180+0000","last_active":"2024-04-26T07:57:24.514862+0000","last_peered":"2024-04-26T07:57:24.514862+0000","last_clean":"2024-04-26T07:57:24.514862+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:24.514862+0000","last_undegraded":"2024-04-26T07:57:24.514862+0000","last_fullsized":"2024-04-26T07:57:24.514862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:27.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892086+0000","last_change":"2024-04-26T07:54:17.018068+0000","last_active":"2024-04-26T07:56:29.892086+0000","last_peered":"2024-04-26T07:56:29.892086+0000","last_clean":"2024-04-26T07:56:29.892086+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:56:29.892086+0000","last_undegraded":"2024-04-26T07:56:29.892086+0000","last_fullsized":"2024-04-26T07:56:29.892086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:46.004871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.058116+0000","last_change":"2024-04-26T07:54:15.021552+0000","last_active":"2024-04-26T07:55:02.058116+0000","last_peered":"2024-04-26T07:55:02.058116+0000","last_clean":"2024-04-26T07:55:02.058116+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:55:02.058116+0000","last_undegraded":"2024-04-26T07:55:02.058116+0000","last_fullsized":"2024-04-26T07:55:02.058116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048189+0000","last_change":"2024-04-26T07:54:19.017311+0000","last_active":"2024-04-26T07:55:02.048189+0000","last_peered":"2024-04-26T07:55:02.048189+0000","last_clean":"2024-04-26T07:55:02.048189+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:55:02.048189+0000","last_undegraded":"2024-04-26T07:55:02.048189+0000","last_fullsized":"2024-04-26T07:55:02.048189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:28.216267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.356414+0000","last_change":"2024-04-26T07:54:21.017174+0000","last_active":"2024-04-26T07:56:22.356414+0000","last_peered":"2024-04-26T07:56:22.356414+0000","last_clean":"2024-04-26T07:56:22.356414+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:56:22.356414+0000","last_undegraded":"2024-04-26T07:56:22.356414+0000","last_fullsized":"2024-04-26T07:56:22.356414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:32.852893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048871+0000","last_change":"2024-04-26T07:54:23.028206+0000","last_active":"2024-04-26T07:55:02.048871+0000","last_peered":"2024-04-26T07:55:02.048871+0000","last_clean":"2024-04-26T07:55:02.048871+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:55:02.048871+0000","last_undegraded":"2024-04-26T07:55:02.048871+0000","last_fullsized":"2024-04-26T07:55:02.048871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:39.298078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.965189+0000","last_change":"2024-04-26T07:54:25.038132+0000","last_active":"2024-04-26T07:55:39.965189+0000","last_peered":"2024-04-26T07:55:39.965189+0000","last_clean":"2024-04-26T07:55:39.965189+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:55:39.965189+0000","last_undegraded":"2024-04-26T07:55:39.965189+0000","last_fullsized":"2024-04-26T07:55:39.965189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:39.692413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511248+0000","last_change":"2024-04-26T07:54:16.999342+0000","last_active":"2024-04-26T07:57:24.511248+0000","last_peered":"2024-04-26T07:57:24.511248+0000","last_clean":"2024-04-26T07:57:24.511248+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:57:24.511248+0000","last_undegraded":"2024-04-26T07:57:24.511248+0000","last_fullsized":"2024-04-26T07:57:24.511248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:50.720873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055973+0000","last_change":"2024-04-26T07:54:15.021572+0000","last_active":"2024-04-26T07:55:02.055973+0000","last_peered":"2024-04-26T07:55:02.055973+0000","last_clean":"2024-04-26T07:55:02.055973+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:55:02.055973+0000","last_undegraded":"2024-04-26T07:55:02.055973+0000","last_fullsized":"2024-04-26T07:55:02.055973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047802+0000","last_change":"2024-04-26T07:54:19.014010+0000","last_active":"2024-04-26T07:55:02.047802+0000","last_peered":"2024-04-26T07:55:02.047802+0000","last_clean":"2024-04-26T07:55:02.047802+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:55:02.047802+0000","last_undegraded":"2024-04-26T07:55:02.047802+0000","last_fullsized":"2024-04-26T07:55:02.047802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:51.749121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893869+0000","last_change":"2024-04-26T07:54:21.021470+0000","last_active":"2024-04-26T07:56:39.893869+0000","last_peered":"2024-04-26T07:56:39.893869+0000","last_clean":"2024-04-26T07:56:39.893869+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:56:39.893869+0000","last_undegraded":"2024-04-26T07:56:39.893869+0000","last_fullsized":"2024-04-26T07:56:39.893869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.505241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047573+0000","last_change":"2024-04-26T07:54:23.028229+0000","last_active":"2024-04-26T07:55:02.047573+0000","last_peered":"2024-04-26T07:55:02.047573+0000","last_clean":"2024-04-26T07:55:02.047573+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:55:02.047573+0000","last_undegraded":"2024-04-26T07:55:02.047573+0000","last_fullsized":"2024-04-26T07:55:02.047573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:37.685058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:34.432492+0000","last_change":"2024-04-26T07:54:25.031077+0000","last_active":"2024-04-26T07:55:34.432492+0000","last_peered":"2024-04-26T07:55:34.432492+0000","last_clean":"2024-04-26T07:55:34.432492+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:55:34.432492+0000","last_undegraded":"2024-04-26T07:55:34.432492+0000","last_fullsized":"2024-04-26T07:55:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:53.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891503+0000","last_change":"2024-04-26T07:54:17.015501+0000","last_active":"2024-04-26T07:56:29.891503+0000","last_peered":"2024-04-26T07:56:29.891503+0000","last_clean":"2024-04-26T07:56:29.891503+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:56:29.891503+0000","last_undegraded":"2024-04-26T07:56:29.891503+0000","last_fullsized":"2024-04-26T07:56:29.891503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:45.257757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048885+0000","last_change":"2024-04-26T07:54:15.026188+0000","last_active":"2024-04-26T07:55:02.048885+0000","last_peered":"2024-04-26T07:55:02.048885+0000","last_clean":"2024-04-26T07:55:02.048885+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:55:02.048885+0000","last_undegraded":"2024-04-26T07:55:02.048885+0000","last_fullsized":"2024-04-26T07:55:02.048885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:34.359927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049912+0000","last_change":"2024-04-26T07:54:19.014021+0000","last_active":"2024-04-26T07:55:02.049912+0000","last_peered":"2024-04-26T07:55:02.049912+0000","last_clean":"2024-04-26T07:55:02.049912+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:55:02.049912+0000","last_undegraded":"2024-04-26T07:55:02.049912+0000","last_fullsized":"2024-04-26T07:55:02.049912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:28.216267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.358572+0000","last_change":"2024-04-26T07:54:21.021799+0000","last_active":"2024-04-26T07:56:22.358572+0000","last_peered":"2024-04-26T07:56:22.358572+0000","last_clean":"2024-04-26T07:56:22.358572+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:56:22.358572+0000","last_undegraded":"2024-04-26T07:56:22.358572+0000","last_fullsized":"2024-04-26T07:56:22.358572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:22.358993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":348,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.641002+0000","last_change":"2024-04-26T07:54:23.023487+0000","last_active":"2024-04-26T07:57:24.641002+0000","last_peered":"2024-04-26T07:57:24.641002+0000","last_clean":"2024-04-26T07:57:24.641002+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:24.641002+0000","last_undegraded":"2024-04-26T07:57:24.641002+0000","last_fullsized":"2024-04-26T07:57:24.641002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.968900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049165+0000","last_change":"2024-04-26T07:54:25.030802+0000","last_active":"2024-04-26T07:55:02.049165+0000","last_peered":"2024-04-26T07:55:02.049165+0000","last_clean":"2024-04-26T07:55:02.049165+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:55:02.049165+0000","last_undegraded":"2024-04-26T07:55:02.049165+0000","last_fullsized":"2024-04-26T07:55:02.049165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:55.721790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'7","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.488370+0000","last_change":"2024-04-26T07:54:17.003162+0000","last_active":"2024-04-26T07:57:24.488370+0000","last_peered":"2024-04-26T07:57:24.488370+0000","last_clean":"2024-04-26T07:57:24.488370+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:24.488370+0000","last_undegraded":"2024-04-26T07:57:24.488370+0000","last_fullsized":"2024-04-26T07:57:24.488370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:24.843992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047648+0000","last_change":"2024-04-26T07:54:15.029358+0000","last_active":"2024-04-26T07:55:02.047648+0000","last_peered":"2024-04-26T07:55:02.047648+0000","last_clean":"2024-04-26T07:55:02.047648+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:55:02.047648+0000","last_undegraded":"2024-04-26T07:55:02.047648+0000","last_fullsized":"2024-04-26T07:55:02.047648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.653945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048162+0000","last_change":"2024-04-26T07:54:19.011909+0000","last_active":"2024-04-26T07:55:02.048162+0000","last_peered":"2024-04-26T07:55:02.048162+0000","last_clean":"2024-04-26T07:55:02.048162+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:55:02.048162+0000","last_undegraded":"2024-04-26T07:55:02.048162+0000","last_fullsized":"2024-04-26T07:55:02.048162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:27.746901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'55","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.806242+0000","last_change":"2024-04-26T07:54:21.021179+0000","last_active":"2024-04-26T07:56:23.806242+0000","last_peered":"2024-04-26T07:56:23.806242+0000","last_clean":"2024-04-26T07:56:23.806242+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:56:23.806242+0000","last_undegraded":"2024-04-26T07:56:23.806242+0000","last_fullsized":"2024-04-26T07:56:23.806242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:42.295311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047462+0000","last_change":"2024-04-26T07:54:23.025278+0000","last_active":"2024-04-26T07:55:02.047462+0000","last_peered":"2024-04-26T07:55:02.047462+0000","last_clean":"2024-04-26T07:55:02.047462+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:55:02.047462+0000","last_undegraded":"2024-04-26T07:55:02.047462+0000","last_fullsized":"2024-04-26T07:55:02.047462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:56.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.615064+0000","last_change":"2024-04-26T07:54:25.034316+0000","last_active":"2024-04-26T07:57:24.615064+0000","last_peered":"2024-04-26T07:57:24.615064+0000","last_clean":"2024-04-26T07:57:24.615064+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:57:24.615064+0000","last_undegraded":"2024-04-26T07:57:24.615064+0000","last_fullsized":"2024-04-26T07:57:24.615064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:26.372578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053141+0000","last_change":"2024-04-26T07:54:17.013013+0000","last_active":"2024-04-26T07:55:02.053141+0000","last_peered":"2024-04-26T07:55:02.053141+0000","last_clean":"2024-04-26T07:55:02.053141+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:55:02.053141+0000","last_undegraded":"2024-04-26T07:55:02.053141+0000","last_fullsized":"2024-04-26T07:55:02.053141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:20.449523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048743+0000","last_change":"2024-04-26T07:54:15.001977+0000","last_active":"2024-04-26T07:55:02.048743+0000","last_peered":"2024-04-26T07:55:02.048743+0000","last_clean":"2024-04-26T07:55:02.048743+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:55:02.048743+0000","last_undegraded":"2024-04-26T07:55:02.048743+0000","last_fullsized":"2024-04-26T07:55:02.048743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055480+0000","last_change":"2024-04-26T07:54:19.016120+0000","last_active":"2024-04-26T07:55:02.055480+0000","last_peered":"2024-04-26T07:55:02.055480+0000","last_clean":"2024-04-26T07:55:02.055480+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:55:02.055480+0000","last_undegraded":"2024-04-26T07:55:02.055480+0000","last_fullsized":"2024-04-26T07:55:02.055480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:50.686377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.340595+0000","last_change":"2024-04-26T07:54:21.015734+0000","last_active":"2024-04-26T07:56:22.340595+0000","last_peered":"2024-04-26T07:56:22.340595+0000","last_clean":"2024-04-26T07:56:22.340595+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:56:22.340595+0000","last_undegraded":"2024-04-26T07:56:22.340595+0000","last_fullsized":"2024-04-26T07:56:22.340595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:01.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051951+0000","last_change":"2024-04-26T07:54:23.029968+0000","last_active":"2024-04-26T07:55:02.051951+0000","last_peered":"2024-04-26T07:55:02.051951+0000","last_clean":"2024-04-26T07:55:02.051951+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:55:02.051951+0000","last_undegraded":"2024-04-26T07:55:02.051951+0000","last_fullsized":"2024-04-26T07:55:02.051951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:29:48.620441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891158+0000","last_change":"2024-04-26T07:54:25.037903+0000","last_active":"2024-04-26T07:56:24.891158+0000","last_peered":"2024-04-26T07:56:24.891158+0000","last_clean":"2024-04-26T07:56:24.891158+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:56:24.891158+0000","last_undegraded":"2024-04-26T07:56:24.891158+0000","last_fullsized":"2024-04-26T07:56:24.891158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:45.549253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489138+0000","last_change":"2024-04-26T07:54:17.018272+0000","last_active":"2024-04-26T07:57:24.489138+0000","last_peered":"2024-04-26T07:57:24.489138+0000","last_clean":"2024-04-26T07:57:24.489138+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:24.489138+0000","last_undegraded":"2024-04-26T07:57:24.489138+0000","last_fullsized":"2024-04-26T07:57:24.489138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.173859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047922+0000","last_change":"2024-04-26T07:54:15.023312+0000","last_active":"2024-04-26T07:55:02.047922+0000","last_peered":"2024-04-26T07:55:02.047922+0000","last_clean":"2024-04-26T07:55:02.047922+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:55:02.047922+0000","last_undegraded":"2024-04-26T07:55:02.047922+0000","last_fullsized":"2024-04-26T07:55:02.047922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:10.760572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048541+0000","last_change":"2024-04-26T07:54:19.013889+0000","last_active":"2024-04-26T07:55:02.048541+0000","last_peered":"2024-04-26T07:55:02.048541+0000","last_clean":"2024-04-26T07:55:02.048541+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:55:02.048541+0000","last_undegraded":"2024-04-26T07:55:02.048541+0000","last_fullsized":"2024-04-26T07:55:02.048541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:58.450108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.366970+0000","last_change":"2024-04-26T07:54:21.019300+0000","last_active":"2024-04-26T07:56:22.366970+0000","last_peered":"2024-04-26T07:56:22.366970+0000","last_clean":"2024-04-26T07:56:22.366970+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:56:22.366970+0000","last_undegraded":"2024-04-26T07:56:22.366970+0000","last_fullsized":"2024-04-26T07:56:22.366970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:16.372622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.619110+0000","last_change":"2024-04-26T07:54:23.029786+0000","last_active":"2024-04-26T07:57:24.619110+0000","last_peered":"2024-04-26T07:57:24.619110+0000","last_clean":"2024-04-26T07:57:24.619110+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:24.619110+0000","last_undegraded":"2024-04-26T07:57:24.619110+0000","last_fullsized":"2024-04-26T07:57:24.619110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:18.250538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'12","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885862+0000","last_change":"2024-04-26T07:54:25.029180+0000","last_active":"2024-04-26T07:56:29.885862+0000","last_peered":"2024-04-26T07:56:29.885862+0000","last_clean":"2024-04-26T07:56:29.885862+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:56:29.885862+0000","last_undegraded":"2024-04-26T07:56:29.885862+0000","last_fullsized":"2024-04-26T07:56:29.885862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:48.649422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057608+0000","last_change":"2024-04-26T07:54:17.015565+0000","last_active":"2024-04-26T07:55:02.057608+0000","last_peered":"2024-04-26T07:55:02.057608+0000","last_clean":"2024-04-26T07:55:02.057608+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:55:02.057608+0000","last_undegraded":"2024-04-26T07:55:02.057608+0000","last_fullsized":"2024-04-26T07:55:02.057608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048756+0000","last_change":"2024-04-26T07:54:15.028460+0000","last_active":"2024-04-26T07:55:02.048756+0000","last_peered":"2024-04-26T07:55:02.048756+0000","last_clean":"2024-04-26T07:55:02.048756+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:55:02.048756+0000","last_undegraded":"2024-04-26T07:55:02.048756+0000","last_fullsized":"2024-04-26T07:55:02.048756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:52.128712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.419198+0000","last_change":"2024-04-26T07:55:02.064457+0000","last_active":"2024-04-26T07:56:23.419198+0000","last_peered":"2024-04-26T07:56:23.419198+0000","last_clean":"2024-04-26T07:56:23.419198+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:56:23.419198+0000","last_undegraded":"2024-04-26T07:56:23.419198+0000","last_fullsized":"2024-04-26T07:56:23.419198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:52.346497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048343+0000","last_change":"2024-04-26T07:54:21.021896+0000","last_active":"2024-04-26T07:55:02.048343+0000","last_peered":"2024-04-26T07:55:02.048343+0000","last_clean":"2024-04-26T07:55:02.048343+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:55:02.048343+0000","last_undegraded":"2024-04-26T07:55:02.048343+0000","last_fullsized":"2024-04-26T07:55:02.048343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:54.353284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":465,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.573063+0000","last_change":"2024-04-26T07:54:23.024560+0000","last_active":"2024-04-26T07:57:24.573063+0000","last_peered":"2024-04-26T07:57:24.573063+0000","last_clean":"2024-04-26T07:57:24.573063+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:24.573063+0000","last_undegraded":"2024-04-26T07:57:24.573063+0000","last_fullsized":"2024-04-26T07:57:24.573063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:34.060931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.569763+0000","last_change":"2024-04-26T07:54:25.024615+0000","last_active":"2024-04-26T07:56:23.569763+0000","last_peered":"2024-04-26T07:56:23.569763+0000","last_clean":"2024-04-26T07:56:23.569763+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:56:23.569763+0000","last_undegraded":"2024-04-26T07:56:23.569763+0000","last_fullsized":"2024-04-26T07:56:23.569763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:33.156602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054935+0000","last_change":"2024-04-26T07:54:17.004296+0000","last_active":"2024-04-26T07:55:02.054935+0000","last_peered":"2024-04-26T07:55:02.054935+0000","last_clean":"2024-04-26T07:55:02.054935+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:55:02.054935+0000","last_undegraded":"2024-04-26T07:55:02.054935+0000","last_fullsized":"2024-04-26T07:55:02.054935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:58.770481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891219+0000","last_change":"2024-04-26T07:54:15.030153+0000","last_active":"2024-04-26T07:56:24.891219+0000","last_peered":"2024-04-26T07:56:24.891219+0000","last_clean":"2024-04-26T07:56:24.891219+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:56:24.891219+0000","last_undegraded":"2024-04-26T07:56:24.891219+0000","last_fullsized":"2024-04-26T07:56:24.891219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:22.836554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050562+0000","last_change":"2024-04-26T07:54:19.013153+0000","last_active":"2024-04-26T07:55:02.050562+0000","last_peered":"2024-04-26T07:55:02.050562+0000","last_clean":"2024-04-26T07:55:02.050562+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:55:02.050562+0000","last_undegraded":"2024-04-26T07:55:02.050562+0000","last_fullsized":"2024-04-26T07:55:02.050562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:53.488291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'40","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.353272+0000","last_change":"2024-04-26T07:54:21.017142+0000","last_active":"2024-04-26T07:56:22.353272+0000","last_peered":"2024-04-26T07:56:22.353272+0000","last_clean":"2024-04-26T07:56:22.353272+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:56:22.353272+0000","last_undegraded":"2024-04-26T07:56:22.353272+0000","last_fullsized":"2024-04-26T07:56:22.353272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:59.032052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":52,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055503+0000","last_change":"2024-04-26T07:54:23.031702+0000","last_active":"2024-04-26T07:55:02.055503+0000","last_peered":"2024-04-26T07:55:02.055503+0000","last_clean":"2024-04-26T07:55:02.055503+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:55:02.055503+0000","last_undegraded":"2024-04-26T07:55:02.055503+0000","last_fullsized":"2024-04-26T07:55:02.055503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:01.038281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.546403+0000","last_change":"2024-04-26T07:54:25.025544+0000","last_active":"2024-04-26T07:57:24.546403+0000","last_peered":"2024-04-26T07:57:24.546403+0000","last_clean":"2024-04-26T07:57:24.546403+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:24.546403+0000","last_undegraded":"2024-04-26T07:57:24.546403+0000","last_fullsized":"2024-04-26T07:57:24.546403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:27.858716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438506+0000","last_change":"2024-04-26T07:54:17.016804+0000","last_active":"2024-04-26T07:57:24.438506+0000","last_peered":"2024-04-26T07:57:24.438506+0000","last_clean":"2024-04-26T07:57:24.438506+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:57:24.438506+0000","last_undegraded":"2024-04-26T07:57:24.438506+0000","last_fullsized":"2024-04-26T07:57:24.438506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:57.906958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047957+0000","last_change":"2024-04-26T07:54:06.676207+0000","last_active":"2024-04-26T07:55:02.047957+0000","last_peered":"2024-04-26T07:55:02.047957+0000","last_clean":"2024-04-26T07:55:02.047957+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:55:02.047957+0000","last_undegraded":"2024-04-26T07:55:02.047957+0000","last_fullsized":"2024-04-26T07:55:02.047957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047634+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:55:02.047634+0000","last_peered":"2024-04-26T07:55:02.047634+0000","last_clean":"2024-04-26T07:55:02.047634+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:55:02.047634+0000","last_undegraded":"2024-04-26T07:55:02.047634+0000","last_fullsized":"2024-04-26T07:55:02.047634+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:36.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046885+0000","last_change":"2024-04-26T07:54:15.028934+0000","last_active":"2024-04-26T07:55:02.046885+0000","last_peered":"2024-04-26T07:55:02.046885+0000","last_clean":"2024-04-26T07:55:02.046885+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:55:02.046885+0000","last_undegraded":"2024-04-26T07:55:02.046885+0000","last_fullsized":"2024-04-26T07:55:02.046885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:08.381931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.419477+0000","last_change":"2024-04-26T07:54:19.011625+0000","last_active":"2024-04-26T07:56:23.419477+0000","last_peered":"2024-04-26T07:56:23.419477+0000","last_clean":"2024-04-26T07:56:23.419477+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:56:23.419477+0000","last_undegraded":"2024-04-26T07:56:23.419477+0000","last_fullsized":"2024-04-26T07:56:23.419477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:48.012115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'77","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893142+0000","last_change":"2024-04-26T07:54:21.020941+0000","last_active":"2024-04-26T07:56:34.893142+0000","last_peered":"2024-04-26T07:56:34.893142+0000","last_clean":"2024-04-26T07:56:34.893142+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:56:34.893142+0000","last_undegraded":"2024-04-26T07:56:34.893142+0000","last_fullsized":"2024-04-26T07:56:34.893142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:36.877690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049318+0000","last_change":"2024-04-26T07:54:23.021938+0000","last_active":"2024-04-26T07:55:02.049318+0000","last_peered":"2024-04-26T07:55:02.049318+0000","last_clean":"2024-04-26T07:55:02.049318+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:55:02.049318+0000","last_undegraded":"2024-04-26T07:55:02.049318+0000","last_fullsized":"2024-04-26T07:55:02.049318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:19.361863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.522146+0000","last_change":"2024-04-26T07:54:25.027148+0000","last_active":"2024-04-26T07:57:24.522146+0000","last_peered":"2024-04-26T07:57:24.522146+0000","last_clean":"2024-04-26T07:57:24.522146+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:57:24.522146+0000","last_undegraded":"2024-04-26T07:57:24.522146+0000","last_fullsized":"2024-04-26T07:57:24.522146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.915380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.208184+0000","last_change":"2024-04-26T07:54:17.013632+0000","last_active":"2024-04-26T07:57:24.208184+0000","last_peered":"2024-04-26T07:57:24.208184+0000","last_clean":"2024-04-26T07:57:24.208184+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:57:24.208184+0000","last_undegraded":"2024-04-26T07:57:24.208184+0000","last_fullsized":"2024-04-26T07:57:24.208184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:52.619357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046001+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:55:02.046001+0000","last_peered":"2024-04-26T07:55:02.046001+0000","last_clean":"2024-04-26T07:55:02.046001+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:55:02.046001+0000","last_undegraded":"2024-04-26T07:55:02.046001+0000","last_fullsized":"2024-04-26T07:55:02.046001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:57.072237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884280+0000","last_change":"2024-04-26T07:54:15.007057+0000","last_active":"2024-04-26T07:56:19.884280+0000","last_peered":"2024-04-26T07:56:19.884280+0000","last_clean":"2024-04-26T07:56:19.884280+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:56:19.884280+0000","last_undegraded":"2024-04-26T07:56:19.884280+0000","last_fullsized":"2024-04-26T07:56:19.884280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052936+0000","last_change":"2024-04-26T07:54:19.013958+0000","last_active":"2024-04-26T07:55:02.052936+0000","last_peered":"2024-04-26T07:55:02.052936+0000","last_clean":"2024-04-26T07:55:02.052936+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:55:02.052936+0000","last_undegraded":"2024-04-26T07:55:02.052936+0000","last_fullsized":"2024-04-26T07:55:02.052936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:39:03.143675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094742+0000","last_change":"2024-04-26T07:54:21.024668+0000","last_active":"2024-04-26T07:57:24.094742+0000","last_peered":"2024-04-26T07:57:24.094742+0000","last_clean":"2024-04-26T07:57:24.094742+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:24.094742+0000","last_undegraded":"2024-04-26T07:57:24.094742+0000","last_fullsized":"2024-04-26T07:57:24.094742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:16.244309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047364+0000","last_change":"2024-04-26T07:54:23.030052+0000","last_active":"2024-04-26T07:55:02.047364+0000","last_peered":"2024-04-26T07:55:02.047364+0000","last_clean":"2024-04-26T07:55:02.047364+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:55:02.047364+0000","last_undegraded":"2024-04-26T07:55:02.047364+0000","last_fullsized":"2024-04-26T07:55:02.047364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:01.995533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.470476+0000","last_change":"2024-04-26T07:54:25.030964+0000","last_active":"2024-04-26T07:57:24.470476+0000","last_peered":"2024-04-26T07:57:24.470476+0000","last_clean":"2024-04-26T07:57:24.470476+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:57:24.470476+0000","last_undegraded":"2024-04-26T07:57:24.470476+0000","last_fullsized":"2024-04-26T07:57:24.470476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:48.649422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.614234+0000","last_change":"2024-04-26T07:54:17.006840+0000","last_active":"2024-04-26T07:56:20.614234+0000","last_peered":"2024-04-26T07:56:20.614234+0000","last_clean":"2024-04-26T07:56:20.614234+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:56:20.614234+0000","last_undegraded":"2024-04-26T07:56:20.614234+0000","last_fullsized":"2024-04-26T07:56:20.614234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:09.013983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051901+0000","last_change":"2024-04-26T07:54:06.674967+0000","last_active":"2024-04-26T07:55:02.051901+0000","last_peered":"2024-04-26T07:55:02.051901+0000","last_clean":"2024-04-26T07:55:02.051901+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:55:02.051901+0000","last_undegraded":"2024-04-26T07:55:02.051901+0000","last_fullsized":"2024-04-26T07:55:02.051901+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883517+0000","last_change":"2024-04-26T07:54:15.008990+0000","last_active":"2024-04-26T07:56:14.883517+0000","last_peered":"2024-04-26T07:56:14.883517+0000","last_clean":"2024-04-26T07:56:14.883517+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:56:14.883517+0000","last_undegraded":"2024-04-26T07:56:14.883517+0000","last_fullsized":"2024-04-26T07:56:14.883517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056195+0000","last_change":"2024-04-26T07:54:19.010006+0000","last_active":"2024-04-26T07:55:02.056195+0000","last_peered":"2024-04-26T07:55:02.056195+0000","last_clean":"2024-04-26T07:55:02.056195+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:55:02.056195+0000","last_undegraded":"2024-04-26T07:55:02.056195+0000","last_fullsized":"2024-04-26T07:55:02.056195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:34.544464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094944+0000","last_change":"2024-04-26T07:54:21.019871+0000","last_active":"2024-04-26T07:57:24.094944+0000","last_peered":"2024-04-26T07:57:24.094944+0000","last_clean":"2024-04-26T07:57:24.094944+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:24.094944+0000","last_undegraded":"2024-04-26T07:57:24.094944+0000","last_fullsized":"2024-04-26T07:57:24.094944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:35.816402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049650+0000","last_change":"2024-04-26T07:54:23.023485+0000","last_active":"2024-04-26T07:55:02.049650+0000","last_peered":"2024-04-26T07:55:02.049650+0000","last_clean":"2024-04-26T07:55:02.049650+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:55:02.049650+0000","last_undegraded":"2024-04-26T07:55:02.049650+0000","last_fullsized":"2024-04-26T07:55:02.049650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:57.501307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.611531+0000","last_change":"2024-04-26T07:54:25.038740+0000","last_active":"2024-04-26T07:56:20.611531+0000","last_peered":"2024-04-26T07:56:20.611531+0000","last_clean":"2024-04-26T07:56:20.611531+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:56:20.611531+0000","last_undegraded":"2024-04-26T07:56:20.611531+0000","last_fullsized":"2024-04-26T07:56:20.611531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:57.808739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804102+0000","last_change":"2024-04-26T07:54:17.009576+0000","last_active":"2024-04-26T07:56:23.804102+0000","last_peered":"2024-04-26T07:56:23.804102+0000","last_clean":"2024-04-26T07:56:23.804102+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:56:23.804102+0000","last_undegraded":"2024-04-26T07:56:23.804102+0000","last_fullsized":"2024-04-26T07:56:23.804102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:20.449523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046393+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:55:02.046393+0000","last_peered":"2024-04-26T07:55:02.046393+0000","last_clean":"2024-04-26T07:55:02.046393+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:55:02.046393+0000","last_undegraded":"2024-04-26T07:55:02.046393+0000","last_fullsized":"2024-04-26T07:55:02.046393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:23.138091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054115+0000","last_change":"2024-04-26T07:54:15.006773+0000","last_active":"2024-04-26T07:55:02.054115+0000","last_peered":"2024-04-26T07:55:02.054115+0000","last_clean":"2024-04-26T07:55:02.054115+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:55:02.054115+0000","last_undegraded":"2024-04-26T07:55:02.054115+0000","last_fullsized":"2024-04-26T07:55:02.054115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049086+0000","last_change":"2024-04-26T07:54:19.014648+0000","last_active":"2024-04-26T07:55:02.049086+0000","last_peered":"2024-04-26T07:55:02.049086+0000","last_clean":"2024-04-26T07:55:02.049086+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:55:02.049086+0000","last_undegraded":"2024-04-26T07:55:02.049086+0000","last_fullsized":"2024-04-26T07:55:02.049086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:58.767016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.817648+0000","last_change":"2024-04-26T07:54:21.022796+0000","last_active":"2024-04-26T07:57:23.817648+0000","last_peered":"2024-04-26T07:57:23.817648+0000","last_clean":"2024-04-26T07:57:23.817648+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:57:23.817648+0000","last_undegraded":"2024-04-26T07:57:23.817648+0000","last_fullsized":"2024-04-26T07:57:23.817648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:24.141025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052195+0000","last_change":"2024-04-26T07:54:23.030753+0000","last_active":"2024-04-26T07:55:02.052195+0000","last_peered":"2024-04-26T07:55:02.052195+0000","last_clean":"2024-04-26T07:55:02.052195+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:55:02.052195+0000","last_undegraded":"2024-04-26T07:55:02.052195+0000","last_fullsized":"2024-04-26T07:55:02.052195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:10.717730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.546061+0000","last_change":"2024-04-26T07:54:25.038410+0000","last_active":"2024-04-26T07:56:23.546061+0000","last_peered":"2024-04-26T07:56:23.546061+0000","last_clean":"2024-04-26T07:56:23.546061+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:56:23.546061+0000","last_undegraded":"2024-04-26T07:56:23.546061+0000","last_fullsized":"2024-04-26T07:56:23.546061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:04.495335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804171+0000","last_change":"2024-04-26T07:54:17.011145+0000","last_active":"2024-04-26T07:56:23.804171+0000","last_peered":"2024-04-26T07:56:23.804171+0000","last_clean":"2024-04-26T07:56:23.804171+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:56:23.804171+0000","last_undegraded":"2024-04-26T07:56:23.804171+0000","last_fullsized":"2024-04-26T07:56:23.804171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:59.206585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054154+0000","last_change":"2024-04-26T07:54:15.004789+0000","last_active":"2024-04-26T07:55:02.054154+0000","last_peered":"2024-04-26T07:55:02.054154+0000","last_clean":"2024-04-26T07:55:02.054154+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:55:02.054154+0000","last_undegraded":"2024-04-26T07:55:02.054154+0000","last_fullsized":"2024-04-26T07:55:02.054154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049045+0000","last_change":"2024-04-26T07:54:06.676454+0000","last_active":"2024-04-26T07:55:02.049045+0000","last_peered":"2024-04-26T07:55:02.049045+0000","last_clean":"2024-04-26T07:55:02.049045+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:55:02.049045+0000","last_undegraded":"2024-04-26T07:55:02.049045+0000","last_fullsized":"2024-04-26T07:55:02.049045+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:01.265695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885217+0000","last_change":"2024-04-26T07:54:19.010150+0000","last_active":"2024-04-26T07:56:24.885217+0000","last_peered":"2024-04-26T07:56:24.885217+0000","last_clean":"2024-04-26T07:56:24.885217+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:56:24.885217+0000","last_undegraded":"2024-04-26T07:56:24.885217+0000","last_fullsized":"2024-04-26T07:56:24.885217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:41.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'64","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885138+0000","last_change":"2024-04-26T07:54:21.021222+0000","last_active":"2024-04-26T07:56:24.885138+0000","last_peered":"2024-04-26T07:56:24.885138+0000","last_clean":"2024-04-26T07:56:24.885138+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:56:24.885138+0000","last_undegraded":"2024-04-26T07:56:24.885138+0000","last_fullsized":"2024-04-26T07:56:24.885138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:30.470262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052555+0000","last_change":"2024-04-26T07:54:23.026937+0000","last_active":"2024-04-26T07:55:02.052555+0000","last_peered":"2024-04-26T07:55:02.052555+0000","last_clean":"2024-04-26T07:55:02.052555+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:55:02.052555+0000","last_undegraded":"2024-04-26T07:55:02.052555+0000","last_fullsized":"2024-04-26T07:55:02.052555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:48.973375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.735948+0000","last_change":"2024-04-26T07:54:25.024577+0000","last_active":"2024-04-26T07:56:23.735948+0000","last_peered":"2024-04-26T07:56:23.735948+0000","last_clean":"2024-04-26T07:56:23.735948+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:56:23.735948+0000","last_undegraded":"2024-04-26T07:56:23.735948+0000","last_fullsized":"2024-04-26T07:56:23.735948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:36.834541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294896+0000","last_change":"2024-04-26T07:55:02.058346+0000","last_active":"2024-04-26T07:57:24.294896+0000","last_peered":"2024-04-26T07:57:24.294896+0000","last_clean":"2024-04-26T07:57:24.294896+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:57:24.294896+0000","last_undegraded":"2024-04-26T07:57:24.294896+0000","last_fullsized":"2024-04-26T07:57:24.294896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:32.409505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049780+0000","last_change":"2024-04-26T07:54:15.005472+0000","last_active":"2024-04-26T07:55:02.049780+0000","last_peered":"2024-04-26T07:55:02.049780+0000","last_clean":"2024-04-26T07:55:02.049780+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:55:02.049780+0000","last_undegraded":"2024-04-26T07:55:02.049780+0000","last_fullsized":"2024-04-26T07:55:02.049780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:49.044298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048351+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:55:02.048351+0000","last_peered":"2024-04-26T07:55:02.048351+0000","last_clean":"2024-04-26T07:55:02.048351+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:55:02.048351+0000","last_undegraded":"2024-04-26T07:55:02.048351+0000","last_fullsized":"2024-04-26T07:55:02.048351+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:41.674149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046277+0000","last_change":"2024-04-26T07:54:19.009597+0000","last_active":"2024-04-26T07:55:02.046277+0000","last_peered":"2024-04-26T07:55:02.046277+0000","last_clean":"2024-04-26T07:55:02.046277+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:55:02.046277+0000","last_undegraded":"2024-04-26T07:55:02.046277+0000","last_fullsized":"2024-04-26T07:55:02.046277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:05.707431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049592+0000","last_change":"2024-04-26T07:54:21.022427+0000","last_active":"2024-04-26T07:55:02.049592+0000","last_peered":"2024-04-26T07:55:02.049592+0000","last_clean":"2024-04-26T07:55:02.049592+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:55:02.049592+0000","last_undegraded":"2024-04-26T07:55:02.049592+0000","last_fullsized":"2024-04-26T07:55:02.049592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:56.633388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":355,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094511+0000","last_change":"2024-04-26T07:54:23.024550+0000","last_active":"2024-04-26T07:57:24.094511+0000","last_peered":"2024-04-26T07:57:24.094511+0000","last_clean":"2024-04-26T07:57:24.094511+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:24.094511+0000","last_undegraded":"2024-04-26T07:57:24.094511+0000","last_fullsized":"2024-04-26T07:57:24.094511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:37.685058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.225376+0000","last_change":"2024-04-26T07:54:25.036034+0000","last_active":"2024-04-26T07:57:24.225376+0000","last_peered":"2024-04-26T07:57:24.225376+0000","last_clean":"2024-04-26T07:57:24.225376+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:57:24.225376+0000","last_undegraded":"2024-04-26T07:57:24.225376+0000","last_fullsized":"2024-04-26T07:57:24.225376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:45.968753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.295712+0000","last_change":"2024-04-26T07:54:17.017609+0000","last_active":"2024-04-26T07:57:24.295712+0000","last_peered":"2024-04-26T07:57:24.295712+0000","last_clean":"2024-04-26T07:57:24.295712+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:57:24.295712+0000","last_undegraded":"2024-04-26T07:57:24.295712+0000","last_fullsized":"2024-04-26T07:57:24.295712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:21.219885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052681+0000","last_change":"2024-04-26T07:54:15.023916+0000","last_active":"2024-04-26T07:55:02.052681+0000","last_peered":"2024-04-26T07:55:02.052681+0000","last_clean":"2024-04-26T07:55:02.052681+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:55:02.052681+0000","last_undegraded":"2024-04-26T07:55:02.052681+0000","last_fullsized":"2024-04-26T07:55:02.052681+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:40.137824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049650+0000","last_change":"2024-04-26T07:54:06.676954+0000","last_active":"2024-04-26T07:55:02.049650+0000","last_peered":"2024-04-26T07:55:02.049650+0000","last_clean":"2024-04-26T07:55:02.049650+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:55:02.049650+0000","last_undegraded":"2024-04-26T07:55:02.049650+0000","last_fullsized":"2024-04-26T07:55:02.049650+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:47.328942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048912+0000","last_change":"2024-04-26T07:54:19.015515+0000","last_active":"2024-04-26T07:55:02.048912+0000","last_peered":"2024-04-26T07:55:02.048912+0000","last_clean":"2024-04-26T07:55:02.048912+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:55:02.048912+0000","last_undegraded":"2024-04-26T07:55:02.048912+0000","last_fullsized":"2024-04-26T07:55:02.048912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:23.204322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047680+0000","last_change":"2024-04-26T07:54:21.023142+0000","last_active":"2024-04-26T07:55:02.047680+0000","last_peered":"2024-04-26T07:55:02.047680+0000","last_clean":"2024-04-26T07:55:02.047680+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:55:02.047680+0000","last_undegraded":"2024-04-26T07:55:02.047680+0000","last_fullsized":"2024-04-26T07:55:02.047680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:36.423536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.615719+0000","last_change":"2024-04-26T07:54:23.028166+0000","last_active":"2024-04-26T07:57:24.615719+0000","last_peered":"2024-04-26T07:57:24.615719+0000","last_clean":"2024-04-26T07:57:24.615719+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:24.615719+0000","last_undegraded":"2024-04-26T07:57:24.615719+0000","last_fullsized":"2024-04-26T07:57:24.615719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:34.060931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052901+0000","last_change":"2024-04-26T07:54:25.036997+0000","last_active":"2024-04-26T07:55:02.052901+0000","last_peered":"2024-04-26T07:55:02.052901+0000","last_clean":"2024-04-26T07:55:02.052901+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:55:02.052901+0000","last_undegraded":"2024-04-26T07:55:02.052901+0000","last_fullsized":"2024-04-26T07:55:02.052901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:14.259642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.482999+0000","last_change":"2024-04-26T07:54:17.009702+0000","last_active":"2024-04-26T07:57:24.482999+0000","last_peered":"2024-04-26T07:57:24.482999+0000","last_clean":"2024-04-26T07:57:24.482999+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:57:24.482999+0000","last_undegraded":"2024-04-26T07:57:24.482999+0000","last_fullsized":"2024-04-26T07:57:24.482999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.581557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.189286+0000","last_change":"2024-04-26T07:54:15.009811+0000","last_active":"2024-04-26T07:57:24.189286+0000","last_peered":"2024-04-26T07:57:24.189286+0000","last_clean":"2024-04-26T07:57:24.189286+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:57:24.189286+0000","last_undegraded":"2024-04-26T07:57:24.189286+0000","last_fullsized":"2024-04-26T07:57:24.189286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052128+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:55:02.052128+0000","last_peered":"2024-04-26T07:55:02.052128+0000","last_clean":"2024-04-26T07:55:02.052128+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:55:02.052128+0000","last_undegraded":"2024-04-26T07:55:02.052128+0000","last_fullsized":"2024-04-26T07:55:02.052128+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:13.205208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049055+0000","last_change":"2024-04-26T07:54:19.010329+0000","last_active":"2024-04-26T07:55:02.049055+0000","last_peered":"2024-04-26T07:55:02.049055+0000","last_clean":"2024-04-26T07:55:02.049055+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:55:02.049055+0000","last_undegraded":"2024-04-26T07:55:02.049055+0000","last_fullsized":"2024-04-26T07:55:02.049055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.285062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.350957+0000","last_change":"2024-04-26T07:54:21.022808+0000","last_active":"2024-04-26T07:56:22.350957+0000","last_peered":"2024-04-26T07:56:22.350957+0000","last_clean":"2024-04-26T07:56:22.350957+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:56:22.350957+0000","last_undegraded":"2024-04-26T07:56:22.350957+0000","last_fullsized":"2024-04-26T07:56:22.350957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:50.018902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048378+0000","last_change":"2024-04-26T07:54:23.024114+0000","last_active":"2024-04-26T07:55:02.048378+0000","last_peered":"2024-04-26T07:55:02.048378+0000","last_clean":"2024-04-26T07:55:02.048378+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:55:02.048378+0000","last_undegraded":"2024-04-26T07:55:02.048378+0000","last_fullsized":"2024-04-26T07:55:02.048378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:09.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057538+0000","last_change":"2024-04-26T07:54:25.027810+0000","last_active":"2024-04-26T07:55:02.057538+0000","last_peered":"2024-04-26T07:55:02.057538+0000","last_clean":"2024-04-26T07:55:02.057538+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:55:02.057538+0000","last_undegraded":"2024-04-26T07:55:02.057538+0000","last_fullsized":"2024-04-26T07:55:02.057538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:48.976255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056320+0000","last_change":"2024-04-26T07:54:25.026977+0000","last_active":"2024-04-26T07:55:02.056320+0000","last_peered":"2024-04-26T07:55:02.056320+0000","last_clean":"2024-04-26T07:55:02.056320+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:55:02.056320+0000","last_undegraded":"2024-04-26T07:55:02.056320+0000","last_fullsized":"2024-04-26T07:55:02.056320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:58.871659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.483744+0000","last_change":"2024-04-26T07:54:17.012273+0000","last_active":"2024-04-26T07:57:24.483744+0000","last_peered":"2024-04-26T07:57:24.483744+0000","last_clean":"2024-04-26T07:57:24.483744+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:57:24.483744+0000","last_undegraded":"2024-04-26T07:57:24.483744+0000","last_fullsized":"2024-04-26T07:57:24.483744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:05.420036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047619+0000","last_change":"2024-04-26T07:54:15.030451+0000","last_active":"2024-04-26T07:55:02.047619+0000","last_peered":"2024-04-26T07:55:02.047619+0000","last_clean":"2024-04-26T07:55:02.047619+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:55:02.047619+0000","last_undegraded":"2024-04-26T07:55:02.047619+0000","last_fullsized":"2024-04-26T07:55:02.047619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:06.194881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051614+0000","last_change":"2024-04-26T07:54:19.011757+0000","last_active":"2024-04-26T07:55:02.051614+0000","last_peered":"2024-04-26T07:55:02.051614+0000","last_clean":"2024-04-26T07:55:02.051614+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:55:02.051614+0000","last_undegraded":"2024-04-26T07:55:02.051614+0000","last_fullsized":"2024-04-26T07:55:02.051614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:49.389674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.357538+0000","last_change":"2024-04-26T07:54:21.019609+0000","last_active":"2024-04-26T07:56:22.357538+0000","last_peered":"2024-04-26T07:56:22.357538+0000","last_clean":"2024-04-26T07:56:22.357538+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:56:22.357538+0000","last_undegraded":"2024-04-26T07:56:22.357538+0000","last_fullsized":"2024-04-26T07:56:22.357538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:33:50.119690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047082+0000","last_change":"2024-04-26T07:54:23.032745+0000","last_active":"2024-04-26T07:55:02.047082+0000","last_peered":"2024-04-26T07:55:02.047082+0000","last_clean":"2024-04-26T07:55:02.047082+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:55:02.047082+0000","last_undegraded":"2024-04-26T07:55:02.047082+0000","last_fullsized":"2024-04-26T07:55:02.047082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:08.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.068854+0000","last_change":"2024-04-26T07:54:25.036781+0000","last_active":"2024-04-26T07:56:22.068854+0000","last_peered":"2024-04-26T07:56:22.068854+0000","last_clean":"2024-04-26T07:56:22.068854+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:56:22.068854+0000","last_undegraded":"2024-04-26T07:56:22.068854+0000","last_fullsized":"2024-04-26T07:56:22.068854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:57.686455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511454+0000","last_change":"2024-04-26T07:54:17.011329+0000","last_active":"2024-04-26T07:57:24.511454+0000","last_peered":"2024-04-26T07:57:24.511454+0000","last_clean":"2024-04-26T07:57:24.511454+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:24.511454+0000","last_undegraded":"2024-04-26T07:57:24.511454+0000","last_fullsized":"2024-04-26T07:57:24.511454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:23:51.477720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055095+0000","last_change":"2024-04-26T07:54:15.016903+0000","last_active":"2024-04-26T07:55:02.055095+0000","last_peered":"2024-04-26T07:55:02.055095+0000","last_clean":"2024-04-26T07:55:02.055095+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:55:02.055095+0000","last_undegraded":"2024-04-26T07:55:02.055095+0000","last_fullsized":"2024-04-26T07:55:02.055095+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048423+0000","last_change":"2024-04-26T07:54:19.009331+0000","last_active":"2024-04-26T07:55:02.048423+0000","last_peered":"2024-04-26T07:55:02.048423+0000","last_clean":"2024-04-26T07:55:02.048423+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:55:02.048423+0000","last_undegraded":"2024-04-26T07:55:02.048423+0000","last_fullsized":"2024-04-26T07:55:02.048423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:15.348847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.822696+0000","last_change":"2024-04-26T07:54:21.017937+0000","last_active":"2024-04-26T07:57:23.822696+0000","last_peered":"2024-04-26T07:57:23.822696+0000","last_clean":"2024-04-26T07:57:23.822696+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:23.822696+0000","last_undegraded":"2024-04-26T07:57:23.822696+0000","last_fullsized":"2024-04-26T07:57:23.822696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:26.134595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052140+0000","last_change":"2024-04-26T07:54:23.031660+0000","last_active":"2024-04-26T07:55:02.052140+0000","last_peered":"2024-04-26T07:55:02.052140+0000","last_clean":"2024-04-26T07:55:02.052140+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:55:02.052140+0000","last_undegraded":"2024-04-26T07:55:02.052140+0000","last_fullsized":"2024-04-26T07:55:02.052140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:21.172069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048627+0000","last_change":"2024-04-26T07:54:25.029345+0000","last_active":"2024-04-26T07:55:02.048627+0000","last_peered":"2024-04-26T07:55:02.048627+0000","last_clean":"2024-04-26T07:55:02.048627+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:55:02.048627+0000","last_undegraded":"2024-04-26T07:55:02.048627+0000","last_fullsized":"2024-04-26T07:55:02.048627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:30.573662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'5","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.488888+0000","last_change":"2024-04-26T07:55:02.054995+0000","last_active":"2024-04-26T07:57:24.488888+0000","last_peered":"2024-04-26T07:57:24.488888+0000","last_clean":"2024-04-26T07:57:24.488888+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:57:24.488888+0000","last_undegraded":"2024-04-26T07:57:24.488888+0000","last_fullsized":"2024-04-26T07:57:24.488888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:16:17.485859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056320+0000","last_change":"2024-04-26T07:54:15.021860+0000","last_active":"2024-04-26T07:55:02.056320+0000","last_peered":"2024-04-26T07:55:02.056320+0000","last_clean":"2024-04-26T07:55:02.056320+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:55:02.056320+0000","last_undegraded":"2024-04-26T07:55:02.056320+0000","last_fullsized":"2024-04-26T07:55:02.056320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:49.044298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051003+0000","last_change":"2024-04-26T07:54:19.014096+0000","last_active":"2024-04-26T07:55:02.051003+0000","last_peered":"2024-04-26T07:55:02.051003+0000","last_clean":"2024-04-26T07:55:02.051003+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:55:02.051003+0000","last_undegraded":"2024-04-26T07:55:02.051003+0000","last_fullsized":"2024-04-26T07:55:02.051003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:15.068431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.883027+0000","last_change":"2024-04-26T07:54:21.019068+0000","last_active":"2024-04-26T07:57:23.883027+0000","last_peered":"2024-04-26T07:57:23.883027+0000","last_clean":"2024-04-26T07:57:23.883027+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:23.883027+0000","last_undegraded":"2024-04-26T07:57:23.883027+0000","last_fullsized":"2024-04-26T07:57:23.883027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:42.500340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048368+0000","last_change":"2024-04-26T07:54:23.024354+0000","last_active":"2024-04-26T07:55:02.048368+0000","last_peered":"2024-04-26T07:55:02.048368+0000","last_clean":"2024-04-26T07:55:02.048368+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:55:02.048368+0000","last_undegraded":"2024-04-26T07:55:02.048368+0000","last_fullsized":"2024-04-26T07:55:02.048368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.968900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049310+0000","last_change":"2024-04-26T07:54:25.040358+0000","last_active":"2024-04-26T07:55:02.049310+0000","last_peered":"2024-04-26T07:55:02.049310+0000","last_clean":"2024-04-26T07:55:02.049310+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:55:02.049310+0000","last_undegraded":"2024-04-26T07:55:02.049310+0000","last_fullsized":"2024-04-26T07:55:02.049310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:35.575840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'7","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489597+0000","last_change":"2024-04-26T07:54:17.017717+0000","last_active":"2024-04-26T07:57:24.489597+0000","last_peered":"2024-04-26T07:57:24.489597+0000","last_clean":"2024-04-26T07:57:24.489597+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:57:24.489597+0000","last_undegraded":"2024-04-26T07:57:24.489597+0000","last_fullsized":"2024-04-26T07:57:24.489597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:28.838862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054198+0000","last_change":"2024-04-26T07:54:15.016622+0000","last_active":"2024-04-26T07:55:02.054198+0000","last_peered":"2024-04-26T07:55:02.054198+0000","last_clean":"2024-04-26T07:55:02.054198+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:55:02.054198+0000","last_undegraded":"2024-04-26T07:55:02.054198+0000","last_fullsized":"2024-04-26T07:55:02.054198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045982+0000","last_change":"2024-04-26T07:54:19.014674+0000","last_active":"2024-04-26T07:55:02.045982+0000","last_peered":"2024-04-26T07:55:02.045982+0000","last_clean":"2024-04-26T07:55:02.045982+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:55:02.045982+0000","last_undegraded":"2024-04-26T07:55:02.045982+0000","last_fullsized":"2024-04-26T07:55:02.045982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.182169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894113+0000","last_change":"2024-04-26T07:54:21.019559+0000","last_active":"2024-04-26T07:56:44.894113+0000","last_peered":"2024-04-26T07:56:44.894113+0000","last_clean":"2024-04-26T07:56:44.894113+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:56:44.894113+0000","last_undegraded":"2024-04-26T07:56:44.894113+0000","last_fullsized":"2024-04-26T07:56:44.894113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:30.223054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053654+0000","last_change":"2024-04-26T07:54:23.027939+0000","last_active":"2024-04-26T07:55:02.053654+0000","last_peered":"2024-04-26T07:55:02.053654+0000","last_clean":"2024-04-26T07:55:02.053654+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:55:02.053654+0000","last_undegraded":"2024-04-26T07:55:02.053654+0000","last_fullsized":"2024-04-26T07:55:02.053654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:30.224134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207208+0000","last_change":"2024-04-26T07:54:17.009497+0000","last_active":"2024-04-26T07:57:24.207208+0000","last_peered":"2024-04-26T07:57:24.207208+0000","last_clean":"2024-04-26T07:57:24.207208+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:57:24.207208+0000","last_undegraded":"2024-04-26T07:57:24.207208+0000","last_fullsized":"2024-04-26T07:57:24.207208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:55.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046088+0000","last_change":"2024-04-26T07:54:15.030594+0000","last_active":"2024-04-26T07:55:02.046088+0000","last_peered":"2024-04-26T07:55:02.046088+0000","last_clean":"2024-04-26T07:55:02.046088+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:55:02.046088+0000","last_undegraded":"2024-04-26T07:55:02.046088+0000","last_fullsized":"2024-04-26T07:55:02.046088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:29.574119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050906+0000","last_change":"2024-04-26T07:54:19.014571+0000","last_active":"2024-04-26T07:55:02.050906+0000","last_peered":"2024-04-26T07:55:02.050906+0000","last_clean":"2024-04-26T07:55:02.050906+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:55:02.050906+0000","last_undegraded":"2024-04-26T07:55:02.050906+0000","last_fullsized":"2024-04-26T07:55:02.050906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:33.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.363588+0000","last_change":"2024-04-26T07:54:21.020615+0000","last_active":"2024-04-26T07:56:22.363588+0000","last_peered":"2024-04-26T07:56:22.363588+0000","last_clean":"2024-04-26T07:56:22.363588+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:56:22.363588+0000","last_undegraded":"2024-04-26T07:56:22.363588+0000","last_fullsized":"2024-04-26T07:56:22.363588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:19.165840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054281+0000","last_change":"2024-04-26T07:54:23.028286+0000","last_active":"2024-04-26T07:55:02.054281+0000","last_peered":"2024-04-26T07:55:02.054281+0000","last_clean":"2024-04-26T07:55:02.054281+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:55:02.054281+0000","last_undegraded":"2024-04-26T07:55:02.054281+0000","last_fullsized":"2024-04-26T07:55:02.054281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:21.669790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.799225+0000","last_change":"2024-04-26T07:54:25.029358+0000","last_active":"2024-04-26T07:56:23.799225+0000","last_peered":"2024-04-26T07:56:23.799225+0000","last_clean":"2024-04-26T07:56:23.799225+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:56:23.799225+0000","last_undegraded":"2024-04-26T07:56:23.799225+0000","last_fullsized":"2024-04-26T07:56:23.799225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:53.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050746+0000","last_change":"2024-04-26T07:54:17.006732+0000","last_active":"2024-04-26T07:55:02.050746+0000","last_peered":"2024-04-26T07:55:02.050746+0000","last_clean":"2024-04-26T07:55:02.050746+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:55:02.050746+0000","last_undegraded":"2024-04-26T07:55:02.050746+0000","last_fullsized":"2024-04-26T07:55:02.050746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:50.720873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048000+0000","last_change":"2024-04-26T07:54:15.016457+0000","last_active":"2024-04-26T07:55:02.048000+0000","last_peered":"2024-04-26T07:55:02.048000+0000","last_clean":"2024-04-26T07:55:02.048000+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:55:02.048000+0000","last_undegraded":"2024-04-26T07:55:02.048000+0000","last_fullsized":"2024-04-26T07:55:02.048000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:34.137578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.058106+0000","last_change":"2024-04-26T07:54:19.010468+0000","last_active":"2024-04-26T07:55:02.058106+0000","last_peered":"2024-04-26T07:55:02.058106+0000","last_clean":"2024-04-26T07:55:02.058106+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:55:02.058106+0000","last_undegraded":"2024-04-26T07:55:02.058106+0000","last_fullsized":"2024-04-26T07:55:02.058106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:00.247411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.343549+0000","last_change":"2024-04-26T07:54:21.021362+0000","last_active":"2024-04-26T07:56:22.343549+0000","last_peered":"2024-04-26T07:56:22.343549+0000","last_clean":"2024-04-26T07:56:22.343549+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:56:22.343549+0000","last_undegraded":"2024-04-26T07:56:22.343549+0000","last_fullsized":"2024-04-26T07:56:22.343549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:01.562210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048176+0000","last_change":"2024-04-26T07:54:23.033211+0000","last_active":"2024-04-26T07:55:02.048176+0000","last_peered":"2024-04-26T07:55:02.048176+0000","last_clean":"2024-04-26T07:55:02.048176+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:55:02.048176+0000","last_undegraded":"2024-04-26T07:55:02.048176+0000","last_fullsized":"2024-04-26T07:55:02.048176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:56.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046065+0000","last_change":"2024-04-26T07:54:25.040148+0000","last_active":"2024-04-26T07:55:02.046065+0000","last_peered":"2024-04-26T07:55:02.046065+0000","last_clean":"2024-04-26T07:55:02.046065+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:55:02.046065+0000","last_undegraded":"2024-04-26T07:55:02.046065+0000","last_fullsized":"2024-04-26T07:55:02.046065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:26.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.135910+0000","last_change":"2024-04-26T07:55:02.061611+0000","last_active":"2024-04-26T07:55:40.135910+0000","last_peered":"2024-04-26T07:55:40.135910+0000","last_clean":"2024-04-26T07:55:40.135910+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:55:40.135910+0000","last_undegraded":"2024-04-26T07:55:40.135910+0000","last_fullsized":"2024-04-26T07:55:40.135910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.609944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048558+0000","last_change":"2024-04-26T07:54:15.009041+0000","last_active":"2024-04-26T07:55:02.048558+0000","last_peered":"2024-04-26T07:55:02.048558+0000","last_clean":"2024-04-26T07:55:02.048558+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:55:02.048558+0000","last_undegraded":"2024-04-26T07:55:02.048558+0000","last_fullsized":"2024-04-26T07:55:02.048558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054642+0000","last_change":"2024-04-26T07:54:19.006121+0000","last_active":"2024-04-26T07:55:02.054642+0000","last_peered":"2024-04-26T07:55:02.054642+0000","last_clean":"2024-04-26T07:55:02.054642+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:55:02.054642+0000","last_undegraded":"2024-04-26T07:55:02.054642+0000","last_fullsized":"2024-04-26T07:55:02.054642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:46.405445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.361578+0000","last_change":"2024-04-26T07:54:21.021334+0000","last_active":"2024-04-26T07:56:22.361578+0000","last_peered":"2024-04-26T07:56:22.361578+0000","last_clean":"2024-04-26T07:56:22.361578+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:56:22.361578+0000","last_undegraded":"2024-04-26T07:56:22.361578+0000","last_fullsized":"2024-04-26T07:56:22.361578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:46.967145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049254+0000","last_change":"2024-04-26T07:54:23.035770+0000","last_active":"2024-04-26T07:55:02.049254+0000","last_peered":"2024-04-26T07:55:02.049254+0000","last_clean":"2024-04-26T07:55:02.049254+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:55:02.049254+0000","last_undegraded":"2024-04-26T07:55:02.049254+0000","last_fullsized":"2024-04-26T07:55:02.049254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:10.697769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.797401+0000","last_change":"2024-04-26T07:54:25.039740+0000","last_active":"2024-04-26T07:56:23.797401+0000","last_peered":"2024-04-26T07:56:23.797401+0000","last_clean":"2024-04-26T07:56:23.797401+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:56:23.797401+0000","last_undegraded":"2024-04-26T07:56:23.797401+0000","last_fullsized":"2024-04-26T07:56:23.797401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:43.196570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294830+0000","last_change":"2024-04-26T07:54:17.009954+0000","last_active":"2024-04-26T07:57:24.294830+0000","last_peered":"2024-04-26T07:57:24.294830+0000","last_clean":"2024-04-26T07:57:24.294830+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:57:24.294830+0000","last_undegraded":"2024-04-26T07:57:24.294830+0000","last_fullsized":"2024-04-26T07:57:24.294830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:38.661383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.421082+0000","last_change":"2024-04-26T07:54:15.028318+0000","last_active":"2024-04-26T07:57:24.421082+0000","last_peered":"2024-04-26T07:57:24.421082+0000","last_clean":"2024-04-26T07:57:24.421082+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:57:24.421082+0000","last_undegraded":"2024-04-26T07:57:24.421082+0000","last_fullsized":"2024-04-26T07:57:24.421082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:14.941698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051548+0000","last_change":"2024-04-26T07:54:19.011607+0000","last_active":"2024-04-26T07:55:02.051548+0000","last_peered":"2024-04-26T07:55:02.051548+0000","last_clean":"2024-04-26T07:55:02.051548+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:55:02.051548+0000","last_undegraded":"2024-04-26T07:55:02.051548+0000","last_fullsized":"2024-04-26T07:55:02.051548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:48.273952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050383+0000","last_change":"2024-04-26T07:54:21.024776+0000","last_active":"2024-04-26T07:55:02.050383+0000","last_peered":"2024-04-26T07:55:02.050383+0000","last_clean":"2024-04-26T07:55:02.050383+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:55:02.050383+0000","last_undegraded":"2024-04-26T07:55:02.050383+0000","last_fullsized":"2024-04-26T07:55:02.050383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:11.648384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.516448+0000","last_change":"2024-04-26T07:54:23.031565+0000","last_active":"2024-04-26T07:57:24.516448+0000","last_peered":"2024-04-26T07:57:24.516448+0000","last_clean":"2024-04-26T07:57:24.516448+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:24.516448+0000","last_undegraded":"2024-04-26T07:57:24.516448+0000","last_fullsized":"2024-04-26T07:57:24.516448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:58.639617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.140553+0000","last_change":"2024-04-26T07:54:25.037610+0000","last_active":"2024-04-26T07:55:40.140553+0000","last_peered":"2024-04-26T07:55:40.140553+0000","last_clean":"2024-04-26T07:55:40.140553+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:55:40.140553+0000","last_undegraded":"2024-04-26T07:55:40.140553+0000","last_fullsized":"2024-04-26T07:55:40.140553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:53.664483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.957760+0000","last_change":"2024-04-26T07:54:17.009270+0000","last_active":"2024-04-26T07:55:39.957760+0000","last_peered":"2024-04-26T07:55:39.957760+0000","last_clean":"2024-04-26T07:55:39.957760+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:55:39.957760+0000","last_undegraded":"2024-04-26T07:55:39.957760+0000","last_fullsized":"2024-04-26T07:55:39.957760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.947552+0000","last_change":"2024-04-26T07:54:15.017919+0000","last_active":"2024-04-26T07:55:39.947552+0000","last_peered":"2024-04-26T07:55:39.947552+0000","last_clean":"2024-04-26T07:55:39.947552+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:55:39.947552+0000","last_undegraded":"2024-04-26T07:55:39.947552+0000","last_fullsized":"2024-04-26T07:55:39.947552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049929+0000","last_change":"2024-04-26T07:54:19.012254+0000","last_active":"2024-04-26T07:55:02.049929+0000","last_peered":"2024-04-26T07:55:02.049929+0000","last_clean":"2024-04-26T07:55:02.049929+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:55:02.049929+0000","last_undegraded":"2024-04-26T07:55:02.049929+0000","last_fullsized":"2024-04-26T07:55:02.049929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:27.631378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.334158+0000","last_change":"2024-04-26T07:54:21.016502+0000","last_active":"2024-04-26T07:56:22.334158+0000","last_peered":"2024-04-26T07:56:22.334158+0000","last_clean":"2024-04-26T07:56:22.334158+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:56:22.334158+0000","last_undegraded":"2024-04-26T07:56:22.334158+0000","last_fullsized":"2024-04-26T07:56:22.334158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:19.663560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047166+0000","last_change":"2024-04-26T07:54:23.020772+0000","last_active":"2024-04-26T07:55:02.047166+0000","last_peered":"2024-04-26T07:55:02.047166+0000","last_clean":"2024-04-26T07:55:02.047166+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:55:02.047166+0000","last_undegraded":"2024-04-26T07:55:02.047166+0000","last_fullsized":"2024-04-26T07:55:02.047166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:33.445518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054643+0000","last_change":"2024-04-26T07:54:25.030663+0000","last_active":"2024-04-26T07:55:02.054643+0000","last_peered":"2024-04-26T07:55:02.054643+0000","last_clean":"2024-04-26T07:55:02.054643+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:55:02.054643+0000","last_undegraded":"2024-04-26T07:55:02.054643+0000","last_fullsized":"2024-04-26T07:55:02.054643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:30.573662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'18","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567445+0000","last_change":"2024-04-26T07:54:17.006502+0000","last_active":"2024-04-26T07:57:24.567445+0000","last_peered":"2024-04-26T07:57:24.567445+0000","last_clean":"2024-04-26T07:57:24.567445+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:24.567445+0000","last_undegraded":"2024-04-26T07:57:24.567445+0000","last_fullsized":"2024-04-26T07:57:24.567445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:10.389370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.660248+0000","last_change":"2024-04-26T07:54:15.028304+0000","last_active":"2024-04-26T07:56:23.660248+0000","last_peered":"2024-04-26T07:56:23.660248+0000","last_clean":"2024-04-26T07:56:23.660248+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:56:23.660248+0000","last_undegraded":"2024-04-26T07:56:23.660248+0000","last_fullsized":"2024-04-26T07:56:23.660248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:40.508331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054707+0000","last_change":"2024-04-26T07:54:19.016077+0000","last_active":"2024-04-26T07:55:02.054707+0000","last_peered":"2024-04-26T07:55:02.054707+0000","last_clean":"2024-04-26T07:55:02.054707+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:55:02.054707+0000","last_undegraded":"2024-04-26T07:55:02.054707+0000","last_fullsized":"2024-04-26T07:55:02.054707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.777725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.335268+0000","last_change":"2024-04-26T07:54:21.021321+0000","last_active":"2024-04-26T07:56:22.335268+0000","last_peered":"2024-04-26T07:56:22.335268+0000","last_clean":"2024-04-26T07:56:22.335268+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:56:22.335268+0000","last_undegraded":"2024-04-26T07:56:22.335268+0000","last_fullsized":"2024-04-26T07:56:22.335268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:07.791597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045753+0000","last_change":"2024-04-26T07:54:23.035765+0000","last_active":"2024-04-26T07:55:02.045753+0000","last_peered":"2024-04-26T07:55:02.045753+0000","last_clean":"2024-04-26T07:55:02.045753+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:55:02.045753+0000","last_undegraded":"2024-04-26T07:55:02.045753+0000","last_fullsized":"2024-04-26T07:55:02.045753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:37.356445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.484896+0000","last_change":"2024-04-26T07:54:25.035955+0000","last_active":"2024-04-26T07:57:24.484896+0000","last_peered":"2024-04-26T07:57:24.484896+0000","last_clean":"2024-04-26T07:57:24.484896+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:57:24.484896+0000","last_undegraded":"2024-04-26T07:57:24.484896+0000","last_fullsized":"2024-04-26T07:57:24.484896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:17.547313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.483578+0000","last_change":"2024-04-26T07:54:17.010362+0000","last_active":"2024-04-26T07:57:24.483578+0000","last_peered":"2024-04-26T07:57:24.483578+0000","last_clean":"2024-04-26T07:57:24.483578+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:57:24.483578+0000","last_undegraded":"2024-04-26T07:57:24.483578+0000","last_fullsized":"2024-04-26T07:57:24.483578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:03.777566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050470+0000","last_change":"2024-04-26T07:54:15.009093+0000","last_active":"2024-04-26T07:55:02.050470+0000","last_peered":"2024-04-26T07:55:02.050470+0000","last_clean":"2024-04-26T07:55:02.050470+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:55:02.050470+0000","last_undegraded":"2024-04-26T07:55:02.050470+0000","last_fullsized":"2024-04-26T07:55:02.050470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:42.204889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052220+0000","last_change":"2024-04-26T07:54:19.010756+0000","last_active":"2024-04-26T07:55:02.052220+0000","last_peered":"2024-04-26T07:55:02.052220+0000","last_clean":"2024-04-26T07:55:02.052220+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:55:02.052220+0000","last_undegraded":"2024-04-26T07:55:02.052220+0000","last_fullsized":"2024-04-26T07:55:02.052220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.227129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.359469+0000","last_change":"2024-04-26T07:54:21.020800+0000","last_active":"2024-04-26T07:56:22.359469+0000","last_peered":"2024-04-26T07:56:22.359469+0000","last_clean":"2024-04-26T07:56:22.359469+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:56:22.359469+0000","last_undegraded":"2024-04-26T07:56:22.359469+0000","last_fullsized":"2024-04-26T07:56:22.359469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:26.613231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046306+0000","last_change":"2024-04-26T07:54:23.036351+0000","last_active":"2024-04-26T07:55:02.046306+0000","last_peered":"2024-04-26T07:55:02.046306+0000","last_clean":"2024-04-26T07:55:02.046306+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:55:02.046306+0000","last_undegraded":"2024-04-26T07:55:02.046306+0000","last_fullsized":"2024-04-26T07:55:02.046306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:41.433119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.902253+0000","last_change":"2024-04-26T07:54:25.039985+0000","last_active":"2024-04-26T07:57:23.902253+0000","last_peered":"2024-04-26T07:57:23.902253+0000","last_clean":"2024-04-26T07:57:23.902253+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:57:23.902253+0000","last_undegraded":"2024-04-26T07:57:23.902253+0000","last_fullsized":"2024-04-26T07:57:23.902253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:59.311879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050871+0000","last_change":"2024-04-26T07:54:17.003817+0000","last_active":"2024-04-26T07:55:02.050871+0000","last_peered":"2024-04-26T07:55:02.050871+0000","last_clean":"2024-04-26T07:55:02.050871+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:55:02.050871+0000","last_undegraded":"2024-04-26T07:55:02.050871+0000","last_fullsized":"2024-04-26T07:55:02.050871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:28:51.342246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054411+0000","last_change":"2024-04-26T07:54:15.019611+0000","last_active":"2024-04-26T07:55:02.054411+0000","last_peered":"2024-04-26T07:55:02.054411+0000","last_clean":"2024-04-26T07:55:02.054411+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:55:02.054411+0000","last_undegraded":"2024-04-26T07:55:02.054411+0000","last_fullsized":"2024-04-26T07:55:02.054411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:21.027132+0000","last_change":"2024-04-26T07:54:19.017393+0000","last_active":"2024-04-26T07:56:21.027132+0000","last_peered":"2024-04-26T07:56:21.027132+0000","last_clean":"2024-04-26T07:56:21.027132+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:56:21.027132+0000","last_undegraded":"2024-04-26T07:56:21.027132+0000","last_fullsized":"2024-04-26T07:56:21.027132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:30.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'33","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.841717+0000","last_change":"2024-04-26T07:54:21.021890+0000","last_active":"2024-04-26T07:57:23.841717+0000","last_peered":"2024-04-26T07:57:23.841717+0000","last_clean":"2024-04-26T07:57:23.841717+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:57:23.841717+0000","last_undegraded":"2024-04-26T07:57:23.841717+0000","last_fullsized":"2024-04-26T07:57:23.841717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:56.471143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048221+0000","last_change":"2024-04-26T07:54:23.021881+0000","last_active":"2024-04-26T07:55:02.048221+0000","last_peered":"2024-04-26T07:55:02.048221+0000","last_clean":"2024-04-26T07:55:02.048221+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:55:02.048221+0000","last_undegraded":"2024-04-26T07:55:02.048221+0000","last_fullsized":"2024-04-26T07:55:02.048221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:57.195185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.371916+0000","last_change":"2024-04-26T07:54:25.040953+0000","last_active":"2024-04-26T07:56:22.371916+0000","last_peered":"2024-04-26T07:56:22.371916+0000","last_clean":"2024-04-26T07:56:22.371916+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:56:22.371916+0000","last_undegraded":"2024-04-26T07:56:22.371916+0000","last_fullsized":"2024-04-26T07:56:22.371916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:37.200888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.803805+0000","last_change":"2024-04-26T07:54:17.004457+0000","last_active":"2024-04-26T07:56:23.803805+0000","last_peered":"2024-04-26T07:56:23.803805+0000","last_clean":"2024-04-26T07:56:23.803805+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:56:23.803805+0000","last_undegraded":"2024-04-26T07:56:23.803805+0000","last_fullsized":"2024-04-26T07:56:23.803805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:27:58.240167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050573+0000","last_change":"2024-04-26T07:54:15.022353+0000","last_active":"2024-04-26T07:55:02.050573+0000","last_peered":"2024-04-26T07:55:02.050573+0000","last_clean":"2024-04-26T07:55:02.050573+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:55:02.050573+0000","last_undegraded":"2024-04-26T07:55:02.050573+0000","last_fullsized":"2024-04-26T07:55:02.050573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050768+0000","last_change":"2024-04-26T07:54:17.015322+0000","last_active":"2024-04-26T07:55:02.050768+0000","last_peered":"2024-04-26T07:55:02.050768+0000","last_clean":"2024-04-26T07:55:02.050768+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:55:02.050768+0000","last_undegraded":"2024-04-26T07:55:02.050768+0000","last_fullsized":"2024-04-26T07:55:02.050768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:08.202320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.423953+0000","last_change":"2024-04-26T07:54:15.001522+0000","last_active":"2024-04-26T07:57:24.423953+0000","last_peered":"2024-04-26T07:57:24.423953+0000","last_clean":"2024-04-26T07:57:24.423953+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:57:24.423953+0000","last_undegraded":"2024-04-26T07:57:24.423953+0000","last_fullsized":"2024-04-26T07:57:24.423953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048458+0000","last_change":"2024-04-26T07:54:17.010190+0000","last_active":"2024-04-26T07:55:02.048458+0000","last_peered":"2024-04-26T07:55:02.048458+0000","last_clean":"2024-04-26T07:55:02.048458+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:55:02.048458+0000","last_undegraded":"2024-04-26T07:55:02.048458+0000","last_fullsized":"2024-04-26T07:55:02.048458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:24.203874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046564+0000","last_change":"2024-04-26T07:54:15.025512+0000","last_active":"2024-04-26T07:55:02.046564+0000","last_peered":"2024-04-26T07:55:02.046564+0000","last_clean":"2024-04-26T07:55:02.046564+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:55:02.046564+0000","last_undegraded":"2024-04-26T07:55:02.046564+0000","last_fullsized":"2024-04-26T07:55:02.046564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:43.250319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143581+0000","last_change":"2024-04-26T07:54:17.009848+0000","last_active":"2024-04-26T07:55:40.143581+0000","last_peered":"2024-04-26T07:55:40.143581+0000","last_clean":"2024-04-26T07:55:40.143581+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:55:40.143581+0000","last_undegraded":"2024-04-26T07:55:40.143581+0000","last_fullsized":"2024-04-26T07:55:40.143581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884316+0000","last_change":"2024-04-26T07:54:15.005595+0000","last_active":"2024-04-26T07:56:19.884316+0000","last_peered":"2024-04-26T07:56:19.884316+0000","last_clean":"2024-04-26T07:56:19.884316+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:56:19.884316+0000","last_undegraded":"2024-04-26T07:56:19.884316+0000","last_fullsized":"2024-04-26T07:56:19.884316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.613906+0000","last_change":"2024-04-26T07:54:16.999767+0000","last_active":"2024-04-26T07:56:20.613906+0000","last_peered":"2024-04-26T07:56:20.613906+0000","last_clean":"2024-04-26T07:56:20.613906+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:56:20.613906+0000","last_undegraded":"2024-04-26T07:56:20.613906+0000","last_fullsized":"2024-04-26T07:56:20.613906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.777807+0000","last_change":"2024-04-26T07:54:15.003280+0000","last_active":"2024-04-26T07:56:23.777807+0000","last_peered":"2024-04-26T07:56:23.777807+0000","last_clean":"2024-04-26T07:56:23.777807+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:56:23.777807+0000","last_undegraded":"2024-04-26T07:56:23.777807+0000","last_fullsized":"2024-04-26T07:56:23.777807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511668+0000","last_change":"2024-04-26T07:54:17.003908+0000","last_active":"2024-04-26T07:57:24.511668+0000","last_peered":"2024-04-26T07:57:24.511668+0000","last_clean":"2024-04-26T07:57:24.511668+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:57:24.511668+0000","last_undegraded":"2024-04-26T07:57:24.511668+0000","last_fullsized":"2024-04-26T07:57:24.511668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:48.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048401+0000","last_change":"2024-04-26T07:54:15.017747+0000","last_active":"2024-04-26T07:55:02.048401+0000","last_peered":"2024-04-26T07:55:02.048401+0000","last_clean":"2024-04-26T07:55:02.048401+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:55:02.048401+0000","last_undegraded":"2024-04-26T07:55:02.048401+0000","last_fullsized":"2024-04-26T07:55:02.048401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518610+0000","last_change":"2024-04-26T07:54:17.006648+0000","last_active":"2024-04-26T07:57:24.518610+0000","last_peered":"2024-04-26T07:57:24.518610+0000","last_clean":"2024-04-26T07:57:24.518610+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:57:24.518610+0000","last_undegraded":"2024-04-26T07:57:24.518610+0000","last_fullsized":"2024-04-26T07:57:24.518610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:05.420036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056521+0000","last_change":"2024-04-26T07:54:15.022184+0000","last_active":"2024-04-26T07:55:02.056521+0000","last_peered":"2024-04-26T07:55:02.056521+0000","last_clean":"2024-04-26T07:55:02.056521+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:55:02.056521+0000","last_undegraded":"2024-04-26T07:55:02.056521+0000","last_fullsized":"2024-04-26T07:55:02.056521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294965+0000","last_change":"2024-04-26T07:54:16.999609+0000","last_active":"2024-04-26T07:57:24.294965+0000","last_peered":"2024-04-26T07:57:24.294965+0000","last_clean":"2024-04-26T07:57:24.294965+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:57:24.294965+0000","last_undegraded":"2024-04-26T07:57:24.294965+0000","last_fullsized":"2024-04-26T07:57:24.294965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049858+0000","last_change":"2024-04-26T07:54:15.005424+0000","last_active":"2024-04-26T07:55:02.049858+0000","last_peered":"2024-04-26T07:55:02.049858+0000","last_clean":"2024-04-26T07:55:02.049858+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:55:02.049858+0000","last_undegraded":"2024-04-26T07:55:02.049858+0000","last_fullsized":"2024-04-26T07:55:02.049858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:44.643100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.444923+0000","last_change":"2024-04-26T07:54:17.006417+0000","last_active":"2024-04-26T07:57:24.444923+0000","last_peered":"2024-04-26T07:57:24.444923+0000","last_clean":"2024-04-26T07:57:24.444923+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:57:24.444923+0000","last_undegraded":"2024-04-26T07:57:24.444923+0000","last_fullsized":"2024-04-26T07:57:24.444923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:32.537219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046690+0000","last_change":"2024-04-26T07:54:15.029863+0000","last_active":"2024-04-26T07:55:02.046690+0000","last_peered":"2024-04-26T07:55:02.046690+0000","last_clean":"2024-04-26T07:55:02.046690+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:55:02.046690+0000","last_undegraded":"2024-04-26T07:55:02.046690+0000","last_fullsized":"2024-04-26T07:55:02.046690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.237116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049233+0000","last_change":"2024-04-26T07:54:17.018186+0000","last_active":"2024-04-26T07:55:02.049233+0000","last_peered":"2024-04-26T07:55:02.049233+0000","last_clean":"2024-04-26T07:55:02.049233+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:55:02.049233+0000","last_undegraded":"2024-04-26T07:55:02.049233+0000","last_fullsized":"2024-04-26T07:55:02.049233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:42.953114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048139+0000","last_change":"2024-04-26T07:54:15.007396+0000","last_active":"2024-04-26T07:55:02.048139+0000","last_peered":"2024-04-26T07:55:02.048139+0000","last_clean":"2024-04-26T07:55:02.048139+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:55:02.048139+0000","last_undegraded":"2024-04-26T07:55:02.048139+0000","last_fullsized":"2024-04-26T07:55:02.048139+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.957894+0000","last_change":"2024-04-26T07:54:17.011327+0000","last_active":"2024-04-26T07:55:39.957894+0000","last_peered":"2024-04-26T07:55:39.957894+0000","last_clean":"2024-04-26T07:55:39.957894+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:55:39.957894+0000","last_undegraded":"2024-04-26T07:55:39.957894+0000","last_fullsized":"2024-04-26T07:55:39.957894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.428008+0000","last_change":"2024-04-26T07:54:15.017542+0000","last_active":"2024-04-26T07:57:24.428008+0000","last_peered":"2024-04-26T07:57:24.428008+0000","last_clean":"2024-04-26T07:57:24.428008+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:57:24.428008+0000","last_undegraded":"2024-04-26T07:57:24.428008+0000","last_fullsized":"2024-04-26T07:57:24.428008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:07.237734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438319+0000","last_change":"2024-04-26T07:54:17.003159+0000","last_active":"2024-04-26T07:57:24.438319+0000","last_peered":"2024-04-26T07:57:24.438319+0000","last_clean":"2024-04-26T07:57:24.438319+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:57:24.438319+0000","last_undegraded":"2024-04-26T07:57:24.438319+0000","last_fullsized":"2024-04-26T07:57:24.438319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:44.398201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.417790+0000","last_change":"2024-04-26T07:54:15.008754+0000","last_active":"2024-04-26T07:57:24.417790+0000","last_peered":"2024-04-26T07:57:24.417790+0000","last_clean":"2024-04-26T07:57:24.417790+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:57:24.417790+0000","last_undegraded":"2024-04-26T07:57:24.417790+0000","last_fullsized":"2024-04-26T07:57:24.417790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207862+0000","last_change":"2024-04-26T07:54:17.009514+0000","last_active":"2024-04-26T07:57:24.207862+0000","last_peered":"2024-04-26T07:57:24.207862+0000","last_clean":"2024-04-26T07:57:24.207862+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:57:24.207862+0000","last_undegraded":"2024-04-26T07:57:24.207862+0000","last_fullsized":"2024-04-26T07:57:24.207862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:08.202320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.431092+0000","last_change":"2024-04-26T07:54:15.022986+0000","last_active":"2024-04-26T07:57:24.431092+0000","last_peered":"2024-04-26T07:57:24.431092+0000","last_clean":"2024-04-26T07:57:24.431092+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:57:24.431092+0000","last_undegraded":"2024-04-26T07:57:24.431092+0000","last_fullsized":"2024-04-26T07:57:24.431092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:48.713435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511353+0000","last_change":"2024-04-26T07:54:17.007792+0000","last_active":"2024-04-26T07:57:24.511353+0000","last_peered":"2024-04-26T07:57:24.511353+0000","last_clean":"2024-04-26T07:57:24.511353+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:57:24.511353+0000","last_undegraded":"2024-04-26T07:57:24.511353+0000","last_fullsized":"2024-04-26T07:57:24.511353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:13.061187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048771+0000","last_change":"2024-04-26T07:54:15.026508+0000","last_active":"2024-04-26T07:55:02.048771+0000","last_peered":"2024-04-26T07:55:02.048771+0000","last_clean":"2024-04-26T07:55:02.048771+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:55:02.048771+0000","last_undegraded":"2024-04-26T07:55:02.048771+0000","last_fullsized":"2024-04-26T07:55:02.048771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.940423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804054+0000","last_change":"2024-04-26T07:54:17.016231+0000","last_active":"2024-04-26T07:56:23.804054+0000","last_peered":"2024-04-26T07:56:23.804054+0000","last_clean":"2024-04-26T07:56:23.804054+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:56:23.804054+0000","last_undegraded":"2024-04-26T07:56:23.804054+0000","last_fullsized":"2024-04-26T07:56:23.804054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.266707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057701+0000","last_change":"2024-04-26T07:54:15.022552+0000","last_active":"2024-04-26T07:55:02.057701+0000","last_peered":"2024-04-26T07:55:02.057701+0000","last_clean":"2024-04-26T07:55:02.057701+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:55:02.057701+0000","last_undegraded":"2024-04-26T07:55:02.057701+0000","last_fullsized":"2024-04-26T07:55:02.057701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143346+0000","last_change":"2024-04-26T07:54:17.000134+0000","last_active":"2024-04-26T07:55:40.143346+0000","last_peered":"2024-04-26T07:55:40.143346+0000","last_clean":"2024-04-26T07:55:40.143346+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:55:40.143346+0000","last_undegraded":"2024-04-26T07:55:40.143346+0000","last_fullsized":"2024-04-26T07:55:40.143346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052235+0000","last_change":"2024-04-26T07:54:15.025822+0000","last_active":"2024-04-26T07:55:02.052235+0000","last_peered":"2024-04-26T07:55:02.052235+0000","last_clean":"2024-04-26T07:55:02.052235+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:55:02.052235+0000","last_undegraded":"2024-04-26T07:55:02.052235+0000","last_fullsized":"2024-04-26T07:55:02.052235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:03.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047156+0000","last_change":"2024-04-26T07:54:15.029803+0000","last_active":"2024-04-26T07:55:02.047156+0000","last_peered":"2024-04-26T07:55:02.047156+0000","last_clean":"2024-04-26T07:55:02.047156+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:55:02.047156+0000","last_undegraded":"2024-04-26T07:55:02.047156+0000","last_fullsized":"2024-04-26T07:55:02.047156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:28:49.334808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511260+0000","last_change":"2024-04-26T07:54:17.001393+0000","last_active":"2024-04-26T07:57:24.511260+0000","last_peered":"2024-04-26T07:57:24.511260+0000","last_clean":"2024-04-26T07:57:24.511260+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:57:24.511260+0000","last_undegraded":"2024-04-26T07:57:24.511260+0000","last_fullsized":"2024-04-26T07:57:24.511260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:13.730381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048048+0000","last_change":"2024-04-26T07:54:15.007421+0000","last_active":"2024-04-26T07:55:02.048048+0000","last_peered":"2024-04-26T07:55:02.048048+0000","last_clean":"2024-04-26T07:55:02.048048+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:55:02.048048+0000","last_undegraded":"2024-04-26T07:55:02.048048+0000","last_fullsized":"2024-04-26T07:55:02.048048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511321+0000","last_change":"2024-04-26T07:54:17.002953+0000","last_active":"2024-04-26T07:57:24.511321+0000","last_peered":"2024-04-26T07:57:24.511321+0000","last_clean":"2024-04-26T07:57:24.511321+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:57:24.511321+0000","last_undegraded":"2024-04-26T07:57:24.511321+0000","last_fullsized":"2024-04-26T07:57:24.511321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42228,"kb_used_data":6892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329612,"statfs":{"total":96636764160,"available":96593522688,"internally_reserved":0,"allocated":7057408,"data_stored":6751956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705707,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48896,"kb_used_data":13560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322944,"statfs":{"total":96636764160,"available":96586694656,"internally_reserved":0,"allocated":13885440,"data_stored":13632181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48600,"kb_used_data":13264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323240,"statfs":{"total":96636764160,"available":96586997760,"internally_reserved":0,"allocated":13582336,"data_stored":13307988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38024,"kb_used_data":6848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333816,"statfs":{"total":96636764160,"available":96597827584,"internally_reserved":0,"allocated":7012352,"data_stored":6749173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:57:31.954 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T07:57:31.954 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.088+0000 7f45fefd2640 1 Processor -- start 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.088+0000 7f45fefd2640 1 -- start start 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.088+0000 7f45fefd2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f45f812eba0 0x7f45f8130f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.088+0000 7f45fefd2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f806da60 con 0x7f45f8128920 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.088+0000 7f45fefd2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f45f8073070 con 0x7f45f812eba0 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.088+0000 7f45f7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f45f812eba0 0x7f45f8130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.088+0000 7f45fcd6e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f45f8128920 0x7f45f8128d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46458/0 (socket says 172.21.15.1:46458) 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.088+0000 7f45fcd6e640 1 -- 172.21.15.1:0/2690961068 learned_addr learned my addr 172.21.15.1:0/2690961068 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.089+0000 7f45f7fff640 1 -- 172.21.15.1:0/2690961068 >> v1:172.21.15.1:6789/0 conn(0x7f45f8128920 legacy=0x7f45f8128d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.089+0000 7f45f77fe640 1 -- 172.21.15.1:0/2690961068 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265929593 0 0) 0x7f45ec001110 con 0x7f45f8128920 2024-04-26T07:57:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.089+0000 7f45f7fff640 1 -- 172.21.15.1:0/2690961068 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f8094640 con 0x7f45f812eba0 2024-04-26T07:57:32.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.089+0000 7f45f7fff640 1 --2- 172.21.15.1:0/2690961068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f812eba0 0x7f45f8130f90 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009720 tx=0x7f45e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb85798b81ca525d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:32.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45f77fe640 1 -- 172.21.15.1:0/2690961068 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e40316d0 con 0x7f45f812eba0 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45f77fe640 1 -- 172.21.15.1:0/2690961068 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e4037070 con 0x7f45f812eba0 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45f77fe640 1 -- 172.21.15.1:0/2690961068 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e40319c0 con 0x7f45f812eba0 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45fefd2640 1 -- 172.21.15.1:0/2690961068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f812eba0 msgr2=0x7f45f8130f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45fefd2640 1 --2- 172.21.15.1:0/2690961068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f812eba0 0x7f45f8130f90 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009720 tx=0x7f45e402b840 comp rx=0 tx=0).stop 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45fefd2640 1 -- 172.21.15.1:0/2690961068 shutdown_connections 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45fefd2640 1 --2- 172.21.15.1:0/2690961068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f812eba0 0x7f45f8130f90 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45fefd2640 1 -- 172.21.15.1:0/2690961068 >> 172.21.15.1:0/2690961068 conn(0x7f45f809add0 msgr2=0x7f45f809b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45fefd2640 1 -- 172.21.15.1:0/2690961068 shutdown_connections 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.090+0000 7f45fefd2640 1 -- 172.21.15.1:0/2690961068 wait complete. 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.091+0000 7f45fefd2640 1 Processor -- start 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.091+0000 7f45fefd2640 1 -- start start 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fefd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f8128920 0x7f45f812c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:32.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fefd2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f45f806d620 con 0x7f45f8128920 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fcd6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f8128920 0x7f45f812c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fcd6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f8128920 0x7f45f812c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35838/0 (socket says 172.21.15.1:35838) 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fcd6e640 1 -- 172.21.15.1:0/3245263261 learned_addr learned my addr 172.21.15.1:0/3245263261 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fcd6e640 1 -- 172.21.15.1:0/3245263261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f8098a70 con 0x7f45f8128920 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fcd6e640 1 --2- 172.21.15.1:0/3245263261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f8128920 0x7f45f812c7c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c700 tx=0x7f45ec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45f57fa640 1 -- 172.21.15.1:0/3245263261 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45ec018070 con 0x7f45f8128920 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45f57fa640 1 -- 172.21.15.1:0/3245263261 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec0070d0 con 0x7f45f8128920 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45f57fa640 1 -- 172.21.15.1:0/3245263261 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45ec0073f0 con 0x7f45f8128920 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f8122170 con 0x7f45f8128920 2024-04-26T07:57:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.092+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f8072c00 con 0x7f45f8128920 2024-04-26T07:57:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.093+0000 7f45f57fa640 1 -- 172.21.15.1:0/3245263261 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f45ec01b070 con 0x7f45f8128920 2024-04-26T07:57:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.093+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f8122c80 con 0x7f45f8128920 2024-04-26T07:57:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.093+0000 7f45f57fa640 1 --2- 172.21.15.1:0/3245263261 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f45dc0385c0 0x7f45dc03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.093+0000 7f45f57fa640 1 -- 172.21.15.1:0/3245263261 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f45ec04b440 con 0x7f45f8128920 2024-04-26T07:57:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.094+0000 7f45f7fff640 1 --2- 172.21.15.1:0/3245263261 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f45dc0385c0 0x7f45dc03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.094+0000 7f45f7fff640 1 --2- 172.21.15.1:0/3245263261 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f45dc0385c0 0x7f45dc03aa80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45e4036000 tx=0x7f45e4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:32.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.098+0000 7f45f57fa640 1 -- 172.21.15.1:0/3245263261 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45f806da60 con 0x7f45f8128920 2024-04-26T07:57:32.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.279+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45f8122450 con 0x7f45dc0385c0 2024-04-26T07:57:32.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.296+0000 7f45f57fa640 1 -- 172.21.15.1:0/3245263261 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665701 (secure 0 0 0) 0x7f45f8122450 con 0x7f45dc0385c0 2024-04-26T07:57:32.301 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:57:32.306 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:57:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f45dc0385c0 msgr2=0x7f45dc03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 --2- 172.21.15.1:0/3245263261 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f45dc0385c0 0x7f45dc03aa80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45e4036000 tx=0x7f45e4008030 comp rx=0 tx=0).stop 2024-04-26T07:57:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f8128920 msgr2=0x7f45f812c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 --2- 172.21.15.1:0/3245263261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f8128920 0x7f45f812c7c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c700 tx=0x7f45ec00cbc0 comp rx=0 tx=0).stop 2024-04-26T07:57:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 shutdown_connections 2024-04-26T07:57:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 --2- 172.21.15.1:0/3245263261 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f45dc0385c0 0x7f45dc03aa80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 --2- 172.21.15.1:0/3245263261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45f8128920 0x7f45f812c7c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 >> 172.21.15.1:0/3245263261 conn(0x7f45f809add0 msgr2=0x7f45f8094c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:32.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 shutdown_connections 2024-04-26T07:57:32.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.300+0000 7f45fefd2640 1 -- 172.21.15.1:0/3245263261 wait complete. 2024-04-26T07:57:32.310 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-04-26T07:57:30.868555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4887,"num_read_kb":4464,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177748,"kb_used_data":40564,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309612,"statfs":{"total":386547056640,"available":386365042688,"internally_reserved":0,"allocated":41537536,"data_stored":40441298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003453"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.633565+0000","last_change":"2024-04-26T07:54:15.021756+0000","last_active":"2024-04-26T07:56:23.633565+0000","last_peered":"2024-04-26T07:56:23.633565+0000","last_clean":"2024-04-26T07:56:23.633565+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:56:23.633565+0000","last_undegraded":"2024-04-26T07:56:23.633565+0000","last_fullsized":"2024-04-26T07:56:23.633565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895004+0000","last_change":"2024-04-26T07:54:17.007567+0000","last_active":"2024-04-26T07:56:49.895004+0000","last_peered":"2024-04-26T07:56:49.895004+0000","last_clean":"2024-04-26T07:56:49.895004+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:56:49.895004+0000","last_undegraded":"2024-04-26T07:56:49.895004+0000","last_fullsized":"2024-04-26T07:56:49.895004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050522+0000","last_change":"2024-04-26T07:54:15.008962+0000","last_active":"2024-04-26T07:55:02.050522+0000","last_peered":"2024-04-26T07:55:02.050522+0000","last_clean":"2024-04-26T07:55:02.050522+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:55:02.050522+0000","last_undegraded":"2024-04-26T07:55:02.050522+0000","last_fullsized":"2024-04-26T07:55:02.050522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.209457+0000","last_change":"2024-04-26T07:54:17.015486+0000","last_active":"2024-04-26T07:57:24.209457+0000","last_peered":"2024-04-26T07:57:24.209457+0000","last_clean":"2024-04-26T07:57:24.209457+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:57:24.209457+0000","last_undegraded":"2024-04-26T07:57:24.209457+0000","last_fullsized":"2024-04-26T07:57:24.209457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:22.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049119+0000","last_change":"2024-04-26T07:54:15.026276+0000","last_active":"2024-04-26T07:55:02.049119+0000","last_peered":"2024-04-26T07:55:02.049119+0000","last_clean":"2024-04-26T07:55:02.049119+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:55:02.049119+0000","last_undegraded":"2024-04-26T07:55:02.049119+0000","last_fullsized":"2024-04-26T07:55:02.049119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:33.771147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511438+0000","last_change":"2024-04-26T07:54:17.018611+0000","last_active":"2024-04-26T07:57:24.511438+0000","last_peered":"2024-04-26T07:57:24.511438+0000","last_clean":"2024-04-26T07:57:24.511438+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:24.511438+0000","last_undegraded":"2024-04-26T07:57:24.511438+0000","last_fullsized":"2024-04-26T07:57:24.511438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:15.151809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054671+0000","last_change":"2024-04-26T07:54:15.020803+0000","last_active":"2024-04-26T07:55:02.054671+0000","last_peered":"2024-04-26T07:55:02.054671+0000","last_clean":"2024-04-26T07:55:02.054671+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:55:02.054671+0000","last_undegraded":"2024-04-26T07:55:02.054671+0000","last_fullsized":"2024-04-26T07:55:02.054671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047930+0000","last_change":"2024-04-26T07:54:17.011187+0000","last_active":"2024-04-26T07:55:02.047930+0000","last_peered":"2024-04-26T07:55:02.047930+0000","last_clean":"2024-04-26T07:55:02.047930+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:55:02.047930+0000","last_undegraded":"2024-04-26T07:55:02.047930+0000","last_fullsized":"2024-04-26T07:55:02.047930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:47.382429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047464+0000","last_change":"2024-04-26T07:54:15.025367+0000","last_active":"2024-04-26T07:55:02.047464+0000","last_peered":"2024-04-26T07:55:02.047464+0000","last_clean":"2024-04-26T07:55:02.047464+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:55:02.047464+0000","last_undegraded":"2024-04-26T07:55:02.047464+0000","last_fullsized":"2024-04-26T07:55:02.047464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:02.114318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511501+0000","last_change":"2024-04-26T07:54:17.001492+0000","last_active":"2024-04-26T07:57:24.511501+0000","last_peered":"2024-04-26T07:57:24.511501+0000","last_clean":"2024-04-26T07:57:24.511501+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:57:24.511501+0000","last_undegraded":"2024-04-26T07:57:24.511501+0000","last_fullsized":"2024-04-26T07:57:24.511501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:09.013983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.506545+0000","last_change":"2024-04-26T07:54:15.019896+0000","last_active":"2024-04-26T07:57:24.506545+0000","last_peered":"2024-04-26T07:57:24.506545+0000","last_clean":"2024-04-26T07:57:24.506545+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:57:24.506545+0000","last_undegraded":"2024-04-26T07:57:24.506545+0000","last_fullsized":"2024-04-26T07:57:24.506545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:42.204889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511288+0000","last_change":"2024-04-26T07:54:17.018051+0000","last_active":"2024-04-26T07:57:24.511288+0000","last_peered":"2024-04-26T07:57:24.511288+0000","last_clean":"2024-04-26T07:57:24.511288+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:24.511288+0000","last_undegraded":"2024-04-26T07:57:24.511288+0000","last_fullsized":"2024-04-26T07:57:24.511288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:26.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.170249+0000","last_change":"2024-04-26T07:54:15.021920+0000","last_active":"2024-04-26T07:57:24.170249+0000","last_peered":"2024-04-26T07:57:24.170249+0000","last_clean":"2024-04-26T07:57:24.170249+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:57:24.170249+0000","last_undegraded":"2024-04-26T07:57:24.170249+0000","last_fullsized":"2024-04-26T07:57:24.170249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:35.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.615508+0000","last_change":"2024-04-26T07:54:17.016378+0000","last_active":"2024-04-26T07:56:20.615508+0000","last_peered":"2024-04-26T07:56:20.615508+0000","last_clean":"2024-04-26T07:56:20.615508+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:56:20.615508+0000","last_undegraded":"2024-04-26T07:56:20.615508+0000","last_fullsized":"2024-04-26T07:56:20.615508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047579+0000","last_change":"2024-04-26T07:54:15.008904+0000","last_active":"2024-04-26T07:55:02.047579+0000","last_peered":"2024-04-26T07:55:02.047579+0000","last_clean":"2024-04-26T07:55:02.047579+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:55:02.047579+0000","last_undegraded":"2024-04-26T07:55:02.047579+0000","last_fullsized":"2024-04-26T07:55:02.047579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207539+0000","last_change":"2024-04-26T07:54:17.011542+0000","last_active":"2024-04-26T07:57:24.207539+0000","last_peered":"2024-04-26T07:57:24.207539+0000","last_clean":"2024-04-26T07:57:24.207539+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:57:24.207539+0000","last_undegraded":"2024-04-26T07:57:24.207539+0000","last_fullsized":"2024-04-26T07:57:24.207539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143674+0000","last_change":"2024-04-26T07:54:17.018794+0000","last_active":"2024-04-26T07:55:40.143674+0000","last_peered":"2024-04-26T07:55:40.143674+0000","last_clean":"2024-04-26T07:55:40.143674+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:55:40.143674+0000","last_undegraded":"2024-04-26T07:55:40.143674+0000","last_fullsized":"2024-04-26T07:55:40.143674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:25.624134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054524+0000","last_change":"2024-04-26T07:54:15.020059+0000","last_active":"2024-04-26T07:55:02.054524+0000","last_peered":"2024-04-26T07:55:02.054524+0000","last_clean":"2024-04-26T07:55:02.054524+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:55:02.054524+0000","last_undegraded":"2024-04-26T07:55:02.054524+0000","last_fullsized":"2024-04-26T07:55:02.054524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.614746+0000","last_change":"2024-04-26T07:54:17.007162+0000","last_active":"2024-04-26T07:56:20.614746+0000","last_peered":"2024-04-26T07:56:20.614746+0000","last_clean":"2024-04-26T07:56:20.614746+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:56:20.614746+0000","last_undegraded":"2024-04-26T07:56:20.614746+0000","last_fullsized":"2024-04-26T07:56:20.614746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057735+0000","last_change":"2024-04-26T07:54:15.023259+0000","last_active":"2024-04-26T07:55:02.057735+0000","last_peered":"2024-04-26T07:55:02.057735+0000","last_clean":"2024-04-26T07:55:02.057735+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:55:02.057735+0000","last_undegraded":"2024-04-26T07:55:02.057735+0000","last_fullsized":"2024-04-26T07:55:02.057735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.295581+0000","last_change":"2024-04-26T07:54:17.016377+0000","last_active":"2024-04-26T07:57:24.295581+0000","last_peered":"2024-04-26T07:57:24.295581+0000","last_clean":"2024-04-26T07:57:24.295581+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:24.295581+0000","last_undegraded":"2024-04-26T07:57:24.295581+0000","last_fullsized":"2024-04-26T07:57:24.295581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:20.487011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048878+0000","last_change":"2024-04-26T07:54:15.017989+0000","last_active":"2024-04-26T07:55:02.048878+0000","last_peered":"2024-04-26T07:55:02.048878+0000","last_clean":"2024-04-26T07:55:02.048878+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:55:02.048878+0000","last_undegraded":"2024-04-26T07:55:02.048878+0000","last_fullsized":"2024-04-26T07:55:02.048878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.215781+0000","last_change":"2024-04-26T07:54:17.011769+0000","last_active":"2024-04-26T07:57:24.215781+0000","last_peered":"2024-04-26T07:57:24.215781+0000","last_clean":"2024-04-26T07:57:24.215781+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:57:24.215781+0000","last_undegraded":"2024-04-26T07:57:24.215781+0000","last_fullsized":"2024-04-26T07:57:24.215781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055070+0000","last_change":"2024-04-26T07:54:15.017753+0000","last_active":"2024-04-26T07:55:02.055070+0000","last_peered":"2024-04-26T07:55:02.055070+0000","last_clean":"2024-04-26T07:55:02.055070+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:55:02.055070+0000","last_undegraded":"2024-04-26T07:55:02.055070+0000","last_fullsized":"2024-04-26T07:55:02.055070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143749+0000","last_change":"2024-04-26T07:54:17.012327+0000","last_active":"2024-04-26T07:55:40.143749+0000","last_peered":"2024-04-26T07:55:40.143749+0000","last_clean":"2024-04-26T07:55:40.143749+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:55:40.143749+0000","last_undegraded":"2024-04-26T07:55:40.143749+0000","last_fullsized":"2024-04-26T07:55:40.143749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049152+0000","last_change":"2024-04-26T07:54:15.008684+0000","last_active":"2024-04-26T07:55:02.049152+0000","last_peered":"2024-04-26T07:55:02.049152+0000","last_clean":"2024-04-26T07:55:02.049152+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:55:02.049152+0000","last_undegraded":"2024-04-26T07:55:02.049152+0000","last_fullsized":"2024-04-26T07:55:02.049152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511606+0000","last_change":"2024-04-26T07:54:16.998745+0000","last_active":"2024-04-26T07:57:24.511606+0000","last_peered":"2024-04-26T07:57:24.511606+0000","last_clean":"2024-04-26T07:57:24.511606+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:57:24.511606+0000","last_undegraded":"2024-04-26T07:57:24.511606+0000","last_fullsized":"2024-04-26T07:57:24.511606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:13.730381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047329+0000","last_change":"2024-04-26T07:54:15.017883+0000","last_active":"2024-04-26T07:55:02.047329+0000","last_peered":"2024-04-26T07:55:02.047329+0000","last_clean":"2024-04-26T07:55:02.047329+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:55:02.047329+0000","last_undegraded":"2024-04-26T07:55:02.047329+0000","last_fullsized":"2024-04-26T07:55:02.047329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:44.995414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.463089+0000","last_change":"2024-04-26T07:54:25.037823+0000","last_active":"2024-04-26T07:57:24.463089+0000","last_peered":"2024-04-26T07:57:24.463089+0000","last_clean":"2024-04-26T07:57:24.463089+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:57:24.463089+0000","last_undegraded":"2024-04-26T07:57:24.463089+0000","last_fullsized":"2024-04-26T07:57:24.463089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.012082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'13","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489530+0000","last_change":"2024-04-26T07:54:17.010298+0000","last_active":"2024-04-26T07:57:24.489530+0000","last_peered":"2024-04-26T07:57:24.489530+0000","last_clean":"2024-04-26T07:57:24.489530+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:57:24.489530+0000","last_undegraded":"2024-04-26T07:57:24.489530+0000","last_fullsized":"2024-04-26T07:57:24.489530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:38.486309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892998+0000","last_change":"2024-04-26T07:54:15.028485+0000","last_active":"2024-04-26T07:56:34.892998+0000","last_peered":"2024-04-26T07:56:34.892998+0000","last_clean":"2024-04-26T07:56:34.892998+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:56:34.892998+0000","last_undegraded":"2024-04-26T07:56:34.892998+0000","last_fullsized":"2024-04-26T07:56:34.892998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:43.230145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047546+0000","last_change":"2024-04-26T07:54:19.013097+0000","last_active":"2024-04-26T07:55:02.047546+0000","last_peered":"2024-04-26T07:55:02.047546+0000","last_clean":"2024-04-26T07:55:02.047546+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:55:02.047546+0000","last_undegraded":"2024-04-26T07:55:02.047546+0000","last_fullsized":"2024-04-26T07:55:02.047546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:06.684753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.351988+0000","last_change":"2024-04-26T07:54:21.023071+0000","last_active":"2024-04-26T07:56:22.351988+0000","last_peered":"2024-04-26T07:56:22.351988+0000","last_clean":"2024-04-26T07:56:22.351988+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:56:22.351988+0000","last_undegraded":"2024-04-26T07:56:22.351988+0000","last_fullsized":"2024-04-26T07:56:22.351988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:31.663330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054306+0000","last_change":"2024-04-26T07:54:23.030948+0000","last_active":"2024-04-26T07:55:02.054306+0000","last_peered":"2024-04-26T07:55:02.054306+0000","last_clean":"2024-04-26T07:55:02.054306+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:55:02.054306+0000","last_undegraded":"2024-04-26T07:55:02.054306+0000","last_fullsized":"2024-04-26T07:55:02.054306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:09.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.570875+0000","last_change":"2024-04-26T07:54:25.029434+0000","last_active":"2024-04-26T07:57:24.570875+0000","last_peered":"2024-04-26T07:57:24.570875+0000","last_clean":"2024-04-26T07:57:24.570875+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:24.570875+0000","last_undegraded":"2024-04-26T07:57:24.570875+0000","last_fullsized":"2024-04-26T07:57:24.570875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:48.982630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.301766+0000","last_change":"2024-04-26T07:54:17.010194+0000","last_active":"2024-04-26T07:57:24.301766+0000","last_peered":"2024-04-26T07:57:24.301766+0000","last_clean":"2024-04-26T07:57:24.301766+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:57:24.301766+0000","last_undegraded":"2024-04-26T07:57:24.301766+0000","last_fullsized":"2024-04-26T07:57:24.301766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.230278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053713+0000","last_change":"2024-04-26T07:54:15.018699+0000","last_active":"2024-04-26T07:55:02.053713+0000","last_peered":"2024-04-26T07:55:02.053713+0000","last_clean":"2024-04-26T07:55:02.053713+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:55:02.053713+0000","last_undegraded":"2024-04-26T07:55:02.053713+0000","last_fullsized":"2024-04-26T07:55:02.053713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:44.643100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'4","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.408334+0000","last_change":"2024-04-26T07:55:02.067003+0000","last_active":"2024-04-26T07:56:23.408334+0000","last_peered":"2024-04-26T07:56:23.408334+0000","last_clean":"2024-04-26T07:56:23.408334+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:56:23.408334+0000","last_undegraded":"2024-04-26T07:56:23.408334+0000","last_fullsized":"2024-04-26T07:56:23.408334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:29.656543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"27'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053400+0000","last_change":"2024-04-26T07:54:21.015968+0000","last_active":"2024-04-26T07:55:02.053400+0000","last_peered":"2024-04-26T07:55:02.053400+0000","last_clean":"2024-04-26T07:55:02.053400+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:55:02.053400+0000","last_undegraded":"2024-04-26T07:55:02.053400+0000","last_fullsized":"2024-04-26T07:55:02.053400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:13.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050187+0000","last_change":"2024-04-26T07:54:23.035869+0000","last_active":"2024-04-26T07:55:02.050187+0000","last_peered":"2024-04-26T07:55:02.050187+0000","last_clean":"2024-04-26T07:55:02.050187+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:55:02.050187+0000","last_undegraded":"2024-04-26T07:55:02.050187+0000","last_fullsized":"2024-04-26T07:55:02.050187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:57.195185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047465+0000","last_change":"2024-04-26T07:54:25.027104+0000","last_active":"2024-04-26T07:55:02.047465+0000","last_peered":"2024-04-26T07:55:02.047465+0000","last_clean":"2024-04-26T07:55:02.047465+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:55:02.047465+0000","last_undegraded":"2024-04-26T07:55:02.047465+0000","last_fullsized":"2024-04-26T07:55:02.047465+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:04.495335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:04.879358+0000","last_change":"2024-04-26T07:55:02.065992+0000","last_active":"2024-04-26T07:55:04.879358+0000","last_peered":"2024-04-26T07:55:04.879358+0000","last_clean":"2024-04-26T07:55:04.879358+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:55:04.879358+0000","last_undegraded":"2024-04-26T07:55:04.879358+0000","last_fullsized":"2024-04-26T07:55:04.879358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:09.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045977+0000","last_change":"2024-04-26T07:54:15.028375+0000","last_active":"2024-04-26T07:55:02.045977+0000","last_peered":"2024-04-26T07:55:02.045977+0000","last_clean":"2024-04-26T07:55:02.045977+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:55:02.045977+0000","last_undegraded":"2024-04-26T07:55:02.045977+0000","last_fullsized":"2024-04-26T07:55:02.045977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:32.915801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050812+0000","last_change":"2024-04-26T07:54:19.014182+0000","last_active":"2024-04-26T07:55:02.050812+0000","last_peered":"2024-04-26T07:55:02.050812+0000","last_clean":"2024-04-26T07:55:02.050812+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:55:02.050812+0000","last_undegraded":"2024-04-26T07:55:02.050812+0000","last_fullsized":"2024-04-26T07:55:02.050812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:14.365835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.145043+0000","last_change":"2024-04-26T07:54:21.024658+0000","last_active":"2024-04-26T07:55:40.145043+0000","last_peered":"2024-04-26T07:55:40.145043+0000","last_clean":"2024-04-26T07:55:40.145043+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:55:40.145043+0000","last_undegraded":"2024-04-26T07:55:40.145043+0000","last_fullsized":"2024-04-26T07:55:40.145043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:25.233916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":385,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.630004+0000","last_change":"2024-04-26T07:54:23.036180+0000","last_active":"2024-04-26T07:57:24.630004+0000","last_peered":"2024-04-26T07:57:24.630004+0000","last_clean":"2024-04-26T07:57:24.630004+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:57:24.630004+0000","last_undegraded":"2024-04-26T07:57:24.630004+0000","last_fullsized":"2024-04-26T07:57:24.630004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:08.558861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053408+0000","last_change":"2024-04-26T07:54:25.027799+0000","last_active":"2024-04-26T07:55:02.053408+0000","last_peered":"2024-04-26T07:55:02.053408+0000","last_clean":"2024-04-26T07:55:02.053408+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:55:02.053408+0000","last_undegraded":"2024-04-26T07:55:02.053408+0000","last_fullsized":"2024-04-26T07:55:02.053408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:35.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438362+0000","last_change":"2024-04-26T07:54:17.006664+0000","last_active":"2024-04-26T07:57:24.438362+0000","last_peered":"2024-04-26T07:57:24.438362+0000","last_clean":"2024-04-26T07:57:24.438362+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:57:24.438362+0000","last_undegraded":"2024-04-26T07:57:24.438362+0000","last_fullsized":"2024-04-26T07:57:24.438362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049744+0000","last_change":"2024-04-26T07:54:15.020158+0000","last_active":"2024-04-26T07:55:02.049744+0000","last_peered":"2024-04-26T07:55:02.049744+0000","last_clean":"2024-04-26T07:55:02.049744+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:55:02.049744+0000","last_undegraded":"2024-04-26T07:55:02.049744+0000","last_fullsized":"2024-04-26T07:55:02.049744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:33.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.060242+0000","last_change":"2024-04-26T07:55:02.059077+0000","last_active":"2024-04-26T07:55:02.060242+0000","last_peered":"2024-04-26T07:55:02.060242+0000","last_clean":"2024-04-26T07:55:02.060242+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:55:02.060242+0000","last_undegraded":"2024-04-26T07:55:02.060242+0000","last_fullsized":"2024-04-26T07:55:02.060242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:20.105862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.346496+0000","last_change":"2024-04-26T07:54:21.022437+0000","last_active":"2024-04-26T07:56:22.346496+0000","last_peered":"2024-04-26T07:56:22.346496+0000","last_clean":"2024-04-26T07:56:22.346496+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:56:22.346496+0000","last_undegraded":"2024-04-26T07:56:22.346496+0000","last_fullsized":"2024-04-26T07:56:22.346496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:43.415554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.514862+0000","last_change":"2024-04-26T07:54:23.029180+0000","last_active":"2024-04-26T07:57:24.514862+0000","last_peered":"2024-04-26T07:57:24.514862+0000","last_clean":"2024-04-26T07:57:24.514862+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:24.514862+0000","last_undegraded":"2024-04-26T07:57:24.514862+0000","last_fullsized":"2024-04-26T07:57:24.514862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:27.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892086+0000","last_change":"2024-04-26T07:54:17.018068+0000","last_active":"2024-04-26T07:56:29.892086+0000","last_peered":"2024-04-26T07:56:29.892086+0000","last_clean":"2024-04-26T07:56:29.892086+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:56:29.892086+0000","last_undegraded":"2024-04-26T07:56:29.892086+0000","last_fullsized":"2024-04-26T07:56:29.892086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:46.004871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.058116+0000","last_change":"2024-04-26T07:54:15.021552+0000","last_active":"2024-04-26T07:55:02.058116+0000","last_peered":"2024-04-26T07:55:02.058116+0000","last_clean":"2024-04-26T07:55:02.058116+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:55:02.058116+0000","last_undegraded":"2024-04-26T07:55:02.058116+0000","last_fullsized":"2024-04-26T07:55:02.058116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048189+0000","last_change":"2024-04-26T07:54:19.017311+0000","last_active":"2024-04-26T07:55:02.048189+0000","last_peered":"2024-04-26T07:55:02.048189+0000","last_clean":"2024-04-26T07:55:02.048189+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:55:02.048189+0000","last_undegraded":"2024-04-26T07:55:02.048189+0000","last_fullsized":"2024-04-26T07:55:02.048189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:28.216267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.356414+0000","last_change":"2024-04-26T07:54:21.017174+0000","last_active":"2024-04-26T07:56:22.356414+0000","last_peered":"2024-04-26T07:56:22.356414+0000","last_clean":"2024-04-26T07:56:22.356414+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:56:22.356414+0000","last_undegraded":"2024-04-26T07:56:22.356414+0000","last_fullsized":"2024-04-26T07:56:22.356414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:32.852893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048871+0000","last_change":"2024-04-26T07:54:23.028206+0000","last_active":"2024-04-26T07:55:02.048871+0000","last_peered":"2024-04-26T07:55:02.048871+0000","last_clean":"2024-04-26T07:55:02.048871+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:55:02.048871+0000","last_undegraded":"2024-04-26T07:55:02.048871+0000","last_fullsized":"2024-04-26T07:55:02.048871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:39.298078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.965189+0000","last_change":"2024-04-26T07:54:25.038132+0000","last_active":"2024-04-26T07:55:39.965189+0000","last_peered":"2024-04-26T07:55:39.965189+0000","last_clean":"2024-04-26T07:55:39.965189+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:55:39.965189+0000","last_undegraded":"2024-04-26T07:55:39.965189+0000","last_fullsized":"2024-04-26T07:55:39.965189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:39.692413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511248+0000","last_change":"2024-04-26T07:54:16.999342+0000","last_active":"2024-04-26T07:57:24.511248+0000","last_peered":"2024-04-26T07:57:24.511248+0000","last_clean":"2024-04-26T07:57:24.511248+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:57:24.511248+0000","last_undegraded":"2024-04-26T07:57:24.511248+0000","last_fullsized":"2024-04-26T07:57:24.511248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:50.720873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055973+0000","last_change":"2024-04-26T07:54:15.021572+0000","last_active":"2024-04-26T07:55:02.055973+0000","last_peered":"2024-04-26T07:55:02.055973+0000","last_clean":"2024-04-26T07:55:02.055973+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:55:02.055973+0000","last_undegraded":"2024-04-26T07:55:02.055973+0000","last_fullsized":"2024-04-26T07:55:02.055973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047802+0000","last_change":"2024-04-26T07:54:19.014010+0000","last_active":"2024-04-26T07:55:02.047802+0000","last_peered":"2024-04-26T07:55:02.047802+0000","last_clean":"2024-04-26T07:55:02.047802+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:55:02.047802+0000","last_undegraded":"2024-04-26T07:55:02.047802+0000","last_fullsized":"2024-04-26T07:55:02.047802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:51.749121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893869+0000","last_change":"2024-04-26T07:54:21.021470+0000","last_active":"2024-04-26T07:56:39.893869+0000","last_peered":"2024-04-26T07:56:39.893869+0000","last_clean":"2024-04-26T07:56:39.893869+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:56:39.893869+0000","last_undegraded":"2024-04-26T07:56:39.893869+0000","last_fullsized":"2024-04-26T07:56:39.893869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.505241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047573+0000","last_change":"2024-04-26T07:54:23.028229+0000","last_active":"2024-04-26T07:55:02.047573+0000","last_peered":"2024-04-26T07:55:02.047573+0000","last_clean":"2024-04-26T07:55:02.047573+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:55:02.047573+0000","last_undegraded":"2024-04-26T07:55:02.047573+0000","last_fullsized":"2024-04-26T07:55:02.047573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:37.685058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:34.432492+0000","last_change":"2024-04-26T07:54:25.031077+0000","last_active":"2024-04-26T07:55:34.432492+0000","last_peered":"2024-04-26T07:55:34.432492+0000","last_clean":"2024-04-26T07:55:34.432492+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:55:34.432492+0000","last_undegraded":"2024-04-26T07:55:34.432492+0000","last_fullsized":"2024-04-26T07:55:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:53.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891503+0000","last_change":"2024-04-26T07:54:17.015501+0000","last_active":"2024-04-26T07:56:29.891503+0000","last_peered":"2024-04-26T07:56:29.891503+0000","last_clean":"2024-04-26T07:56:29.891503+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:56:29.891503+0000","last_undegraded":"2024-04-26T07:56:29.891503+0000","last_fullsized":"2024-04-26T07:56:29.891503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:45.257757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048885+0000","last_change":"2024-04-26T07:54:15.026188+0000","last_active":"2024-04-26T07:55:02.048885+0000","last_peered":"2024-04-26T07:55:02.048885+0000","last_clean":"2024-04-26T07:55:02.048885+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:55:02.048885+0000","last_undegraded":"2024-04-26T07:55:02.048885+0000","last_fullsized":"2024-04-26T07:55:02.048885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:34.359927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049912+0000","last_change":"2024-04-26T07:54:19.014021+0000","last_active":"2024-04-26T07:55:02.049912+0000","last_peered":"2024-04-26T07:55:02.049912+0000","last_clean":"2024-04-26T07:55:02.049912+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:55:02.049912+0000","last_undegraded":"2024-04-26T07:55:02.049912+0000","last_fullsized":"2024-04-26T07:55:02.049912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:28.216267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.358572+0000","last_change":"2024-04-26T07:54:21.021799+0000","last_active":"2024-04-26T07:56:22.358572+0000","last_peered":"2024-04-26T07:56:22.358572+0000","last_clean":"2024-04-26T07:56:22.358572+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:56:22.358572+0000","last_undegraded":"2024-04-26T07:56:22.358572+0000","last_fullsized":"2024-04-26T07:56:22.358572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:22.358993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":348,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.641002+0000","last_change":"2024-04-26T07:54:23.023487+0000","last_active":"2024-04-26T07:57:24.641002+0000","last_peered":"2024-04-26T07:57:24.641002+0000","last_clean":"2024-04-26T07:57:24.641002+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:24.641002+0000","last_undegraded":"2024-04-26T07:57:24.641002+0000","last_fullsized":"2024-04-26T07:57:24.641002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.968900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049165+0000","last_change":"2024-04-26T07:54:25.030802+0000","last_active":"2024-04-26T07:55:02.049165+0000","last_peered":"2024-04-26T07:55:02.049165+0000","last_clean":"2024-04-26T07:55:02.049165+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:55:02.049165+0000","last_undegraded":"2024-04-26T07:55:02.049165+0000","last_fullsized":"2024-04-26T07:55:02.049165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:55.721790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'7","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.488370+0000","last_change":"2024-04-26T07:54:17.003162+0000","last_active":"2024-04-26T07:57:24.488370+0000","last_peered":"2024-04-26T07:57:24.488370+0000","last_clean":"2024-04-26T07:57:24.488370+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:24.488370+0000","last_undegraded":"2024-04-26T07:57:24.488370+0000","last_fullsized":"2024-04-26T07:57:24.488370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:24.843992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047648+0000","last_change":"2024-04-26T07:54:15.029358+0000","last_active":"2024-04-26T07:55:02.047648+0000","last_peered":"2024-04-26T07:55:02.047648+0000","last_clean":"2024-04-26T07:55:02.047648+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:55:02.047648+0000","last_undegraded":"2024-04-26T07:55:02.047648+0000","last_fullsized":"2024-04-26T07:55:02.047648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.653945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048162+0000","last_change":"2024-04-26T07:54:19.011909+0000","last_active":"2024-04-26T07:55:02.048162+0000","last_peered":"2024-04-26T07:55:02.048162+0000","last_clean":"2024-04-26T07:55:02.048162+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:55:02.048162+0000","last_undegraded":"2024-04-26T07:55:02.048162+0000","last_fullsized":"2024-04-26T07:55:02.048162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:27.746901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'55","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.806242+0000","last_change":"2024-04-26T07:54:21.021179+0000","last_active":"2024-04-26T07:56:23.806242+0000","last_peered":"2024-04-26T07:56:23.806242+0000","last_clean":"2024-04-26T07:56:23.806242+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:56:23.806242+0000","last_undegraded":"2024-04-26T07:56:23.806242+0000","last_fullsized":"2024-04-26T07:56:23.806242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:42.295311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047462+0000","last_change":"2024-04-26T07:54:23.025278+0000","last_active":"2024-04-26T07:55:02.047462+0000","last_peered":"2024-04-26T07:55:02.047462+0000","last_clean":"2024-04-26T07:55:02.047462+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:55:02.047462+0000","last_undegraded":"2024-04-26T07:55:02.047462+0000","last_fullsized":"2024-04-26T07:55:02.047462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:56.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.615064+0000","last_change":"2024-04-26T07:54:25.034316+0000","last_active":"2024-04-26T07:57:24.615064+0000","last_peered":"2024-04-26T07:57:24.615064+0000","last_clean":"2024-04-26T07:57:24.615064+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:57:24.615064+0000","last_undegraded":"2024-04-26T07:57:24.615064+0000","last_fullsized":"2024-04-26T07:57:24.615064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:26.372578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053141+0000","last_change":"2024-04-26T07:54:17.013013+0000","last_active":"2024-04-26T07:55:02.053141+0000","last_peered":"2024-04-26T07:55:02.053141+0000","last_clean":"2024-04-26T07:55:02.053141+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:55:02.053141+0000","last_undegraded":"2024-04-26T07:55:02.053141+0000","last_fullsized":"2024-04-26T07:55:02.053141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:20.449523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048743+0000","last_change":"2024-04-26T07:54:15.001977+0000","last_active":"2024-04-26T07:55:02.048743+0000","last_peered":"2024-04-26T07:55:02.048743+0000","last_clean":"2024-04-26T07:55:02.048743+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:55:02.048743+0000","last_undegraded":"2024-04-26T07:55:02.048743+0000","last_fullsized":"2024-04-26T07:55:02.048743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055480+0000","last_change":"2024-04-26T07:54:19.016120+0000","last_active":"2024-04-26T07:55:02.055480+0000","last_peered":"2024-04-26T07:55:02.055480+0000","last_clean":"2024-04-26T07:55:02.055480+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:55:02.055480+0000","last_undegraded":"2024-04-26T07:55:02.055480+0000","last_fullsized":"2024-04-26T07:55:02.055480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:50.686377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.340595+0000","last_change":"2024-04-26T07:54:21.015734+0000","last_active":"2024-04-26T07:56:22.340595+0000","last_peered":"2024-04-26T07:56:22.340595+0000","last_clean":"2024-04-26T07:56:22.340595+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:56:22.340595+0000","last_undegraded":"2024-04-26T07:56:22.340595+0000","last_fullsized":"2024-04-26T07:56:22.340595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:01.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051951+0000","last_change":"2024-04-26T07:54:23.029968+0000","last_active":"2024-04-26T07:55:02.051951+0000","last_peered":"2024-04-26T07:55:02.051951+0000","last_clean":"2024-04-26T07:55:02.051951+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:55:02.051951+0000","last_undegraded":"2024-04-26T07:55:02.051951+0000","last_fullsized":"2024-04-26T07:55:02.051951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:29:48.620441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891158+0000","last_change":"2024-04-26T07:54:25.037903+0000","last_active":"2024-04-26T07:56:24.891158+0000","last_peered":"2024-04-26T07:56:24.891158+0000","last_clean":"2024-04-26T07:56:24.891158+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:56:24.891158+0000","last_undegraded":"2024-04-26T07:56:24.891158+0000","last_fullsized":"2024-04-26T07:56:24.891158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:45.549253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489138+0000","last_change":"2024-04-26T07:54:17.018272+0000","last_active":"2024-04-26T07:57:24.489138+0000","last_peered":"2024-04-26T07:57:24.489138+0000","last_clean":"2024-04-26T07:57:24.489138+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:24.489138+0000","last_undegraded":"2024-04-26T07:57:24.489138+0000","last_fullsized":"2024-04-26T07:57:24.489138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.173859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047922+0000","last_change":"2024-04-26T07:54:15.023312+0000","last_active":"2024-04-26T07:55:02.047922+0000","last_peered":"2024-04-26T07:55:02.047922+0000","last_clean":"2024-04-26T07:55:02.047922+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:55:02.047922+0000","last_undegraded":"2024-04-26T07:55:02.047922+0000","last_fullsized":"2024-04-26T07:55:02.047922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:10.760572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048541+0000","last_change":"2024-04-26T07:54:19.013889+0000","last_active":"2024-04-26T07:55:02.048541+0000","last_peered":"2024-04-26T07:55:02.048541+0000","last_clean":"2024-04-26T07:55:02.048541+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:55:02.048541+0000","last_undegraded":"2024-04-26T07:55:02.048541+0000","last_fullsized":"2024-04-26T07:55:02.048541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:58.450108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.366970+0000","last_change":"2024-04-26T07:54:21.019300+0000","last_active":"2024-04-26T07:56:22.366970+0000","last_peered":"2024-04-26T07:56:22.366970+0000","last_clean":"2024-04-26T07:56:22.366970+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:56:22.366970+0000","last_undegraded":"2024-04-26T07:56:22.366970+0000","last_fullsized":"2024-04-26T07:56:22.366970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:16.372622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.619110+0000","last_change":"2024-04-26T07:54:23.029786+0000","last_active":"2024-04-26T07:57:24.619110+0000","last_peered":"2024-04-26T07:57:24.619110+0000","last_clean":"2024-04-26T07:57:24.619110+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:24.619110+0000","last_undegraded":"2024-04-26T07:57:24.619110+0000","last_fullsized":"2024-04-26T07:57:24.619110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:18.250538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'12","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885862+0000","last_change":"2024-04-26T07:54:25.029180+0000","last_active":"2024-04-26T07:56:29.885862+0000","last_peered":"2024-04-26T07:56:29.885862+0000","last_clean":"2024-04-26T07:56:29.885862+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:56:29.885862+0000","last_undegraded":"2024-04-26T07:56:29.885862+0000","last_fullsized":"2024-04-26T07:56:29.885862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:48.649422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057608+0000","last_change":"2024-04-26T07:54:17.015565+0000","last_active":"2024-04-26T07:55:02.057608+0000","last_peered":"2024-04-26T07:55:02.057608+0000","last_clean":"2024-04-26T07:55:02.057608+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:55:02.057608+0000","last_undegraded":"2024-04-26T07:55:02.057608+0000","last_fullsized":"2024-04-26T07:55:02.057608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048756+0000","last_change":"2024-04-26T07:54:15.028460+0000","last_active":"2024-04-26T07:55:02.048756+0000","last_peered":"2024-04-26T07:55:02.048756+0000","last_clean":"2024-04-26T07:55:02.048756+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:55:02.048756+0000","last_undegraded":"2024-04-26T07:55:02.048756+0000","last_fullsized":"2024-04-26T07:55:02.048756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:52.128712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.419198+0000","last_change":"2024-04-26T07:55:02.064457+0000","last_active":"2024-04-26T07:56:23.419198+0000","last_peered":"2024-04-26T07:56:23.419198+0000","last_clean":"2024-04-26T07:56:23.419198+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:56:23.419198+0000","last_undegraded":"2024-04-26T07:56:23.419198+0000","last_fullsized":"2024-04-26T07:56:23.419198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:52.346497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048343+0000","last_change":"2024-04-26T07:54:21.021896+0000","last_active":"2024-04-26T07:55:02.048343+0000","last_peered":"2024-04-26T07:55:02.048343+0000","last_clean":"2024-04-26T07:55:02.048343+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:55:02.048343+0000","last_undegraded":"2024-04-26T07:55:02.048343+0000","last_fullsized":"2024-04-26T07:55:02.048343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:54.353284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":465,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.573063+0000","last_change":"2024-04-26T07:54:23.024560+0000","last_active":"2024-04-26T07:57:24.573063+0000","last_peered":"2024-04-26T07:57:24.573063+0000","last_clean":"2024-04-26T07:57:24.573063+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:24.573063+0000","last_undegraded":"2024-04-26T07:57:24.573063+0000","last_fullsized":"2024-04-26T07:57:24.573063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:34.060931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.569763+0000","last_change":"2024-04-26T07:54:25.024615+0000","last_active":"2024-04-26T07:56:23.569763+0000","last_peered":"2024-04-26T07:56:23.569763+0000","last_clean":"2024-04-26T07:56:23.569763+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:56:23.569763+0000","last_undegraded":"2024-04-26T07:56:23.569763+0000","last_fullsized":"2024-04-26T07:56:23.569763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:33.156602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054935+0000","last_change":"2024-04-26T07:54:17.004296+0000","last_active":"2024-04-26T07:55:02.054935+0000","last_peered":"2024-04-26T07:55:02.054935+0000","last_clean":"2024-04-26T07:55:02.054935+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:55:02.054935+0000","last_undegraded":"2024-04-26T07:55:02.054935+0000","last_fullsized":"2024-04-26T07:55:02.054935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:58.770481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891219+0000","last_change":"2024-04-26T07:54:15.030153+0000","last_active":"2024-04-26T07:56:24.891219+0000","last_peered":"2024-04-26T07:56:24.891219+0000","last_clean":"2024-04-26T07:56:24.891219+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:56:24.891219+0000","last_undegraded":"2024-04-26T07:56:24.891219+0000","last_fullsized":"2024-04-26T07:56:24.891219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:22.836554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050562+0000","last_change":"2024-04-26T07:54:19.013153+0000","last_active":"2024-04-26T07:55:02.050562+0000","last_peered":"2024-04-26T07:55:02.050562+0000","last_clean":"2024-04-26T07:55:02.050562+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:55:02.050562+0000","last_undegraded":"2024-04-26T07:55:02.050562+0000","last_fullsized":"2024-04-26T07:55:02.050562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:53.488291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'40","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.353272+0000","last_change":"2024-04-26T07:54:21.017142+0000","last_active":"2024-04-26T07:56:22.353272+0000","last_peered":"2024-04-26T07:56:22.353272+0000","last_clean":"2024-04-26T07:56:22.353272+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:56:22.353272+0000","last_undegraded":"2024-04-26T07:56:22.353272+0000","last_fullsized":"2024-04-26T07:56:22.353272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:59.032052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":52,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055503+0000","last_change":"2024-04-26T07:54:23.031702+0000","last_active":"2024-04-26T07:55:02.055503+0000","last_peered":"2024-04-26T07:55:02.055503+0000","last_clean":"2024-04-26T07:55:02.055503+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:55:02.055503+0000","last_undegraded":"2024-04-26T07:55:02.055503+0000","last_fullsized":"2024-04-26T07:55:02.055503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:01.038281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.546403+0000","last_change":"2024-04-26T07:54:25.025544+0000","last_active":"2024-04-26T07:57:24.546403+0000","last_peered":"2024-04-26T07:57:24.546403+0000","last_clean":"2024-04-26T07:57:24.546403+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:24.546403+0000","last_undegraded":"2024-04-26T07:57:24.546403+0000","last_fullsized":"2024-04-26T07:57:24.546403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:27.858716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438506+0000","last_change":"2024-04-26T07:54:17.016804+0000","last_active":"2024-04-26T07:57:24.438506+0000","last_peered":"2024-04-26T07:57:24.438506+0000","last_clean":"2024-04-26T07:57:24.438506+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:57:24.438506+0000","last_undegraded":"2024-04-26T07:57:24.438506+0000","last_fullsized":"2024-04-26T07:57:24.438506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:57.906958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047957+0000","last_change":"2024-04-26T07:54:06.676207+0000","last_active":"2024-04-26T07:55:02.047957+0000","last_peered":"2024-04-26T07:55:02.047957+0000","last_clean":"2024-04-26T07:55:02.047957+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:55:02.047957+0000","last_undegraded":"2024-04-26T07:55:02.047957+0000","last_fullsized":"2024-04-26T07:55:02.047957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047634+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:55:02.047634+0000","last_peered":"2024-04-26T07:55:02.047634+0000","last_clean":"2024-04-26T07:55:02.047634+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:55:02.047634+0000","last_undegraded":"2024-04-26T07:55:02.047634+0000","last_fullsized":"2024-04-26T07:55:02.047634+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:36.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046885+0000","last_change":"2024-04-26T07:54:15.028934+0000","last_active":"2024-04-26T07:55:02.046885+0000","last_peered":"2024-04-26T07:55:02.046885+0000","last_clean":"2024-04-26T07:55:02.046885+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:55:02.046885+0000","last_undegraded":"2024-04-26T07:55:02.046885+0000","last_fullsized":"2024-04-26T07:55:02.046885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:08.381931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.419477+0000","last_change":"2024-04-26T07:54:19.011625+0000","last_active":"2024-04-26T07:56:23.419477+0000","last_peered":"2024-04-26T07:56:23.419477+0000","last_clean":"2024-04-26T07:56:23.419477+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:56:23.419477+0000","last_undegraded":"2024-04-26T07:56:23.419477+0000","last_fullsized":"2024-04-26T07:56:23.419477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:48.012115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'77","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893142+0000","last_change":"2024-04-26T07:54:21.020941+0000","last_active":"2024-04-26T07:56:34.893142+0000","last_peered":"2024-04-26T07:56:34.893142+0000","last_clean":"2024-04-26T07:56:34.893142+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:56:34.893142+0000","last_undegraded":"2024-04-26T07:56:34.893142+0000","last_fullsized":"2024-04-26T07:56:34.893142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:36.877690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049318+0000","last_change":"2024-04-26T07:54:23.021938+0000","last_active":"2024-04-26T07:55:02.049318+0000","last_peered":"2024-04-26T07:55:02.049318+0000","last_clean":"2024-04-26T07:55:02.049318+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:55:02.049318+0000","last_undegraded":"2024-04-26T07:55:02.049318+0000","last_fullsized":"2024-04-26T07:55:02.049318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:19.361863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.522146+0000","last_change":"2024-04-26T07:54:25.027148+0000","last_active":"2024-04-26T07:57:24.522146+0000","last_peered":"2024-04-26T07:57:24.522146+0000","last_clean":"2024-04-26T07:57:24.522146+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:57:24.522146+0000","last_undegraded":"2024-04-26T07:57:24.522146+0000","last_fullsized":"2024-04-26T07:57:24.522146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.915380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.208184+0000","last_change":"2024-04-26T07:54:17.013632+0000","last_active":"2024-04-26T07:57:24.208184+0000","last_peered":"2024-04-26T07:57:24.208184+0000","last_clean":"2024-04-26T07:57:24.208184+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:57:24.208184+0000","last_undegraded":"2024-04-26T07:57:24.208184+0000","last_fullsized":"2024-04-26T07:57:24.208184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:52.619357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046001+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:55:02.046001+0000","last_peered":"2024-04-26T07:55:02.046001+0000","last_clean":"2024-04-26T07:55:02.046001+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:55:02.046001+0000","last_undegraded":"2024-04-26T07:55:02.046001+0000","last_fullsized":"2024-04-26T07:55:02.046001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:57.072237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884280+0000","last_change":"2024-04-26T07:54:15.007057+0000","last_active":"2024-04-26T07:56:19.884280+0000","last_peered":"2024-04-26T07:56:19.884280+0000","last_clean":"2024-04-26T07:56:19.884280+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:56:19.884280+0000","last_undegraded":"2024-04-26T07:56:19.884280+0000","last_fullsized":"2024-04-26T07:56:19.884280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052936+0000","last_change":"2024-04-26T07:54:19.013958+0000","last_active":"2024-04-26T07:55:02.052936+0000","last_peered":"2024-04-26T07:55:02.052936+0000","last_clean":"2024-04-26T07:55:02.052936+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:55:02.052936+0000","last_undegraded":"2024-04-26T07:55:02.052936+0000","last_fullsized":"2024-04-26T07:55:02.052936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:39:03.143675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094742+0000","last_change":"2024-04-26T07:54:21.024668+0000","last_active":"2024-04-26T07:57:24.094742+0000","last_peered":"2024-04-26T07:57:24.094742+0000","last_clean":"2024-04-26T07:57:24.094742+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:24.094742+0000","last_undegraded":"2024-04-26T07:57:24.094742+0000","last_fullsized":"2024-04-26T07:57:24.094742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:16.244309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047364+0000","last_change":"2024-04-26T07:54:23.030052+0000","last_active":"2024-04-26T07:55:02.047364+0000","last_peered":"2024-04-26T07:55:02.047364+0000","last_clean":"2024-04-26T07:55:02.047364+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:55:02.047364+0000","last_undegraded":"2024-04-26T07:55:02.047364+0000","last_fullsized":"2024-04-26T07:55:02.047364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:01.995533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.470476+0000","last_change":"2024-04-26T07:54:25.030964+0000","last_active":"2024-04-26T07:57:24.470476+0000","last_peered":"2024-04-26T07:57:24.470476+0000","last_clean":"2024-04-26T07:57:24.470476+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:57:24.470476+0000","last_undegraded":"2024-04-26T07:57:24.470476+0000","last_fullsized":"2024-04-26T07:57:24.470476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:48.649422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.614234+0000","last_change":"2024-04-26T07:54:17.006840+0000","last_active":"2024-04-26T07:56:20.614234+0000","last_peered":"2024-04-26T07:56:20.614234+0000","last_clean":"2024-04-26T07:56:20.614234+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:56:20.614234+0000","last_undegraded":"2024-04-26T07:56:20.614234+0000","last_fullsized":"2024-04-26T07:56:20.614234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:09.013983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051901+0000","last_change":"2024-04-26T07:54:06.674967+0000","last_active":"2024-04-26T07:55:02.051901+0000","last_peered":"2024-04-26T07:55:02.051901+0000","last_clean":"2024-04-26T07:55:02.051901+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:55:02.051901+0000","last_undegraded":"2024-04-26T07:55:02.051901+0000","last_fullsized":"2024-04-26T07:55:02.051901+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883517+0000","last_change":"2024-04-26T07:54:15.008990+0000","last_active":"2024-04-26T07:56:14.883517+0000","last_peered":"2024-04-26T07:56:14.883517+0000","last_clean":"2024-04-26T07:56:14.883517+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:56:14.883517+0000","last_undegraded":"2024-04-26T07:56:14.883517+0000","last_fullsized":"2024-04-26T07:56:14.883517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056195+0000","last_change":"2024-04-26T07:54:19.010006+0000","last_active":"2024-04-26T07:55:02.056195+0000","last_peered":"2024-04-26T07:55:02.056195+0000","last_clean":"2024-04-26T07:55:02.056195+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:55:02.056195+0000","last_undegraded":"2024-04-26T07:55:02.056195+0000","last_fullsized":"2024-04-26T07:55:02.056195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:34.544464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094944+0000","last_change":"2024-04-26T07:54:21.019871+0000","last_active":"2024-04-26T07:57:24.094944+0000","last_peered":"2024-04-26T07:57:24.094944+0000","last_clean":"2024-04-26T07:57:24.094944+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:24.094944+0000","last_undegraded":"2024-04-26T07:57:24.094944+0000","last_fullsized":"2024-04-26T07:57:24.094944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:35.816402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049650+0000","last_change":"2024-04-26T07:54:23.023485+0000","last_active":"2024-04-26T07:55:02.049650+0000","last_peered":"2024-04-26T07:55:02.049650+0000","last_clean":"2024-04-26T07:55:02.049650+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:55:02.049650+0000","last_undegraded":"2024-04-26T07:55:02.049650+0000","last_fullsized":"2024-04-26T07:55:02.049650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:57.501307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.611531+0000","last_change":"2024-04-26T07:54:25.038740+0000","last_active":"2024-04-26T07:56:20.611531+0000","last_peered":"2024-04-26T07:56:20.611531+0000","last_clean":"2024-04-26T07:56:20.611531+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:56:20.611531+0000","last_undegraded":"2024-04-26T07:56:20.611531+0000","last_fullsized":"2024-04-26T07:56:20.611531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:57.808739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804102+0000","last_change":"2024-04-26T07:54:17.009576+0000","last_active":"2024-04-26T07:56:23.804102+0000","last_peered":"2024-04-26T07:56:23.804102+0000","last_clean":"2024-04-26T07:56:23.804102+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:56:23.804102+0000","last_undegraded":"2024-04-26T07:56:23.804102+0000","last_fullsized":"2024-04-26T07:56:23.804102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:20.449523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046393+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:55:02.046393+0000","last_peered":"2024-04-26T07:55:02.046393+0000","last_clean":"2024-04-26T07:55:02.046393+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:55:02.046393+0000","last_undegraded":"2024-04-26T07:55:02.046393+0000","last_fullsized":"2024-04-26T07:55:02.046393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:23.138091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054115+0000","last_change":"2024-04-26T07:54:15.006773+0000","last_active":"2024-04-26T07:55:02.054115+0000","last_peered":"2024-04-26T07:55:02.054115+0000","last_clean":"2024-04-26T07:55:02.054115+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:55:02.054115+0000","last_undegraded":"2024-04-26T07:55:02.054115+0000","last_fullsized":"2024-04-26T07:55:02.054115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049086+0000","last_change":"2024-04-26T07:54:19.014648+0000","last_active":"2024-04-26T07:55:02.049086+0000","last_peered":"2024-04-26T07:55:02.049086+0000","last_clean":"2024-04-26T07:55:02.049086+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:55:02.049086+0000","last_undegraded":"2024-04-26T07:55:02.049086+0000","last_fullsized":"2024-04-26T07:55:02.049086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:58.767016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.817648+0000","last_change":"2024-04-26T07:54:21.022796+0000","last_active":"2024-04-26T07:57:23.817648+0000","last_peered":"2024-04-26T07:57:23.817648+0000","last_clean":"2024-04-26T07:57:23.817648+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:57:23.817648+0000","last_undegraded":"2024-04-26T07:57:23.817648+0000","last_fullsized":"2024-04-26T07:57:23.817648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:24.141025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052195+0000","last_change":"2024-04-26T07:54:23.030753+0000","last_active":"2024-04-26T07:55:02.052195+0000","last_peered":"2024-04-26T07:55:02.052195+0000","last_clean":"2024-04-26T07:55:02.052195+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:55:02.052195+0000","last_undegraded":"2024-04-26T07:55:02.052195+0000","last_fullsized":"2024-04-26T07:55:02.052195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:10.717730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.546061+0000","last_change":"2024-04-26T07:54:25.038410+0000","last_active":"2024-04-26T07:56:23.546061+0000","last_peered":"2024-04-26T07:56:23.546061+0000","last_clean":"2024-04-26T07:56:23.546061+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:56:23.546061+0000","last_undegraded":"2024-04-26T07:56:23.546061+0000","last_fullsized":"2024-04-26T07:56:23.546061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:04.495335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804171+0000","last_change":"2024-04-26T07:54:17.011145+0000","last_active":"2024-04-26T07:56:23.804171+0000","last_peered":"2024-04-26T07:56:23.804171+0000","last_clean":"2024-04-26T07:56:23.804171+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:56:23.804171+0000","last_undegraded":"2024-04-26T07:56:23.804171+0000","last_fullsized":"2024-04-26T07:56:23.804171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:59.206585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054154+0000","last_change":"2024-04-26T07:54:15.004789+0000","last_active":"2024-04-26T07:55:02.054154+0000","last_peered":"2024-04-26T07:55:02.054154+0000","last_clean":"2024-04-26T07:55:02.054154+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:55:02.054154+0000","last_undegraded":"2024-04-26T07:55:02.054154+0000","last_fullsized":"2024-04-26T07:55:02.054154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049045+0000","last_change":"2024-04-26T07:54:06.676454+0000","last_active":"2024-04-26T07:55:02.049045+0000","last_peered":"2024-04-26T07:55:02.049045+0000","last_clean":"2024-04-26T07:55:02.049045+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:55:02.049045+0000","last_undegraded":"2024-04-26T07:55:02.049045+0000","last_fullsized":"2024-04-26T07:55:02.049045+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:01.265695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885217+0000","last_change":"2024-04-26T07:54:19.010150+0000","last_active":"2024-04-26T07:56:24.885217+0000","last_peered":"2024-04-26T07:56:24.885217+0000","last_clean":"2024-04-26T07:56:24.885217+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:56:24.885217+0000","last_undegraded":"2024-04-26T07:56:24.885217+0000","last_fullsized":"2024-04-26T07:56:24.885217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:41.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'64","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885138+0000","last_change":"2024-04-26T07:54:21.021222+0000","last_active":"2024-04-26T07:56:24.885138+0000","last_peered":"2024-04-26T07:56:24.885138+0000","last_clean":"2024-04-26T07:56:24.885138+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:56:24.885138+0000","last_undegraded":"2024-04-26T07:56:24.885138+0000","last_fullsized":"2024-04-26T07:56:24.885138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:30.470262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052555+0000","last_change":"2024-04-26T07:54:23.026937+0000","last_active":"2024-04-26T07:55:02.052555+0000","last_peered":"2024-04-26T07:55:02.052555+0000","last_clean":"2024-04-26T07:55:02.052555+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:55:02.052555+0000","last_undegraded":"2024-04-26T07:55:02.052555+0000","last_fullsized":"2024-04-26T07:55:02.052555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:48.973375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.735948+0000","last_change":"2024-04-26T07:54:25.024577+0000","last_active":"2024-04-26T07:56:23.735948+0000","last_peered":"2024-04-26T07:56:23.735948+0000","last_clean":"2024-04-26T07:56:23.735948+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:56:23.735948+0000","last_undegraded":"2024-04-26T07:56:23.735948+0000","last_fullsized":"2024-04-26T07:56:23.735948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:36.834541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294896+0000","last_change":"2024-04-26T07:55:02.058346+0000","last_active":"2024-04-26T07:57:24.294896+0000","last_peered":"2024-04-26T07:57:24.294896+0000","last_clean":"2024-04-26T07:57:24.294896+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:57:24.294896+0000","last_undegraded":"2024-04-26T07:57:24.294896+0000","last_fullsized":"2024-04-26T07:57:24.294896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:32.409505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049780+0000","last_change":"2024-04-26T07:54:15.005472+0000","last_active":"2024-04-26T07:55:02.049780+0000","last_peered":"2024-04-26T07:55:02.049780+0000","last_clean":"2024-04-26T07:55:02.049780+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:55:02.049780+0000","last_undegraded":"2024-04-26T07:55:02.049780+0000","last_fullsized":"2024-04-26T07:55:02.049780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:49.044298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048351+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:55:02.048351+0000","last_peered":"2024-04-26T07:55:02.048351+0000","last_clean":"2024-04-26T07:55:02.048351+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:55:02.048351+0000","last_undegraded":"2024-04-26T07:55:02.048351+0000","last_fullsized":"2024-04-26T07:55:02.048351+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:41.674149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046277+0000","last_change":"2024-04-26T07:54:19.009597+0000","last_active":"2024-04-26T07:55:02.046277+0000","last_peered":"2024-04-26T07:55:02.046277+0000","last_clean":"2024-04-26T07:55:02.046277+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:55:02.046277+0000","last_undegraded":"2024-04-26T07:55:02.046277+0000","last_fullsized":"2024-04-26T07:55:02.046277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:05.707431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049592+0000","last_change":"2024-04-26T07:54:21.022427+0000","last_active":"2024-04-26T07:55:02.049592+0000","last_peered":"2024-04-26T07:55:02.049592+0000","last_clean":"2024-04-26T07:55:02.049592+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:55:02.049592+0000","last_undegraded":"2024-04-26T07:55:02.049592+0000","last_fullsized":"2024-04-26T07:55:02.049592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:56.633388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":355,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094511+0000","last_change":"2024-04-26T07:54:23.024550+0000","last_active":"2024-04-26T07:57:24.094511+0000","last_peered":"2024-04-26T07:57:24.094511+0000","last_clean":"2024-04-26T07:57:24.094511+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:24.094511+0000","last_undegraded":"2024-04-26T07:57:24.094511+0000","last_fullsized":"2024-04-26T07:57:24.094511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:37.685058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.225376+0000","last_change":"2024-04-26T07:54:25.036034+0000","last_active":"2024-04-26T07:57:24.225376+0000","last_peered":"2024-04-26T07:57:24.225376+0000","last_clean":"2024-04-26T07:57:24.225376+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:57:24.225376+0000","last_undegraded":"2024-04-26T07:57:24.225376+0000","last_fullsized":"2024-04-26T07:57:24.225376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:45.968753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.295712+0000","last_change":"2024-04-26T07:54:17.017609+0000","last_active":"2024-04-26T07:57:24.295712+0000","last_peered":"2024-04-26T07:57:24.295712+0000","last_clean":"2024-04-26T07:57:24.295712+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:57:24.295712+0000","last_undegraded":"2024-04-26T07:57:24.295712+0000","last_fullsized":"2024-04-26T07:57:24.295712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:21.219885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052681+0000","last_change":"2024-04-26T07:54:15.023916+0000","last_active":"2024-04-26T07:55:02.052681+0000","last_peered":"2024-04-26T07:55:02.052681+0000","last_clean":"2024-04-26T07:55:02.052681+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:55:02.052681+0000","last_undegraded":"2024-04-26T07:55:02.052681+0000","last_fullsized":"2024-04-26T07:55:02.052681+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:40.137824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049650+0000","last_change":"2024-04-26T07:54:06.676954+0000","last_active":"2024-04-26T07:55:02.049650+0000","last_peered":"2024-04-26T07:55:02.049650+0000","last_clean":"2024-04-26T07:55:02.049650+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:55:02.049650+0000","last_undegraded":"2024-04-26T07:55:02.049650+0000","last_fullsized":"2024-04-26T07:55:02.049650+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:47.328942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048912+0000","last_change":"2024-04-26T07:54:19.015515+0000","last_active":"2024-04-26T07:55:02.048912+0000","last_peered":"2024-04-26T07:55:02.048912+0000","last_clean":"2024-04-26T07:55:02.048912+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:55:02.048912+0000","last_undegraded":"2024-04-26T07:55:02.048912+0000","last_fullsized":"2024-04-26T07:55:02.048912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:23.204322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047680+0000","last_change":"2024-04-26T07:54:21.023142+0000","last_active":"2024-04-26T07:55:02.047680+0000","last_peered":"2024-04-26T07:55:02.047680+0000","last_clean":"2024-04-26T07:55:02.047680+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:55:02.047680+0000","last_undegraded":"2024-04-26T07:55:02.047680+0000","last_fullsized":"2024-04-26T07:55:02.047680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:36.423536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.615719+0000","last_change":"2024-04-26T07:54:23.028166+0000","last_active":"2024-04-26T07:57:24.615719+0000","last_peered":"2024-04-26T07:57:24.615719+0000","last_clean":"2024-04-26T07:57:24.615719+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:24.615719+0000","last_undegraded":"2024-04-26T07:57:24.615719+0000","last_fullsized":"2024-04-26T07:57:24.615719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:34.060931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052901+0000","last_change":"2024-04-26T07:54:25.036997+0000","last_active":"2024-04-26T07:55:02.052901+0000","last_peered":"2024-04-26T07:55:02.052901+0000","last_clean":"2024-04-26T07:55:02.052901+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:55:02.052901+0000","last_undegraded":"2024-04-26T07:55:02.052901+0000","last_fullsized":"2024-04-26T07:55:02.052901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:14.259642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.482999+0000","last_change":"2024-04-26T07:54:17.009702+0000","last_active":"2024-04-26T07:57:24.482999+0000","last_peered":"2024-04-26T07:57:24.482999+0000","last_clean":"2024-04-26T07:57:24.482999+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:57:24.482999+0000","last_undegraded":"2024-04-26T07:57:24.482999+0000","last_fullsized":"2024-04-26T07:57:24.482999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.581557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.189286+0000","last_change":"2024-04-26T07:54:15.009811+0000","last_active":"2024-04-26T07:57:24.189286+0000","last_peered":"2024-04-26T07:57:24.189286+0000","last_clean":"2024-04-26T07:57:24.189286+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:57:24.189286+0000","last_undegraded":"2024-04-26T07:57:24.189286+0000","last_fullsized":"2024-04-26T07:57:24.189286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052128+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:55:02.052128+0000","last_peered":"2024-04-26T07:55:02.052128+0000","last_clean":"2024-04-26T07:55:02.052128+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:55:02.052128+0000","last_undegraded":"2024-04-26T07:55:02.052128+0000","last_fullsized":"2024-04-26T07:55:02.052128+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:13.205208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049055+0000","last_change":"2024-04-26T07:54:19.010329+0000","last_active":"2024-04-26T07:55:02.049055+0000","last_peered":"2024-04-26T07:55:02.049055+0000","last_clean":"2024-04-26T07:55:02.049055+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:55:02.049055+0000","last_undegraded":"2024-04-26T07:55:02.049055+0000","last_fullsized":"2024-04-26T07:55:02.049055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.285062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.350957+0000","last_change":"2024-04-26T07:54:21.022808+0000","last_active":"2024-04-26T07:56:22.350957+0000","last_peered":"2024-04-26T07:56:22.350957+0000","last_clean":"2024-04-26T07:56:22.350957+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:56:22.350957+0000","last_undegraded":"2024-04-26T07:56:22.350957+0000","last_fullsized":"2024-04-26T07:56:22.350957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:50.018902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048378+0000","last_change":"2024-04-26T07:54:23.024114+0000","last_active":"2024-04-26T07:55:02.048378+0000","last_peered":"2024-04-26T07:55:02.048378+0000","last_clean":"2024-04-26T07:55:02.048378+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:55:02.048378+0000","last_undegraded":"2024-04-26T07:55:02.048378+0000","last_fullsized":"2024-04-26T07:55:02.048378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:09.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057538+0000","last_change":"2024-04-26T07:54:25.027810+0000","last_active":"2024-04-26T07:55:02.057538+0000","last_peered":"2024-04-26T07:55:02.057538+0000","last_clean":"2024-04-26T07:55:02.057538+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:55:02.057538+0000","last_undegraded":"2024-04-26T07:55:02.057538+0000","last_fullsized":"2024-04-26T07:55:02.057538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:48.976255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056320+0000","last_change":"2024-04-26T07:54:25.026977+0000","last_active":"2024-04-26T07:55:02.056320+0000","last_peered":"2024-04-26T07:55:02.056320+0000","last_clean":"2024-04-26T07:55:02.056320+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:55:02.056320+0000","last_undegraded":"2024-04-26T07:55:02.056320+0000","last_fullsized":"2024-04-26T07:55:02.056320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:58.871659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.483744+0000","last_change":"2024-04-26T07:54:17.012273+0000","last_active":"2024-04-26T07:57:24.483744+0000","last_peered":"2024-04-26T07:57:24.483744+0000","last_clean":"2024-04-26T07:57:24.483744+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:57:24.483744+0000","last_undegraded":"2024-04-26T07:57:24.483744+0000","last_fullsized":"2024-04-26T07:57:24.483744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:05.420036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047619+0000","last_change":"2024-04-26T07:54:15.030451+0000","last_active":"2024-04-26T07:55:02.047619+0000","last_peered":"2024-04-26T07:55:02.047619+0000","last_clean":"2024-04-26T07:55:02.047619+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:55:02.047619+0000","last_undegraded":"2024-04-26T07:55:02.047619+0000","last_fullsized":"2024-04-26T07:55:02.047619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:06.194881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051614+0000","last_change":"2024-04-26T07:54:19.011757+0000","last_active":"2024-04-26T07:55:02.051614+0000","last_peered":"2024-04-26T07:55:02.051614+0000","last_clean":"2024-04-26T07:55:02.051614+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:55:02.051614+0000","last_undegraded":"2024-04-26T07:55:02.051614+0000","last_fullsized":"2024-04-26T07:55:02.051614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:49.389674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.357538+0000","last_change":"2024-04-26T07:54:21.019609+0000","last_active":"2024-04-26T07:56:22.357538+0000","last_peered":"2024-04-26T07:56:22.357538+0000","last_clean":"2024-04-26T07:56:22.357538+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:56:22.357538+0000","last_undegraded":"2024-04-26T07:56:22.357538+0000","last_fullsized":"2024-04-26T07:56:22.357538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:33:50.119690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047082+0000","last_change":"2024-04-26T07:54:23.032745+0000","last_active":"2024-04-26T07:55:02.047082+0000","last_peered":"2024-04-26T07:55:02.047082+0000","last_clean":"2024-04-26T07:55:02.047082+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:55:02.047082+0000","last_undegraded":"2024-04-26T07:55:02.047082+0000","last_fullsized":"2024-04-26T07:55:02.047082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:08.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.068854+0000","last_change":"2024-04-26T07:54:25.036781+0000","last_active":"2024-04-26T07:56:22.068854+0000","last_peered":"2024-04-26T07:56:22.068854+0000","last_clean":"2024-04-26T07:56:22.068854+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:56:22.068854+0000","last_undegraded":"2024-04-26T07:56:22.068854+0000","last_fullsized":"2024-04-26T07:56:22.068854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:57.686455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511454+0000","last_change":"2024-04-26T07:54:17.011329+0000","last_active":"2024-04-26T07:57:24.511454+0000","last_peered":"2024-04-26T07:57:24.511454+0000","last_clean":"2024-04-26T07:57:24.511454+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:24.511454+0000","last_undegraded":"2024-04-26T07:57:24.511454+0000","last_fullsized":"2024-04-26T07:57:24.511454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:23:51.477720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055095+0000","last_change":"2024-04-26T07:54:15.016903+0000","last_active":"2024-04-26T07:55:02.055095+0000","last_peered":"2024-04-26T07:55:02.055095+0000","last_clean":"2024-04-26T07:55:02.055095+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:55:02.055095+0000","last_undegraded":"2024-04-26T07:55:02.055095+0000","last_fullsized":"2024-04-26T07:55:02.055095+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048423+0000","last_change":"2024-04-26T07:54:19.009331+0000","last_active":"2024-04-26T07:55:02.048423+0000","last_peered":"2024-04-26T07:55:02.048423+0000","last_clean":"2024-04-26T07:55:02.048423+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:55:02.048423+0000","last_undegraded":"2024-04-26T07:55:02.048423+0000","last_fullsized":"2024-04-26T07:55:02.048423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:15.348847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.822696+0000","last_change":"2024-04-26T07:54:21.017937+0000","last_active":"2024-04-26T07:57:23.822696+0000","last_peered":"2024-04-26T07:57:23.822696+0000","last_clean":"2024-04-26T07:57:23.822696+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:23.822696+0000","last_undegraded":"2024-04-26T07:57:23.822696+0000","last_fullsized":"2024-04-26T07:57:23.822696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:26.134595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052140+0000","last_change":"2024-04-26T07:54:23.031660+0000","last_active":"2024-04-26T07:55:02.052140+0000","last_peered":"2024-04-26T07:55:02.052140+0000","last_clean":"2024-04-26T07:55:02.052140+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:55:02.052140+0000","last_undegraded":"2024-04-26T07:55:02.052140+0000","last_fullsized":"2024-04-26T07:55:02.052140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:21.172069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048627+0000","last_change":"2024-04-26T07:54:25.029345+0000","last_active":"2024-04-26T07:55:02.048627+0000","last_peered":"2024-04-26T07:55:02.048627+0000","last_clean":"2024-04-26T07:55:02.048627+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:55:02.048627+0000","last_undegraded":"2024-04-26T07:55:02.048627+0000","last_fullsized":"2024-04-26T07:55:02.048627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:30.573662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'5","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.488888+0000","last_change":"2024-04-26T07:55:02.054995+0000","last_active":"2024-04-26T07:57:24.488888+0000","last_peered":"2024-04-26T07:57:24.488888+0000","last_clean":"2024-04-26T07:57:24.488888+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:57:24.488888+0000","last_undegraded":"2024-04-26T07:57:24.488888+0000","last_fullsized":"2024-04-26T07:57:24.488888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:16:17.485859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056320+0000","last_change":"2024-04-26T07:54:15.021860+0000","last_active":"2024-04-26T07:55:02.056320+0000","last_peered":"2024-04-26T07:55:02.056320+0000","last_clean":"2024-04-26T07:55:02.056320+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:55:02.056320+0000","last_undegraded":"2024-04-26T07:55:02.056320+0000","last_fullsized":"2024-04-26T07:55:02.056320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:49.044298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051003+0000","last_change":"2024-04-26T07:54:19.014096+0000","last_active":"2024-04-26T07:55:02.051003+0000","last_peered":"2024-04-26T07:55:02.051003+0000","last_clean":"2024-04-26T07:55:02.051003+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:55:02.051003+0000","last_undegraded":"2024-04-26T07:55:02.051003+0000","last_fullsized":"2024-04-26T07:55:02.051003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:15.068431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.883027+0000","last_change":"2024-04-26T07:54:21.019068+0000","last_active":"2024-04-26T07:57:23.883027+0000","last_peered":"2024-04-26T07:57:23.883027+0000","last_clean":"2024-04-26T07:57:23.883027+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:23.883027+0000","last_undegraded":"2024-04-26T07:57:23.883027+0000","last_fullsized":"2024-04-26T07:57:23.883027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:42.500340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048368+0000","last_change":"2024-04-26T07:54:23.024354+0000","last_active":"2024-04-26T07:55:02.048368+0000","last_peered":"2024-04-26T07:55:02.048368+0000","last_clean":"2024-04-26T07:55:02.048368+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:55:02.048368+0000","last_undegraded":"2024-04-26T07:55:02.048368+0000","last_fullsized":"2024-04-26T07:55:02.048368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.968900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049310+0000","last_change":"2024-04-26T07:54:25.040358+0000","last_active":"2024-04-26T07:55:02.049310+0000","last_peered":"2024-04-26T07:55:02.049310+0000","last_clean":"2024-04-26T07:55:02.049310+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:55:02.049310+0000","last_undegraded":"2024-04-26T07:55:02.049310+0000","last_fullsized":"2024-04-26T07:55:02.049310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:35.575840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'7","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489597+0000","last_change":"2024-04-26T07:54:17.017717+0000","last_active":"2024-04-26T07:57:24.489597+0000","last_peered":"2024-04-26T07:57:24.489597+0000","last_clean":"2024-04-26T07:57:24.489597+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:57:24.489597+0000","last_undegraded":"2024-04-26T07:57:24.489597+0000","last_fullsized":"2024-04-26T07:57:24.489597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:28.838862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054198+0000","last_change":"2024-04-26T07:54:15.016622+0000","last_active":"2024-04-26T07:55:02.054198+0000","last_peered":"2024-04-26T07:55:02.054198+0000","last_clean":"2024-04-26T07:55:02.054198+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:55:02.054198+0000","last_undegraded":"2024-04-26T07:55:02.054198+0000","last_fullsized":"2024-04-26T07:55:02.054198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045982+0000","last_change":"2024-04-26T07:54:19.014674+0000","last_active":"2024-04-26T07:55:02.045982+0000","last_peered":"2024-04-26T07:55:02.045982+0000","last_clean":"2024-04-26T07:55:02.045982+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:55:02.045982+0000","last_undegraded":"2024-04-26T07:55:02.045982+0000","last_fullsized":"2024-04-26T07:55:02.045982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.182169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894113+0000","last_change":"2024-04-26T07:54:21.019559+0000","last_active":"2024-04-26T07:56:44.894113+0000","last_peered":"2024-04-26T07:56:44.894113+0000","last_clean":"2024-04-26T07:56:44.894113+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:56:44.894113+0000","last_undegraded":"2024-04-26T07:56:44.894113+0000","last_fullsized":"2024-04-26T07:56:44.894113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:30.223054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053654+0000","last_change":"2024-04-26T07:54:23.027939+0000","last_active":"2024-04-26T07:55:02.053654+0000","last_peered":"2024-04-26T07:55:02.053654+0000","last_clean":"2024-04-26T07:55:02.053654+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:55:02.053654+0000","last_undegraded":"2024-04-26T07:55:02.053654+0000","last_fullsized":"2024-04-26T07:55:02.053654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:30.224134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207208+0000","last_change":"2024-04-26T07:54:17.009497+0000","last_active":"2024-04-26T07:57:24.207208+0000","last_peered":"2024-04-26T07:57:24.207208+0000","last_clean":"2024-04-26T07:57:24.207208+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:57:24.207208+0000","last_undegraded":"2024-04-26T07:57:24.207208+0000","last_fullsized":"2024-04-26T07:57:24.207208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:55.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046088+0000","last_change":"2024-04-26T07:54:15.030594+0000","last_active":"2024-04-26T07:55:02.046088+0000","last_peered":"2024-04-26T07:55:02.046088+0000","last_clean":"2024-04-26T07:55:02.046088+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:55:02.046088+0000","last_undegraded":"2024-04-26T07:55:02.046088+0000","last_fullsized":"2024-04-26T07:55:02.046088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:29.574119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050906+0000","last_change":"2024-04-26T07:54:19.014571+0000","last_active":"2024-04-26T07:55:02.050906+0000","last_peered":"2024-04-26T07:55:02.050906+0000","last_clean":"2024-04-26T07:55:02.050906+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:55:02.050906+0000","last_undegraded":"2024-04-26T07:55:02.050906+0000","last_fullsized":"2024-04-26T07:55:02.050906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:33.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.363588+0000","last_change":"2024-04-26T07:54:21.020615+0000","last_active":"2024-04-26T07:56:22.363588+0000","last_peered":"2024-04-26T07:56:22.363588+0000","last_clean":"2024-04-26T07:56:22.363588+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:56:22.363588+0000","last_undegraded":"2024-04-26T07:56:22.363588+0000","last_fullsized":"2024-04-26T07:56:22.363588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:19.165840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054281+0000","last_change":"2024-04-26T07:54:23.028286+0000","last_active":"2024-04-26T07:55:02.054281+0000","last_peered":"2024-04-26T07:55:02.054281+0000","last_clean":"2024-04-26T07:55:02.054281+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:55:02.054281+0000","last_undegraded":"2024-04-26T07:55:02.054281+0000","last_fullsized":"2024-04-26T07:55:02.054281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:21.669790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.799225+0000","last_change":"2024-04-26T07:54:25.029358+0000","last_active":"2024-04-26T07:56:23.799225+0000","last_peered":"2024-04-26T07:56:23.799225+0000","last_clean":"2024-04-26T07:56:23.799225+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:56:23.799225+0000","last_undegraded":"2024-04-26T07:56:23.799225+0000","last_fullsized":"2024-04-26T07:56:23.799225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:53.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050746+0000","last_change":"2024-04-26T07:54:17.006732+0000","last_active":"2024-04-26T07:55:02.050746+0000","last_peered":"2024-04-26T07:55:02.050746+0000","last_clean":"2024-04-26T07:55:02.050746+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:55:02.050746+0000","last_undegraded":"2024-04-26T07:55:02.050746+0000","last_fullsized":"2024-04-26T07:55:02.050746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:50.720873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048000+0000","last_change":"2024-04-26T07:54:15.016457+0000","last_active":"2024-04-26T07:55:02.048000+0000","last_peered":"2024-04-26T07:55:02.048000+0000","last_clean":"2024-04-26T07:55:02.048000+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:55:02.048000+0000","last_undegraded":"2024-04-26T07:55:02.048000+0000","last_fullsized":"2024-04-26T07:55:02.048000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:34.137578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.058106+0000","last_change":"2024-04-26T07:54:19.010468+0000","last_active":"2024-04-26T07:55:02.058106+0000","last_peered":"2024-04-26T07:55:02.058106+0000","last_clean":"2024-04-26T07:55:02.058106+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:55:02.058106+0000","last_undegraded":"2024-04-26T07:55:02.058106+0000","last_fullsized":"2024-04-26T07:55:02.058106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:00.247411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.343549+0000","last_change":"2024-04-26T07:54:21.021362+0000","last_active":"2024-04-26T07:56:22.343549+0000","last_peered":"2024-04-26T07:56:22.343549+0000","last_clean":"2024-04-26T07:56:22.343549+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:56:22.343549+0000","last_undegraded":"2024-04-26T07:56:22.343549+0000","last_fullsized":"2024-04-26T07:56:22.343549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:01.562210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048176+0000","last_change":"2024-04-26T07:54:23.033211+0000","last_active":"2024-04-26T07:55:02.048176+0000","last_peered":"2024-04-26T07:55:02.048176+0000","last_clean":"2024-04-26T07:55:02.048176+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:55:02.048176+0000","last_undegraded":"2024-04-26T07:55:02.048176+0000","last_fullsized":"2024-04-26T07:55:02.048176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:56.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046065+0000","last_change":"2024-04-26T07:54:25.040148+0000","last_active":"2024-04-26T07:55:02.046065+0000","last_peered":"2024-04-26T07:55:02.046065+0000","last_clean":"2024-04-26T07:55:02.046065+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:55:02.046065+0000","last_undegraded":"2024-04-26T07:55:02.046065+0000","last_fullsized":"2024-04-26T07:55:02.046065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:26.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.135910+0000","last_change":"2024-04-26T07:55:02.061611+0000","last_active":"2024-04-26T07:55:40.135910+0000","last_peered":"2024-04-26T07:55:40.135910+0000","last_clean":"2024-04-26T07:55:40.135910+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:55:40.135910+0000","last_undegraded":"2024-04-26T07:55:40.135910+0000","last_fullsized":"2024-04-26T07:55:40.135910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.609944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048558+0000","last_change":"2024-04-26T07:54:15.009041+0000","last_active":"2024-04-26T07:55:02.048558+0000","last_peered":"2024-04-26T07:55:02.048558+0000","last_clean":"2024-04-26T07:55:02.048558+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:55:02.048558+0000","last_undegraded":"2024-04-26T07:55:02.048558+0000","last_fullsized":"2024-04-26T07:55:02.048558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054642+0000","last_change":"2024-04-26T07:54:19.006121+0000","last_active":"2024-04-26T07:55:02.054642+0000","last_peered":"2024-04-26T07:55:02.054642+0000","last_clean":"2024-04-26T07:55:02.054642+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:55:02.054642+0000","last_undegraded":"2024-04-26T07:55:02.054642+0000","last_fullsized":"2024-04-26T07:55:02.054642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:46.405445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.361578+0000","last_change":"2024-04-26T07:54:21.021334+0000","last_active":"2024-04-26T07:56:22.361578+0000","last_peered":"2024-04-26T07:56:22.361578+0000","last_clean":"2024-04-26T07:56:22.361578+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:56:22.361578+0000","last_undegraded":"2024-04-26T07:56:22.361578+0000","last_fullsized":"2024-04-26T07:56:22.361578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:46.967145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049254+0000","last_change":"2024-04-26T07:54:23.035770+0000","last_active":"2024-04-26T07:55:02.049254+0000","last_peered":"2024-04-26T07:55:02.049254+0000","last_clean":"2024-04-26T07:55:02.049254+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:55:02.049254+0000","last_undegraded":"2024-04-26T07:55:02.049254+0000","last_fullsized":"2024-04-26T07:55:02.049254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:10.697769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.797401+0000","last_change":"2024-04-26T07:54:25.039740+0000","last_active":"2024-04-26T07:56:23.797401+0000","last_peered":"2024-04-26T07:56:23.797401+0000","last_clean":"2024-04-26T07:56:23.797401+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:56:23.797401+0000","last_undegraded":"2024-04-26T07:56:23.797401+0000","last_fullsized":"2024-04-26T07:56:23.797401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:43.196570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294830+0000","last_change":"2024-04-26T07:54:17.009954+0000","last_active":"2024-04-26T07:57:24.294830+0000","last_peered":"2024-04-26T07:57:24.294830+0000","last_clean":"2024-04-26T07:57:24.294830+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:57:24.294830+0000","last_undegraded":"2024-04-26T07:57:24.294830+0000","last_fullsized":"2024-04-26T07:57:24.294830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:38.661383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.421082+0000","last_change":"2024-04-26T07:54:15.028318+0000","last_active":"2024-04-26T07:57:24.421082+0000","last_peered":"2024-04-26T07:57:24.421082+0000","last_clean":"2024-04-26T07:57:24.421082+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:57:24.421082+0000","last_undegraded":"2024-04-26T07:57:24.421082+0000","last_fullsized":"2024-04-26T07:57:24.421082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:14.941698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051548+0000","last_change":"2024-04-26T07:54:19.011607+0000","last_active":"2024-04-26T07:55:02.051548+0000","last_peered":"2024-04-26T07:55:02.051548+0000","last_clean":"2024-04-26T07:55:02.051548+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:55:02.051548+0000","last_undegraded":"2024-04-26T07:55:02.051548+0000","last_fullsized":"2024-04-26T07:55:02.051548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:48.273952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050383+0000","last_change":"2024-04-26T07:54:21.024776+0000","last_active":"2024-04-26T07:55:02.050383+0000","last_peered":"2024-04-26T07:55:02.050383+0000","last_clean":"2024-04-26T07:55:02.050383+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:55:02.050383+0000","last_undegraded":"2024-04-26T07:55:02.050383+0000","last_fullsized":"2024-04-26T07:55:02.050383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:11.648384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.516448+0000","last_change":"2024-04-26T07:54:23.031565+0000","last_active":"2024-04-26T07:57:24.516448+0000","last_peered":"2024-04-26T07:57:24.516448+0000","last_clean":"2024-04-26T07:57:24.516448+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:24.516448+0000","last_undegraded":"2024-04-26T07:57:24.516448+0000","last_fullsized":"2024-04-26T07:57:24.516448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:58.639617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.140553+0000","last_change":"2024-04-26T07:54:25.037610+0000","last_active":"2024-04-26T07:55:40.140553+0000","last_peered":"2024-04-26T07:55:40.140553+0000","last_clean":"2024-04-26T07:55:40.140553+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:55:40.140553+0000","last_undegraded":"2024-04-26T07:55:40.140553+0000","last_fullsized":"2024-04-26T07:55:40.140553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:53.664483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.957760+0000","last_change":"2024-04-26T07:54:17.009270+0000","last_active":"2024-04-26T07:55:39.957760+0000","last_peered":"2024-04-26T07:55:39.957760+0000","last_clean":"2024-04-26T07:55:39.957760+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:55:39.957760+0000","last_undegraded":"2024-04-26T07:55:39.957760+0000","last_fullsized":"2024-04-26T07:55:39.957760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.947552+0000","last_change":"2024-04-26T07:54:15.017919+0000","last_active":"2024-04-26T07:55:39.947552+0000","last_peered":"2024-04-26T07:55:39.947552+0000","last_clean":"2024-04-26T07:55:39.947552+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:55:39.947552+0000","last_undegraded":"2024-04-26T07:55:39.947552+0000","last_fullsized":"2024-04-26T07:55:39.947552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049929+0000","last_change":"2024-04-26T07:54:19.012254+0000","last_active":"2024-04-26T07:55:02.049929+0000","last_peered":"2024-04-26T07:55:02.049929+0000","last_clean":"2024-04-26T07:55:02.049929+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:55:02.049929+0000","last_undegraded":"2024-04-26T07:55:02.049929+0000","last_fullsized":"2024-04-26T07:55:02.049929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:27.631378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.334158+0000","last_change":"2024-04-26T07:54:21.016502+0000","last_active":"2024-04-26T07:56:22.334158+0000","last_peered":"2024-04-26T07:56:22.334158+0000","last_clean":"2024-04-26T07:56:22.334158+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:56:22.334158+0000","last_undegraded":"2024-04-26T07:56:22.334158+0000","last_fullsized":"2024-04-26T07:56:22.334158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:19.663560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047166+0000","last_change":"2024-04-26T07:54:23.020772+0000","last_active":"2024-04-26T07:55:02.047166+0000","last_peered":"2024-04-26T07:55:02.047166+0000","last_clean":"2024-04-26T07:55:02.047166+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:55:02.047166+0000","last_undegraded":"2024-04-26T07:55:02.047166+0000","last_fullsized":"2024-04-26T07:55:02.047166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:33.445518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054643+0000","last_change":"2024-04-26T07:54:25.030663+0000","last_active":"2024-04-26T07:55:02.054643+0000","last_peered":"2024-04-26T07:55:02.054643+0000","last_clean":"2024-04-26T07:55:02.054643+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:55:02.054643+0000","last_undegraded":"2024-04-26T07:55:02.054643+0000","last_fullsized":"2024-04-26T07:55:02.054643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:30.573662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'18","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567445+0000","last_change":"2024-04-26T07:54:17.006502+0000","last_active":"2024-04-26T07:57:24.567445+0000","last_peered":"2024-04-26T07:57:24.567445+0000","last_clean":"2024-04-26T07:57:24.567445+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:24.567445+0000","last_undegraded":"2024-04-26T07:57:24.567445+0000","last_fullsized":"2024-04-26T07:57:24.567445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:10.389370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.660248+0000","last_change":"2024-04-26T07:54:15.028304+0000","last_active":"2024-04-26T07:56:23.660248+0000","last_peered":"2024-04-26T07:56:23.660248+0000","last_clean":"2024-04-26T07:56:23.660248+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:56:23.660248+0000","last_undegraded":"2024-04-26T07:56:23.660248+0000","last_fullsized":"2024-04-26T07:56:23.660248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:40.508331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054707+0000","last_change":"2024-04-26T07:54:19.016077+0000","last_active":"2024-04-26T07:55:02.054707+0000","last_peered":"2024-04-26T07:55:02.054707+0000","last_clean":"2024-04-26T07:55:02.054707+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:55:02.054707+0000","last_undegraded":"2024-04-26T07:55:02.054707+0000","last_fullsized":"2024-04-26T07:55:02.054707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.777725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.335268+0000","last_change":"2024-04-26T07:54:21.021321+0000","last_active":"2024-04-26T07:56:22.335268+0000","last_peered":"2024-04-26T07:56:22.335268+0000","last_clean":"2024-04-26T07:56:22.335268+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:56:22.335268+0000","last_undegraded":"2024-04-26T07:56:22.335268+0000","last_fullsized":"2024-04-26T07:56:22.335268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:07.791597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045753+0000","last_change":"2024-04-26T07:54:23.035765+0000","last_active":"2024-04-26T07:55:02.045753+0000","last_peered":"2024-04-26T07:55:02.045753+0000","last_clean":"2024-04-26T07:55:02.045753+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:55:02.045753+0000","last_undegraded":"2024-04-26T07:55:02.045753+0000","last_fullsized":"2024-04-26T07:55:02.045753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:37.356445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.484896+0000","last_change":"2024-04-26T07:54:25.035955+0000","last_active":"2024-04-26T07:57:24.484896+0000","last_peered":"2024-04-26T07:57:24.484896+0000","last_clean":"2024-04-26T07:57:24.484896+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:57:24.484896+0000","last_undegraded":"2024-04-26T07:57:24.484896+0000","last_fullsized":"2024-04-26T07:57:24.484896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:17.547313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.483578+0000","last_change":"2024-04-26T07:54:17.010362+0000","last_active":"2024-04-26T07:57:24.483578+0000","last_peered":"2024-04-26T07:57:24.483578+0000","last_clean":"2024-04-26T07:57:24.483578+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:57:24.483578+0000","last_undegraded":"2024-04-26T07:57:24.483578+0000","last_fullsized":"2024-04-26T07:57:24.483578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:03.777566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050470+0000","last_change":"2024-04-26T07:54:15.009093+0000","last_active":"2024-04-26T07:55:02.050470+0000","last_peered":"2024-04-26T07:55:02.050470+0000","last_clean":"2024-04-26T07:55:02.050470+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:55:02.050470+0000","last_undegraded":"2024-04-26T07:55:02.050470+0000","last_fullsized":"2024-04-26T07:55:02.050470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:42.204889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052220+0000","last_change":"2024-04-26T07:54:19.010756+0000","last_active":"2024-04-26T07:55:02.052220+0000","last_peered":"2024-04-26T07:55:02.052220+0000","last_clean":"2024-04-26T07:55:02.052220+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:55:02.052220+0000","last_undegraded":"2024-04-26T07:55:02.052220+0000","last_fullsized":"2024-04-26T07:55:02.052220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.227129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.359469+0000","last_change":"2024-04-26T07:54:21.020800+0000","last_active":"2024-04-26T07:56:22.359469+0000","last_peered":"2024-04-26T07:56:22.359469+0000","last_clean":"2024-04-26T07:56:22.359469+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:56:22.359469+0000","last_undegraded":"2024-04-26T07:56:22.359469+0000","last_fullsized":"2024-04-26T07:56:22.359469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:26.613231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046306+0000","last_change":"2024-04-26T07:54:23.036351+0000","last_active":"2024-04-26T07:55:02.046306+0000","last_peered":"2024-04-26T07:55:02.046306+0000","last_clean":"2024-04-26T07:55:02.046306+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:55:02.046306+0000","last_undegraded":"2024-04-26T07:55:02.046306+0000","last_fullsized":"2024-04-26T07:55:02.046306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:41.433119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.902253+0000","last_change":"2024-04-26T07:54:25.039985+0000","last_active":"2024-04-26T07:57:23.902253+0000","last_peered":"2024-04-26T07:57:23.902253+0000","last_clean":"2024-04-26T07:57:23.902253+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:57:23.902253+0000","last_undegraded":"2024-04-26T07:57:23.902253+0000","last_fullsized":"2024-04-26T07:57:23.902253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:59.311879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050871+0000","last_change":"2024-04-26T07:54:17.003817+0000","last_active":"2024-04-26T07:55:02.050871+0000","last_peered":"2024-04-26T07:55:02.050871+0000","last_clean":"2024-04-26T07:55:02.050871+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:55:02.050871+0000","last_undegraded":"2024-04-26T07:55:02.050871+0000","last_fullsized":"2024-04-26T07:55:02.050871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:28:51.342246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054411+0000","last_change":"2024-04-26T07:54:15.019611+0000","last_active":"2024-04-26T07:55:02.054411+0000","last_peered":"2024-04-26T07:55:02.054411+0000","last_clean":"2024-04-26T07:55:02.054411+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:55:02.054411+0000","last_undegraded":"2024-04-26T07:55:02.054411+0000","last_fullsized":"2024-04-26T07:55:02.054411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:21.027132+0000","last_change":"2024-04-26T07:54:19.017393+0000","last_active":"2024-04-26T07:56:21.027132+0000","last_peered":"2024-04-26T07:56:21.027132+0000","last_clean":"2024-04-26T07:56:21.027132+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:56:21.027132+0000","last_undegraded":"2024-04-26T07:56:21.027132+0000","last_fullsized":"2024-04-26T07:56:21.027132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:30.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'33","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.841717+0000","last_change":"2024-04-26T07:54:21.021890+0000","last_active":"2024-04-26T07:57:23.841717+0000","last_peered":"2024-04-26T07:57:23.841717+0000","last_clean":"2024-04-26T07:57:23.841717+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:57:23.841717+0000","last_undegraded":"2024-04-26T07:57:23.841717+0000","last_fullsized":"2024-04-26T07:57:23.841717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:56.471143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048221+0000","last_change":"2024-04-26T07:54:23.021881+0000","last_active":"2024-04-26T07:55:02.048221+0000","last_peered":"2024-04-26T07:55:02.048221+0000","last_clean":"2024-04-26T07:55:02.048221+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:55:02.048221+0000","last_undegraded":"2024-04-26T07:55:02.048221+0000","last_fullsized":"2024-04-26T07:55:02.048221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:57.195185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.371916+0000","last_change":"2024-04-26T07:54:25.040953+0000","last_active":"2024-04-26T07:56:22.371916+0000","last_peered":"2024-04-26T07:56:22.371916+0000","last_clean":"2024-04-26T07:56:22.371916+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:56:22.371916+0000","last_undegraded":"2024-04-26T07:56:22.371916+0000","last_fullsized":"2024-04-26T07:56:22.371916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:37.200888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.803805+0000","last_change":"2024-04-26T07:54:17.004457+0000","last_active":"2024-04-26T07:56:23.803805+0000","last_peered":"2024-04-26T07:56:23.803805+0000","last_clean":"2024-04-26T07:56:23.803805+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:56:23.803805+0000","last_undegraded":"2024-04-26T07:56:23.803805+0000","last_fullsized":"2024-04-26T07:56:23.803805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:27:58.240167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050573+0000","last_change":"2024-04-26T07:54:15.022353+0000","last_active":"2024-04-26T07:55:02.050573+0000","last_peered":"2024-04-26T07:55:02.050573+0000","last_clean":"2024-04-26T07:55:02.050573+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:55:02.050573+0000","last_undegraded":"2024-04-26T07:55:02.050573+0000","last_fullsized":"2024-04-26T07:55:02.050573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050768+0000","last_change":"2024-04-26T07:54:17.015322+0000","last_active":"2024-04-26T07:55:02.050768+0000","last_peered":"2024-04-26T07:55:02.050768+0000","last_clean":"2024-04-26T07:55:02.050768+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:55:02.050768+0000","last_undegraded":"2024-04-26T07:55:02.050768+0000","last_fullsized":"2024-04-26T07:55:02.050768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:08.202320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.423953+0000","last_change":"2024-04-26T07:54:15.001522+0000","last_active":"2024-04-26T07:57:24.423953+0000","last_peered":"2024-04-26T07:57:24.423953+0000","last_clean":"2024-04-26T07:57:24.423953+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:57:24.423953+0000","last_undegraded":"2024-04-26T07:57:24.423953+0000","last_fullsized":"2024-04-26T07:57:24.423953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048458+0000","last_change":"2024-04-26T07:54:17.010190+0000","last_active":"2024-04-26T07:55:02.048458+0000","last_peered":"2024-04-26T07:55:02.048458+0000","last_clean":"2024-04-26T07:55:02.048458+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:55:02.048458+0000","last_undegraded":"2024-04-26T07:55:02.048458+0000","last_fullsized":"2024-04-26T07:55:02.048458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:24.203874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046564+0000","last_change":"2024-04-26T07:54:15.025512+0000","last_active":"2024-04-26T07:55:02.046564+0000","last_peered":"2024-04-26T07:55:02.046564+0000","last_clean":"2024-04-26T07:55:02.046564+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:55:02.046564+0000","last_undegraded":"2024-04-26T07:55:02.046564+0000","last_fullsized":"2024-04-26T07:55:02.046564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:43.250319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143581+0000","last_change":"2024-04-26T07:54:17.009848+0000","last_active":"2024-04-26T07:55:40.143581+0000","last_peered":"2024-04-26T07:55:40.143581+0000","last_clean":"2024-04-26T07:55:40.143581+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:55:40.143581+0000","last_undegraded":"2024-04-26T07:55:40.143581+0000","last_fullsized":"2024-04-26T07:55:40.143581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884316+0000","last_change":"2024-04-26T07:54:15.005595+0000","last_active":"2024-04-26T07:56:19.884316+0000","last_peered":"2024-04-26T07:56:19.884316+0000","last_clean":"2024-04-26T07:56:19.884316+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:56:19.884316+0000","last_undegraded":"2024-04-26T07:56:19.884316+0000","last_fullsized":"2024-04-26T07:56:19.884316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.613906+0000","last_change":"2024-04-26T07:54:16.999767+0000","last_active":"2024-04-26T07:56:20.613906+0000","last_peered":"2024-04-26T07:56:20.613906+0000","last_clean":"2024-04-26T07:56:20.613906+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:56:20.613906+0000","last_undegraded":"2024-04-26T07:56:20.613906+0000","last_fullsized":"2024-04-26T07:56:20.613906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.777807+0000","last_change":"2024-04-26T07:54:15.003280+0000","last_active":"2024-04-26T07:56:23.777807+0000","last_peered":"2024-04-26T07:56:23.777807+0000","last_clean":"2024-04-26T07:56:23.777807+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:56:23.777807+0000","last_undegraded":"2024-04-26T07:56:23.777807+0000","last_fullsized":"2024-04-26T07:56:23.777807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511668+0000","last_change":"2024-04-26T07:54:17.003908+0000","last_active":"2024-04-26T07:57:24.511668+0000","last_peered":"2024-04-26T07:57:24.511668+0000","last_clean":"2024-04-26T07:57:24.511668+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:57:24.511668+0000","last_undegraded":"2024-04-26T07:57:24.511668+0000","last_fullsized":"2024-04-26T07:57:24.511668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:48.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048401+0000","last_change":"2024-04-26T07:54:15.017747+0000","last_active":"2024-04-26T07:55:02.048401+0000","last_peered":"2024-04-26T07:55:02.048401+0000","last_clean":"2024-04-26T07:55:02.048401+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:55:02.048401+0000","last_undegraded":"2024-04-26T07:55:02.048401+0000","last_fullsized":"2024-04-26T07:55:02.048401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518610+0000","last_change":"2024-04-26T07:54:17.006648+0000","last_active":"2024-04-26T07:57:24.518610+0000","last_peered":"2024-04-26T07:57:24.518610+0000","last_clean":"2024-04-26T07:57:24.518610+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:57:24.518610+0000","last_undegraded":"2024-04-26T07:57:24.518610+0000","last_fullsized":"2024-04-26T07:57:24.518610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:05.420036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056521+0000","last_change":"2024-04-26T07:54:15.022184+0000","last_active":"2024-04-26T07:55:02.056521+0000","last_peered":"2024-04-26T07:55:02.056521+0000","last_clean":"2024-04-26T07:55:02.056521+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:55:02.056521+0000","last_undegraded":"2024-04-26T07:55:02.056521+0000","last_fullsized":"2024-04-26T07:55:02.056521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294965+0000","last_change":"2024-04-26T07:54:16.999609+0000","last_active":"2024-04-26T07:57:24.294965+0000","last_peered":"2024-04-26T07:57:24.294965+0000","last_clean":"2024-04-26T07:57:24.294965+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:57:24.294965+0000","last_undegraded":"2024-04-26T07:57:24.294965+0000","last_fullsized":"2024-04-26T07:57:24.294965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049858+0000","last_change":"2024-04-26T07:54:15.005424+0000","last_active":"2024-04-26T07:55:02.049858+0000","last_peered":"2024-04-26T07:55:02.049858+0000","last_clean":"2024-04-26T07:55:02.049858+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:55:02.049858+0000","last_undegraded":"2024-04-26T07:55:02.049858+0000","last_fullsized":"2024-04-26T07:55:02.049858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:44.643100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.444923+0000","last_change":"2024-04-26T07:54:17.006417+0000","last_active":"2024-04-26T07:57:24.444923+0000","last_peered":"2024-04-26T07:57:24.444923+0000","last_clean":"2024-04-26T07:57:24.444923+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:57:24.444923+0000","last_undegraded":"2024-04-26T07:57:24.444923+0000","last_fullsized":"2024-04-26T07:57:24.444923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:32.537219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046690+0000","last_change":"2024-04-26T07:54:15.029863+0000","last_active":"2024-04-26T07:55:02.046690+0000","last_peered":"2024-04-26T07:55:02.046690+0000","last_clean":"2024-04-26T07:55:02.046690+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:55:02.046690+0000","last_undegraded":"2024-04-26T07:55:02.046690+0000","last_fullsized":"2024-04-26T07:55:02.046690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.237116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049233+0000","last_change":"2024-04-26T07:54:17.018186+0000","last_active":"2024-04-26T07:55:02.049233+0000","last_peered":"2024-04-26T07:55:02.049233+0000","last_clean":"2024-04-26T07:55:02.049233+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:55:02.049233+0000","last_undegraded":"2024-04-26T07:55:02.049233+0000","last_fullsized":"2024-04-26T07:55:02.049233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:42.953114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048139+0000","last_change":"2024-04-26T07:54:15.007396+0000","last_active":"2024-04-26T07:55:02.048139+0000","last_peered":"2024-04-26T07:55:02.048139+0000","last_clean":"2024-04-26T07:55:02.048139+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:55:02.048139+0000","last_undegraded":"2024-04-26T07:55:02.048139+0000","last_fullsized":"2024-04-26T07:55:02.048139+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.957894+0000","last_change":"2024-04-26T07:54:17.011327+0000","last_active":"2024-04-26T07:55:39.957894+0000","last_peered":"2024-04-26T07:55:39.957894+0000","last_clean":"2024-04-26T07:55:39.957894+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:55:39.957894+0000","last_undegraded":"2024-04-26T07:55:39.957894+0000","last_fullsized":"2024-04-26T07:55:39.957894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.428008+0000","last_change":"2024-04-26T07:54:15.017542+0000","last_active":"2024-04-26T07:57:24.428008+0000","last_peered":"2024-04-26T07:57:24.428008+0000","last_clean":"2024-04-26T07:57:24.428008+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:57:24.428008+0000","last_undegraded":"2024-04-26T07:57:24.428008+0000","last_fullsized":"2024-04-26T07:57:24.428008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:07.237734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438319+0000","last_change":"2024-04-26T07:54:17.003159+0000","last_active":"2024-04-26T07:57:24.438319+0000","last_peered":"2024-04-26T07:57:24.438319+0000","last_clean":"2024-04-26T07:57:24.438319+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:57:24.438319+0000","last_undegraded":"2024-04-26T07:57:24.438319+0000","last_fullsized":"2024-04-26T07:57:24.438319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:44.398201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.417790+0000","last_change":"2024-04-26T07:54:15.008754+0000","last_active":"2024-04-26T07:57:24.417790+0000","last_peered":"2024-04-26T07:57:24.417790+0000","last_clean":"2024-04-26T07:57:24.417790+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:57:24.417790+0000","last_undegraded":"2024-04-26T07:57:24.417790+0000","last_fullsized":"2024-04-26T07:57:24.417790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207862+0000","last_change":"2024-04-26T07:54:17.009514+0000","last_active":"2024-04-26T07:57:24.207862+0000","last_peered":"2024-04-26T07:57:24.207862+0000","last_clean":"2024-04-26T07:57:24.207862+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:57:24.207862+0000","last_undegraded":"2024-04-26T07:57:24.207862+0000","last_fullsized":"2024-04-26T07:57:24.207862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:08.202320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.431092+0000","last_change":"2024-04-26T07:54:15.022986+0000","last_active":"2024-04-26T07:57:24.431092+0000","last_peered":"2024-04-26T07:57:24.431092+0000","last_clean":"2024-04-26T07:57:24.431092+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:57:24.431092+0000","last_undegraded":"2024-04-26T07:57:24.431092+0000","last_fullsized":"2024-04-26T07:57:24.431092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:48.713435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511353+0000","last_change":"2024-04-26T07:54:17.007792+0000","last_active":"2024-04-26T07:57:24.511353+0000","last_peered":"2024-04-26T07:57:24.511353+0000","last_clean":"2024-04-26T07:57:24.511353+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:57:24.511353+0000","last_undegraded":"2024-04-26T07:57:24.511353+0000","last_fullsized":"2024-04-26T07:57:24.511353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:13.061187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048771+0000","last_change":"2024-04-26T07:54:15.026508+0000","last_active":"2024-04-26T07:55:02.048771+0000","last_peered":"2024-04-26T07:55:02.048771+0000","last_clean":"2024-04-26T07:55:02.048771+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:55:02.048771+0000","last_undegraded":"2024-04-26T07:55:02.048771+0000","last_fullsized":"2024-04-26T07:55:02.048771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.940423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804054+0000","last_change":"2024-04-26T07:54:17.016231+0000","last_active":"2024-04-26T07:56:23.804054+0000","last_peered":"2024-04-26T07:56:23.804054+0000","last_clean":"2024-04-26T07:56:23.804054+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:56:23.804054+0000","last_undegraded":"2024-04-26T07:56:23.804054+0000","last_fullsized":"2024-04-26T07:56:23.804054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.266707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057701+0000","last_change":"2024-04-26T07:54:15.022552+0000","last_active":"2024-04-26T07:55:02.057701+0000","last_peered":"2024-04-26T07:55:02.057701+0000","last_clean":"2024-04-26T07:55:02.057701+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:55:02.057701+0000","last_undegraded":"2024-04-26T07:55:02.057701+0000","last_fullsized":"2024-04-26T07:55:02.057701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143346+0000","last_change":"2024-04-26T07:54:17.000134+0000","last_active":"2024-04-26T07:55:40.143346+0000","last_peered":"2024-04-26T07:55:40.143346+0000","last_clean":"2024-04-26T07:55:40.143346+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:55:40.143346+0000","last_undegraded":"2024-04-26T07:55:40.143346+0000","last_fullsized":"2024-04-26T07:55:40.143346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052235+0000","last_change":"2024-04-26T07:54:15.025822+0000","last_active":"2024-04-26T07:55:02.052235+0000","last_peered":"2024-04-26T07:55:02.052235+0000","last_clean":"2024-04-26T07:55:02.052235+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:55:02.052235+0000","last_undegraded":"2024-04-26T07:55:02.052235+0000","last_fullsized":"2024-04-26T07:55:02.052235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:03.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047156+0000","last_change":"2024-04-26T07:54:15.029803+0000","last_active":"2024-04-26T07:55:02.047156+0000","last_peered":"2024-04-26T07:55:02.047156+0000","last_clean":"2024-04-26T07:55:02.047156+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:55:02.047156+0000","last_undegraded":"2024-04-26T07:55:02.047156+0000","last_fullsized":"2024-04-26T07:55:02.047156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:28:49.334808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511260+0000","last_change":"2024-04-26T07:54:17.001393+0000","last_active":"2024-04-26T07:57:24.511260+0000","last_peered":"2024-04-26T07:57:24.511260+0000","last_clean":"2024-04-26T07:57:24.511260+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:57:24.511260+0000","last_undegraded":"2024-04-26T07:57:24.511260+0000","last_fullsized":"2024-04-26T07:57:24.511260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:13.730381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048048+0000","last_change":"2024-04-26T07:54:15.007421+0000","last_active":"2024-04-26T07:55:02.048048+0000","last_peered":"2024-04-26T07:55:02.048048+0000","last_clean":"2024-04-26T07:55:02.048048+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:55:02.048048+0000","last_undegraded":"2024-04-26T07:55:02.048048+0000","last_fullsized":"2024-04-26T07:55:02.048048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511321+0000","last_change":"2024-04-26T07:54:17.002953+0000","last_active":"2024-04-26T07:57:24.511321+0000","last_peered":"2024-04-26T07:57:24.511321+0000","last_clean":"2024-04-26T07:57:24.511321+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:57:24.511321+0000","last_undegraded":"2024-04-26T07:57:24.511321+0000","last_fullsized":"2024-04-26T07:57:24.511321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42228,"kb_used_data":6892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329612,"statfs":{"total":96636764160,"available":96593522688,"internally_reserved":0,"allocated":7057408,"data_stored":6751956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705707,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48896,"kb_used_data":13560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322944,"statfs":{"total":96636764160,"available":96586694656,"internally_reserved":0,"allocated":13885440,"data_stored":13632181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48600,"kb_used_data":13264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323240,"statfs":{"total":96636764160,"available":96586997760,"internally_reserved":0,"allocated":13582336,"data_stored":13307988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38024,"kb_used_data":6848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333816,"statfs":{"total":96636764160,"available":96597827584,"internally_reserved":0,"allocated":7012352,"data_stored":6749173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:57:32.321 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.452+0000 7f88d7406640 1 Processor -- start 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.452+0000 7f88d7406640 1 -- start start 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.452+0000 7f88d7406640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f88d012c9e0 0x7f88d012cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.452+0000 7f88d7406640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d0096c10 con 0x7f88d0096510 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.452+0000 7f88d7406640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f88d0096de0 con 0x7f88d012c9e0 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.452+0000 7f88d51a2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f88d012c9e0 0x7f88d012cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.452+0000 7f88d49a1640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f88d0096510 0x7f88d0129440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46468/0 (socket says 172.21.15.1:46468) 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.452+0000 7f88d49a1640 1 -- 172.21.15.1:0/1593053568 learned_addr learned my addr 172.21.15.1:0/1593053568 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.453+0000 7f88d51a2640 1 -- 172.21.15.1:0/1593053568 >> v1:172.21.15.1:6789/0 conn(0x7f88d0096510 legacy=0x7f88d0129440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:32.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.453+0000 7f88d51a2640 1 -- 172.21.15.1:0/1593053568 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d012d4b0 con 0x7f88d012c9e0 2024-04-26T07:57:32.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.453+0000 7f88c7fff640 1 -- 172.21.15.1:0/1593053568 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008520435 0 0) 0x7f88d0096c10 con 0x7f88d0096510 2024-04-26T07:57:32.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.453+0000 7f88d51a2640 1 --2- 172.21.15.1:0/1593053568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d012c9e0 0x7f88d012cf70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009720 tx=0x7f88cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f695a84bdc65590a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:32.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.453+0000 7f88c7fff640 1 -- 172.21.15.1:0/1593053568 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc0316d0 con 0x7f88d012c9e0 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88c7fff640 1 -- 172.21.15.1:0/1593053568 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc037070 con 0x7f88d012c9e0 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88c7fff640 1 -- 172.21.15.1:0/1593053568 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc0319c0 con 0x7f88d012c9e0 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88d7406640 1 -- 172.21.15.1:0/1593053568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d012c9e0 msgr2=0x7f88d012cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88d7406640 1 --2- 172.21.15.1:0/1593053568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d012c9e0 0x7f88d012cf70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009720 tx=0x7f88cc02b840 comp rx=0 tx=0).stop 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88d7406640 1 -- 172.21.15.1:0/1593053568 shutdown_connections 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88d7406640 1 --2- 172.21.15.1:0/1593053568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d012c9e0 0x7f88d012cf70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88d7406640 1 -- 172.21.15.1:0/1593053568 >> 172.21.15.1:0/1593053568 conn(0x7f88d009add0 msgr2=0x7f88d009b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88d7406640 1 -- 172.21.15.1:0/1593053568 shutdown_connections 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.454+0000 7f88d7406640 1 -- 172.21.15.1:0/1593053568 wait complete. 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.455+0000 7f88d7406640 1 Processor -- start 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.455+0000 7f88d7406640 1 -- start start 2024-04-26T07:57:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.455+0000 7f88d7406640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d0096510 0x7f88d0093620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.455+0000 7f88d7406640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f88d0129b50 con 0x7f88d0096510 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.455+0000 7f88d51a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d0096510 0x7f88d0093620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.455+0000 7f88d51a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d0096510 0x7f88d0093620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35864/0 (socket says 172.21.15.1:35864) 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.455+0000 7f88d51a2640 1 -- 172.21.15.1:0/1598931856 learned_addr learned my addr 172.21.15.1:0/1598931856 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.456+0000 7f88d51a2640 1 -- 172.21.15.1:0/1598931856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d006ea30 con 0x7f88d0096510 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.456+0000 7f88d51a2640 1 --2- 172.21.15.1:0/1598931856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d0096510 0x7f88d0093620 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f88cc034040 tx=0x7f88cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.456+0000 7f88c5ffb640 1 -- 172.21.15.1:0/1598931856 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc032770 con 0x7f88d0096510 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.456+0000 7f88c5ffb640 1 -- 172.21.15.1:0/1598931856 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc032930 con 0x7f88d0096510 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.456+0000 7f88c5ffb640 1 -- 172.21.15.1:0/1598931856 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc032c50 con 0x7f88d0096510 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.456+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d006e130 con 0x7f88d0096510 2024-04-26T07:57:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.456+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d01246c0 con 0x7f88d0096510 2024-04-26T07:57:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.457+0000 7f88c5ffb640 1 -- 172.21.15.1:0/1598931856 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f88cc04c060 con 0x7f88d0096510 2024-04-26T07:57:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.457+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d00636f0 con 0x7f88d0096510 2024-04-26T07:57:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.457+0000 7f88c5ffb640 1 --2- 172.21.15.1:0/1598931856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f88b40385c0 0x7f88b403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.457+0000 7f88c5ffb640 1 -- 172.21.15.1:0/1598931856 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f88cc02f050 con 0x7f88d0096510 2024-04-26T07:57:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.458+0000 7f88d49a1640 1 --2- 172.21.15.1:0/1598931856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f88b40385c0 0x7f88b403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.458+0000 7f88d49a1640 1 --2- 172.21.15.1:0/1598931856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f88b40385c0 0x7f88b403aa80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88c0000c00 tx=0x7f88c0007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:32.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.462+0000 7f88c5ffb640 1 -- 172.21.15.1:0/1598931856 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f88cc040070 con 0x7f88d0096510 2024-04-26T07:57:32.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-26T07:57:32.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.653+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88d00992e0 con 0x7f88d0096510 2024-04-26T07:57:32.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.654+0000 7f88c5ffb640 1 -- 172.21.15.1:0/1598931856 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20924 (secure 0 0 0) 0x7f88cc039310 con 0x7f88d0096510 2024-04-26T07:57:32.651 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:57:32.651 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":29,"fsid":"ed2f0749-350f-459a-96bf-130a296577eb","created":"2024-04-26T07:53:56.542247+0000","modified":"2024-04-26T07:55:02.042579+0000","last_up_change":"2024-04-26T07:54:04.666258+0000","last_in_change":"2024-04-26T07:53:57.679587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T07:54:04.826613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:54:05.492038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T07:54:12.980548+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T07:54:15.324989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T07:54:17.270496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T07:54:19.080837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T07:54:21.028881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T07:54:23.107137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26a6bcce-05b9-47ad-a6e3-1e096604187a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6801","nonce":3827982423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6803","nonce":3827982423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6807","nonce":3827982423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3827982423},{"type":"v1","addr":"172.21.15.1:6805","nonce":3827982423}]},"public_addr":"172.21.15.1:6801/3827982423","cluster_addr":"172.21.15.1:6803/3827982423","heartbeat_back_addr":"172.21.15.1:6807/3827982423","heartbeat_front_addr":"172.21.15.1:6805/3827982423","state":["exists","up"]},{"osd":1,"uuid":"61f3627b-bf5b-44b1-8c7a-49c6f237241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6801","nonce":1888558046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6803","nonce":1888558046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6807","nonce":1888558046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1888558046},{"type":"v1","addr":"172.21.15.62:6805","nonce":1888558046}]},"public_addr":"172.21.15.62:6801/1888558046","cluster_addr":"172.21.15.62:6803/1888558046","heartbeat_back_addr":"172.21.15.62:6807/1888558046","heartbeat_front_addr":"172.21.15.62:6805/1888558046","state":["exists","up"]},{"osd":2,"uuid":"80545748-33d8-421e-9138-61368e68ba31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6809","nonce":1138534927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6811","nonce":1138534927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6815","nonce":1138534927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1138534927},{"type":"v1","addr":"172.21.15.62:6813","nonce":1138534927}]},"public_addr":"172.21.15.62:6809/1138534927","cluster_addr":"172.21.15.62:6811/1138534927","heartbeat_back_addr":"172.21.15.62:6815/1138534927","heartbeat_front_addr":"172.21.15.62:6813/1138534927","state":["exists","up"]},{"osd":3,"uuid":"29666b44-480b-4bce-9098-149f556d175e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6817","nonce":1472283839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6819","nonce":1472283839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6823","nonce":1472283839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1472283839},{"type":"v1","addr":"172.21.15.62:6821","nonce":1472283839}]},"public_addr":"172.21.15.62:6817/1472283839","cluster_addr":"172.21.15.62:6819/1472283839","heartbeat_back_addr":"172.21.15.62:6823/1472283839","heartbeat_front_addr":"172.21.15.62:6821/1472283839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.762879+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.791186+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:02.815660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:54:04.602611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.3","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"5.f","mappings":[{"from":0,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]},{"pgid":"5.16","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f88b40385c0 msgr2=0x7f88b403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 --2- 172.21.15.1:0/1598931856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f88b40385c0 0x7f88b403aa80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88c0000c00 tx=0x7f88c0007910 comp rx=0 tx=0).stop 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d0096510 msgr2=0x7f88d0093620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 --2- 172.21.15.1:0/1598931856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d0096510 0x7f88d0093620 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f88cc034040 tx=0x7f88cc0046c0 comp rx=0 tx=0).stop 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 shutdown_connections 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 --2- 172.21.15.1:0/1598931856 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f88b40385c0 0x7f88b403aa80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 --2- 172.21.15.1:0/1598931856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88d0096510 0x7f88d0093620 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 >> 172.21.15.1:0/1598931856 conn(0x7f88d009add0 msgr2=0x7f88d00978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.656+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 shutdown_connections 2024-04-26T07:57:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:32.657+0000 7f88d7406640 1 -- 172.21.15.1:0/1598931856 wait complete. 2024-04-26T07:57:33.664 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T07:57:33.664 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:57:33.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.785+0000 7f7cbff4b640 1 Processor -- start 2024-04-26T07:57:33.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.785+0000 7f7cbff4b640 1 -- start start 2024-04-26T07:57:33.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.785+0000 7f7cbff4b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7cb806d410 0x7f7cb8096ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:33.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.785+0000 7f7cbff4b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb8073520 con 0x7f7cb8096b10 2024-04-26T07:57:33.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.785+0000 7f7cbff4b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f7cb806dfd0 con 0x7f7cb806d410 2024-04-26T07:57:33.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.786+0000 7f7cbd4e6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7cb806d410 0x7f7cb8096ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:33.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.786+0000 7f7cbdce7640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7cb8096b10 0x7f7cb8122070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46472/0 (socket says 172.21.15.1:46472) 2024-04-26T07:57:33.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.786+0000 7f7cbdce7640 1 -- 172.21.15.1:0/2527905828 learned_addr learned my addr 172.21.15.1:0/2527905828 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:33.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.786+0000 7f7cbd4e6640 1 -- 172.21.15.1:0/2527905828 >> v1:172.21.15.1:6789/0 conn(0x7f7cb8096b10 legacy=0x7f7cb8122070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:33.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.786+0000 7f7cbd4e6640 1 -- 172.21.15.1:0/2527905828 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb80966e0 con 0x7f7cb806d410 2024-04-26T07:57:33.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbd4e6640 1 --2- 172.21.15.1:0/2527905828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8096ef0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009720 tx=0x7f7ca802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146f0f593cf592fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:33.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbcce5640 1 -- 172.21.15.1:0/2527905828 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca80316d0 con 0x7f7cb806d410 2024-04-26T07:57:33.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbcce5640 1 -- 172.21.15.1:0/2527905828 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca8037070 con 0x7f7cb806d410 2024-04-26T07:57:33.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbcce5640 1 -- 172.21.15.1:0/2527905828 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca80319c0 con 0x7f7cb806d410 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2527905828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 msgr2=0x7f7cb8096ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbff4b640 1 --2- 172.21.15.1:0/2527905828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8096ef0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009720 tx=0x7f7ca802b840 comp rx=0 tx=0).stop 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2527905828 shutdown_connections 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbff4b640 1 --2- 172.21.15.1:0/2527905828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8096ef0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.787+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2527905828 >> 172.21.15.1:0/2527905828 conn(0x7f7cb809b4e0 msgr2=0x7f7cb809b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.788+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2527905828 shutdown_connections 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.788+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2527905828 wait complete. 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.788+0000 7f7cbff4b640 1 Processor -- start 2024-04-26T07:57:33.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.788+0000 7f7cbff4b640 1 -- start start 2024-04-26T07:57:33.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cbff4b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8093890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:33.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cbff4b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb806dab0 con 0x7f7cb806d410 2024-04-26T07:57:33.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cbdce7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8093890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cbdce7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8093890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35872/0 (socket says 172.21.15.1:35872) 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cbdce7640 1 -- 172.21.15.1:0/2337727146 learned_addr learned my addr 172.21.15.1:0/2337727146 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cbdce7640 1 -- 172.21.15.1:0/2337727146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb80725c0 con 0x7f7cb806d410 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cbdce7640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8093890 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c4a0 tx=0x7f7cb400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cb4017070 con 0x7f7cb806d410 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb4005c10 con 0x7f7cb806d410 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb8071240 con 0x7f7cb806d410 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.789+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cb4007070 con 0x7f7cb806d410 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.790+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb8071700 con 0x7f7cb806d410 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.790+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7cb8098f10 con 0x7f7cb806d410 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.790+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7cb401a070 con 0x7f7cb806d410 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cae7fc640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c9c0385c0 0x7f7c9c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:33.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f7cb404b390 con 0x7f7cb806d410 2024-04-26T07:57:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cae7fc640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7c9c044a20 0x7f7c9c046ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c9c047590 con 0x7f7c9c044a20 2024-04-26T07:57:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7cb4052050 con 0x7f7cb806d410 2024-04-26T07:57:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cbe4e8640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7c9c044a20 0x7f7c9c046ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cbd4e6640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c9c0385c0 0x7f7c9c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cbe4e8640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7c9c044a20 0x7f7c9c046ec0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.791+0000 7f7cbd4e6640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c9c0385c0 0x7f7c9c03aa80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8036000 tx=0x7f7ca8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.792+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 <== osd.0 v2:172.21.15.1:6800/3827982423 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c9c047590 con 0x7f7c9c044a20 2024-04-26T07:57:33.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.805+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 --> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7cb81256c0 con 0x7f7c9c044a20 2024-04-26T07:57:33.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.805+0000 7f7cae7fc640 1 -- 172.21.15.1:0/2337727146 <== osd.0 v2:172.21.15.1:6800/3827982423 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7cb81256c0 con 0x7f7c9c044a20 2024-04-26T07:57:33.802 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-04-26T07:57:33.802 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:57:33.802 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-04-26T07:57:33.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7c9c044a20 msgr2=0x7f7c9c046ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:33.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7c9c044a20 0x7f7c9c046ec0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:33.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c9c0385c0 msgr2=0x7f7c9c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:33.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c9c0385c0 0x7f7c9c03aa80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8036000 tx=0x7f7ca8008030 comp rx=0 tx=0).stop 2024-04-26T07:57:33.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 msgr2=0x7f7cb8093890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:33.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8093890 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c4a0 tx=0x7f7cb400c960 comp rx=0 tx=0).stop 2024-04-26T07:57:33.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 shutdown_connections 2024-04-26T07:57:33.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:6800/3827982423,v1:172.21.15.1:6801/3827982423] conn(0x7f7c9c044a20 0x7f7c9c046ec0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:33.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f7c9c0385c0 0x7f7c9c03aa80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:33.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 --2- 172.21.15.1:0/2337727146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cb806d410 0x7f7cb8093890 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:33.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 >> 172.21.15.1:0/2337727146 conn(0x7f7cb809b4e0 msgr2=0x7f7cb8128d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:33.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 shutdown_connections 2024-04-26T07:57:33.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.806+0000 7f7cbff4b640 1 -- 172.21.15.1:0/2337727146 wait complete. 2024-04-26T07:57:33.812 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T07:57:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.918+0000 7f420a25b640 1 Processor -- start 2024-04-26T07:57:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.918+0000 7f420a25b640 1 -- start start 2024-04-26T07:57:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.918+0000 7f420a25b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f420412c9e0 0x7f420412cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.918+0000 7f420a25b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4204096c10 con 0x7f4204096510 2024-04-26T07:57:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.918+0000 7f420a25b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f4204096de0 con 0x7f420412c9e0 2024-04-26T07:57:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.918+0000 7f42037fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f420412c9e0 0x7f420412cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.918+0000 7f4202ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4204096510 0x7f4204129440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46488/0 (socket says 172.21.15.1:46488) 2024-04-26T07:57:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.918+0000 7f4202ffd640 1 -- 172.21.15.1:0/741239507 learned_addr learned my addr 172.21.15.1:0/741239507 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.919+0000 7f42037fe640 1 -- 172.21.15.1:0/741239507 >> v1:172.21.15.1:6789/0 conn(0x7f4204096510 legacy=0x7f4204129440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.919+0000 7f42037fe640 1 -- 172.21.15.1:0/741239507 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420412d4b0 con 0x7f420412c9e0 2024-04-26T07:57:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.919+0000 7f42027fc640 1 -- 172.21.15.1:0/741239507 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116551106 0 0) 0x7f4204096c10 con 0x7f4204096510 2024-04-26T07:57:33.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.919+0000 7f42037fe640 1 --2- 172.21.15.1:0/741239507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f420412c9e0 0x7f420412cf70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009720 tx=0x7f41f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4143e3ae9c1017 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f42027fc640 1 -- 172.21.15.1:0/741239507 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f80316d0 con 0x7f420412c9e0 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f42027fc640 1 -- 172.21.15.1:0/741239507 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f8037070 con 0x7f420412c9e0 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f42027fc640 1 -- 172.21.15.1:0/741239507 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f80319c0 con 0x7f420412c9e0 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f420a25b640 1 -- 172.21.15.1:0/741239507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f420412c9e0 msgr2=0x7f420412cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f420a25b640 1 --2- 172.21.15.1:0/741239507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f420412c9e0 0x7f420412cf70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009720 tx=0x7f41f802b840 comp rx=0 tx=0).stop 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f420a25b640 1 -- 172.21.15.1:0/741239507 shutdown_connections 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f420a25b640 1 --2- 172.21.15.1:0/741239507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f420412c9e0 0x7f420412cf70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f420a25b640 1 -- 172.21.15.1:0/741239507 >> 172.21.15.1:0/741239507 conn(0x7f420409add0 msgr2=0x7f420409b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f420a25b640 1 -- 172.21.15.1:0/741239507 shutdown_connections 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.920+0000 7f420a25b640 1 -- 172.21.15.1:0/741239507 wait complete. 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.921+0000 7f420a25b640 1 Processor -- start 2024-04-26T07:57:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.921+0000 7f420a25b640 1 -- start start 2024-04-26T07:57:33.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f420a25b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4204096510 0x7f4204093620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:33.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f420a25b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4204129b50 con 0x7f4204096510 2024-04-26T07:57:33.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f42037fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4204096510 0x7f4204093620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:33.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f42037fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4204096510 0x7f4204093620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35892/0 (socket says 172.21.15.1:35892) 2024-04-26T07:57:33.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f42037fe640 1 -- 172.21.15.1:0/2097641959 learned_addr learned my addr 172.21.15.1:0/2097641959 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:33.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f42037fe640 1 -- 172.21.15.1:0/2097641959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420406ea30 con 0x7f4204096510 2024-04-26T07:57:33.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f42037fe640 1 --2- 172.21.15.1:0/2097641959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4204096510 0x7f4204093620 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f41f8034040 tx=0x7f41f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:33.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f41ebfff640 1 -- 172.21.15.1:0/2097641959 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f8032770 con 0x7f4204096510 2024-04-26T07:57:33.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f41ebfff640 1 -- 172.21.15.1:0/2097641959 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f8032930 con 0x7f4204096510 2024-04-26T07:57:33.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420406e130 con 0x7f4204096510 2024-04-26T07:57:33.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f41ebfff640 1 -- 172.21.15.1:0/2097641959 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f8032c50 con 0x7f4204096510 2024-04-26T07:57:33.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.922+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42041246c0 con 0x7f4204096510 2024-04-26T07:57:33.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.923+0000 7f41ebfff640 1 -- 172.21.15.1:0/2097641959 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f41f804c060 con 0x7f4204096510 2024-04-26T07:57:33.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.923+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42040636f0 con 0x7f4204096510 2024-04-26T07:57:33.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.923+0000 7f41ebfff640 1 --2- 172.21.15.1:0/2097641959 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f41f00385c0 0x7f41f003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:33.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.923+0000 7f41ebfff640 1 -- 172.21.15.1:0/2097641959 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f41f802f050 con 0x7f4204096510 2024-04-26T07:57:33.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.924+0000 7f4202ffd640 1 --2- 172.21.15.1:0/2097641959 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f41f00385c0 0x7f41f003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:33.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.924+0000 7f4202ffd640 1 --2- 172.21.15.1:0/2097641959 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f41f00385c0 0x7f41f003aa80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f41f4000c00 tx=0x7f41f4007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:33.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:33.928+0000 7f41ebfff640 1 -- 172.21.15.1:0/2097641959 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f41f8040070 con 0x7f4204096510 2024-04-26T07:57:34.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.114+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f42040992e0 con 0x7f41f00385c0 2024-04-26T07:57:34.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.115+0000 7f41ebfff640 1 -- 172.21.15.1:0/2097641959 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f42040992e0 con 0x7f41f00385c0 2024-04-26T07:57:34.111 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T07:57:34.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.117+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f41f00385c0 msgr2=0x7f41f003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.117+0000 7f420a25b640 1 --2- 172.21.15.1:0/2097641959 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f41f00385c0 0x7f41f003aa80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f41f4000c00 tx=0x7f41f4007910 comp rx=0 tx=0).stop 2024-04-26T07:57:34.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.117+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4204096510 msgr2=0x7f4204093620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.117+0000 7f420a25b640 1 --2- 172.21.15.1:0/2097641959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4204096510 0x7f4204093620 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f41f8034040 tx=0x7f41f80046c0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.117+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 shutdown_connections 2024-04-26T07:57:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.117+0000 7f420a25b640 1 --2- 172.21.15.1:0/2097641959 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f41f00385c0 0x7f41f003aa80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.117+0000 7f420a25b640 1 --2- 172.21.15.1:0/2097641959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4204096510 0x7f4204093620 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.117+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 >> 172.21.15.1:0/2097641959 conn(0x7f420409add0 msgr2=0x7f42040978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.118+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 shutdown_connections 2024-04-26T07:57:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.118+0000 7f420a25b640 1 -- 172.21.15.1:0/2097641959 wait complete. 2024-04-26T07:57:34.124 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T07:57:34.125 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:57:34.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.231+0000 7fe2d3f15640 1 Processor -- start 2024-04-26T07:57:34.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.231+0000 7fe2d3f15640 1 -- start start 2024-04-26T07:57:34.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d3f15640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2cc098cc0 0x7fe2cc0990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d3f15640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2cc09ac30 con 0x7fe2cc0995e0 2024-04-26T07:57:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d3f15640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe2cc09b7a0 con 0x7fe2cc098cc0 2024-04-26T07:57:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d1cb1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2cc098cc0 0x7fe2cc0990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d14b0640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe2cc0995e0 0x7fe2cc12eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46494/0 (socket says 172.21.15.1:46494) 2024-04-26T07:57:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d14b0640 1 -- 172.21.15.1:0/2449887267 learned_addr learned my addr 172.21.15.1:0/2449887267 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d1cb1640 1 -- 172.21.15.1:0/2449887267 >> v1:172.21.15.1:6789/0 conn(0x7fe2cc0995e0 legacy=0x7fe2cc12eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d1cb1640 1 -- 172.21.15.1:0/2449887267 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc09b490 con 0x7fe2cc098cc0 2024-04-26T07:57:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.232+0000 7fe2d0caf640 1 -- 172.21.15.1:0/2449887267 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3171957741 0 0) 0x7fe2cc09ac30 con 0x7fe2cc0995e0 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.233+0000 7fe2d1cb1640 1 --2- 172.21.15.1:0/2449887267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc0990a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009720 tx=0x7fe2c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aabbd5cb78bc14e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.233+0000 7fe2d0caf640 1 -- 172.21.15.1:0/2449887267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c4035020 con 0x7fe2cc098cc0 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.233+0000 7fe2d0caf640 1 -- 172.21.15.1:0/2449887267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c4031760 con 0x7fe2cc098cc0 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.233+0000 7fe2d0caf640 1 -- 172.21.15.1:0/2449887267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c4031a60 con 0x7fe2cc098cc0 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.234+0000 7fe2d3f15640 1 -- 172.21.15.1:0/2449887267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 msgr2=0x7fe2cc0990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.234+0000 7fe2d3f15640 1 --2- 172.21.15.1:0/2449887267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc0990a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009720 tx=0x7fe2c402b8d0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.234+0000 7fe2d3f15640 1 -- 172.21.15.1:0/2449887267 shutdown_connections 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.234+0000 7fe2d3f15640 1 --2- 172.21.15.1:0/2449887267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc0990a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.234+0000 7fe2d3f15640 1 -- 172.21.15.1:0/2449887267 >> 172.21.15.1:0/2449887267 conn(0x7fe2cc0a1700 msgr2=0x7fe2cc0a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.234+0000 7fe2d3f15640 1 -- 172.21.15.1:0/2449887267 shutdown_connections 2024-04-26T07:57:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.234+0000 7fe2d3f15640 1 -- 172.21.15.1:0/2449887267 wait complete. 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d3f15640 1 Processor -- start 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d3f15640 1 -- start start 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d3f15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc127a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d3f15640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc12f530 con 0x7fe2cc098cc0 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d1cb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc127a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d1cb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc127a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35914/0 (socket says 172.21.15.1:35914) 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d1cb1640 1 -- 172.21.15.1:0/3030928036 learned_addr learned my addr 172.21.15.1:0/3030928036 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d1cb1640 1 -- 172.21.15.1:0/3030928036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc128920 con 0x7fe2cc098cc0 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.235+0000 7fe2d1cb1640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc127a70 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009720 tx=0x7fe2c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.236+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c403b980 con 0x7fe2cc098cc0 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.236+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c403bb40 con 0x7fe2cc098cc0 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.236+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2cc1292f0 con 0x7fe2cc098cc0 2024-04-26T07:57:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.236+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c403be60 con 0x7fe2cc098cc0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.236+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2cc127fb0 con 0x7fe2cc098cc0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.236+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2cc0976e0 con 0x7fe2cc098cc0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.236+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe2c404c060 con 0x7fe2cc098cc0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.237+0000 7fe2ca7fc640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe2b80385c0 0x7fe2b803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.237+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fe2c406de70 con 0x7fe2cc098cc0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.237+0000 7fe2ca7fc640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7fe2b80449c0 0x7fe2b8046e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.237+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2c4046e50 con 0x7fe2b80449c0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.237+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe2c4070520 con 0x7fe2cc098cc0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.237+0000 7fe2d14b0640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe2b80385c0 0x7fe2b803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.237+0000 7fe2d24b2640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7fe2b80449c0 0x7fe2b8046e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.238+0000 7fe2d24b2640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7fe2b80449c0 0x7fe2b8046e60 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.238+0000 7fe2d14b0640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe2b80385c0 0x7fe2b803aa80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0000c00 tx=0x7fe2c0007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.238+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 <== osd.1 v2:172.21.15.62:6800/1888558046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2c4046e50 con 0x7fe2b80449c0 2024-04-26T07:57:34.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.251+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 --> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe2cc06edc0 con 0x7fe2b80449c0 2024-04-26T07:57:34.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2ca7fc640 1 -- 172.21.15.1:0/3030928036 <== osd.1 v2:172.21.15.62:6800/1888558046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe2cc06edc0 con 0x7fe2b80449c0 2024-04-26T07:57:34.248 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-04-26T07:57:34.248 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:57:34.248 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-04-26T07:57:34.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7fe2b80449c0 msgr2=0x7fe2b8046e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7fe2b80449c0 0x7fe2b8046e60 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe2b80385c0 msgr2=0x7fe2b803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe2b80385c0 0x7fe2b803aa80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0000c00 tx=0x7fe2c0007970 comp rx=0 tx=0).stop 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 msgr2=0x7fe2cc127a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc127a70 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009720 tx=0x7fe2c40046c0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 shutdown_connections 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6800/1888558046,v1:172.21.15.62:6801/1888558046] conn(0x7fe2b80449c0 0x7fe2b8046e60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fe2b80385c0 0x7fe2b803aa80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 --2- 172.21.15.1:0/3030928036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2cc098cc0 0x7fe2cc127a70 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 >> 172.21.15.1:0/3030928036 conn(0x7fe2cc0a1700 msgr2=0x7fe2cc09cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 shutdown_connections 2024-04-26T07:57:34.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.252+0000 7fe2d3f15640 1 -- 172.21.15.1:0/3030928036 wait complete. 2024-04-26T07:57:34.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.363+0000 7f3706f6d640 1 Processor -- start 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.363+0000 7f3706f6d640 1 -- start start 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.363+0000 7f3706f6d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3700128920 0x7f3700128d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.363+0000 7f3706f6d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f370006da60 con 0x7f3700095d70 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.363+0000 7f3706f6d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f3700073070 con 0x7f3700128920 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.363+0000 7f3704d09640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3700128920 0x7f3700128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.363+0000 7f36fffff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3700095d70 0x7f3700096190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46500/0 (socket says 172.21.15.1:46500) 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.363+0000 7f36fffff640 1 -- 172.21.15.1:0/1334548755 learned_addr learned my addr 172.21.15.1:0/1334548755 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.364+0000 7f3704d09640 1 -- 172.21.15.1:0/1334548755 >> v1:172.21.15.1:6789/0 conn(0x7f3700095d70 legacy=0x7f3700096190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.364+0000 7f3704d09640 1 -- 172.21.15.1:0/1334548755 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3700129240 con 0x7f3700128920 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.364+0000 7f3704d09640 1 --2- 172.21.15.1:0/1334548755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700128920 0x7f3700128d00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009d90 tx=0x7f36f802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a97d28fe0a80b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.364+0000 7f36ff7fe640 1 -- 172.21.15.1:0/1334548755 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f8039070 con 0x7f3700128920 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.364+0000 7f36ff7fe640 1 -- 172.21.15.1:0/1334548755 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f802cb10 con 0x7f3700128920 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.364+0000 7f36ff7fe640 1 -- 172.21.15.1:0/1334548755 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f802ce10 con 0x7f3700128920 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.365+0000 7f3706f6d640 1 -- 172.21.15.1:0/1334548755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700128920 msgr2=0x7f3700128d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.365+0000 7f3706f6d640 1 --2- 172.21.15.1:0/1334548755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700128920 0x7f3700128d00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009d90 tx=0x7f36f802beb0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.365+0000 7f3706f6d640 1 -- 172.21.15.1:0/1334548755 shutdown_connections 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.365+0000 7f3706f6d640 1 --2- 172.21.15.1:0/1334548755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700128920 0x7f3700128d00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.365+0000 7f3706f6d640 1 -- 172.21.15.1:0/1334548755 >> 172.21.15.1:0/1334548755 conn(0x7f370009add0 msgr2=0x7f370009b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.365+0000 7f3706f6d640 1 -- 172.21.15.1:0/1334548755 shutdown_connections 2024-04-26T07:57:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.365+0000 7f3706f6d640 1 -- 172.21.15.1:0/1334548755 wait complete. 2024-04-26T07:57:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.366+0000 7f3706f6d640 1 Processor -- start 2024-04-26T07:57:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.366+0000 7f3706f6d640 1 -- start start 2024-04-26T07:57:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.366+0000 7f3706f6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700095d70 0x7f370008e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.366+0000 7f3706f6d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f370006d0f0 con 0x7f3700095d70 2024-04-26T07:57:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.366+0000 7f3704d09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700095d70 0x7f370008e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.366+0000 7f3704d09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700095d70 0x7f370008e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35940/0 (socket says 172.21.15.1:35940) 2024-04-26T07:57:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.366+0000 7f3704d09640 1 -- 172.21.15.1:0/3115359341 learned_addr learned my addr 172.21.15.1:0/3115359341 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.367+0000 7f3704d09640 1 -- 172.21.15.1:0/3115359341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3700093e60 con 0x7f3700095d70 2024-04-26T07:57:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.367+0000 7f3704d09640 1 --2- 172.21.15.1:0/3115359341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700095d70 0x7f370008e090 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f36f8037040 tx=0x7f36f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.367+0000 7f36fd7fa640 1 -- 172.21.15.1:0/3115359341 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f8039050 con 0x7f3700095d70 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.367+0000 7f36fd7fa640 1 -- 172.21.15.1:0/3115359341 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f8045070 con 0x7f3700095d70 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.367+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37000918a0 con 0x7f3700095d70 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.367+0000 7f36fd7fa640 1 -- 172.21.15.1:0/3115359341 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f803e8b0 con 0x7f3700095d70 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.367+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370008e7b0 con 0x7f3700095d70 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.368+0000 7f36fd7fa640 1 -- 172.21.15.1:0/3115359341 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f36f803ea50 con 0x7f3700095d70 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.368+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37000636f0 con 0x7f3700095d70 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.368+0000 7f36fd7fa640 1 --2- 172.21.15.1:0/3115359341 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f36e00385c0 0x7f36e003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.368+0000 7f36fd7fa640 1 -- 172.21.15.1:0/3115359341 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f36f806f100 con 0x7f3700095d70 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.369+0000 7f36fffff640 1 --2- 172.21.15.1:0/3115359341 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f36e00385c0 0x7f36e003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.369+0000 7f36fffff640 1 --2- 172.21.15.1:0/3115359341 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f36e00385c0 0x7f36e003aa80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f36e8000f60 tx=0x7f36e8007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.373+0000 7f36fd7fa640 1 -- 172.21.15.1:0/3115359341 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36f8032e20 con 0x7f3700095d70 2024-04-26T07:57:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.556+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f370006b6f0 con 0x7f36e00385c0 2024-04-26T07:57:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.556+0000 7f36fd7fa640 1 -- 172.21.15.1:0/3115359341 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f370006b6f0 con 0x7f36e00385c0 2024-04-26T07:57:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T07:57:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.558+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f36e00385c0 msgr2=0x7f36e003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.558+0000 7f3706f6d640 1 --2- 172.21.15.1:0/3115359341 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f36e00385c0 0x7f36e003aa80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f36e8000f60 tx=0x7f36e8007a80 comp rx=0 tx=0).stop 2024-04-26T07:57:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.558+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700095d70 msgr2=0x7f370008e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.558+0000 7f3706f6d640 1 --2- 172.21.15.1:0/3115359341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700095d70 0x7f370008e090 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f36f8037040 tx=0x7f36f8004a40 comp rx=0 tx=0).stop 2024-04-26T07:57:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.559+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 shutdown_connections 2024-04-26T07:57:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.559+0000 7f3706f6d640 1 --2- 172.21.15.1:0/3115359341 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f36e00385c0 0x7f36e003aa80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.559+0000 7f3706f6d640 1 --2- 172.21.15.1:0/3115359341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3700095d70 0x7f370008e090 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.559+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 >> 172.21.15.1:0/3115359341 conn(0x7f370009add0 msgr2=0x7f3700121f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.559+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 shutdown_connections 2024-04-26T07:57:34.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.559+0000 7f3706f6d640 1 -- 172.21.15.1:0/3115359341 wait complete. 2024-04-26T07:57:34.565 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T07:57:34.565 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:57:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.673+0000 7f0450def640 1 Processor -- start 2024-04-26T07:57:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.673+0000 7f0450def640 1 -- start start 2024-04-26T07:57:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.673+0000 7f0450def640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f044c12cfd0 0x7f044c12d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.674+0000 7f0450def640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044c12cb80 con 0x7f044c0954c0 2024-04-26T07:57:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.674+0000 7f0450def640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f044c097330 con 0x7f044c12cfd0 2024-04-26T07:57:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.674+0000 7f044a59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f044c12cfd0 0x7f044c12d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.674+0000 7f0449d9b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f044c0954c0 0x7f044c095930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46512/0 (socket says 172.21.15.1:46512) 2024-04-26T07:57:34.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.674+0000 7f0449d9b640 1 -- 172.21.15.1:0/565451938 learned_addr learned my addr 172.21.15.1:0/565451938 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:34.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.674+0000 7f044a59c640 1 -- 172.21.15.1:0/565451938 >> v1:172.21.15.1:6789/0 conn(0x7f044c0954c0 legacy=0x7f044c095930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.674+0000 7f044a59c640 1 -- 172.21.15.1:0/565451938 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c09c600 con 0x7f044c12cfd0 2024-04-26T07:57:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f044a59c640 1 --2- 172.21.15.1:0/565451938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c12cfd0 0x7f044c12d3b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0444009720 tx=0x7f044402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813467e6aa534c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f044959a640 1 -- 172.21.15.1:0/565451938 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04440316d0 con 0x7f044c12cfd0 2024-04-26T07:57:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f044959a640 1 -- 172.21.15.1:0/565451938 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0444037070 con 0x7f044c12cfd0 2024-04-26T07:57:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f044959a640 1 -- 172.21.15.1:0/565451938 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04440319c0 con 0x7f044c12cfd0 2024-04-26T07:57:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f0450def640 1 -- 172.21.15.1:0/565451938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c12cfd0 msgr2=0x7f044c12d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f0450def640 1 --2- 172.21.15.1:0/565451938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c12cfd0 0x7f044c12d3b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0444009720 tx=0x7f044402b840 comp rx=0 tx=0).stop 2024-04-26T07:57:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f0450def640 1 -- 172.21.15.1:0/565451938 shutdown_connections 2024-04-26T07:57:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f0450def640 1 --2- 172.21.15.1:0/565451938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c12cfd0 0x7f044c12d3b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.675+0000 7f0450def640 1 -- 172.21.15.1:0/565451938 >> 172.21.15.1:0/565451938 conn(0x7f044c09b4e0 msgr2=0x7f044c09b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.676+0000 7f0450def640 1 -- 172.21.15.1:0/565451938 shutdown_connections 2024-04-26T07:57:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.676+0000 7f0450def640 1 -- 172.21.15.1:0/565451938 wait complete. 2024-04-26T07:57:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.676+0000 7f0450def640 1 Processor -- start 2024-04-26T07:57:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.676+0000 7f0450def640 1 -- start start 2024-04-26T07:57:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f0450def640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c0954c0 0x7f044c1c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f0450def640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f044c09cb10 con 0x7f044c0954c0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f044a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c0954c0 0x7f044c1c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f044a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c0954c0 0x7f044c1c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55528/0 (socket says 172.21.15.1:55528) 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f044a59c640 1 -- 172.21.15.1:0/472062965 learned_addr learned my addr 172.21.15.1:0/472062965 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f044a59c640 1 -- 172.21.15.1:0/472062965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c126eb0 con 0x7f044c0954c0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f044a59c640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c0954c0 0x7f044c1c3890 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0444000c00 tx=0x7f04440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0444032770 con 0x7f044c0954c0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0444032910 con 0x7f044c0954c0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0444032c30 con 0x7f044c0954c0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.677+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c092480 con 0x7f044c0954c0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.678+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c1c3dd0 con 0x7f044c0954c0 2024-04-26T07:57:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.678+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f044c098e90 con 0x7f044c0954c0 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.678+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f044404c060 con 0x7f044c0954c0 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f0442ffd640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f042c0385c0 0x7f042c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f044402f050 con 0x7f044c0954c0 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f0442ffd640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f042c0449c0 0x7f042c046e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0444001d30 con 0x7f042c0449c0 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f04440722a0 con 0x7f044c0954c0 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f0449d9b640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f042c0385c0 0x7f042c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f044ad9d640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f042c0449c0 0x7f042c046e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f0449d9b640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f042c0385c0 0x7f042c03aa80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0434007fd0 tx=0x7f0434007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.679+0000 7f044ad9d640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f042c0449c0 0x7f042c046e60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.680+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 <== osd.2 v2:172.21.15.62:6808/1138534927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0444001d30 con 0x7f042c0449c0 2024-04-26T07:57:34.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.693+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 --> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f044c0907a0 con 0x7f042c0449c0 2024-04-26T07:57:34.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.694+0000 7f0442ffd640 1 -- 172.21.15.1:0/472062965 <== osd.2 v2:172.21.15.62:6808/1138534927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f043c00adb0 con 0x7f042c0449c0 2024-04-26T07:57:34.690 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-04-26T07:57:34.690 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:57:34.691 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.694+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f042c0449c0 msgr2=0x7f042c046e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.694+0000 7f0450def640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f042c0449c0 0x7f042c046e60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f042c0385c0 msgr2=0x7f042c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f042c0385c0 0x7f042c03aa80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0434007fd0 tx=0x7f0434007ac0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c0954c0 msgr2=0x7f044c1c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c0954c0 0x7f044c1c3890 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0444000c00 tx=0x7f04440046c0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 shutdown_connections 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6808/1138534927,v1:172.21.15.62:6809/1138534927] conn(0x7f042c0449c0 0x7f042c046e60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f042c0385c0 0x7f042c03aa80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 --2- 172.21.15.1:0/472062965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f044c0954c0 0x7f044c1c3890 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 >> 172.21.15.1:0/472062965 conn(0x7f044c09b4e0 msgr2=0x7f044c093930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 shutdown_connections 2024-04-26T07:57:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.695+0000 7f0450def640 1 -- 172.21.15.1:0/472062965 wait complete. 2024-04-26T07:57:34.701 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T07:57:34.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.805+0000 7f893e481640 1 Processor -- start 2024-04-26T07:57:34.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.805+0000 7f893e481640 1 -- start start 2024-04-26T07:57:34.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f893e481640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f893812c370 0x7f89381340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f893e481640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893809a780 con 0x7f893812b880 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f893e481640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f893809a9c0 con 0x7f893812c370 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f89377fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f893812c370 0x7f89381340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f8937fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f893812b880 0x7f893812bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43688/0 (socket says 172.21.15.1:43688) 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f8937fff640 1 -- 172.21.15.1:0/2842776864 learned_addr learned my addr 172.21.15.1:0/2842776864 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f89377fe640 1 -- 172.21.15.1:0/2842776864 >> v1:172.21.15.1:6789/0 conn(0x7f893812b880 legacy=0x7f893812bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f8936ffd640 1 -- 172.21.15.1:0/2842776864 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396507714 0 0) 0x7f892c001110 con 0x7f893812b880 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.806+0000 7f89377fe640 1 -- 172.21.15.1:0/2842776864 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893809b750 con 0x7f893812c370 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.807+0000 7f89377fe640 1 --2- 172.21.15.1:0/2842776864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812c370 0x7f89381340a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8928009720 tx=0x7f892802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7afbac58562ddca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.807+0000 7f8936ffd640 1 -- 172.21.15.1:0/2842776864 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8928035020 con 0x7f893812c370 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.807+0000 7f8936ffd640 1 -- 172.21.15.1:0/2842776864 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8928031760 con 0x7f893812c370 2024-04-26T07:57:34.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.807+0000 7f8936ffd640 1 -- 172.21.15.1:0/2842776864 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8928031a60 con 0x7f893812c370 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.808+0000 7f893e481640 1 -- 172.21.15.1:0/2842776864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812c370 msgr2=0x7f89381340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.808+0000 7f893e481640 1 --2- 172.21.15.1:0/2842776864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812c370 0x7f89381340a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8928009720 tx=0x7f892802b8d0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.808+0000 7f893e481640 1 -- 172.21.15.1:0/2842776864 shutdown_connections 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.808+0000 7f893e481640 1 --2- 172.21.15.1:0/2842776864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812c370 0x7f89381340a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.808+0000 7f893e481640 1 -- 172.21.15.1:0/2842776864 >> 172.21.15.1:0/2842776864 conn(0x7f89380a1700 msgr2=0x7f89380a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.808+0000 7f893e481640 1 -- 172.21.15.1:0/2842776864 shutdown_connections 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.808+0000 7f893e481640 1 -- 172.21.15.1:0/2842776864 wait complete. 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.809+0000 7f893e481640 1 Processor -- start 2024-04-26T07:57:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.809+0000 7f893e481640 1 -- start start 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.809+0000 7f893e481640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812b880 0x7f89381c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.809+0000 7f893e481640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8938134760 con 0x7f893812b880 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.809+0000 7f8937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812b880 0x7f89381c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.809+0000 7f8937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812b880 0x7f89381c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55544/0 (socket says 172.21.15.1:55544) 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.809+0000 7f8937fff640 1 -- 172.21.15.1:0/3614513987 learned_addr learned my addr 172.21.15.1:0/3614513987 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.810+0000 7f8937fff640 1 -- 172.21.15.1:0/3614513987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893806da00 con 0x7f893812b880 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.810+0000 7f8937fff640 1 --2- 172.21.15.1:0/3614513987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812b880 0x7f89381c3a80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c700 tx=0x7f892c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.810+0000 7f8934ff9640 1 -- 172.21.15.1:0/3614513987 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f892c018070 con 0x7f893812b880 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.810+0000 7f8934ff9640 1 -- 172.21.15.1:0/3614513987 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892c0070d0 con 0x7f893812b880 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.810+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893806e540 con 0x7f893812b880 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.810+0000 7f8934ff9640 1 -- 172.21.15.1:0/3614513987 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f892c0073f0 con 0x7f893812b880 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.810+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893806e100 con 0x7f893812b880 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.811+0000 7f8934ff9640 1 -- 172.21.15.1:0/3614513987 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f892c01b070 con 0x7f893812b880 2024-04-26T07:57:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.811+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f893806d1d0 con 0x7f893812b880 2024-04-26T07:57:34.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.811+0000 7f8934ff9640 1 --2- 172.21.15.1:0/3614513987 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f89240385c0 0x7f892403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:34.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.811+0000 7f8934ff9640 1 -- 172.21.15.1:0/3614513987 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f892c04b440 con 0x7f893812b880 2024-04-26T07:57:34.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.811+0000 7f89377fe640 1 --2- 172.21.15.1:0/3614513987 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f89240385c0 0x7f892403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:34.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.812+0000 7f89377fe640 1 --2- 172.21.15.1:0/3614513987 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f89240385c0 0x7f892403aa80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8928036000 tx=0x7f8928008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:34.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:34.816+0000 7f8934ff9640 1 -- 172.21.15.1:0/3614513987 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f893809a780 con 0x7f893812b880 2024-04-26T07:57:34.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.000+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f893806e390 con 0x7f89240385c0 2024-04-26T07:57:34.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.001+0000 7f8934ff9640 1 -- 172.21.15.1:0/3614513987 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f893806e390 con 0x7f89240385c0 2024-04-26T07:57:34.997 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f89240385c0 msgr2=0x7f892403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 --2- 172.21.15.1:0/3614513987 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f89240385c0 0x7f892403aa80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8928036000 tx=0x7f8928008030 comp rx=0 tx=0).stop 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812b880 msgr2=0x7f89381c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 --2- 172.21.15.1:0/3614513987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812b880 0x7f89381c3a80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c700 tx=0x7f892c00cbc0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 shutdown_connections 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 --2- 172.21.15.1:0/3614513987 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f89240385c0 0x7f892403aa80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 --2- 172.21.15.1:0/3614513987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f893812b880 0x7f89381c3a80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 >> 172.21.15.1:0/3614513987 conn(0x7f89380a1700 msgr2=0x7f893812e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 shutdown_connections 2024-04-26T07:57:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.002+0000 7f893e481640 1 -- 172.21.15.1:0/3614513987 wait complete. 2024-04-26T07:57:35.009 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T07:57:35.010 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:57:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.118+0000 7f5a11274640 1 Processor -- start 2024-04-26T07:57:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.118+0000 7f5a11274640 1 -- start start 2024-04-26T07:57:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.118+0000 7f5a11274640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5a0c12cfd0 0x7f5a0c12d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.118+0000 7f5a11274640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0c12cb80 con 0x7f5a0c0954c0 2024-04-26T07:57:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.118+0000 7f5a11274640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f5a0c097330 con 0x7f5a0c12cfd0 2024-04-26T07:57:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.119+0000 7f5a0affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5a0c12cfd0 0x7f5a0c12d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.119+0000 7f5a0a7fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5a0c0954c0 0x7f5a0c095930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43692/0 (socket says 172.21.15.1:43692) 2024-04-26T07:57:35.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.119+0000 7f5a0a7fc640 1 -- 172.21.15.1:0/1654537888 learned_addr learned my addr 172.21.15.1:0/1654537888 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:35.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.119+0000 7f5a0affd640 1 -- 172.21.15.1:0/1654537888 >> v1:172.21.15.1:6789/0 conn(0x7f5a0c0954c0 legacy=0x7f5a0c095930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.119+0000 7f5a0affd640 1 -- 172.21.15.1:0/1654537888 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c09c600 con 0x7f5a0c12cfd0 2024-04-26T07:57:35.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.119+0000 7f5a09ffb640 1 -- 172.21.15.1:0/1654537888 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941716070 0 0) 0x7f5a0c12cb80 con 0x7f5a0c0954c0 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a0affd640 1 --2- 172.21.15.1:0/1654537888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c12cfd0 0x7f5a0c12d3b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f59fc009d90 tx=0x7f59fc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a1fd56bd7bd27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a09ffb640 1 -- 172.21.15.1:0/1654537888 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59fc039070 con 0x7f5a0c12cfd0 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a09ffb640 1 -- 172.21.15.1:0/1654537888 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59fc02cb10 con 0x7f5a0c12cfd0 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a09ffb640 1 -- 172.21.15.1:0/1654537888 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59fc02ce10 con 0x7f5a0c12cfd0 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a11274640 1 -- 172.21.15.1:0/1654537888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c12cfd0 msgr2=0x7f5a0c12d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a11274640 1 --2- 172.21.15.1:0/1654537888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c12cfd0 0x7f5a0c12d3b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f59fc009d90 tx=0x7f59fc02beb0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a11274640 1 -- 172.21.15.1:0/1654537888 shutdown_connections 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a11274640 1 --2- 172.21.15.1:0/1654537888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c12cfd0 0x7f5a0c12d3b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a11274640 1 -- 172.21.15.1:0/1654537888 >> 172.21.15.1:0/1654537888 conn(0x7f5a0c09b4e0 msgr2=0x7f5a0c09b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:35.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a11274640 1 -- 172.21.15.1:0/1654537888 shutdown_connections 2024-04-26T07:57:35.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.120+0000 7f5a11274640 1 -- 172.21.15.1:0/1654537888 wait complete. 2024-04-26T07:57:35.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.121+0000 7f5a11274640 1 Processor -- start 2024-04-26T07:57:35.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.121+0000 7f5a11274640 1 -- start start 2024-04-26T07:57:35.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a11274640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c0954c0 0x7f5a0c1c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a11274640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c09cb10 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a0affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c0954c0 0x7f5a0c1c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a0affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c0954c0 0x7f5a0c1c1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55552/0 (socket says 172.21.15.1:55552) 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a0affd640 1 -- 172.21.15.1:0/2508482511 learned_addr learned my addr 172.21.15.1:0/2508482511 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a0affd640 1 -- 172.21.15.1:0/2508482511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c128b70 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a0affd640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c0954c0 0x7f5a0c1c1ae0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f59fc037040 tx=0x7f59fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59fc044070 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59fc034e10 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.122+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0c129340 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.123+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59fc039040 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.123+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0c1299e0 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.123+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a0c098eb0 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.123+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f59fc03f5b0 con 0x7f5a0c0954c0 2024-04-26T07:57:35.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.123+0000 7f5a037fe640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f59ec0385f0 0x7f59ec03aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.123+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f59fc06e5a0 con 0x7f5a0c0954c0 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.124+0000 7f5a037fe640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7f59ec0449f0 0x7f59ec046e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.124+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59ec047560 con 0x7f59ec0449f0 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.124+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f59fc075050 con 0x7f5a0c0954c0 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.124+0000 7f5a0a7fc640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f59ec0385f0 0x7f59ec03aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.124+0000 7f5a0b7fe640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7f59ec0449f0 0x7f59ec046e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.124+0000 7f5a0b7fe640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7f59ec0449f0 0x7f59ec046e90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.124+0000 7f5a0a7fc640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f59ec0385f0 0x7f59ec03aab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f59f4000c00 tx=0x7f59f4007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.125+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 <== osd.3 v2:172.21.15.62:6816/1472283839 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59ec047560 con 0x7f59ec0449f0 2024-04-26T07:57:35.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 --> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5a0c0636f0 con 0x7f59ec0449f0 2024-04-26T07:57:35.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a037fe640 1 -- 172.21.15.1:0/2508482511 <== osd.3 v2:172.21.15.62:6816/1472283839 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5a0c0636f0 con 0x7f59ec0449f0 2024-04-26T07:57:35.135 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-04-26T07:57:35.135 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:57:35.135 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-04-26T07:57:35.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7f59ec0449f0 msgr2=0x7f59ec046e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7f59ec0449f0 0x7f59ec046e90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f59ec0385f0 msgr2=0x7f59ec03aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f59ec0385f0 0x7f59ec03aab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f59f4000c00 tx=0x7f59f4007910 comp rx=0 tx=0).stop 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c0954c0 msgr2=0x7f5a0c1c1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c0954c0 0x7f5a0c1c1ae0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f59fc037040 tx=0x7f59fc004a40 comp rx=0 tx=0).stop 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 shutdown_connections 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6816/1472283839,v1:172.21.15.62:6817/1472283839] conn(0x7f59ec0449f0 0x7f59ec046e90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f59ec0385f0 0x7f59ec03aab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 --2- 172.21.15.1:0/2508482511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a0c0954c0 0x7f5a0c1c1ae0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.139+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 >> 172.21.15.1:0/2508482511 conn(0x7f5a0c09b4e0 msgr2=0x7f5a0c12c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.140+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 shutdown_connections 2024-04-26T07:57:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.140+0000 7f5a11274640 1 -- 172.21.15.1:0/2508482511 wait complete. 2024-04-26T07:57:35.146 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.251+0000 7f0b7443a640 1 Processor -- start 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.251+0000 7f0b7443a640 1 -- start start 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.251+0000 7f0b7443a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0b6c132fb0 0x7f0b6c133660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.251+0000 7f0b7443a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b6c0967f0 con 0x7f0b6c133ba0 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.251+0000 7f0b7443a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f0b6c095ed0 con 0x7f0b6c132fb0 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.252+0000 7f0b721d6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0b6c132fb0 0x7f0b6c133660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.252+0000 7f0b719d5640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0b6c133ba0 0x7f0b6c12fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43702/0 (socket says 172.21.15.1:43702) 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.252+0000 7f0b719d5640 1 -- 172.21.15.1:0/1351626656 learned_addr learned my addr 172.21.15.1:0/1351626656 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.252+0000 7f0b721d6640 1 -- 172.21.15.1:0/1351626656 >> v1:172.21.15.1:6789/0 conn(0x7f0b6c133ba0 legacy=0x7f0b6c12fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.252+0000 7f0b721d6640 1 -- 172.21.15.1:0/1351626656 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c073210 con 0x7f0b6c132fb0 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b721d6640 1 --2- 172.21.15.1:0/1351626656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c133660 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009720 tx=0x7f0b5c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e00565b184b9271 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b711d4640 1 -- 172.21.15.1:0/1351626656 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b5c0316d0 con 0x7f0b6c132fb0 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b711d4640 1 -- 172.21.15.1:0/1351626656 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c037070 con 0x7f0b6c132fb0 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b711d4640 1 -- 172.21.15.1:0/1351626656 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b5c0319c0 con 0x7f0b6c132fb0 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b7443a640 1 -- 172.21.15.1:0/1351626656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 msgr2=0x7f0b6c133660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b7443a640 1 --2- 172.21.15.1:0/1351626656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c133660 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009720 tx=0x7f0b5c02b840 comp rx=0 tx=0).stop 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b7443a640 1 -- 172.21.15.1:0/1351626656 shutdown_connections 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b7443a640 1 --2- 172.21.15.1:0/1351626656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c133660 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.253+0000 7f0b7443a640 1 -- 172.21.15.1:0/1351626656 >> 172.21.15.1:0/1351626656 conn(0x7f0b6c09add0 msgr2=0x7f0b6c09b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.254+0000 7f0b7443a640 1 -- 172.21.15.1:0/1351626656 shutdown_connections 2024-04-26T07:57:35.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.254+0000 7f0b7443a640 1 -- 172.21.15.1:0/1351626656 wait complete. 2024-04-26T07:57:35.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.254+0000 7f0b7443a640 1 Processor -- start 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.254+0000 7f0b7443a640 1 -- start start 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b7443a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b7443a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c096d90 con 0x7f0b6c132fb0 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b721d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b721d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c1c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55566/0 (socket says 172.21.15.1:55566) 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b721d6640 1 -- 172.21.15.1:0/2921959479 learned_addr learned my addr 172.21.15.1:0/2921959479 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b721d6640 1 -- 172.21.15.1:0/2921959479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c071540 con 0x7f0b6c132fb0 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b721d6640 1 --2- 172.21.15.1:0/2921959479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c1c8170 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c000c00 tx=0x7f0b5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b62ffd640 1 -- 172.21.15.1:0/2921959479 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b5c032640 con 0x7f0b6c132fb0 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.255+0000 7f0b62ffd640 1 -- 172.21.15.1:0/2921959479 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c032800 con 0x7f0b6c132fb0 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.256+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6c071f70 con 0x7f0b6c132fb0 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.256+0000 7f0b62ffd640 1 -- 172.21.15.1:0/2921959479 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b5c032b20 con 0x7f0b6c132fb0 2024-04-26T07:57:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.256+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6c0719c0 con 0x7f0b6c132fb0 2024-04-26T07:57:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.256+0000 7f0b62ffd640 1 -- 172.21.15.1:0/2921959479 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0b5c04c060 con 0x7f0b6c132fb0 2024-04-26T07:57:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.256+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6c0636f0 con 0x7f0b6c132fb0 2024-04-26T07:57:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.257+0000 7f0b62ffd640 1 --2- 172.21.15.1:0/2921959479 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b50038570 0x7f0b5003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.257+0000 7f0b62ffd640 1 -- 172.21.15.1:0/2921959479 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f0b5c02f050 con 0x7f0b6c132fb0 2024-04-26T07:57:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.257+0000 7f0b719d5640 1 --2- 172.21.15.1:0/2921959479 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b50038570 0x7f0b5003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.257+0000 7f0b719d5640 1 --2- 172.21.15.1:0/2921959479 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b50038570 0x7f0b5003aa30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b68007fd0 tx=0x7f0b68007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.261+0000 7f0b62ffd640 1 -- 172.21.15.1:0/2921959479 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b5c040070 con 0x7f0b6c132fb0 2024-04-26T07:57:35.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.446+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f0b6c071350 con 0x7f0b50038570 2024-04-26T07:57:35.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.447+0000 7f0b62ffd640 1 -- 172.21.15.1:0/2921959479 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0b6c071350 con 0x7f0b50038570 2024-04-26T07:57:35.443 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T07:57:35.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b50038570 msgr2=0x7f0b5003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 --2- 172.21.15.1:0/2921959479 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b50038570 0x7f0b5003aa30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b68007fd0 tx=0x7f0b68007ac0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 msgr2=0x7f0b6c1c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 --2- 172.21.15.1:0/2921959479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c1c8170 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c000c00 tx=0x7f0b5c0046c0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 shutdown_connections 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 --2- 172.21.15.1:0/2921959479 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f0b50038570 0x7f0b5003aa30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 --2- 172.21.15.1:0/2921959479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c132fb0 0x7f0b6c1c8170 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 >> 172.21.15.1:0/2921959479 conn(0x7f0b6c09add0 msgr2=0x7f0b6c0978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 shutdown_connections 2024-04-26T07:57:35.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.449+0000 7f0b7443a640 1 -- 172.21.15.1:0/2921959479 wait complete. 2024-04-26T07:57:35.456 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.559+0000 7ff98a115640 1 Processor -- start 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.559+0000 7ff98a115640 1 -- start start 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.559+0000 7ff98a115640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff984128920 0x7ff984128d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.559+0000 7ff98a115640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff98406da60 con 0x7ff984095d70 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.559+0000 7ff98a115640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff984073070 con 0x7ff984128920 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.559+0000 7ff9837fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff984128920 0x7ff984128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.559+0000 7ff982ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff984095d70 0x7ff984096190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43714/0 (socket says 172.21.15.1:43714) 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.559+0000 7ff982ffd640 1 -- 172.21.15.1:0/2609343018 learned_addr learned my addr 172.21.15.1:0/2609343018 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:35.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.560+0000 7ff9837fe640 1 -- 172.21.15.1:0/2609343018 >> v1:172.21.15.1:6789/0 conn(0x7ff984095d70 legacy=0x7ff984096190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.560+0000 7ff9837fe640 1 -- 172.21.15.1:0/2609343018 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff984129240 con 0x7ff984128920 2024-04-26T07:57:35.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.560+0000 7ff9837fe640 1 --2- 172.21.15.1:0/2609343018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984128920 0x7ff984128d00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff974009720 tx=0x7ff97402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb2c1f9a4f11a7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff9827fc640 1 -- 172.21.15.1:0/2609343018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9740316d0 con 0x7ff984128920 2024-04-26T07:57:35.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff9827fc640 1 -- 172.21.15.1:0/2609343018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974037070 con 0x7ff984128920 2024-04-26T07:57:35.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff9827fc640 1 -- 172.21.15.1:0/2609343018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9740319c0 con 0x7ff984128920 2024-04-26T07:57:35.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff98a115640 1 -- 172.21.15.1:0/2609343018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984128920 msgr2=0x7ff984128d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff98a115640 1 --2- 172.21.15.1:0/2609343018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984128920 0x7ff984128d00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff974009720 tx=0x7ff97402b840 comp rx=0 tx=0).stop 2024-04-26T07:57:35.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff98a115640 1 -- 172.21.15.1:0/2609343018 shutdown_connections 2024-04-26T07:57:35.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff98a115640 1 --2- 172.21.15.1:0/2609343018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984128920 0x7ff984128d00 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff98a115640 1 -- 172.21.15.1:0/2609343018 >> 172.21.15.1:0/2609343018 conn(0x7ff98409add0 msgr2=0x7ff98409b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:35.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff98a115640 1 -- 172.21.15.1:0/2609343018 shutdown_connections 2024-04-26T07:57:35.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.561+0000 7ff98a115640 1 -- 172.21.15.1:0/2609343018 wait complete. 2024-04-26T07:57:35.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.562+0000 7ff98a115640 1 Processor -- start 2024-04-26T07:57:35.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.562+0000 7ff98a115640 1 -- start start 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff98a115640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984095d70 0x7ff98408c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff98a115640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff98406d0f0 con 0x7ff984095d70 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff9837fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984095d70 0x7ff98408c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff9837fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984095d70 0x7ff98408c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55592/0 (socket says 172.21.15.1:55592) 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff9837fe640 1 -- 172.21.15.1:0/643425733 learned_addr learned my addr 172.21.15.1:0/643425733 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff9837fe640 1 -- 172.21.15.1:0/643425733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98408f3e0 con 0x7ff984095d70 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff9837fe640 1 --2- 172.21.15.1:0/643425733 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984095d70 0x7ff98408c320 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff974000c00 tx=0x7ff9740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff96bfff640 1 -- 172.21.15.1:0/643425733 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff974032770 con 0x7ff984095d70 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff96bfff640 1 -- 172.21.15.1:0/643425733 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974032910 con 0x7ff984095d70 2024-04-26T07:57:35.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98408f820 con 0x7ff984095d70 2024-04-26T07:57:35.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff96bfff640 1 -- 172.21.15.1:0/643425733 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff974032c30 con 0x7ff984095d70 2024-04-26T07:57:35.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.563+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98408ca40 con 0x7ff984095d70 2024-04-26T07:57:35.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.564+0000 7ff96bfff640 1 -- 172.21.15.1:0/643425733 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff97404c060 con 0x7ff984095d70 2024-04-26T07:57:35.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.564+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98408eb70 con 0x7ff984095d70 2024-04-26T07:57:35.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.564+0000 7ff96bfff640 1 --2- 172.21.15.1:0/643425733 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9700385c0 0x7ff97003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:35.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.564+0000 7ff96bfff640 1 -- 172.21.15.1:0/643425733 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7ff97402f050 con 0x7ff984095d70 2024-04-26T07:57:35.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.565+0000 7ff982ffd640 1 --2- 172.21.15.1:0/643425733 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9700385c0 0x7ff97003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:35.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.565+0000 7ff982ffd640 1 --2- 172.21.15.1:0/643425733 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9700385c0 0x7ff97003aa80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff978007fd0 tx=0x7ff978007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:35.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.569+0000 7ff96bfff640 1 -- 172.21.15.1:0/643425733 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff98408eb70 con 0x7ff984095d70 2024-04-26T07:57:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.750+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff98408db40 con 0x7ff9700385c0 2024-04-26T07:57:35.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.767+0000 7ff96bfff640 1 -- 172.21.15.1:0/643425733 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665701 (secure 0 0 0) 0x7ff9780058b0 con 0x7ff9700385c0 2024-04-26T07:57:35.770 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:57:35.775 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:57:35.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9700385c0 msgr2=0x7ff97003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 --2- 172.21.15.1:0/643425733 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9700385c0 0x7ff97003aa80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff978007fd0 tx=0x7ff978007ac0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984095d70 msgr2=0x7ff98408c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 --2- 172.21.15.1:0/643425733 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984095d70 0x7ff98408c320 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff974000c00 tx=0x7ff9740046c0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 shutdown_connections 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 --2- 172.21.15.1:0/643425733 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7ff9700385c0 0x7ff97003aa80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 --2- 172.21.15.1:0/643425733 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff984095d70 0x7ff98408c320 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 >> 172.21.15.1:0/643425733 conn(0x7ff98409add0 msgr2=0x7ff984097e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 shutdown_connections 2024-04-26T07:57:35.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:35.772+0000 7ff98a115640 1 -- 172.21.15.1:0/643425733 wait complete. 2024-04-26T07:57:35.779 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-04-26T07:57:34.870060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4887,"num_read_kb":4464,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177748,"kb_used_data":40564,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309612,"statfs":{"total":386547056640,"available":386365042688,"internally_reserved":0,"allocated":41537536,"data_stored":40441298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003644"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.633565+0000","last_change":"2024-04-26T07:54:15.021756+0000","last_active":"2024-04-26T07:56:23.633565+0000","last_peered":"2024-04-26T07:56:23.633565+0000","last_clean":"2024-04-26T07:56:23.633565+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:56:23.633565+0000","last_undegraded":"2024-04-26T07:56:23.633565+0000","last_fullsized":"2024-04-26T07:56:23.633565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895004+0000","last_change":"2024-04-26T07:54:17.007567+0000","last_active":"2024-04-26T07:56:49.895004+0000","last_peered":"2024-04-26T07:56:49.895004+0000","last_clean":"2024-04-26T07:56:49.895004+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:56:49.895004+0000","last_undegraded":"2024-04-26T07:56:49.895004+0000","last_fullsized":"2024-04-26T07:56:49.895004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050522+0000","last_change":"2024-04-26T07:54:15.008962+0000","last_active":"2024-04-26T07:55:02.050522+0000","last_peered":"2024-04-26T07:55:02.050522+0000","last_clean":"2024-04-26T07:55:02.050522+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:55:02.050522+0000","last_undegraded":"2024-04-26T07:55:02.050522+0000","last_fullsized":"2024-04-26T07:55:02.050522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.209457+0000","last_change":"2024-04-26T07:54:17.015486+0000","last_active":"2024-04-26T07:57:24.209457+0000","last_peered":"2024-04-26T07:57:24.209457+0000","last_clean":"2024-04-26T07:57:24.209457+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:57:24.209457+0000","last_undegraded":"2024-04-26T07:57:24.209457+0000","last_fullsized":"2024-04-26T07:57:24.209457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:22.120564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049119+0000","last_change":"2024-04-26T07:54:15.026276+0000","last_active":"2024-04-26T07:55:02.049119+0000","last_peered":"2024-04-26T07:55:02.049119+0000","last_clean":"2024-04-26T07:55:02.049119+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:55:02.049119+0000","last_undegraded":"2024-04-26T07:55:02.049119+0000","last_fullsized":"2024-04-26T07:55:02.049119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:33.771147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511438+0000","last_change":"2024-04-26T07:54:17.018611+0000","last_active":"2024-04-26T07:57:24.511438+0000","last_peered":"2024-04-26T07:57:24.511438+0000","last_clean":"2024-04-26T07:57:24.511438+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:24.511438+0000","last_undegraded":"2024-04-26T07:57:24.511438+0000","last_fullsized":"2024-04-26T07:57:24.511438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:15.151809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054671+0000","last_change":"2024-04-26T07:54:15.020803+0000","last_active":"2024-04-26T07:55:02.054671+0000","last_peered":"2024-04-26T07:55:02.054671+0000","last_clean":"2024-04-26T07:55:02.054671+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:55:02.054671+0000","last_undegraded":"2024-04-26T07:55:02.054671+0000","last_fullsized":"2024-04-26T07:55:02.054671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047930+0000","last_change":"2024-04-26T07:54:17.011187+0000","last_active":"2024-04-26T07:55:02.047930+0000","last_peered":"2024-04-26T07:55:02.047930+0000","last_clean":"2024-04-26T07:55:02.047930+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:55:02.047930+0000","last_undegraded":"2024-04-26T07:55:02.047930+0000","last_fullsized":"2024-04-26T07:55:02.047930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:47.382429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047464+0000","last_change":"2024-04-26T07:54:15.025367+0000","last_active":"2024-04-26T07:55:02.047464+0000","last_peered":"2024-04-26T07:55:02.047464+0000","last_clean":"2024-04-26T07:55:02.047464+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:55:02.047464+0000","last_undegraded":"2024-04-26T07:55:02.047464+0000","last_fullsized":"2024-04-26T07:55:02.047464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:02.114318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511501+0000","last_change":"2024-04-26T07:54:17.001492+0000","last_active":"2024-04-26T07:57:24.511501+0000","last_peered":"2024-04-26T07:57:24.511501+0000","last_clean":"2024-04-26T07:57:24.511501+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:57:24.511501+0000","last_undegraded":"2024-04-26T07:57:24.511501+0000","last_fullsized":"2024-04-26T07:57:24.511501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:09.013983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.506545+0000","last_change":"2024-04-26T07:54:15.019896+0000","last_active":"2024-04-26T07:57:24.506545+0000","last_peered":"2024-04-26T07:57:24.506545+0000","last_clean":"2024-04-26T07:57:24.506545+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:57:24.506545+0000","last_undegraded":"2024-04-26T07:57:24.506545+0000","last_fullsized":"2024-04-26T07:57:24.506545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:42.204889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511288+0000","last_change":"2024-04-26T07:54:17.018051+0000","last_active":"2024-04-26T07:57:24.511288+0000","last_peered":"2024-04-26T07:57:24.511288+0000","last_clean":"2024-04-26T07:57:24.511288+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:24.511288+0000","last_undegraded":"2024-04-26T07:57:24.511288+0000","last_fullsized":"2024-04-26T07:57:24.511288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:26.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.170249+0000","last_change":"2024-04-26T07:54:15.021920+0000","last_active":"2024-04-26T07:57:24.170249+0000","last_peered":"2024-04-26T07:57:24.170249+0000","last_clean":"2024-04-26T07:57:24.170249+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:57:24.170249+0000","last_undegraded":"2024-04-26T07:57:24.170249+0000","last_fullsized":"2024-04-26T07:57:24.170249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:35.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.615508+0000","last_change":"2024-04-26T07:54:17.016378+0000","last_active":"2024-04-26T07:56:20.615508+0000","last_peered":"2024-04-26T07:56:20.615508+0000","last_clean":"2024-04-26T07:56:20.615508+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:56:20.615508+0000","last_undegraded":"2024-04-26T07:56:20.615508+0000","last_fullsized":"2024-04-26T07:56:20.615508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047579+0000","last_change":"2024-04-26T07:54:15.008904+0000","last_active":"2024-04-26T07:55:02.047579+0000","last_peered":"2024-04-26T07:55:02.047579+0000","last_clean":"2024-04-26T07:55:02.047579+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:55:02.047579+0000","last_undegraded":"2024-04-26T07:55:02.047579+0000","last_fullsized":"2024-04-26T07:55:02.047579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207539+0000","last_change":"2024-04-26T07:54:17.011542+0000","last_active":"2024-04-26T07:57:24.207539+0000","last_peered":"2024-04-26T07:57:24.207539+0000","last_clean":"2024-04-26T07:57:24.207539+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:57:24.207539+0000","last_undegraded":"2024-04-26T07:57:24.207539+0000","last_fullsized":"2024-04-26T07:57:24.207539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143674+0000","last_change":"2024-04-26T07:54:17.018794+0000","last_active":"2024-04-26T07:55:40.143674+0000","last_peered":"2024-04-26T07:55:40.143674+0000","last_clean":"2024-04-26T07:55:40.143674+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:55:40.143674+0000","last_undegraded":"2024-04-26T07:55:40.143674+0000","last_fullsized":"2024-04-26T07:55:40.143674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:25.624134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054524+0000","last_change":"2024-04-26T07:54:15.020059+0000","last_active":"2024-04-26T07:55:02.054524+0000","last_peered":"2024-04-26T07:55:02.054524+0000","last_clean":"2024-04-26T07:55:02.054524+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:55:02.054524+0000","last_undegraded":"2024-04-26T07:55:02.054524+0000","last_fullsized":"2024-04-26T07:55:02.054524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.614746+0000","last_change":"2024-04-26T07:54:17.007162+0000","last_active":"2024-04-26T07:56:20.614746+0000","last_peered":"2024-04-26T07:56:20.614746+0000","last_clean":"2024-04-26T07:56:20.614746+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:56:20.614746+0000","last_undegraded":"2024-04-26T07:56:20.614746+0000","last_fullsized":"2024-04-26T07:56:20.614746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057735+0000","last_change":"2024-04-26T07:54:15.023259+0000","last_active":"2024-04-26T07:55:02.057735+0000","last_peered":"2024-04-26T07:55:02.057735+0000","last_clean":"2024-04-26T07:55:02.057735+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:55:02.057735+0000","last_undegraded":"2024-04-26T07:55:02.057735+0000","last_fullsized":"2024-04-26T07:55:02.057735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.295581+0000","last_change":"2024-04-26T07:54:17.016377+0000","last_active":"2024-04-26T07:57:24.295581+0000","last_peered":"2024-04-26T07:57:24.295581+0000","last_clean":"2024-04-26T07:57:24.295581+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:24.295581+0000","last_undegraded":"2024-04-26T07:57:24.295581+0000","last_fullsized":"2024-04-26T07:57:24.295581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:20.487011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048878+0000","last_change":"2024-04-26T07:54:15.017989+0000","last_active":"2024-04-26T07:55:02.048878+0000","last_peered":"2024-04-26T07:55:02.048878+0000","last_clean":"2024-04-26T07:55:02.048878+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:55:02.048878+0000","last_undegraded":"2024-04-26T07:55:02.048878+0000","last_fullsized":"2024-04-26T07:55:02.048878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.215781+0000","last_change":"2024-04-26T07:54:17.011769+0000","last_active":"2024-04-26T07:57:24.215781+0000","last_peered":"2024-04-26T07:57:24.215781+0000","last_clean":"2024-04-26T07:57:24.215781+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:57:24.215781+0000","last_undegraded":"2024-04-26T07:57:24.215781+0000","last_fullsized":"2024-04-26T07:57:24.215781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055070+0000","last_change":"2024-04-26T07:54:15.017753+0000","last_active":"2024-04-26T07:55:02.055070+0000","last_peered":"2024-04-26T07:55:02.055070+0000","last_clean":"2024-04-26T07:55:02.055070+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:55:02.055070+0000","last_undegraded":"2024-04-26T07:55:02.055070+0000","last_fullsized":"2024-04-26T07:55:02.055070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143749+0000","last_change":"2024-04-26T07:54:17.012327+0000","last_active":"2024-04-26T07:55:40.143749+0000","last_peered":"2024-04-26T07:55:40.143749+0000","last_clean":"2024-04-26T07:55:40.143749+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:55:40.143749+0000","last_undegraded":"2024-04-26T07:55:40.143749+0000","last_fullsized":"2024-04-26T07:55:40.143749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049152+0000","last_change":"2024-04-26T07:54:15.008684+0000","last_active":"2024-04-26T07:55:02.049152+0000","last_peered":"2024-04-26T07:55:02.049152+0000","last_clean":"2024-04-26T07:55:02.049152+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:55:02.049152+0000","last_undegraded":"2024-04-26T07:55:02.049152+0000","last_fullsized":"2024-04-26T07:55:02.049152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511606+0000","last_change":"2024-04-26T07:54:16.998745+0000","last_active":"2024-04-26T07:57:24.511606+0000","last_peered":"2024-04-26T07:57:24.511606+0000","last_clean":"2024-04-26T07:57:24.511606+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:57:24.511606+0000","last_undegraded":"2024-04-26T07:57:24.511606+0000","last_fullsized":"2024-04-26T07:57:24.511606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:13.730381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047329+0000","last_change":"2024-04-26T07:54:15.017883+0000","last_active":"2024-04-26T07:55:02.047329+0000","last_peered":"2024-04-26T07:55:02.047329+0000","last_clean":"2024-04-26T07:55:02.047329+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:55:02.047329+0000","last_undegraded":"2024-04-26T07:55:02.047329+0000","last_fullsized":"2024-04-26T07:55:02.047329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:44.995414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.463089+0000","last_change":"2024-04-26T07:54:25.037823+0000","last_active":"2024-04-26T07:57:24.463089+0000","last_peered":"2024-04-26T07:57:24.463089+0000","last_clean":"2024-04-26T07:57:24.463089+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:57:24.463089+0000","last_undegraded":"2024-04-26T07:57:24.463089+0000","last_fullsized":"2024-04-26T07:57:24.463089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.012082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'13","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489530+0000","last_change":"2024-04-26T07:54:17.010298+0000","last_active":"2024-04-26T07:57:24.489530+0000","last_peered":"2024-04-26T07:57:24.489530+0000","last_clean":"2024-04-26T07:57:24.489530+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:57:24.489530+0000","last_undegraded":"2024-04-26T07:57:24.489530+0000","last_fullsized":"2024-04-26T07:57:24.489530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:38.486309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892998+0000","last_change":"2024-04-26T07:54:15.028485+0000","last_active":"2024-04-26T07:56:34.892998+0000","last_peered":"2024-04-26T07:56:34.892998+0000","last_clean":"2024-04-26T07:56:34.892998+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:56:34.892998+0000","last_undegraded":"2024-04-26T07:56:34.892998+0000","last_fullsized":"2024-04-26T07:56:34.892998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:43.230145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047546+0000","last_change":"2024-04-26T07:54:19.013097+0000","last_active":"2024-04-26T07:55:02.047546+0000","last_peered":"2024-04-26T07:55:02.047546+0000","last_clean":"2024-04-26T07:55:02.047546+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:55:02.047546+0000","last_undegraded":"2024-04-26T07:55:02.047546+0000","last_fullsized":"2024-04-26T07:55:02.047546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:06.684753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.351988+0000","last_change":"2024-04-26T07:54:21.023071+0000","last_active":"2024-04-26T07:56:22.351988+0000","last_peered":"2024-04-26T07:56:22.351988+0000","last_clean":"2024-04-26T07:56:22.351988+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:56:22.351988+0000","last_undegraded":"2024-04-26T07:56:22.351988+0000","last_fullsized":"2024-04-26T07:56:22.351988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:31.663330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054306+0000","last_change":"2024-04-26T07:54:23.030948+0000","last_active":"2024-04-26T07:55:02.054306+0000","last_peered":"2024-04-26T07:55:02.054306+0000","last_clean":"2024-04-26T07:55:02.054306+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:55:02.054306+0000","last_undegraded":"2024-04-26T07:55:02.054306+0000","last_fullsized":"2024-04-26T07:55:02.054306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:09.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.570875+0000","last_change":"2024-04-26T07:54:25.029434+0000","last_active":"2024-04-26T07:57:24.570875+0000","last_peered":"2024-04-26T07:57:24.570875+0000","last_clean":"2024-04-26T07:57:24.570875+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:24.570875+0000","last_undegraded":"2024-04-26T07:57:24.570875+0000","last_fullsized":"2024-04-26T07:57:24.570875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:48.982630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.301766+0000","last_change":"2024-04-26T07:54:17.010194+0000","last_active":"2024-04-26T07:57:24.301766+0000","last_peered":"2024-04-26T07:57:24.301766+0000","last_clean":"2024-04-26T07:57:24.301766+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:57:24.301766+0000","last_undegraded":"2024-04-26T07:57:24.301766+0000","last_fullsized":"2024-04-26T07:57:24.301766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.230278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053713+0000","last_change":"2024-04-26T07:54:15.018699+0000","last_active":"2024-04-26T07:55:02.053713+0000","last_peered":"2024-04-26T07:55:02.053713+0000","last_clean":"2024-04-26T07:55:02.053713+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:55:02.053713+0000","last_undegraded":"2024-04-26T07:55:02.053713+0000","last_fullsized":"2024-04-26T07:55:02.053713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:44.643100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'4","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.408334+0000","last_change":"2024-04-26T07:55:02.067003+0000","last_active":"2024-04-26T07:56:23.408334+0000","last_peered":"2024-04-26T07:56:23.408334+0000","last_clean":"2024-04-26T07:56:23.408334+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:56:23.408334+0000","last_undegraded":"2024-04-26T07:56:23.408334+0000","last_fullsized":"2024-04-26T07:56:23.408334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:29.656543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"27'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053400+0000","last_change":"2024-04-26T07:54:21.015968+0000","last_active":"2024-04-26T07:55:02.053400+0000","last_peered":"2024-04-26T07:55:02.053400+0000","last_clean":"2024-04-26T07:55:02.053400+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:55:02.053400+0000","last_undegraded":"2024-04-26T07:55:02.053400+0000","last_fullsized":"2024-04-26T07:55:02.053400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:13.187889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050187+0000","last_change":"2024-04-26T07:54:23.035869+0000","last_active":"2024-04-26T07:55:02.050187+0000","last_peered":"2024-04-26T07:55:02.050187+0000","last_clean":"2024-04-26T07:55:02.050187+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:55:02.050187+0000","last_undegraded":"2024-04-26T07:55:02.050187+0000","last_fullsized":"2024-04-26T07:55:02.050187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:57.195185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047465+0000","last_change":"2024-04-26T07:54:25.027104+0000","last_active":"2024-04-26T07:55:02.047465+0000","last_peered":"2024-04-26T07:55:02.047465+0000","last_clean":"2024-04-26T07:55:02.047465+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:55:02.047465+0000","last_undegraded":"2024-04-26T07:55:02.047465+0000","last_fullsized":"2024-04-26T07:55:02.047465+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:04.495335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:04.879358+0000","last_change":"2024-04-26T07:55:02.065992+0000","last_active":"2024-04-26T07:55:04.879358+0000","last_peered":"2024-04-26T07:55:04.879358+0000","last_clean":"2024-04-26T07:55:04.879358+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:55:04.879358+0000","last_undegraded":"2024-04-26T07:55:04.879358+0000","last_fullsized":"2024-04-26T07:55:04.879358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:09.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045977+0000","last_change":"2024-04-26T07:54:15.028375+0000","last_active":"2024-04-26T07:55:02.045977+0000","last_peered":"2024-04-26T07:55:02.045977+0000","last_clean":"2024-04-26T07:55:02.045977+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:55:02.045977+0000","last_undegraded":"2024-04-26T07:55:02.045977+0000","last_fullsized":"2024-04-26T07:55:02.045977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:32.915801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050812+0000","last_change":"2024-04-26T07:54:19.014182+0000","last_active":"2024-04-26T07:55:02.050812+0000","last_peered":"2024-04-26T07:55:02.050812+0000","last_clean":"2024-04-26T07:55:02.050812+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:55:02.050812+0000","last_undegraded":"2024-04-26T07:55:02.050812+0000","last_fullsized":"2024-04-26T07:55:02.050812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:14.365835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.145043+0000","last_change":"2024-04-26T07:54:21.024658+0000","last_active":"2024-04-26T07:55:40.145043+0000","last_peered":"2024-04-26T07:55:40.145043+0000","last_clean":"2024-04-26T07:55:40.145043+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:55:40.145043+0000","last_undegraded":"2024-04-26T07:55:40.145043+0000","last_fullsized":"2024-04-26T07:55:40.145043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:25.233916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":385,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.630004+0000","last_change":"2024-04-26T07:54:23.036180+0000","last_active":"2024-04-26T07:57:24.630004+0000","last_peered":"2024-04-26T07:57:24.630004+0000","last_clean":"2024-04-26T07:57:24.630004+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:57:24.630004+0000","last_undegraded":"2024-04-26T07:57:24.630004+0000","last_fullsized":"2024-04-26T07:57:24.630004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:08.558861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053408+0000","last_change":"2024-04-26T07:54:25.027799+0000","last_active":"2024-04-26T07:55:02.053408+0000","last_peered":"2024-04-26T07:55:02.053408+0000","last_clean":"2024-04-26T07:55:02.053408+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:55:02.053408+0000","last_undegraded":"2024-04-26T07:55:02.053408+0000","last_fullsized":"2024-04-26T07:55:02.053408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:35.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438362+0000","last_change":"2024-04-26T07:54:17.006664+0000","last_active":"2024-04-26T07:57:24.438362+0000","last_peered":"2024-04-26T07:57:24.438362+0000","last_clean":"2024-04-26T07:57:24.438362+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:57:24.438362+0000","last_undegraded":"2024-04-26T07:57:24.438362+0000","last_fullsized":"2024-04-26T07:57:24.438362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049744+0000","last_change":"2024-04-26T07:54:15.020158+0000","last_active":"2024-04-26T07:55:02.049744+0000","last_peered":"2024-04-26T07:55:02.049744+0000","last_clean":"2024-04-26T07:55:02.049744+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:55:02.049744+0000","last_undegraded":"2024-04-26T07:55:02.049744+0000","last_fullsized":"2024-04-26T07:55:02.049744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:33.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.060242+0000","last_change":"2024-04-26T07:55:02.059077+0000","last_active":"2024-04-26T07:55:02.060242+0000","last_peered":"2024-04-26T07:55:02.060242+0000","last_clean":"2024-04-26T07:55:02.060242+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:55:02.060242+0000","last_undegraded":"2024-04-26T07:55:02.060242+0000","last_fullsized":"2024-04-26T07:55:02.060242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:20.105862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.346496+0000","last_change":"2024-04-26T07:54:21.022437+0000","last_active":"2024-04-26T07:56:22.346496+0000","last_peered":"2024-04-26T07:56:22.346496+0000","last_clean":"2024-04-26T07:56:22.346496+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:56:22.346496+0000","last_undegraded":"2024-04-26T07:56:22.346496+0000","last_fullsized":"2024-04-26T07:56:22.346496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:43.415554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.514862+0000","last_change":"2024-04-26T07:54:23.029180+0000","last_active":"2024-04-26T07:57:24.514862+0000","last_peered":"2024-04-26T07:57:24.514862+0000","last_clean":"2024-04-26T07:57:24.514862+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:24.514862+0000","last_undegraded":"2024-04-26T07:57:24.514862+0000","last_fullsized":"2024-04-26T07:57:24.514862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:27.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892086+0000","last_change":"2024-04-26T07:54:17.018068+0000","last_active":"2024-04-26T07:56:29.892086+0000","last_peered":"2024-04-26T07:56:29.892086+0000","last_clean":"2024-04-26T07:56:29.892086+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:56:29.892086+0000","last_undegraded":"2024-04-26T07:56:29.892086+0000","last_fullsized":"2024-04-26T07:56:29.892086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:46.004871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.058116+0000","last_change":"2024-04-26T07:54:15.021552+0000","last_active":"2024-04-26T07:55:02.058116+0000","last_peered":"2024-04-26T07:55:02.058116+0000","last_clean":"2024-04-26T07:55:02.058116+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:55:02.058116+0000","last_undegraded":"2024-04-26T07:55:02.058116+0000","last_fullsized":"2024-04-26T07:55:02.058116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048189+0000","last_change":"2024-04-26T07:54:19.017311+0000","last_active":"2024-04-26T07:55:02.048189+0000","last_peered":"2024-04-26T07:55:02.048189+0000","last_clean":"2024-04-26T07:55:02.048189+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:55:02.048189+0000","last_undegraded":"2024-04-26T07:55:02.048189+0000","last_fullsized":"2024-04-26T07:55:02.048189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:28.216267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.356414+0000","last_change":"2024-04-26T07:54:21.017174+0000","last_active":"2024-04-26T07:56:22.356414+0000","last_peered":"2024-04-26T07:56:22.356414+0000","last_clean":"2024-04-26T07:56:22.356414+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:56:22.356414+0000","last_undegraded":"2024-04-26T07:56:22.356414+0000","last_fullsized":"2024-04-26T07:56:22.356414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:32.852893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048871+0000","last_change":"2024-04-26T07:54:23.028206+0000","last_active":"2024-04-26T07:55:02.048871+0000","last_peered":"2024-04-26T07:55:02.048871+0000","last_clean":"2024-04-26T07:55:02.048871+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:55:02.048871+0000","last_undegraded":"2024-04-26T07:55:02.048871+0000","last_fullsized":"2024-04-26T07:55:02.048871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:39.298078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.965189+0000","last_change":"2024-04-26T07:54:25.038132+0000","last_active":"2024-04-26T07:55:39.965189+0000","last_peered":"2024-04-26T07:55:39.965189+0000","last_clean":"2024-04-26T07:55:39.965189+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:55:39.965189+0000","last_undegraded":"2024-04-26T07:55:39.965189+0000","last_fullsized":"2024-04-26T07:55:39.965189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:39.692413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511248+0000","last_change":"2024-04-26T07:54:16.999342+0000","last_active":"2024-04-26T07:57:24.511248+0000","last_peered":"2024-04-26T07:57:24.511248+0000","last_clean":"2024-04-26T07:57:24.511248+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:57:24.511248+0000","last_undegraded":"2024-04-26T07:57:24.511248+0000","last_fullsized":"2024-04-26T07:57:24.511248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:50.720873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055973+0000","last_change":"2024-04-26T07:54:15.021572+0000","last_active":"2024-04-26T07:55:02.055973+0000","last_peered":"2024-04-26T07:55:02.055973+0000","last_clean":"2024-04-26T07:55:02.055973+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:55:02.055973+0000","last_undegraded":"2024-04-26T07:55:02.055973+0000","last_fullsized":"2024-04-26T07:55:02.055973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047802+0000","last_change":"2024-04-26T07:54:19.014010+0000","last_active":"2024-04-26T07:55:02.047802+0000","last_peered":"2024-04-26T07:55:02.047802+0000","last_clean":"2024-04-26T07:55:02.047802+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:55:02.047802+0000","last_undegraded":"2024-04-26T07:55:02.047802+0000","last_fullsized":"2024-04-26T07:55:02.047802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:51.749121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893869+0000","last_change":"2024-04-26T07:54:21.021470+0000","last_active":"2024-04-26T07:56:39.893869+0000","last_peered":"2024-04-26T07:56:39.893869+0000","last_clean":"2024-04-26T07:56:39.893869+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:56:39.893869+0000","last_undegraded":"2024-04-26T07:56:39.893869+0000","last_fullsized":"2024-04-26T07:56:39.893869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.505241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047573+0000","last_change":"2024-04-26T07:54:23.028229+0000","last_active":"2024-04-26T07:55:02.047573+0000","last_peered":"2024-04-26T07:55:02.047573+0000","last_clean":"2024-04-26T07:55:02.047573+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:55:02.047573+0000","last_undegraded":"2024-04-26T07:55:02.047573+0000","last_fullsized":"2024-04-26T07:55:02.047573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:37.685058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:34.432492+0000","last_change":"2024-04-26T07:54:25.031077+0000","last_active":"2024-04-26T07:55:34.432492+0000","last_peered":"2024-04-26T07:55:34.432492+0000","last_clean":"2024-04-26T07:55:34.432492+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:55:34.432492+0000","last_undegraded":"2024-04-26T07:55:34.432492+0000","last_fullsized":"2024-04-26T07:55:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:53.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891503+0000","last_change":"2024-04-26T07:54:17.015501+0000","last_active":"2024-04-26T07:56:29.891503+0000","last_peered":"2024-04-26T07:56:29.891503+0000","last_clean":"2024-04-26T07:56:29.891503+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:56:29.891503+0000","last_undegraded":"2024-04-26T07:56:29.891503+0000","last_fullsized":"2024-04-26T07:56:29.891503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:45.257757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048885+0000","last_change":"2024-04-26T07:54:15.026188+0000","last_active":"2024-04-26T07:55:02.048885+0000","last_peered":"2024-04-26T07:55:02.048885+0000","last_clean":"2024-04-26T07:55:02.048885+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:55:02.048885+0000","last_undegraded":"2024-04-26T07:55:02.048885+0000","last_fullsized":"2024-04-26T07:55:02.048885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:34.359927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049912+0000","last_change":"2024-04-26T07:54:19.014021+0000","last_active":"2024-04-26T07:55:02.049912+0000","last_peered":"2024-04-26T07:55:02.049912+0000","last_clean":"2024-04-26T07:55:02.049912+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:55:02.049912+0000","last_undegraded":"2024-04-26T07:55:02.049912+0000","last_fullsized":"2024-04-26T07:55:02.049912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:28.216267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.358572+0000","last_change":"2024-04-26T07:54:21.021799+0000","last_active":"2024-04-26T07:56:22.358572+0000","last_peered":"2024-04-26T07:56:22.358572+0000","last_clean":"2024-04-26T07:56:22.358572+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:56:22.358572+0000","last_undegraded":"2024-04-26T07:56:22.358572+0000","last_fullsized":"2024-04-26T07:56:22.358572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:22.358993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":348,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.641002+0000","last_change":"2024-04-26T07:54:23.023487+0000","last_active":"2024-04-26T07:57:24.641002+0000","last_peered":"2024-04-26T07:57:24.641002+0000","last_clean":"2024-04-26T07:57:24.641002+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:24.641002+0000","last_undegraded":"2024-04-26T07:57:24.641002+0000","last_fullsized":"2024-04-26T07:57:24.641002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.968900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049165+0000","last_change":"2024-04-26T07:54:25.030802+0000","last_active":"2024-04-26T07:55:02.049165+0000","last_peered":"2024-04-26T07:55:02.049165+0000","last_clean":"2024-04-26T07:55:02.049165+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:55:02.049165+0000","last_undegraded":"2024-04-26T07:55:02.049165+0000","last_fullsized":"2024-04-26T07:55:02.049165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:55.721790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'7","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.488370+0000","last_change":"2024-04-26T07:54:17.003162+0000","last_active":"2024-04-26T07:57:24.488370+0000","last_peered":"2024-04-26T07:57:24.488370+0000","last_clean":"2024-04-26T07:57:24.488370+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:24.488370+0000","last_undegraded":"2024-04-26T07:57:24.488370+0000","last_fullsized":"2024-04-26T07:57:24.488370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:24.843992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047648+0000","last_change":"2024-04-26T07:54:15.029358+0000","last_active":"2024-04-26T07:55:02.047648+0000","last_peered":"2024-04-26T07:55:02.047648+0000","last_clean":"2024-04-26T07:55:02.047648+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:55:02.047648+0000","last_undegraded":"2024-04-26T07:55:02.047648+0000","last_fullsized":"2024-04-26T07:55:02.047648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.653945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048162+0000","last_change":"2024-04-26T07:54:19.011909+0000","last_active":"2024-04-26T07:55:02.048162+0000","last_peered":"2024-04-26T07:55:02.048162+0000","last_clean":"2024-04-26T07:55:02.048162+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:55:02.048162+0000","last_undegraded":"2024-04-26T07:55:02.048162+0000","last_fullsized":"2024-04-26T07:55:02.048162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:27.746901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'55","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.806242+0000","last_change":"2024-04-26T07:54:21.021179+0000","last_active":"2024-04-26T07:56:23.806242+0000","last_peered":"2024-04-26T07:56:23.806242+0000","last_clean":"2024-04-26T07:56:23.806242+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:56:23.806242+0000","last_undegraded":"2024-04-26T07:56:23.806242+0000","last_fullsized":"2024-04-26T07:56:23.806242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:42.295311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047462+0000","last_change":"2024-04-26T07:54:23.025278+0000","last_active":"2024-04-26T07:55:02.047462+0000","last_peered":"2024-04-26T07:55:02.047462+0000","last_clean":"2024-04-26T07:55:02.047462+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:55:02.047462+0000","last_undegraded":"2024-04-26T07:55:02.047462+0000","last_fullsized":"2024-04-26T07:55:02.047462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:56.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.615064+0000","last_change":"2024-04-26T07:54:25.034316+0000","last_active":"2024-04-26T07:57:24.615064+0000","last_peered":"2024-04-26T07:57:24.615064+0000","last_clean":"2024-04-26T07:57:24.615064+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:57:24.615064+0000","last_undegraded":"2024-04-26T07:57:24.615064+0000","last_fullsized":"2024-04-26T07:57:24.615064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:26.372578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053141+0000","last_change":"2024-04-26T07:54:17.013013+0000","last_active":"2024-04-26T07:55:02.053141+0000","last_peered":"2024-04-26T07:55:02.053141+0000","last_clean":"2024-04-26T07:55:02.053141+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:55:02.053141+0000","last_undegraded":"2024-04-26T07:55:02.053141+0000","last_fullsized":"2024-04-26T07:55:02.053141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:20.449523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048743+0000","last_change":"2024-04-26T07:54:15.001977+0000","last_active":"2024-04-26T07:55:02.048743+0000","last_peered":"2024-04-26T07:55:02.048743+0000","last_clean":"2024-04-26T07:55:02.048743+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:55:02.048743+0000","last_undegraded":"2024-04-26T07:55:02.048743+0000","last_fullsized":"2024-04-26T07:55:02.048743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055480+0000","last_change":"2024-04-26T07:54:19.016120+0000","last_active":"2024-04-26T07:55:02.055480+0000","last_peered":"2024-04-26T07:55:02.055480+0000","last_clean":"2024-04-26T07:55:02.055480+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:55:02.055480+0000","last_undegraded":"2024-04-26T07:55:02.055480+0000","last_fullsized":"2024-04-26T07:55:02.055480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:50.686377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.340595+0000","last_change":"2024-04-26T07:54:21.015734+0000","last_active":"2024-04-26T07:56:22.340595+0000","last_peered":"2024-04-26T07:56:22.340595+0000","last_clean":"2024-04-26T07:56:22.340595+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:56:22.340595+0000","last_undegraded":"2024-04-26T07:56:22.340595+0000","last_fullsized":"2024-04-26T07:56:22.340595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:01.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051951+0000","last_change":"2024-04-26T07:54:23.029968+0000","last_active":"2024-04-26T07:55:02.051951+0000","last_peered":"2024-04-26T07:55:02.051951+0000","last_clean":"2024-04-26T07:55:02.051951+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:55:02.051951+0000","last_undegraded":"2024-04-26T07:55:02.051951+0000","last_fullsized":"2024-04-26T07:55:02.051951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:29:48.620441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891158+0000","last_change":"2024-04-26T07:54:25.037903+0000","last_active":"2024-04-26T07:56:24.891158+0000","last_peered":"2024-04-26T07:56:24.891158+0000","last_clean":"2024-04-26T07:56:24.891158+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:56:24.891158+0000","last_undegraded":"2024-04-26T07:56:24.891158+0000","last_fullsized":"2024-04-26T07:56:24.891158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:45.549253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489138+0000","last_change":"2024-04-26T07:54:17.018272+0000","last_active":"2024-04-26T07:57:24.489138+0000","last_peered":"2024-04-26T07:57:24.489138+0000","last_clean":"2024-04-26T07:57:24.489138+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:24.489138+0000","last_undegraded":"2024-04-26T07:57:24.489138+0000","last_fullsized":"2024-04-26T07:57:24.489138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.173859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047922+0000","last_change":"2024-04-26T07:54:15.023312+0000","last_active":"2024-04-26T07:55:02.047922+0000","last_peered":"2024-04-26T07:55:02.047922+0000","last_clean":"2024-04-26T07:55:02.047922+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:55:02.047922+0000","last_undegraded":"2024-04-26T07:55:02.047922+0000","last_fullsized":"2024-04-26T07:55:02.047922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:10.760572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048541+0000","last_change":"2024-04-26T07:54:19.013889+0000","last_active":"2024-04-26T07:55:02.048541+0000","last_peered":"2024-04-26T07:55:02.048541+0000","last_clean":"2024-04-26T07:55:02.048541+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:55:02.048541+0000","last_undegraded":"2024-04-26T07:55:02.048541+0000","last_fullsized":"2024-04-26T07:55:02.048541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:58.450108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.366970+0000","last_change":"2024-04-26T07:54:21.019300+0000","last_active":"2024-04-26T07:56:22.366970+0000","last_peered":"2024-04-26T07:56:22.366970+0000","last_clean":"2024-04-26T07:56:22.366970+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:56:22.366970+0000","last_undegraded":"2024-04-26T07:56:22.366970+0000","last_fullsized":"2024-04-26T07:56:22.366970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:16.372622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.619110+0000","last_change":"2024-04-26T07:54:23.029786+0000","last_active":"2024-04-26T07:57:24.619110+0000","last_peered":"2024-04-26T07:57:24.619110+0000","last_clean":"2024-04-26T07:57:24.619110+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:24.619110+0000","last_undegraded":"2024-04-26T07:57:24.619110+0000","last_fullsized":"2024-04-26T07:57:24.619110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:18.250538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'12","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885862+0000","last_change":"2024-04-26T07:54:25.029180+0000","last_active":"2024-04-26T07:56:29.885862+0000","last_peered":"2024-04-26T07:56:29.885862+0000","last_clean":"2024-04-26T07:56:29.885862+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:56:29.885862+0000","last_undegraded":"2024-04-26T07:56:29.885862+0000","last_fullsized":"2024-04-26T07:56:29.885862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:48.649422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057608+0000","last_change":"2024-04-26T07:54:17.015565+0000","last_active":"2024-04-26T07:55:02.057608+0000","last_peered":"2024-04-26T07:55:02.057608+0000","last_clean":"2024-04-26T07:55:02.057608+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:55:02.057608+0000","last_undegraded":"2024-04-26T07:55:02.057608+0000","last_fullsized":"2024-04-26T07:55:02.057608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048756+0000","last_change":"2024-04-26T07:54:15.028460+0000","last_active":"2024-04-26T07:55:02.048756+0000","last_peered":"2024-04-26T07:55:02.048756+0000","last_clean":"2024-04-26T07:55:02.048756+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:55:02.048756+0000","last_undegraded":"2024-04-26T07:55:02.048756+0000","last_fullsized":"2024-04-26T07:55:02.048756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:52.128712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.419198+0000","last_change":"2024-04-26T07:55:02.064457+0000","last_active":"2024-04-26T07:56:23.419198+0000","last_peered":"2024-04-26T07:56:23.419198+0000","last_clean":"2024-04-26T07:56:23.419198+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:56:23.419198+0000","last_undegraded":"2024-04-26T07:56:23.419198+0000","last_fullsized":"2024-04-26T07:56:23.419198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:52.346497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048343+0000","last_change":"2024-04-26T07:54:21.021896+0000","last_active":"2024-04-26T07:55:02.048343+0000","last_peered":"2024-04-26T07:55:02.048343+0000","last_clean":"2024-04-26T07:55:02.048343+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:55:02.048343+0000","last_undegraded":"2024-04-26T07:55:02.048343+0000","last_fullsized":"2024-04-26T07:55:02.048343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:54.353284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":465,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.573063+0000","last_change":"2024-04-26T07:54:23.024560+0000","last_active":"2024-04-26T07:57:24.573063+0000","last_peered":"2024-04-26T07:57:24.573063+0000","last_clean":"2024-04-26T07:57:24.573063+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:24.573063+0000","last_undegraded":"2024-04-26T07:57:24.573063+0000","last_fullsized":"2024-04-26T07:57:24.573063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:34.060931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.569763+0000","last_change":"2024-04-26T07:54:25.024615+0000","last_active":"2024-04-26T07:56:23.569763+0000","last_peered":"2024-04-26T07:56:23.569763+0000","last_clean":"2024-04-26T07:56:23.569763+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:56:23.569763+0000","last_undegraded":"2024-04-26T07:56:23.569763+0000","last_fullsized":"2024-04-26T07:56:23.569763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:33.156602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054935+0000","last_change":"2024-04-26T07:54:17.004296+0000","last_active":"2024-04-26T07:55:02.054935+0000","last_peered":"2024-04-26T07:55:02.054935+0000","last_clean":"2024-04-26T07:55:02.054935+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:55:02.054935+0000","last_undegraded":"2024-04-26T07:55:02.054935+0000","last_fullsized":"2024-04-26T07:55:02.054935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:58.770481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891219+0000","last_change":"2024-04-26T07:54:15.030153+0000","last_active":"2024-04-26T07:56:24.891219+0000","last_peered":"2024-04-26T07:56:24.891219+0000","last_clean":"2024-04-26T07:56:24.891219+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:56:24.891219+0000","last_undegraded":"2024-04-26T07:56:24.891219+0000","last_fullsized":"2024-04-26T07:56:24.891219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:22.836554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050562+0000","last_change":"2024-04-26T07:54:19.013153+0000","last_active":"2024-04-26T07:55:02.050562+0000","last_peered":"2024-04-26T07:55:02.050562+0000","last_clean":"2024-04-26T07:55:02.050562+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:55:02.050562+0000","last_undegraded":"2024-04-26T07:55:02.050562+0000","last_fullsized":"2024-04-26T07:55:02.050562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:53.488291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'40","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.353272+0000","last_change":"2024-04-26T07:54:21.017142+0000","last_active":"2024-04-26T07:56:22.353272+0000","last_peered":"2024-04-26T07:56:22.353272+0000","last_clean":"2024-04-26T07:56:22.353272+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:56:22.353272+0000","last_undegraded":"2024-04-26T07:56:22.353272+0000","last_fullsized":"2024-04-26T07:56:22.353272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:59.032052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":52,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055503+0000","last_change":"2024-04-26T07:54:23.031702+0000","last_active":"2024-04-26T07:55:02.055503+0000","last_peered":"2024-04-26T07:55:02.055503+0000","last_clean":"2024-04-26T07:55:02.055503+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:55:02.055503+0000","last_undegraded":"2024-04-26T07:55:02.055503+0000","last_fullsized":"2024-04-26T07:55:02.055503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:01.038281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.546403+0000","last_change":"2024-04-26T07:54:25.025544+0000","last_active":"2024-04-26T07:57:24.546403+0000","last_peered":"2024-04-26T07:57:24.546403+0000","last_clean":"2024-04-26T07:57:24.546403+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:24.546403+0000","last_undegraded":"2024-04-26T07:57:24.546403+0000","last_fullsized":"2024-04-26T07:57:24.546403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:27.858716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438506+0000","last_change":"2024-04-26T07:54:17.016804+0000","last_active":"2024-04-26T07:57:24.438506+0000","last_peered":"2024-04-26T07:57:24.438506+0000","last_clean":"2024-04-26T07:57:24.438506+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:57:24.438506+0000","last_undegraded":"2024-04-26T07:57:24.438506+0000","last_fullsized":"2024-04-26T07:57:24.438506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:57.906958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047957+0000","last_change":"2024-04-26T07:54:06.676207+0000","last_active":"2024-04-26T07:55:02.047957+0000","last_peered":"2024-04-26T07:55:02.047957+0000","last_clean":"2024-04-26T07:55:02.047957+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:55:02.047957+0000","last_undegraded":"2024-04-26T07:55:02.047957+0000","last_fullsized":"2024-04-26T07:55:02.047957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047634+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:55:02.047634+0000","last_peered":"2024-04-26T07:55:02.047634+0000","last_clean":"2024-04-26T07:55:02.047634+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:55:02.047634+0000","last_undegraded":"2024-04-26T07:55:02.047634+0000","last_fullsized":"2024-04-26T07:55:02.047634+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:36.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046885+0000","last_change":"2024-04-26T07:54:15.028934+0000","last_active":"2024-04-26T07:55:02.046885+0000","last_peered":"2024-04-26T07:55:02.046885+0000","last_clean":"2024-04-26T07:55:02.046885+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:55:02.046885+0000","last_undegraded":"2024-04-26T07:55:02.046885+0000","last_fullsized":"2024-04-26T07:55:02.046885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:08.381931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.419477+0000","last_change":"2024-04-26T07:54:19.011625+0000","last_active":"2024-04-26T07:56:23.419477+0000","last_peered":"2024-04-26T07:56:23.419477+0000","last_clean":"2024-04-26T07:56:23.419477+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:56:23.419477+0000","last_undegraded":"2024-04-26T07:56:23.419477+0000","last_fullsized":"2024-04-26T07:56:23.419477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:48.012115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'77","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893142+0000","last_change":"2024-04-26T07:54:21.020941+0000","last_active":"2024-04-26T07:56:34.893142+0000","last_peered":"2024-04-26T07:56:34.893142+0000","last_clean":"2024-04-26T07:56:34.893142+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:56:34.893142+0000","last_undegraded":"2024-04-26T07:56:34.893142+0000","last_fullsized":"2024-04-26T07:56:34.893142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:36.877690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049318+0000","last_change":"2024-04-26T07:54:23.021938+0000","last_active":"2024-04-26T07:55:02.049318+0000","last_peered":"2024-04-26T07:55:02.049318+0000","last_clean":"2024-04-26T07:55:02.049318+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:55:02.049318+0000","last_undegraded":"2024-04-26T07:55:02.049318+0000","last_fullsized":"2024-04-26T07:55:02.049318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:19.361863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.522146+0000","last_change":"2024-04-26T07:54:25.027148+0000","last_active":"2024-04-26T07:57:24.522146+0000","last_peered":"2024-04-26T07:57:24.522146+0000","last_clean":"2024-04-26T07:57:24.522146+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:57:24.522146+0000","last_undegraded":"2024-04-26T07:57:24.522146+0000","last_fullsized":"2024-04-26T07:57:24.522146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.915380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.208184+0000","last_change":"2024-04-26T07:54:17.013632+0000","last_active":"2024-04-26T07:57:24.208184+0000","last_peered":"2024-04-26T07:57:24.208184+0000","last_clean":"2024-04-26T07:57:24.208184+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:57:24.208184+0000","last_undegraded":"2024-04-26T07:57:24.208184+0000","last_fullsized":"2024-04-26T07:57:24.208184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:52.619357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046001+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:55:02.046001+0000","last_peered":"2024-04-26T07:55:02.046001+0000","last_clean":"2024-04-26T07:55:02.046001+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:55:02.046001+0000","last_undegraded":"2024-04-26T07:55:02.046001+0000","last_fullsized":"2024-04-26T07:55:02.046001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:57.072237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884280+0000","last_change":"2024-04-26T07:54:15.007057+0000","last_active":"2024-04-26T07:56:19.884280+0000","last_peered":"2024-04-26T07:56:19.884280+0000","last_clean":"2024-04-26T07:56:19.884280+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:56:19.884280+0000","last_undegraded":"2024-04-26T07:56:19.884280+0000","last_fullsized":"2024-04-26T07:56:19.884280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052936+0000","last_change":"2024-04-26T07:54:19.013958+0000","last_active":"2024-04-26T07:55:02.052936+0000","last_peered":"2024-04-26T07:55:02.052936+0000","last_clean":"2024-04-26T07:55:02.052936+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:55:02.052936+0000","last_undegraded":"2024-04-26T07:55:02.052936+0000","last_fullsized":"2024-04-26T07:55:02.052936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:39:03.143675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094742+0000","last_change":"2024-04-26T07:54:21.024668+0000","last_active":"2024-04-26T07:57:24.094742+0000","last_peered":"2024-04-26T07:57:24.094742+0000","last_clean":"2024-04-26T07:57:24.094742+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:24.094742+0000","last_undegraded":"2024-04-26T07:57:24.094742+0000","last_fullsized":"2024-04-26T07:57:24.094742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:16.244309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047364+0000","last_change":"2024-04-26T07:54:23.030052+0000","last_active":"2024-04-26T07:55:02.047364+0000","last_peered":"2024-04-26T07:55:02.047364+0000","last_clean":"2024-04-26T07:55:02.047364+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:55:02.047364+0000","last_undegraded":"2024-04-26T07:55:02.047364+0000","last_fullsized":"2024-04-26T07:55:02.047364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:01.995533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.470476+0000","last_change":"2024-04-26T07:54:25.030964+0000","last_active":"2024-04-26T07:57:24.470476+0000","last_peered":"2024-04-26T07:57:24.470476+0000","last_clean":"2024-04-26T07:57:24.470476+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:57:24.470476+0000","last_undegraded":"2024-04-26T07:57:24.470476+0000","last_fullsized":"2024-04-26T07:57:24.470476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:48.649422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.614234+0000","last_change":"2024-04-26T07:54:17.006840+0000","last_active":"2024-04-26T07:56:20.614234+0000","last_peered":"2024-04-26T07:56:20.614234+0000","last_clean":"2024-04-26T07:56:20.614234+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:56:20.614234+0000","last_undegraded":"2024-04-26T07:56:20.614234+0000","last_fullsized":"2024-04-26T07:56:20.614234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:09.013983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051901+0000","last_change":"2024-04-26T07:54:06.674967+0000","last_active":"2024-04-26T07:55:02.051901+0000","last_peered":"2024-04-26T07:55:02.051901+0000","last_clean":"2024-04-26T07:55:02.051901+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:55:02.051901+0000","last_undegraded":"2024-04-26T07:55:02.051901+0000","last_fullsized":"2024-04-26T07:55:02.051901+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:21.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883517+0000","last_change":"2024-04-26T07:54:15.008990+0000","last_active":"2024-04-26T07:56:14.883517+0000","last_peered":"2024-04-26T07:56:14.883517+0000","last_clean":"2024-04-26T07:56:14.883517+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:56:14.883517+0000","last_undegraded":"2024-04-26T07:56:14.883517+0000","last_fullsized":"2024-04-26T07:56:14.883517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056195+0000","last_change":"2024-04-26T07:54:19.010006+0000","last_active":"2024-04-26T07:55:02.056195+0000","last_peered":"2024-04-26T07:55:02.056195+0000","last_clean":"2024-04-26T07:55:02.056195+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:55:02.056195+0000","last_undegraded":"2024-04-26T07:55:02.056195+0000","last_fullsized":"2024-04-26T07:55:02.056195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:34.544464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094944+0000","last_change":"2024-04-26T07:54:21.019871+0000","last_active":"2024-04-26T07:57:24.094944+0000","last_peered":"2024-04-26T07:57:24.094944+0000","last_clean":"2024-04-26T07:57:24.094944+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:24.094944+0000","last_undegraded":"2024-04-26T07:57:24.094944+0000","last_fullsized":"2024-04-26T07:57:24.094944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:35.816402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049650+0000","last_change":"2024-04-26T07:54:23.023485+0000","last_active":"2024-04-26T07:55:02.049650+0000","last_peered":"2024-04-26T07:55:02.049650+0000","last_clean":"2024-04-26T07:55:02.049650+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:55:02.049650+0000","last_undegraded":"2024-04-26T07:55:02.049650+0000","last_fullsized":"2024-04-26T07:55:02.049650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:57.501307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.611531+0000","last_change":"2024-04-26T07:54:25.038740+0000","last_active":"2024-04-26T07:56:20.611531+0000","last_peered":"2024-04-26T07:56:20.611531+0000","last_clean":"2024-04-26T07:56:20.611531+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:56:20.611531+0000","last_undegraded":"2024-04-26T07:56:20.611531+0000","last_fullsized":"2024-04-26T07:56:20.611531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:57.808739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804102+0000","last_change":"2024-04-26T07:54:17.009576+0000","last_active":"2024-04-26T07:56:23.804102+0000","last_peered":"2024-04-26T07:56:23.804102+0000","last_clean":"2024-04-26T07:56:23.804102+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:56:23.804102+0000","last_undegraded":"2024-04-26T07:56:23.804102+0000","last_fullsized":"2024-04-26T07:56:23.804102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:20.449523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046393+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:55:02.046393+0000","last_peered":"2024-04-26T07:55:02.046393+0000","last_clean":"2024-04-26T07:55:02.046393+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:55:02.046393+0000","last_undegraded":"2024-04-26T07:55:02.046393+0000","last_fullsized":"2024-04-26T07:55:02.046393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:23.138091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054115+0000","last_change":"2024-04-26T07:54:15.006773+0000","last_active":"2024-04-26T07:55:02.054115+0000","last_peered":"2024-04-26T07:55:02.054115+0000","last_clean":"2024-04-26T07:55:02.054115+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:55:02.054115+0000","last_undegraded":"2024-04-26T07:55:02.054115+0000","last_fullsized":"2024-04-26T07:55:02.054115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049086+0000","last_change":"2024-04-26T07:54:19.014648+0000","last_active":"2024-04-26T07:55:02.049086+0000","last_peered":"2024-04-26T07:55:02.049086+0000","last_clean":"2024-04-26T07:55:02.049086+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:55:02.049086+0000","last_undegraded":"2024-04-26T07:55:02.049086+0000","last_fullsized":"2024-04-26T07:55:02.049086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:58.767016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.817648+0000","last_change":"2024-04-26T07:54:21.022796+0000","last_active":"2024-04-26T07:57:23.817648+0000","last_peered":"2024-04-26T07:57:23.817648+0000","last_clean":"2024-04-26T07:57:23.817648+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:57:23.817648+0000","last_undegraded":"2024-04-26T07:57:23.817648+0000","last_fullsized":"2024-04-26T07:57:23.817648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:24.141025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052195+0000","last_change":"2024-04-26T07:54:23.030753+0000","last_active":"2024-04-26T07:55:02.052195+0000","last_peered":"2024-04-26T07:55:02.052195+0000","last_clean":"2024-04-26T07:55:02.052195+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:55:02.052195+0000","last_undegraded":"2024-04-26T07:55:02.052195+0000","last_fullsized":"2024-04-26T07:55:02.052195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:10.717730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.546061+0000","last_change":"2024-04-26T07:54:25.038410+0000","last_active":"2024-04-26T07:56:23.546061+0000","last_peered":"2024-04-26T07:56:23.546061+0000","last_clean":"2024-04-26T07:56:23.546061+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:56:23.546061+0000","last_undegraded":"2024-04-26T07:56:23.546061+0000","last_fullsized":"2024-04-26T07:56:23.546061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:04.495335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804171+0000","last_change":"2024-04-26T07:54:17.011145+0000","last_active":"2024-04-26T07:56:23.804171+0000","last_peered":"2024-04-26T07:56:23.804171+0000","last_clean":"2024-04-26T07:56:23.804171+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:56:23.804171+0000","last_undegraded":"2024-04-26T07:56:23.804171+0000","last_fullsized":"2024-04-26T07:56:23.804171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:59.206585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054154+0000","last_change":"2024-04-26T07:54:15.004789+0000","last_active":"2024-04-26T07:55:02.054154+0000","last_peered":"2024-04-26T07:55:02.054154+0000","last_clean":"2024-04-26T07:55:02.054154+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:55:02.054154+0000","last_undegraded":"2024-04-26T07:55:02.054154+0000","last_fullsized":"2024-04-26T07:55:02.054154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049045+0000","last_change":"2024-04-26T07:54:06.676454+0000","last_active":"2024-04-26T07:55:02.049045+0000","last_peered":"2024-04-26T07:55:02.049045+0000","last_clean":"2024-04-26T07:55:02.049045+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:55:02.049045+0000","last_undegraded":"2024-04-26T07:55:02.049045+0000","last_fullsized":"2024-04-26T07:55:02.049045+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:01.265695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885217+0000","last_change":"2024-04-26T07:54:19.010150+0000","last_active":"2024-04-26T07:56:24.885217+0000","last_peered":"2024-04-26T07:56:24.885217+0000","last_clean":"2024-04-26T07:56:24.885217+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:56:24.885217+0000","last_undegraded":"2024-04-26T07:56:24.885217+0000","last_fullsized":"2024-04-26T07:56:24.885217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:41.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'64","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885138+0000","last_change":"2024-04-26T07:54:21.021222+0000","last_active":"2024-04-26T07:56:24.885138+0000","last_peered":"2024-04-26T07:56:24.885138+0000","last_clean":"2024-04-26T07:56:24.885138+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:56:24.885138+0000","last_undegraded":"2024-04-26T07:56:24.885138+0000","last_fullsized":"2024-04-26T07:56:24.885138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:30.470262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052555+0000","last_change":"2024-04-26T07:54:23.026937+0000","last_active":"2024-04-26T07:55:02.052555+0000","last_peered":"2024-04-26T07:55:02.052555+0000","last_clean":"2024-04-26T07:55:02.052555+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:55:02.052555+0000","last_undegraded":"2024-04-26T07:55:02.052555+0000","last_fullsized":"2024-04-26T07:55:02.052555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:48.973375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.735948+0000","last_change":"2024-04-26T07:54:25.024577+0000","last_active":"2024-04-26T07:56:23.735948+0000","last_peered":"2024-04-26T07:56:23.735948+0000","last_clean":"2024-04-26T07:56:23.735948+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:56:23.735948+0000","last_undegraded":"2024-04-26T07:56:23.735948+0000","last_fullsized":"2024-04-26T07:56:23.735948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:36.834541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294896+0000","last_change":"2024-04-26T07:55:02.058346+0000","last_active":"2024-04-26T07:57:24.294896+0000","last_peered":"2024-04-26T07:57:24.294896+0000","last_clean":"2024-04-26T07:57:24.294896+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:57:24.294896+0000","last_undegraded":"2024-04-26T07:57:24.294896+0000","last_fullsized":"2024-04-26T07:57:24.294896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:32.409505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049780+0000","last_change":"2024-04-26T07:54:15.005472+0000","last_active":"2024-04-26T07:55:02.049780+0000","last_peered":"2024-04-26T07:55:02.049780+0000","last_clean":"2024-04-26T07:55:02.049780+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:55:02.049780+0000","last_undegraded":"2024-04-26T07:55:02.049780+0000","last_fullsized":"2024-04-26T07:55:02.049780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:49.044298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048351+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:55:02.048351+0000","last_peered":"2024-04-26T07:55:02.048351+0000","last_clean":"2024-04-26T07:55:02.048351+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:55:02.048351+0000","last_undegraded":"2024-04-26T07:55:02.048351+0000","last_fullsized":"2024-04-26T07:55:02.048351+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:41.674149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046277+0000","last_change":"2024-04-26T07:54:19.009597+0000","last_active":"2024-04-26T07:55:02.046277+0000","last_peered":"2024-04-26T07:55:02.046277+0000","last_clean":"2024-04-26T07:55:02.046277+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:55:02.046277+0000","last_undegraded":"2024-04-26T07:55:02.046277+0000","last_fullsized":"2024-04-26T07:55:02.046277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:05.707431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049592+0000","last_change":"2024-04-26T07:54:21.022427+0000","last_active":"2024-04-26T07:55:02.049592+0000","last_peered":"2024-04-26T07:55:02.049592+0000","last_clean":"2024-04-26T07:55:02.049592+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:55:02.049592+0000","last_undegraded":"2024-04-26T07:55:02.049592+0000","last_fullsized":"2024-04-26T07:55:02.049592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:56.633388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":355,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.094511+0000","last_change":"2024-04-26T07:54:23.024550+0000","last_active":"2024-04-26T07:57:24.094511+0000","last_peered":"2024-04-26T07:57:24.094511+0000","last_clean":"2024-04-26T07:57:24.094511+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:24.094511+0000","last_undegraded":"2024-04-26T07:57:24.094511+0000","last_fullsized":"2024-04-26T07:57:24.094511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:37.685058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.225376+0000","last_change":"2024-04-26T07:54:25.036034+0000","last_active":"2024-04-26T07:57:24.225376+0000","last_peered":"2024-04-26T07:57:24.225376+0000","last_clean":"2024-04-26T07:57:24.225376+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:57:24.225376+0000","last_undegraded":"2024-04-26T07:57:24.225376+0000","last_fullsized":"2024-04-26T07:57:24.225376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:45.968753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.295712+0000","last_change":"2024-04-26T07:54:17.017609+0000","last_active":"2024-04-26T07:57:24.295712+0000","last_peered":"2024-04-26T07:57:24.295712+0000","last_clean":"2024-04-26T07:57:24.295712+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:57:24.295712+0000","last_undegraded":"2024-04-26T07:57:24.295712+0000","last_fullsized":"2024-04-26T07:57:24.295712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:21.219885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052681+0000","last_change":"2024-04-26T07:54:15.023916+0000","last_active":"2024-04-26T07:55:02.052681+0000","last_peered":"2024-04-26T07:55:02.052681+0000","last_clean":"2024-04-26T07:55:02.052681+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:55:02.052681+0000","last_undegraded":"2024-04-26T07:55:02.052681+0000","last_fullsized":"2024-04-26T07:55:02.052681+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:40.137824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049650+0000","last_change":"2024-04-26T07:54:06.676954+0000","last_active":"2024-04-26T07:55:02.049650+0000","last_peered":"2024-04-26T07:55:02.049650+0000","last_clean":"2024-04-26T07:55:02.049650+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:55:02.049650+0000","last_undegraded":"2024-04-26T07:55:02.049650+0000","last_fullsized":"2024-04-26T07:55:02.049650+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:47.328942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048912+0000","last_change":"2024-04-26T07:54:19.015515+0000","last_active":"2024-04-26T07:55:02.048912+0000","last_peered":"2024-04-26T07:55:02.048912+0000","last_clean":"2024-04-26T07:55:02.048912+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:55:02.048912+0000","last_undegraded":"2024-04-26T07:55:02.048912+0000","last_fullsized":"2024-04-26T07:55:02.048912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:23.204322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047680+0000","last_change":"2024-04-26T07:54:21.023142+0000","last_active":"2024-04-26T07:55:02.047680+0000","last_peered":"2024-04-26T07:55:02.047680+0000","last_clean":"2024-04-26T07:55:02.047680+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:55:02.047680+0000","last_undegraded":"2024-04-26T07:55:02.047680+0000","last_fullsized":"2024-04-26T07:55:02.047680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:36.423536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.615719+0000","last_change":"2024-04-26T07:54:23.028166+0000","last_active":"2024-04-26T07:57:24.615719+0000","last_peered":"2024-04-26T07:57:24.615719+0000","last_clean":"2024-04-26T07:57:24.615719+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:24.615719+0000","last_undegraded":"2024-04-26T07:57:24.615719+0000","last_fullsized":"2024-04-26T07:57:24.615719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:34.060931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052901+0000","last_change":"2024-04-26T07:54:25.036997+0000","last_active":"2024-04-26T07:55:02.052901+0000","last_peered":"2024-04-26T07:55:02.052901+0000","last_clean":"2024-04-26T07:55:02.052901+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:55:02.052901+0000","last_undegraded":"2024-04-26T07:55:02.052901+0000","last_fullsized":"2024-04-26T07:55:02.052901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:14.259642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.482999+0000","last_change":"2024-04-26T07:54:17.009702+0000","last_active":"2024-04-26T07:57:24.482999+0000","last_peered":"2024-04-26T07:57:24.482999+0000","last_clean":"2024-04-26T07:57:24.482999+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:57:24.482999+0000","last_undegraded":"2024-04-26T07:57:24.482999+0000","last_fullsized":"2024-04-26T07:57:24.482999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.581557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.189286+0000","last_change":"2024-04-26T07:54:15.009811+0000","last_active":"2024-04-26T07:57:24.189286+0000","last_peered":"2024-04-26T07:57:24.189286+0000","last_clean":"2024-04-26T07:57:24.189286+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:57:24.189286+0000","last_undegraded":"2024-04-26T07:57:24.189286+0000","last_fullsized":"2024-04-26T07:57:24.189286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:22.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052128+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:55:02.052128+0000","last_peered":"2024-04-26T07:55:02.052128+0000","last_clean":"2024-04-26T07:55:02.052128+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:55:02.052128+0000","last_undegraded":"2024-04-26T07:55:02.052128+0000","last_fullsized":"2024-04-26T07:55:02.052128+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:13.205208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049055+0000","last_change":"2024-04-26T07:54:19.010329+0000","last_active":"2024-04-26T07:55:02.049055+0000","last_peered":"2024-04-26T07:55:02.049055+0000","last_clean":"2024-04-26T07:55:02.049055+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:55:02.049055+0000","last_undegraded":"2024-04-26T07:55:02.049055+0000","last_fullsized":"2024-04-26T07:55:02.049055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.285062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.350957+0000","last_change":"2024-04-26T07:54:21.022808+0000","last_active":"2024-04-26T07:56:22.350957+0000","last_peered":"2024-04-26T07:56:22.350957+0000","last_clean":"2024-04-26T07:56:22.350957+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:56:22.350957+0000","last_undegraded":"2024-04-26T07:56:22.350957+0000","last_fullsized":"2024-04-26T07:56:22.350957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:50.018902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048378+0000","last_change":"2024-04-26T07:54:23.024114+0000","last_active":"2024-04-26T07:55:02.048378+0000","last_peered":"2024-04-26T07:55:02.048378+0000","last_clean":"2024-04-26T07:55:02.048378+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:55:02.048378+0000","last_undegraded":"2024-04-26T07:55:02.048378+0000","last_fullsized":"2024-04-26T07:55:02.048378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:09.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057538+0000","last_change":"2024-04-26T07:54:25.027810+0000","last_active":"2024-04-26T07:55:02.057538+0000","last_peered":"2024-04-26T07:55:02.057538+0000","last_clean":"2024-04-26T07:55:02.057538+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:55:02.057538+0000","last_undegraded":"2024-04-26T07:55:02.057538+0000","last_fullsized":"2024-04-26T07:55:02.057538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:48.976255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056320+0000","last_change":"2024-04-26T07:54:25.026977+0000","last_active":"2024-04-26T07:55:02.056320+0000","last_peered":"2024-04-26T07:55:02.056320+0000","last_clean":"2024-04-26T07:55:02.056320+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:55:02.056320+0000","last_undegraded":"2024-04-26T07:55:02.056320+0000","last_fullsized":"2024-04-26T07:55:02.056320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:58.871659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.483744+0000","last_change":"2024-04-26T07:54:17.012273+0000","last_active":"2024-04-26T07:57:24.483744+0000","last_peered":"2024-04-26T07:57:24.483744+0000","last_clean":"2024-04-26T07:57:24.483744+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:57:24.483744+0000","last_undegraded":"2024-04-26T07:57:24.483744+0000","last_fullsized":"2024-04-26T07:57:24.483744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:05.420036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047619+0000","last_change":"2024-04-26T07:54:15.030451+0000","last_active":"2024-04-26T07:55:02.047619+0000","last_peered":"2024-04-26T07:55:02.047619+0000","last_clean":"2024-04-26T07:55:02.047619+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:55:02.047619+0000","last_undegraded":"2024-04-26T07:55:02.047619+0000","last_fullsized":"2024-04-26T07:55:02.047619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:06.194881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051614+0000","last_change":"2024-04-26T07:54:19.011757+0000","last_active":"2024-04-26T07:55:02.051614+0000","last_peered":"2024-04-26T07:55:02.051614+0000","last_clean":"2024-04-26T07:55:02.051614+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:55:02.051614+0000","last_undegraded":"2024-04-26T07:55:02.051614+0000","last_fullsized":"2024-04-26T07:55:02.051614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:49.389674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.357538+0000","last_change":"2024-04-26T07:54:21.019609+0000","last_active":"2024-04-26T07:56:22.357538+0000","last_peered":"2024-04-26T07:56:22.357538+0000","last_clean":"2024-04-26T07:56:22.357538+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:56:22.357538+0000","last_undegraded":"2024-04-26T07:56:22.357538+0000","last_fullsized":"2024-04-26T07:56:22.357538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:33:50.119690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047082+0000","last_change":"2024-04-26T07:54:23.032745+0000","last_active":"2024-04-26T07:55:02.047082+0000","last_peered":"2024-04-26T07:55:02.047082+0000","last_clean":"2024-04-26T07:55:02.047082+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:55:02.047082+0000","last_undegraded":"2024-04-26T07:55:02.047082+0000","last_fullsized":"2024-04-26T07:55:02.047082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:08.135460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.068854+0000","last_change":"2024-04-26T07:54:25.036781+0000","last_active":"2024-04-26T07:56:22.068854+0000","last_peered":"2024-04-26T07:56:22.068854+0000","last_clean":"2024-04-26T07:56:22.068854+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:56:22.068854+0000","last_undegraded":"2024-04-26T07:56:22.068854+0000","last_fullsized":"2024-04-26T07:56:22.068854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:57.686455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511454+0000","last_change":"2024-04-26T07:54:17.011329+0000","last_active":"2024-04-26T07:57:24.511454+0000","last_peered":"2024-04-26T07:57:24.511454+0000","last_clean":"2024-04-26T07:57:24.511454+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:24.511454+0000","last_undegraded":"2024-04-26T07:57:24.511454+0000","last_fullsized":"2024-04-26T07:57:24.511454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:23:51.477720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.055095+0000","last_change":"2024-04-26T07:54:15.016903+0000","last_active":"2024-04-26T07:55:02.055095+0000","last_peered":"2024-04-26T07:55:02.055095+0000","last_clean":"2024-04-26T07:55:02.055095+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:55:02.055095+0000","last_undegraded":"2024-04-26T07:55:02.055095+0000","last_fullsized":"2024-04-26T07:55:02.055095+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048423+0000","last_change":"2024-04-26T07:54:19.009331+0000","last_active":"2024-04-26T07:55:02.048423+0000","last_peered":"2024-04-26T07:55:02.048423+0000","last_clean":"2024-04-26T07:55:02.048423+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:55:02.048423+0000","last_undegraded":"2024-04-26T07:55:02.048423+0000","last_fullsized":"2024-04-26T07:55:02.048423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:15.348847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.822696+0000","last_change":"2024-04-26T07:54:21.017937+0000","last_active":"2024-04-26T07:57:23.822696+0000","last_peered":"2024-04-26T07:57:23.822696+0000","last_clean":"2024-04-26T07:57:23.822696+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:23.822696+0000","last_undegraded":"2024-04-26T07:57:23.822696+0000","last_fullsized":"2024-04-26T07:57:23.822696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:26.134595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052140+0000","last_change":"2024-04-26T07:54:23.031660+0000","last_active":"2024-04-26T07:55:02.052140+0000","last_peered":"2024-04-26T07:55:02.052140+0000","last_clean":"2024-04-26T07:55:02.052140+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:55:02.052140+0000","last_undegraded":"2024-04-26T07:55:02.052140+0000","last_fullsized":"2024-04-26T07:55:02.052140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:21.172069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048627+0000","last_change":"2024-04-26T07:54:25.029345+0000","last_active":"2024-04-26T07:55:02.048627+0000","last_peered":"2024-04-26T07:55:02.048627+0000","last_clean":"2024-04-26T07:55:02.048627+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:55:02.048627+0000","last_undegraded":"2024-04-26T07:55:02.048627+0000","last_fullsized":"2024-04-26T07:55:02.048627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:30.573662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'5","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.488888+0000","last_change":"2024-04-26T07:55:02.054995+0000","last_active":"2024-04-26T07:57:24.488888+0000","last_peered":"2024-04-26T07:57:24.488888+0000","last_clean":"2024-04-26T07:57:24.488888+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:57:24.488888+0000","last_undegraded":"2024-04-26T07:57:24.488888+0000","last_fullsized":"2024-04-26T07:57:24.488888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:16:17.485859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056320+0000","last_change":"2024-04-26T07:54:15.021860+0000","last_active":"2024-04-26T07:55:02.056320+0000","last_peered":"2024-04-26T07:55:02.056320+0000","last_clean":"2024-04-26T07:55:02.056320+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:55:02.056320+0000","last_undegraded":"2024-04-26T07:55:02.056320+0000","last_fullsized":"2024-04-26T07:55:02.056320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:49.044298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051003+0000","last_change":"2024-04-26T07:54:19.014096+0000","last_active":"2024-04-26T07:55:02.051003+0000","last_peered":"2024-04-26T07:55:02.051003+0000","last_clean":"2024-04-26T07:55:02.051003+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:55:02.051003+0000","last_undegraded":"2024-04-26T07:55:02.051003+0000","last_fullsized":"2024-04-26T07:55:02.051003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:15.068431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.883027+0000","last_change":"2024-04-26T07:54:21.019068+0000","last_active":"2024-04-26T07:57:23.883027+0000","last_peered":"2024-04-26T07:57:23.883027+0000","last_clean":"2024-04-26T07:57:23.883027+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:23.883027+0000","last_undegraded":"2024-04-26T07:57:23.883027+0000","last_fullsized":"2024-04-26T07:57:23.883027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:42.500340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048368+0000","last_change":"2024-04-26T07:54:23.024354+0000","last_active":"2024-04-26T07:55:02.048368+0000","last_peered":"2024-04-26T07:55:02.048368+0000","last_clean":"2024-04-26T07:55:02.048368+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:55:02.048368+0000","last_undegraded":"2024-04-26T07:55:02.048368+0000","last_fullsized":"2024-04-26T07:55:02.048368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.968900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049310+0000","last_change":"2024-04-26T07:54:25.040358+0000","last_active":"2024-04-26T07:55:02.049310+0000","last_peered":"2024-04-26T07:55:02.049310+0000","last_clean":"2024-04-26T07:55:02.049310+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:55:02.049310+0000","last_undegraded":"2024-04-26T07:55:02.049310+0000","last_fullsized":"2024-04-26T07:55:02.049310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:35.575840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'7","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489597+0000","last_change":"2024-04-26T07:54:17.017717+0000","last_active":"2024-04-26T07:57:24.489597+0000","last_peered":"2024-04-26T07:57:24.489597+0000","last_clean":"2024-04-26T07:57:24.489597+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:57:24.489597+0000","last_undegraded":"2024-04-26T07:57:24.489597+0000","last_fullsized":"2024-04-26T07:57:24.489597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:28.838862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054198+0000","last_change":"2024-04-26T07:54:15.016622+0000","last_active":"2024-04-26T07:55:02.054198+0000","last_peered":"2024-04-26T07:55:02.054198+0000","last_clean":"2024-04-26T07:55:02.054198+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:55:02.054198+0000","last_undegraded":"2024-04-26T07:55:02.054198+0000","last_fullsized":"2024-04-26T07:55:02.054198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045982+0000","last_change":"2024-04-26T07:54:19.014674+0000","last_active":"2024-04-26T07:55:02.045982+0000","last_peered":"2024-04-26T07:55:02.045982+0000","last_clean":"2024-04-26T07:55:02.045982+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:55:02.045982+0000","last_undegraded":"2024-04-26T07:55:02.045982+0000","last_fullsized":"2024-04-26T07:55:02.045982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.182169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894113+0000","last_change":"2024-04-26T07:54:21.019559+0000","last_active":"2024-04-26T07:56:44.894113+0000","last_peered":"2024-04-26T07:56:44.894113+0000","last_clean":"2024-04-26T07:56:44.894113+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:56:44.894113+0000","last_undegraded":"2024-04-26T07:56:44.894113+0000","last_fullsized":"2024-04-26T07:56:44.894113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:30.223054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.053654+0000","last_change":"2024-04-26T07:54:23.027939+0000","last_active":"2024-04-26T07:55:02.053654+0000","last_peered":"2024-04-26T07:55:02.053654+0000","last_clean":"2024-04-26T07:55:02.053654+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:55:02.053654+0000","last_undegraded":"2024-04-26T07:55:02.053654+0000","last_fullsized":"2024-04-26T07:55:02.053654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:30.224134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207208+0000","last_change":"2024-04-26T07:54:17.009497+0000","last_active":"2024-04-26T07:57:24.207208+0000","last_peered":"2024-04-26T07:57:24.207208+0000","last_clean":"2024-04-26T07:57:24.207208+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:57:24.207208+0000","last_undegraded":"2024-04-26T07:57:24.207208+0000","last_fullsized":"2024-04-26T07:57:24.207208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:55.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046088+0000","last_change":"2024-04-26T07:54:15.030594+0000","last_active":"2024-04-26T07:55:02.046088+0000","last_peered":"2024-04-26T07:55:02.046088+0000","last_clean":"2024-04-26T07:55:02.046088+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:55:02.046088+0000","last_undegraded":"2024-04-26T07:55:02.046088+0000","last_fullsized":"2024-04-26T07:55:02.046088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:29.574119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050906+0000","last_change":"2024-04-26T07:54:19.014571+0000","last_active":"2024-04-26T07:55:02.050906+0000","last_peered":"2024-04-26T07:55:02.050906+0000","last_clean":"2024-04-26T07:55:02.050906+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:55:02.050906+0000","last_undegraded":"2024-04-26T07:55:02.050906+0000","last_fullsized":"2024-04-26T07:55:02.050906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:33.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.363588+0000","last_change":"2024-04-26T07:54:21.020615+0000","last_active":"2024-04-26T07:56:22.363588+0000","last_peered":"2024-04-26T07:56:22.363588+0000","last_clean":"2024-04-26T07:56:22.363588+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:56:22.363588+0000","last_undegraded":"2024-04-26T07:56:22.363588+0000","last_fullsized":"2024-04-26T07:56:22.363588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:19.165840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054281+0000","last_change":"2024-04-26T07:54:23.028286+0000","last_active":"2024-04-26T07:55:02.054281+0000","last_peered":"2024-04-26T07:55:02.054281+0000","last_clean":"2024-04-26T07:55:02.054281+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:55:02.054281+0000","last_undegraded":"2024-04-26T07:55:02.054281+0000","last_fullsized":"2024-04-26T07:55:02.054281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:21.669790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.799225+0000","last_change":"2024-04-26T07:54:25.029358+0000","last_active":"2024-04-26T07:56:23.799225+0000","last_peered":"2024-04-26T07:56:23.799225+0000","last_clean":"2024-04-26T07:56:23.799225+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:56:23.799225+0000","last_undegraded":"2024-04-26T07:56:23.799225+0000","last_fullsized":"2024-04-26T07:56:23.799225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:53.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050746+0000","last_change":"2024-04-26T07:54:17.006732+0000","last_active":"2024-04-26T07:55:02.050746+0000","last_peered":"2024-04-26T07:55:02.050746+0000","last_clean":"2024-04-26T07:55:02.050746+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:55:02.050746+0000","last_undegraded":"2024-04-26T07:55:02.050746+0000","last_fullsized":"2024-04-26T07:55:02.050746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:50.720873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048000+0000","last_change":"2024-04-26T07:54:15.016457+0000","last_active":"2024-04-26T07:55:02.048000+0000","last_peered":"2024-04-26T07:55:02.048000+0000","last_clean":"2024-04-26T07:55:02.048000+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:55:02.048000+0000","last_undegraded":"2024-04-26T07:55:02.048000+0000","last_fullsized":"2024-04-26T07:55:02.048000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:34.137578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.058106+0000","last_change":"2024-04-26T07:54:19.010468+0000","last_active":"2024-04-26T07:55:02.058106+0000","last_peered":"2024-04-26T07:55:02.058106+0000","last_clean":"2024-04-26T07:55:02.058106+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:55:02.058106+0000","last_undegraded":"2024-04-26T07:55:02.058106+0000","last_fullsized":"2024-04-26T07:55:02.058106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:00.247411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.343549+0000","last_change":"2024-04-26T07:54:21.021362+0000","last_active":"2024-04-26T07:56:22.343549+0000","last_peered":"2024-04-26T07:56:22.343549+0000","last_clean":"2024-04-26T07:56:22.343549+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:56:22.343549+0000","last_undegraded":"2024-04-26T07:56:22.343549+0000","last_fullsized":"2024-04-26T07:56:22.343549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:01.562210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048176+0000","last_change":"2024-04-26T07:54:23.033211+0000","last_active":"2024-04-26T07:55:02.048176+0000","last_peered":"2024-04-26T07:55:02.048176+0000","last_clean":"2024-04-26T07:55:02.048176+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:55:02.048176+0000","last_undegraded":"2024-04-26T07:55:02.048176+0000","last_fullsized":"2024-04-26T07:55:02.048176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:23:56.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046065+0000","last_change":"2024-04-26T07:54:25.040148+0000","last_active":"2024-04-26T07:55:02.046065+0000","last_peered":"2024-04-26T07:55:02.046065+0000","last_clean":"2024-04-26T07:55:02.046065+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:55:02.046065+0000","last_undegraded":"2024-04-26T07:55:02.046065+0000","last_fullsized":"2024-04-26T07:55:02.046065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:26.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.135910+0000","last_change":"2024-04-26T07:55:02.061611+0000","last_active":"2024-04-26T07:55:40.135910+0000","last_peered":"2024-04-26T07:55:40.135910+0000","last_clean":"2024-04-26T07:55:40.135910+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:55:40.135910+0000","last_undegraded":"2024-04-26T07:55:40.135910+0000","last_fullsized":"2024-04-26T07:55:40.135910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.609944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048558+0000","last_change":"2024-04-26T07:54:15.009041+0000","last_active":"2024-04-26T07:55:02.048558+0000","last_peered":"2024-04-26T07:55:02.048558+0000","last_clean":"2024-04-26T07:55:02.048558+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:55:02.048558+0000","last_undegraded":"2024-04-26T07:55:02.048558+0000","last_fullsized":"2024-04-26T07:55:02.048558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:39.364496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054642+0000","last_change":"2024-04-26T07:54:19.006121+0000","last_active":"2024-04-26T07:55:02.054642+0000","last_peered":"2024-04-26T07:55:02.054642+0000","last_clean":"2024-04-26T07:55:02.054642+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:55:02.054642+0000","last_undegraded":"2024-04-26T07:55:02.054642+0000","last_fullsized":"2024-04-26T07:55:02.054642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:46.405445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.361578+0000","last_change":"2024-04-26T07:54:21.021334+0000","last_active":"2024-04-26T07:56:22.361578+0000","last_peered":"2024-04-26T07:56:22.361578+0000","last_clean":"2024-04-26T07:56:22.361578+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:56:22.361578+0000","last_undegraded":"2024-04-26T07:56:22.361578+0000","last_fullsized":"2024-04-26T07:56:22.361578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:46.967145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049254+0000","last_change":"2024-04-26T07:54:23.035770+0000","last_active":"2024-04-26T07:55:02.049254+0000","last_peered":"2024-04-26T07:55:02.049254+0000","last_clean":"2024-04-26T07:55:02.049254+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:55:02.049254+0000","last_undegraded":"2024-04-26T07:55:02.049254+0000","last_fullsized":"2024-04-26T07:55:02.049254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:10.697769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.797401+0000","last_change":"2024-04-26T07:54:25.039740+0000","last_active":"2024-04-26T07:56:23.797401+0000","last_peered":"2024-04-26T07:56:23.797401+0000","last_clean":"2024-04-26T07:56:23.797401+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:56:23.797401+0000","last_undegraded":"2024-04-26T07:56:23.797401+0000","last_fullsized":"2024-04-26T07:56:23.797401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:43.196570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294830+0000","last_change":"2024-04-26T07:54:17.009954+0000","last_active":"2024-04-26T07:57:24.294830+0000","last_peered":"2024-04-26T07:57:24.294830+0000","last_clean":"2024-04-26T07:57:24.294830+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:57:24.294830+0000","last_undegraded":"2024-04-26T07:57:24.294830+0000","last_fullsized":"2024-04-26T07:57:24.294830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:38.661383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.421082+0000","last_change":"2024-04-26T07:54:15.028318+0000","last_active":"2024-04-26T07:57:24.421082+0000","last_peered":"2024-04-26T07:57:24.421082+0000","last_clean":"2024-04-26T07:57:24.421082+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:57:24.421082+0000","last_undegraded":"2024-04-26T07:57:24.421082+0000","last_fullsized":"2024-04-26T07:57:24.421082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:14.941698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.051548+0000","last_change":"2024-04-26T07:54:19.011607+0000","last_active":"2024-04-26T07:55:02.051548+0000","last_peered":"2024-04-26T07:55:02.051548+0000","last_clean":"2024-04-26T07:55:02.051548+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:55:02.051548+0000","last_undegraded":"2024-04-26T07:55:02.051548+0000","last_fullsized":"2024-04-26T07:55:02.051548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:48.273952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050383+0000","last_change":"2024-04-26T07:54:21.024776+0000","last_active":"2024-04-26T07:55:02.050383+0000","last_peered":"2024-04-26T07:55:02.050383+0000","last_clean":"2024-04-26T07:55:02.050383+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:55:02.050383+0000","last_undegraded":"2024-04-26T07:55:02.050383+0000","last_fullsized":"2024-04-26T07:55:02.050383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:11.648384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.516448+0000","last_change":"2024-04-26T07:54:23.031565+0000","last_active":"2024-04-26T07:57:24.516448+0000","last_peered":"2024-04-26T07:57:24.516448+0000","last_clean":"2024-04-26T07:57:24.516448+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:24.516448+0000","last_undegraded":"2024-04-26T07:57:24.516448+0000","last_fullsized":"2024-04-26T07:57:24.516448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:58.639617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.140553+0000","last_change":"2024-04-26T07:54:25.037610+0000","last_active":"2024-04-26T07:55:40.140553+0000","last_peered":"2024-04-26T07:55:40.140553+0000","last_clean":"2024-04-26T07:55:40.140553+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:55:40.140553+0000","last_undegraded":"2024-04-26T07:55:40.140553+0000","last_fullsized":"2024-04-26T07:55:40.140553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:53.664483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.957760+0000","last_change":"2024-04-26T07:54:17.009270+0000","last_active":"2024-04-26T07:55:39.957760+0000","last_peered":"2024-04-26T07:55:39.957760+0000","last_clean":"2024-04-26T07:55:39.957760+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:55:39.957760+0000","last_undegraded":"2024-04-26T07:55:39.957760+0000","last_fullsized":"2024-04-26T07:55:39.957760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:54.136150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.947552+0000","last_change":"2024-04-26T07:54:15.017919+0000","last_active":"2024-04-26T07:55:39.947552+0000","last_peered":"2024-04-26T07:55:39.947552+0000","last_clean":"2024-04-26T07:55:39.947552+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:55:39.947552+0000","last_undegraded":"2024-04-26T07:55:39.947552+0000","last_fullsized":"2024-04-26T07:55:39.947552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049929+0000","last_change":"2024-04-26T07:54:19.012254+0000","last_active":"2024-04-26T07:55:02.049929+0000","last_peered":"2024-04-26T07:55:02.049929+0000","last_clean":"2024-04-26T07:55:02.049929+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:55:02.049929+0000","last_undegraded":"2024-04-26T07:55:02.049929+0000","last_fullsized":"2024-04-26T07:55:02.049929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:27.631378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.334158+0000","last_change":"2024-04-26T07:54:21.016502+0000","last_active":"2024-04-26T07:56:22.334158+0000","last_peered":"2024-04-26T07:56:22.334158+0000","last_clean":"2024-04-26T07:56:22.334158+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:56:22.334158+0000","last_undegraded":"2024-04-26T07:56:22.334158+0000","last_fullsized":"2024-04-26T07:56:22.334158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:19.663560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047166+0000","last_change":"2024-04-26T07:54:23.020772+0000","last_active":"2024-04-26T07:55:02.047166+0000","last_peered":"2024-04-26T07:55:02.047166+0000","last_clean":"2024-04-26T07:55:02.047166+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:55:02.047166+0000","last_undegraded":"2024-04-26T07:55:02.047166+0000","last_fullsized":"2024-04-26T07:55:02.047166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:33.445518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054643+0000","last_change":"2024-04-26T07:54:25.030663+0000","last_active":"2024-04-26T07:55:02.054643+0000","last_peered":"2024-04-26T07:55:02.054643+0000","last_clean":"2024-04-26T07:55:02.054643+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:55:02.054643+0000","last_undegraded":"2024-04-26T07:55:02.054643+0000","last_fullsized":"2024-04-26T07:55:02.054643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:30.573662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'18","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567445+0000","last_change":"2024-04-26T07:54:17.006502+0000","last_active":"2024-04-26T07:57:24.567445+0000","last_peered":"2024-04-26T07:57:24.567445+0000","last_clean":"2024-04-26T07:57:24.567445+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:24.567445+0000","last_undegraded":"2024-04-26T07:57:24.567445+0000","last_fullsized":"2024-04-26T07:57:24.567445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:10.389370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.660248+0000","last_change":"2024-04-26T07:54:15.028304+0000","last_active":"2024-04-26T07:56:23.660248+0000","last_peered":"2024-04-26T07:56:23.660248+0000","last_clean":"2024-04-26T07:56:23.660248+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:56:23.660248+0000","last_undegraded":"2024-04-26T07:56:23.660248+0000","last_fullsized":"2024-04-26T07:56:23.660248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:40.508331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054707+0000","last_change":"2024-04-26T07:54:19.016077+0000","last_active":"2024-04-26T07:55:02.054707+0000","last_peered":"2024-04-26T07:55:02.054707+0000","last_clean":"2024-04-26T07:55:02.054707+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:55:02.054707+0000","last_undegraded":"2024-04-26T07:55:02.054707+0000","last_fullsized":"2024-04-26T07:55:02.054707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.777725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.335268+0000","last_change":"2024-04-26T07:54:21.021321+0000","last_active":"2024-04-26T07:56:22.335268+0000","last_peered":"2024-04-26T07:56:22.335268+0000","last_clean":"2024-04-26T07:56:22.335268+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:56:22.335268+0000","last_undegraded":"2024-04-26T07:56:22.335268+0000","last_fullsized":"2024-04-26T07:56:22.335268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:07.791597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.045753+0000","last_change":"2024-04-26T07:54:23.035765+0000","last_active":"2024-04-26T07:55:02.045753+0000","last_peered":"2024-04-26T07:55:02.045753+0000","last_clean":"2024-04-26T07:55:02.045753+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:55:02.045753+0000","last_undegraded":"2024-04-26T07:55:02.045753+0000","last_fullsized":"2024-04-26T07:55:02.045753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:37.356445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.484896+0000","last_change":"2024-04-26T07:54:25.035955+0000","last_active":"2024-04-26T07:57:24.484896+0000","last_peered":"2024-04-26T07:57:24.484896+0000","last_clean":"2024-04-26T07:57:24.484896+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:57:24.484896+0000","last_undegraded":"2024-04-26T07:57:24.484896+0000","last_fullsized":"2024-04-26T07:57:24.484896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:17.547313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.483578+0000","last_change":"2024-04-26T07:54:17.010362+0000","last_active":"2024-04-26T07:57:24.483578+0000","last_peered":"2024-04-26T07:57:24.483578+0000","last_clean":"2024-04-26T07:57:24.483578+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:57:24.483578+0000","last_undegraded":"2024-04-26T07:57:24.483578+0000","last_fullsized":"2024-04-26T07:57:24.483578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:03.777566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050470+0000","last_change":"2024-04-26T07:54:15.009093+0000","last_active":"2024-04-26T07:55:02.050470+0000","last_peered":"2024-04-26T07:55:02.050470+0000","last_clean":"2024-04-26T07:55:02.050470+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:55:02.050470+0000","last_undegraded":"2024-04-26T07:55:02.050470+0000","last_fullsized":"2024-04-26T07:55:02.050470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:42.204889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052220+0000","last_change":"2024-04-26T07:54:19.010756+0000","last_active":"2024-04-26T07:55:02.052220+0000","last_peered":"2024-04-26T07:55:02.052220+0000","last_clean":"2024-04-26T07:55:02.052220+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:55:02.052220+0000","last_undegraded":"2024-04-26T07:55:02.052220+0000","last_fullsized":"2024-04-26T07:55:02.052220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.227129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.359469+0000","last_change":"2024-04-26T07:54:21.020800+0000","last_active":"2024-04-26T07:56:22.359469+0000","last_peered":"2024-04-26T07:56:22.359469+0000","last_clean":"2024-04-26T07:56:22.359469+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:56:22.359469+0000","last_undegraded":"2024-04-26T07:56:22.359469+0000","last_fullsized":"2024-04-26T07:56:22.359469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:26.613231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046306+0000","last_change":"2024-04-26T07:54:23.036351+0000","last_active":"2024-04-26T07:55:02.046306+0000","last_peered":"2024-04-26T07:55:02.046306+0000","last_clean":"2024-04-26T07:55:02.046306+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:55:02.046306+0000","last_undegraded":"2024-04-26T07:55:02.046306+0000","last_fullsized":"2024-04-26T07:55:02.046306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:41.433119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.902253+0000","last_change":"2024-04-26T07:54:25.039985+0000","last_active":"2024-04-26T07:57:23.902253+0000","last_peered":"2024-04-26T07:57:23.902253+0000","last_clean":"2024-04-26T07:57:23.902253+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:57:23.902253+0000","last_undegraded":"2024-04-26T07:57:23.902253+0000","last_fullsized":"2024-04-26T07:57:23.902253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:59.311879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050871+0000","last_change":"2024-04-26T07:54:17.003817+0000","last_active":"2024-04-26T07:55:02.050871+0000","last_peered":"2024-04-26T07:55:02.050871+0000","last_clean":"2024-04-26T07:55:02.050871+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:55:02.050871+0000","last_undegraded":"2024-04-26T07:55:02.050871+0000","last_fullsized":"2024-04-26T07:55:02.050871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:28:51.342246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.054411+0000","last_change":"2024-04-26T07:54:15.019611+0000","last_active":"2024-04-26T07:55:02.054411+0000","last_peered":"2024-04-26T07:55:02.054411+0000","last_clean":"2024-04-26T07:55:02.054411+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:55:02.054411+0000","last_undegraded":"2024-04-26T07:55:02.054411+0000","last_fullsized":"2024-04-26T07:55:02.054411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:21.027132+0000","last_change":"2024-04-26T07:54:19.017393+0000","last_active":"2024-04-26T07:56:21.027132+0000","last_peered":"2024-04-26T07:56:21.027132+0000","last_clean":"2024-04-26T07:56:21.027132+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:56:21.027132+0000","last_undegraded":"2024-04-26T07:56:21.027132+0000","last_fullsized":"2024-04-26T07:56:21.027132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:30.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'33","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.841717+0000","last_change":"2024-04-26T07:54:21.021890+0000","last_active":"2024-04-26T07:57:23.841717+0000","last_peered":"2024-04-26T07:57:23.841717+0000","last_clean":"2024-04-26T07:57:23.841717+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:57:23.841717+0000","last_undegraded":"2024-04-26T07:57:23.841717+0000","last_fullsized":"2024-04-26T07:57:23.841717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:56.471143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048221+0000","last_change":"2024-04-26T07:54:23.021881+0000","last_active":"2024-04-26T07:55:02.048221+0000","last_peered":"2024-04-26T07:55:02.048221+0000","last_clean":"2024-04-26T07:55:02.048221+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:55:02.048221+0000","last_undegraded":"2024-04-26T07:55:02.048221+0000","last_fullsized":"2024-04-26T07:55:02.048221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:57.195185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:22.371916+0000","last_change":"2024-04-26T07:54:25.040953+0000","last_active":"2024-04-26T07:56:22.371916+0000","last_peered":"2024-04-26T07:56:22.371916+0000","last_clean":"2024-04-26T07:56:22.371916+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:56:22.371916+0000","last_undegraded":"2024-04-26T07:56:22.371916+0000","last_fullsized":"2024-04-26T07:56:22.371916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:37.200888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.803805+0000","last_change":"2024-04-26T07:54:17.004457+0000","last_active":"2024-04-26T07:56:23.803805+0000","last_peered":"2024-04-26T07:56:23.803805+0000","last_clean":"2024-04-26T07:56:23.803805+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:56:23.803805+0000","last_undegraded":"2024-04-26T07:56:23.803805+0000","last_fullsized":"2024-04-26T07:56:23.803805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:27:58.240167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050573+0000","last_change":"2024-04-26T07:54:15.022353+0000","last_active":"2024-04-26T07:55:02.050573+0000","last_peered":"2024-04-26T07:55:02.050573+0000","last_clean":"2024-04-26T07:55:02.050573+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:55:02.050573+0000","last_undegraded":"2024-04-26T07:55:02.050573+0000","last_fullsized":"2024-04-26T07:55:02.050573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:54.441268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.050768+0000","last_change":"2024-04-26T07:54:17.015322+0000","last_active":"2024-04-26T07:55:02.050768+0000","last_peered":"2024-04-26T07:55:02.050768+0000","last_clean":"2024-04-26T07:55:02.050768+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:55:02.050768+0000","last_undegraded":"2024-04-26T07:55:02.050768+0000","last_fullsized":"2024-04-26T07:55:02.050768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:08.202320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.423953+0000","last_change":"2024-04-26T07:54:15.001522+0000","last_active":"2024-04-26T07:57:24.423953+0000","last_peered":"2024-04-26T07:57:24.423953+0000","last_clean":"2024-04-26T07:57:24.423953+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:57:24.423953+0000","last_undegraded":"2024-04-26T07:57:24.423953+0000","last_fullsized":"2024-04-26T07:57:24.423953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048458+0000","last_change":"2024-04-26T07:54:17.010190+0000","last_active":"2024-04-26T07:55:02.048458+0000","last_peered":"2024-04-26T07:55:02.048458+0000","last_clean":"2024-04-26T07:55:02.048458+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:55:02.048458+0000","last_undegraded":"2024-04-26T07:55:02.048458+0000","last_fullsized":"2024-04-26T07:55:02.048458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:24.203874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046564+0000","last_change":"2024-04-26T07:54:15.025512+0000","last_active":"2024-04-26T07:55:02.046564+0000","last_peered":"2024-04-26T07:55:02.046564+0000","last_clean":"2024-04-26T07:55:02.046564+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:55:02.046564+0000","last_undegraded":"2024-04-26T07:55:02.046564+0000","last_fullsized":"2024-04-26T07:55:02.046564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:43.250319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143581+0000","last_change":"2024-04-26T07:54:17.009848+0000","last_active":"2024-04-26T07:55:40.143581+0000","last_peered":"2024-04-26T07:55:40.143581+0000","last_clean":"2024-04-26T07:55:40.143581+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:55:40.143581+0000","last_undegraded":"2024-04-26T07:55:40.143581+0000","last_fullsized":"2024-04-26T07:55:40.143581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884316+0000","last_change":"2024-04-26T07:54:15.005595+0000","last_active":"2024-04-26T07:56:19.884316+0000","last_peered":"2024-04-26T07:56:19.884316+0000","last_clean":"2024-04-26T07:56:19.884316+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:56:19.884316+0000","last_undegraded":"2024-04-26T07:56:19.884316+0000","last_fullsized":"2024-04-26T07:56:19.884316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:05.933045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:20.613906+0000","last_change":"2024-04-26T07:54:16.999767+0000","last_active":"2024-04-26T07:56:20.613906+0000","last_peered":"2024-04-26T07:56:20.613906+0000","last_clean":"2024-04-26T07:56:20.613906+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:56:20.613906+0000","last_undegraded":"2024-04-26T07:56:20.613906+0000","last_fullsized":"2024-04-26T07:56:20.613906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.777807+0000","last_change":"2024-04-26T07:54:15.003280+0000","last_active":"2024-04-26T07:56:23.777807+0000","last_peered":"2024-04-26T07:56:23.777807+0000","last_clean":"2024-04-26T07:56:23.777807+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:56:23.777807+0000","last_undegraded":"2024-04-26T07:56:23.777807+0000","last_fullsized":"2024-04-26T07:56:23.777807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:26.222483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511668+0000","last_change":"2024-04-26T07:54:17.003908+0000","last_active":"2024-04-26T07:57:24.511668+0000","last_peered":"2024-04-26T07:57:24.511668+0000","last_clean":"2024-04-26T07:57:24.511668+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:57:24.511668+0000","last_undegraded":"2024-04-26T07:57:24.511668+0000","last_fullsized":"2024-04-26T07:57:24.511668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:48.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048401+0000","last_change":"2024-04-26T07:54:15.017747+0000","last_active":"2024-04-26T07:55:02.048401+0000","last_peered":"2024-04-26T07:55:02.048401+0000","last_clean":"2024-04-26T07:55:02.048401+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:55:02.048401+0000","last_undegraded":"2024-04-26T07:55:02.048401+0000","last_fullsized":"2024-04-26T07:55:02.048401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:55.343440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518610+0000","last_change":"2024-04-26T07:54:17.006648+0000","last_active":"2024-04-26T07:57:24.518610+0000","last_peered":"2024-04-26T07:57:24.518610+0000","last_clean":"2024-04-26T07:57:24.518610+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:57:24.518610+0000","last_undegraded":"2024-04-26T07:57:24.518610+0000","last_fullsized":"2024-04-26T07:57:24.518610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:05.420036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.056521+0000","last_change":"2024-04-26T07:54:15.022184+0000","last_active":"2024-04-26T07:55:02.056521+0000","last_peered":"2024-04-26T07:55:02.056521+0000","last_clean":"2024-04-26T07:55:02.056521+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:55:02.056521+0000","last_undegraded":"2024-04-26T07:55:02.056521+0000","last_fullsized":"2024-04-26T07:55:02.056521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:32.268389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.294965+0000","last_change":"2024-04-26T07:54:16.999609+0000","last_active":"2024-04-26T07:57:24.294965+0000","last_peered":"2024-04-26T07:57:24.294965+0000","last_clean":"2024-04-26T07:57:24.294965+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:57:24.294965+0000","last_undegraded":"2024-04-26T07:57:24.294965+0000","last_fullsized":"2024-04-26T07:57:24.294965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:42.145262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049858+0000","last_change":"2024-04-26T07:54:15.005424+0000","last_active":"2024-04-26T07:55:02.049858+0000","last_peered":"2024-04-26T07:55:02.049858+0000","last_clean":"2024-04-26T07:55:02.049858+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:55:02.049858+0000","last_undegraded":"2024-04-26T07:55:02.049858+0000","last_fullsized":"2024-04-26T07:55:02.049858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:44.643100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.444923+0000","last_change":"2024-04-26T07:54:17.006417+0000","last_active":"2024-04-26T07:57:24.444923+0000","last_peered":"2024-04-26T07:57:24.444923+0000","last_clean":"2024-04-26T07:57:24.444923+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:57:24.444923+0000","last_undegraded":"2024-04-26T07:57:24.444923+0000","last_fullsized":"2024-04-26T07:57:24.444923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:32.537219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.046690+0000","last_change":"2024-04-26T07:54:15.029863+0000","last_active":"2024-04-26T07:55:02.046690+0000","last_peered":"2024-04-26T07:55:02.046690+0000","last_clean":"2024-04-26T07:55:02.046690+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:55:02.046690+0000","last_undegraded":"2024-04-26T07:55:02.046690+0000","last_fullsized":"2024-04-26T07:55:02.046690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.237116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.049233+0000","last_change":"2024-04-26T07:54:17.018186+0000","last_active":"2024-04-26T07:55:02.049233+0000","last_peered":"2024-04-26T07:55:02.049233+0000","last_clean":"2024-04-26T07:55:02.049233+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:55:02.049233+0000","last_undegraded":"2024-04-26T07:55:02.049233+0000","last_fullsized":"2024-04-26T07:55:02.049233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:42.953114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048139+0000","last_change":"2024-04-26T07:54:15.007396+0000","last_active":"2024-04-26T07:55:02.048139+0000","last_peered":"2024-04-26T07:55:02.048139+0000","last_clean":"2024-04-26T07:55:02.048139+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:55:02.048139+0000","last_undegraded":"2024-04-26T07:55:02.048139+0000","last_fullsized":"2024-04-26T07:55:02.048139+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:31.276550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:39.957894+0000","last_change":"2024-04-26T07:54:17.011327+0000","last_active":"2024-04-26T07:55:39.957894+0000","last_peered":"2024-04-26T07:55:39.957894+0000","last_clean":"2024-04-26T07:55:39.957894+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:55:39.957894+0000","last_undegraded":"2024-04-26T07:55:39.957894+0000","last_fullsized":"2024-04-26T07:55:39.957894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:16.244555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.428008+0000","last_change":"2024-04-26T07:54:15.017542+0000","last_active":"2024-04-26T07:57:24.428008+0000","last_peered":"2024-04-26T07:57:24.428008+0000","last_clean":"2024-04-26T07:57:24.428008+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:57:24.428008+0000","last_undegraded":"2024-04-26T07:57:24.428008+0000","last_fullsized":"2024-04-26T07:57:24.428008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:07.237734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.438319+0000","last_change":"2024-04-26T07:54:17.003159+0000","last_active":"2024-04-26T07:57:24.438319+0000","last_peered":"2024-04-26T07:57:24.438319+0000","last_clean":"2024-04-26T07:57:24.438319+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:57:24.438319+0000","last_undegraded":"2024-04-26T07:57:24.438319+0000","last_fullsized":"2024-04-26T07:57:24.438319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:44.398201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.417790+0000","last_change":"2024-04-26T07:54:15.008754+0000","last_active":"2024-04-26T07:57:24.417790+0000","last_peered":"2024-04-26T07:57:24.417790+0000","last_clean":"2024-04-26T07:57:24.417790+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:57:24.417790+0000","last_undegraded":"2024-04-26T07:57:24.417790+0000","last_fullsized":"2024-04-26T07:57:24.417790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.207862+0000","last_change":"2024-04-26T07:54:17.009514+0000","last_active":"2024-04-26T07:57:24.207862+0000","last_peered":"2024-04-26T07:57:24.207862+0000","last_clean":"2024-04-26T07:57:24.207862+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:57:24.207862+0000","last_undegraded":"2024-04-26T07:57:24.207862+0000","last_fullsized":"2024-04-26T07:57:24.207862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:08.202320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.431092+0000","last_change":"2024-04-26T07:54:15.022986+0000","last_active":"2024-04-26T07:57:24.431092+0000","last_peered":"2024-04-26T07:57:24.431092+0000","last_clean":"2024-04-26T07:57:24.431092+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:57:24.431092+0000","last_undegraded":"2024-04-26T07:57:24.431092+0000","last_fullsized":"2024-04-26T07:57:24.431092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:04:48.713435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511353+0000","last_change":"2024-04-26T07:54:17.007792+0000","last_active":"2024-04-26T07:57:24.511353+0000","last_peered":"2024-04-26T07:57:24.511353+0000","last_clean":"2024-04-26T07:57:24.511353+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:57:24.511353+0000","last_undegraded":"2024-04-26T07:57:24.511353+0000","last_fullsized":"2024-04-26T07:57:24.511353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:13.061187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048771+0000","last_change":"2024-04-26T07:54:15.026508+0000","last_active":"2024-04-26T07:55:02.048771+0000","last_peered":"2024-04-26T07:55:02.048771+0000","last_clean":"2024-04-26T07:55:02.048771+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:55:02.048771+0000","last_undegraded":"2024-04-26T07:55:02.048771+0000","last_fullsized":"2024-04-26T07:55:02.048771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:18.940423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.804054+0000","last_change":"2024-04-26T07:54:17.016231+0000","last_active":"2024-04-26T07:56:23.804054+0000","last_peered":"2024-04-26T07:56:23.804054+0000","last_clean":"2024-04-26T07:56:23.804054+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:56:23.804054+0000","last_undegraded":"2024-04-26T07:56:23.804054+0000","last_fullsized":"2024-04-26T07:56:23.804054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.266707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.057701+0000","last_change":"2024-04-26T07:54:15.022552+0000","last_active":"2024-04-26T07:55:02.057701+0000","last_peered":"2024-04-26T07:55:02.057701+0000","last_clean":"2024-04-26T07:55:02.057701+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:55:02.057701+0000","last_undegraded":"2024-04-26T07:55:02.057701+0000","last_fullsized":"2024-04-26T07:55:02.057701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:58.500512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:40.143346+0000","last_change":"2024-04-26T07:54:17.000134+0000","last_active":"2024-04-26T07:55:40.143346+0000","last_peered":"2024-04-26T07:55:40.143346+0000","last_clean":"2024-04-26T07:55:40.143346+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:55:40.143346+0000","last_undegraded":"2024-04-26T07:55:40.143346+0000","last_fullsized":"2024-04-26T07:55:40.143346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:12.768010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.052235+0000","last_change":"2024-04-26T07:54:15.025822+0000","last_active":"2024-04-26T07:55:02.052235+0000","last_peered":"2024-04-26T07:55:02.052235+0000","last_clean":"2024-04-26T07:55:02.052235+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:55:02.052235+0000","last_undegraded":"2024-04-26T07:55:02.052235+0000","last_fullsized":"2024-04-26T07:55:02.052235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:03.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.047156+0000","last_change":"2024-04-26T07:54:15.029803+0000","last_active":"2024-04-26T07:55:02.047156+0000","last_peered":"2024-04-26T07:55:02.047156+0000","last_clean":"2024-04-26T07:55:02.047156+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:55:02.047156+0000","last_undegraded":"2024-04-26T07:55:02.047156+0000","last_fullsized":"2024-04-26T07:55:02.047156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:28:49.334808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511260+0000","last_change":"2024-04-26T07:54:17.001393+0000","last_active":"2024-04-26T07:57:24.511260+0000","last_peered":"2024-04-26T07:57:24.511260+0000","last_clean":"2024-04-26T07:57:24.511260+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:57:24.511260+0000","last_undegraded":"2024-04-26T07:57:24.511260+0000","last_fullsized":"2024-04-26T07:57:24.511260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:13.730381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:55:02.048048+0000","last_change":"2024-04-26T07:54:15.007421+0000","last_active":"2024-04-26T07:55:02.048048+0000","last_peered":"2024-04-26T07:55:02.048048+0000","last_clean":"2024-04-26T07:55:02.048048+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:55:02.048048+0000","last_undegraded":"2024-04-26T07:55:02.048048+0000","last_fullsized":"2024-04-26T07:55:02.048048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:21.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.511321+0000","last_change":"2024-04-26T07:54:17.002953+0000","last_active":"2024-04-26T07:57:24.511321+0000","last_peered":"2024-04-26T07:57:24.511321+0000","last_clean":"2024-04-26T07:57:24.511321+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:57:24.511321+0000","last_undegraded":"2024-04-26T07:57:24.511321+0000","last_fullsized":"2024-04-26T07:57:24.511321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:35.778586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42228,"kb_used_data":6892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329612,"statfs":{"total":96636764160,"available":96593522688,"internally_reserved":0,"allocated":7057408,"data_stored":6751956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705707,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48896,"kb_used_data":13560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322944,"statfs":{"total":96636764160,"available":96586694656,"internally_reserved":0,"allocated":13885440,"data_stored":13632181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48600,"kb_used_data":13264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323240,"statfs":{"total":96636764160,"available":96586997760,"internally_reserved":0,"allocated":13582336,"data_stored":13307988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38024,"kb_used_data":6848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333816,"statfs":{"total":96636764160,"available":96597827584,"internally_reserved":0,"allocated":7012352,"data_stored":6749173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:57:35.790 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.790 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.791 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.791 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.791 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.791 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.791 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.792 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.792 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.792 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.792 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.792 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.793 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.793 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.793 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.793 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.794 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.794 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.794 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.794 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.795 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.795 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.795 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.796 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.796 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.796 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.796 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.797 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.797 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.797 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.797 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.797 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.797 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.798 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.798 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.798 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.798 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.799 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.799 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.799 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.799 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.800 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.800 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.800 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.800 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.801 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.801 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.801 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.801 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.801 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.802 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.802 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.802 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.802 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.802 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.802 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.802 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.803 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.804 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.805 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.806 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.806 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.806 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.806 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.806 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.806 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.806 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.806 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.807 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.808 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.808 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.808 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.808 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.808 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.808 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.808 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.808 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.809 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.809 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.809 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.809 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.809 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.809 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.809 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.809 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.810 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.811 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.812 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.812 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.812 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.812 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.812 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.812 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.812 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.812 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.813 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.813 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.813 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.813 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.813 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.813 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.814 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.814 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.814 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.814 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.814 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.814 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.814 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.815 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.816 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.816 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.816 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.816 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.816 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.816 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.816 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.817 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.817 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.817 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.817 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.817 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.817 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.817 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.817 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.818 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.818 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.818 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.818 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.818 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.818 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.818 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.818 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.819 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.820 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.820 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.820 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.820 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.820 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.820 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.820 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.820 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.821 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.822 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.822 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.822 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.822 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.822 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.822 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.822 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.823 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.824 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.824 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.824 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.824 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.824 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.824 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.824 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.824 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.825 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.826 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.827 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.827 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.827 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.827 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.827 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.827 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.827 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:35.827 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:57:55.828 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:57:55.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.944+0000 7fce5b460640 1 Processor -- start 2024-04-26T07:57:55.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce5b460640 1 -- start start 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce5b460640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce5412b880 0x7fce5412bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce5b460640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5409a780 con 0x7fce5412c1a0 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce5b460640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fce5409a9c0 con 0x7fce5412b880 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce591fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce5412b880 0x7fce5412bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce589fb640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fce5412c1a0 0x7fce5412ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58242/0 (socket says 172.21.15.1:58242) 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce589fb640 1 -- 172.21.15.1:0/3219515461 learned_addr learned my addr 172.21.15.1:0/3219515461 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce591fc640 1 -- 172.21.15.1:0/3219515461 >> v1:172.21.15.1:6789/0 conn(0x7fce5412c1a0 legacy=0x7fce5412ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce591fc640 1 -- 172.21.15.1:0/3219515461 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5409b750 con 0x7fce5412b880 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.945+0000 7fce4bfff640 1 -- 172.21.15.1:0/3219515461 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478195282 0 0) 0x7fce44001110 con 0x7fce5412c1a0 2024-04-26T07:57:55.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.946+0000 7fce591fc640 1 --2- 172.21.15.1:0/3219515461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce5412bc60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fce50009720 tx=0x7fce5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3ac9b0f23492e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.946+0000 7fce4bfff640 1 -- 172.21.15.1:0/3219515461 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce50035020 con 0x7fce5412b880 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.946+0000 7fce4bfff640 1 -- 172.21.15.1:0/3219515461 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce50031760 con 0x7fce5412b880 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.946+0000 7fce4bfff640 1 -- 172.21.15.1:0/3219515461 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce50031a60 con 0x7fce5412b880 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.947+0000 7fce5b460640 1 -- 172.21.15.1:0/3219515461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 msgr2=0x7fce5412bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.947+0000 7fce5b460640 1 --2- 172.21.15.1:0/3219515461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce5412bc60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fce50009720 tx=0x7fce5002b8d0 comp rx=0 tx=0).stop 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.947+0000 7fce5b460640 1 -- 172.21.15.1:0/3219515461 shutdown_connections 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.947+0000 7fce5b460640 1 --2- 172.21.15.1:0/3219515461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce5412bc60 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.947+0000 7fce5b460640 1 -- 172.21.15.1:0/3219515461 >> 172.21.15.1:0/3219515461 conn(0x7fce540a1700 msgr2=0x7fce540a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.947+0000 7fce5b460640 1 -- 172.21.15.1:0/3219515461 shutdown_connections 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.947+0000 7fce5b460640 1 -- 172.21.15.1:0/3219515461 wait complete. 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.948+0000 7fce5b460640 1 Processor -- start 2024-04-26T07:57:55.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.948+0000 7fce5b460640 1 -- start start 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.948+0000 7fce5b460640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce540701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.948+0000 7fce5b460640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fce5409b0b0 con 0x7fce5412b880 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.948+0000 7fce591fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce540701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.948+0000 7fce591fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce540701c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57448/0 (socket says 172.21.15.1:57448) 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.948+0000 7fce591fc640 1 -- 172.21.15.1:0/426006304 learned_addr learned my addr 172.21.15.1:0/426006304 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.949+0000 7fce591fc640 1 -- 172.21.15.1:0/426006304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5412eea0 con 0x7fce5412b880 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.949+0000 7fce591fc640 1 --2- 172.21.15.1:0/426006304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce540701c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fce50009720 tx=0x7fce500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.949+0000 7fce49ffb640 1 -- 172.21.15.1:0/426006304 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5003b980 con 0x7fce5412b880 2024-04-26T07:57:55.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.949+0000 7fce49ffb640 1 -- 172.21.15.1:0/426006304 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5003bb40 con 0x7fce5412b880 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.949+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce54072c80 con 0x7fce5412b880 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.949+0000 7fce49ffb640 1 -- 172.21.15.1:0/426006304 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5003be60 con 0x7fce5412b880 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.949+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce54070700 con 0x7fce5412b880 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.950+0000 7fce49ffb640 1 -- 172.21.15.1:0/426006304 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fce5004c060 con 0x7fce5412b880 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.950+0000 7fce49ffb640 1 --2- 172.21.15.1:0/426006304 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce380385c0 0x7fce3803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.950+0000 7fce49ffb640 1 -- 172.21.15.1:0/426006304 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fce5006dea0 con 0x7fce5412b880 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.950+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce540636f0 con 0x7fce5412b880 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.951+0000 7fce589fb640 1 --2- 172.21.15.1:0/426006304 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce380385c0 0x7fce3803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:57:55.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.951+0000 7fce589fb640 1 --2- 172.21.15.1:0/426006304 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce380385c0 0x7fce3803aa80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fce44007fd0 tx=0x7fce44001320 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:57:55.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:55.955+0000 7fce49ffb640 1 -- 172.21.15.1:0/426006304 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce50040070 con 0x7fce5412b880 2024-04-26T07:57:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.136+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce54072f60 con 0x7fce380385c0 2024-04-26T07:57:56.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.152+0000 7fce49ffb640 1 -- 172.21.15.1:0/426006304 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658117 (secure 0 0 0) 0x7fce440070d0 con 0x7fce380385c0 2024-04-26T07:57:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:57:56.162 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:57:56.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce380385c0 msgr2=0x7fce3803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:56.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 --2- 172.21.15.1:0/426006304 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce380385c0 0x7fce3803aa80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fce44007fd0 tx=0x7fce44001320 comp rx=0 tx=0).stop 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 msgr2=0x7fce540701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 --2- 172.21.15.1:0/426006304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce540701c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fce50009720 tx=0x7fce500046c0 comp rx=0 tx=0).stop 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 shutdown_connections 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 --2- 172.21.15.1:0/426006304 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fce380385c0 0x7fce3803aa80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 --2- 172.21.15.1:0/426006304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce5412b880 0x7fce540701c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 >> 172.21.15.1:0/426006304 conn(0x7fce540a1700 msgr2=0x7fce5409bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 shutdown_connections 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:57:56.157+0000 7fce5b460640 1 -- 172.21.15.1:0/426006304 wait complete. 2024-04-26T07:57:56.165 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-26T07:57:54.876429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5103,"num_read_kb":4684,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4716,"ondisk_log_size":4716,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148248,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339112,"statfs":{"total":386547056640,"available":386395250688,"internally_reserved":0,"allocated":2809856,"data_stored":1718390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003591"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.636062+0000","last_change":"2024-04-26T07:54:15.021756+0000","last_active":"2024-04-26T07:56:23.636062+0000","last_peered":"2024-04-26T07:56:23.636062+0000","last_clean":"2024-04-26T07:56:23.636062+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:56:23.636062+0000","last_undegraded":"2024-04-26T07:56:23.636062+0000","last_fullsized":"2024-04-26T07:56:23.636062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567766+0000","last_change":"2024-04-26T07:54:17.007567+0000","last_active":"2024-04-26T07:57:24.567766+0000","last_peered":"2024-04-26T07:57:24.567766+0000","last_clean":"2024-04-26T07:57:24.567766+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:57:24.567766+0000","last_undegraded":"2024-04-26T07:57:24.567766+0000","last_fullsized":"2024-04-26T07:57:24.567766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884369+0000","last_change":"2024-04-26T07:54:15.008962+0000","last_active":"2024-04-26T07:56:19.884369+0000","last_peered":"2024-04-26T07:56:19.884369+0000","last_clean":"2024-04-26T07:56:19.884369+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:56:19.884369+0000","last_undegraded":"2024-04-26T07:56:19.884369+0000","last_fullsized":"2024-04-26T07:56:19.884369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.216222+0000","last_change":"2024-04-26T07:54:17.015486+0000","last_active":"2024-04-26T07:57:24.216222+0000","last_peered":"2024-04-26T07:57:24.216222+0000","last_clean":"2024-04-26T07:57:24.216222+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:57:24.216222+0000","last_undegraded":"2024-04-26T07:57:24.216222+0000","last_fullsized":"2024-04-26T07:57:24.216222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.890522+0000","last_change":"2024-04-26T07:54:15.026276+0000","last_active":"2024-04-26T07:56:19.890522+0000","last_peered":"2024-04-26T07:56:19.890522+0000","last_clean":"2024-04-26T07:56:19.890522+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:56:19.890522+0000","last_undegraded":"2024-04-26T07:56:19.890522+0000","last_fullsized":"2024-04-26T07:56:19.890522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.517875+0000","last_change":"2024-04-26T07:54:17.018611+0000","last_active":"2024-04-26T07:57:24.517875+0000","last_peered":"2024-04-26T07:57:24.517875+0000","last_clean":"2024-04-26T07:57:24.517875+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:24.517875+0000","last_undegraded":"2024-04-26T07:57:24.517875+0000","last_fullsized":"2024-04-26T07:57:24.517875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.889138+0000","last_change":"2024-04-26T07:54:15.020803+0000","last_active":"2024-04-26T07:56:14.889138+0000","last_peered":"2024-04-26T07:56:14.889138+0000","last_clean":"2024-04-26T07:56:14.889138+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:56:14.889138+0000","last_undegraded":"2024-04-26T07:56:14.889138+0000","last_fullsized":"2024-04-26T07:56:14.889138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895671+0000","last_change":"2024-04-26T07:54:17.011187+0000","last_active":"2024-04-26T07:56:49.895671+0000","last_peered":"2024-04-26T07:56:49.895671+0000","last_clean":"2024-04-26T07:56:49.895671+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:56:49.895671+0000","last_undegraded":"2024-04-26T07:56:49.895671+0000","last_fullsized":"2024-04-26T07:56:49.895671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894751+0000","last_change":"2024-04-26T07:54:15.025367+0000","last_active":"2024-04-26T07:56:44.894751+0000","last_peered":"2024-04-26T07:56:44.894751+0000","last_clean":"2024-04-26T07:56:44.894751+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:56:44.894751+0000","last_undegraded":"2024-04-26T07:56:44.894751+0000","last_fullsized":"2024-04-26T07:56:44.894751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.519026+0000","last_change":"2024-04-26T07:54:17.001492+0000","last_active":"2024-04-26T07:57:24.519026+0000","last_peered":"2024-04-26T07:57:24.519026+0000","last_clean":"2024-04-26T07:57:24.519026+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:57:24.519026+0000","last_undegraded":"2024-04-26T07:57:24.519026+0000","last_fullsized":"2024-04-26T07:57:24.519026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.508835+0000","last_change":"2024-04-26T07:54:15.019896+0000","last_active":"2024-04-26T07:57:24.508835+0000","last_peered":"2024-04-26T07:57:24.508835+0000","last_clean":"2024-04-26T07:57:24.508835+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:57:24.508835+0000","last_undegraded":"2024-04-26T07:57:24.508835+0000","last_fullsized":"2024-04-26T07:57:24.508835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518920+0000","last_change":"2024-04-26T07:54:17.018051+0000","last_active":"2024-04-26T07:57:24.518920+0000","last_peered":"2024-04-26T07:57:24.518920+0000","last_clean":"2024-04-26T07:57:24.518920+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:24.518920+0000","last_undegraded":"2024-04-26T07:57:24.518920+0000","last_fullsized":"2024-04-26T07:57:24.518920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.173213+0000","last_change":"2024-04-26T07:54:15.021920+0000","last_active":"2024-04-26T07:57:24.173213+0000","last_peered":"2024-04-26T07:57:24.173213+0000","last_clean":"2024-04-26T07:57:24.173213+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:57:24.173213+0000","last_undegraded":"2024-04-26T07:57:24.173213+0000","last_fullsized":"2024-04-26T07:57:24.173213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.890870+0000","last_change":"2024-04-26T07:54:17.016378+0000","last_active":"2024-04-26T07:56:24.890870+0000","last_peered":"2024-04-26T07:56:24.890870+0000","last_clean":"2024-04-26T07:56:24.890870+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:56:24.890870+0000","last_undegraded":"2024-04-26T07:56:24.890870+0000","last_fullsized":"2024-04-26T07:56:24.890870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.888248+0000","last_change":"2024-04-26T07:54:15.008904+0000","last_active":"2024-04-26T07:56:44.888248+0000","last_peered":"2024-04-26T07:56:44.888248+0000","last_clean":"2024-04-26T07:56:44.888248+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:56:44.888248+0000","last_undegraded":"2024-04-26T07:56:44.888248+0000","last_fullsized":"2024-04-26T07:56:44.888248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.216568+0000","last_change":"2024-04-26T07:54:17.011542+0000","last_active":"2024-04-26T07:57:24.216568+0000","last_peered":"2024-04-26T07:57:24.216568+0000","last_clean":"2024-04-26T07:57:24.216568+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:57:24.216568+0000","last_undegraded":"2024-04-26T07:57:24.216568+0000","last_fullsized":"2024-04-26T07:57:24.216568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.952669+0000","last_change":"2024-04-26T07:57:47.952694+0000","last_active":"2024-04-26T07:57:47.952669+0000","last_peered":"2024-04-26T07:57:47.952669+0000","last_clean":"2024-04-26T07:57:47.952669+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:57:47.952669+0000","last_undegraded":"2024-04-26T07:57:47.952669+0000","last_fullsized":"2024-04-26T07:57:47.952669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.952578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:27.282056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893599+0000","last_change":"2024-04-26T07:54:15.020059+0000","last_active":"2024-04-26T07:56:39.893599+0000","last_peered":"2024-04-26T07:56:39.893599+0000","last_clean":"2024-04-26T07:56:39.893599+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:56:39.893599+0000","last_undegraded":"2024-04-26T07:56:39.893599+0000","last_fullsized":"2024-04-26T07:56:39.893599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893340+0000","last_change":"2024-04-26T07:54:17.007162+0000","last_active":"2024-04-26T07:56:39.893340+0000","last_peered":"2024-04-26T07:56:39.893340+0000","last_clean":"2024-04-26T07:56:39.893340+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:56:39.893340+0000","last_undegraded":"2024-04-26T07:56:39.893340+0000","last_fullsized":"2024-04-26T07:56:39.893340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893517+0000","last_change":"2024-04-26T07:54:15.023259+0000","last_active":"2024-04-26T07:56:39.893517+0000","last_peered":"2024-04-26T07:56:39.893517+0000","last_clean":"2024-04-26T07:56:39.893517+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:56:39.893517+0000","last_undegraded":"2024-04-26T07:56:39.893517+0000","last_fullsized":"2024-04-26T07:56:39.893517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.302491+0000","last_change":"2024-04-26T07:54:17.016377+0000","last_active":"2024-04-26T07:57:24.302491+0000","last_peered":"2024-04-26T07:57:24.302491+0000","last_clean":"2024-04-26T07:57:24.302491+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:24.302491+0000","last_undegraded":"2024-04-26T07:57:24.302491+0000","last_fullsized":"2024-04-26T07:57:24.302491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893509+0000","last_change":"2024-04-26T07:54:15.017989+0000","last_active":"2024-04-26T07:56:39.893509+0000","last_peered":"2024-04-26T07:56:39.893509+0000","last_clean":"2024-04-26T07:56:39.893509+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:56:39.893509+0000","last_undegraded":"2024-04-26T07:56:39.893509+0000","last_fullsized":"2024-04-26T07:56:39.893509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.216269+0000","last_change":"2024-04-26T07:54:17.011769+0000","last_active":"2024-04-26T07:57:24.216269+0000","last_peered":"2024-04-26T07:57:24.216269+0000","last_clean":"2024-04-26T07:57:24.216269+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:57:24.216269+0000","last_undegraded":"2024-04-26T07:57:24.216269+0000","last_fullsized":"2024-04-26T07:57:24.216269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893462+0000","last_change":"2024-04-26T07:54:15.017753+0000","last_active":"2024-04-26T07:56:39.893462+0000","last_peered":"2024-04-26T07:56:39.893462+0000","last_clean":"2024-04-26T07:56:39.893462+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:56:39.893462+0000","last_undegraded":"2024-04-26T07:56:39.893462+0000","last_fullsized":"2024-04-26T07:56:39.893462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894177+0000","last_change":"2024-04-26T07:54:17.012327+0000","last_active":"2024-04-26T07:56:44.894177+0000","last_peered":"2024-04-26T07:56:44.894177+0000","last_clean":"2024-04-26T07:56:44.894177+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:56:44.894177+0000","last_undegraded":"2024-04-26T07:56:44.894177+0000","last_fullsized":"2024-04-26T07:56:44.894177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.887607+0000","last_change":"2024-04-26T07:54:15.008684+0000","last_active":"2024-04-26T07:56:39.887607+0000","last_peered":"2024-04-26T07:56:39.887607+0000","last_clean":"2024-04-26T07:56:39.887607+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:56:39.887607+0000","last_undegraded":"2024-04-26T07:56:39.887607+0000","last_fullsized":"2024-04-26T07:56:39.887607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518812+0000","last_change":"2024-04-26T07:54:16.998745+0000","last_active":"2024-04-26T07:57:24.518812+0000","last_peered":"2024-04-26T07:57:24.518812+0000","last_clean":"2024-04-26T07:57:24.518812+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:57:24.518812+0000","last_undegraded":"2024-04-26T07:57:24.518812+0000","last_fullsized":"2024-04-26T07:57:24.518812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892974+0000","last_change":"2024-04-26T07:54:15.017883+0000","last_active":"2024-04-26T07:56:34.892974+0000","last_peered":"2024-04-26T07:56:34.892974+0000","last_clean":"2024-04-26T07:56:34.892974+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:56:34.892974+0000","last_undegraded":"2024-04-26T07:56:34.892974+0000","last_fullsized":"2024-04-26T07:56:34.892974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.528476+0000","last_change":"2024-04-26T07:54:25.037823+0000","last_active":"2024-04-26T07:57:24.528476+0000","last_peered":"2024-04-26T07:57:24.528476+0000","last_clean":"2024-04-26T07:57:24.528476+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:57:24.528476+0000","last_undegraded":"2024-04-26T07:57:24.528476+0000","last_fullsized":"2024-04-26T07:57:24.528476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'13","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567471+0000","last_change":"2024-04-26T07:54:17.010298+0000","last_active":"2024-04-26T07:57:24.567471+0000","last_peered":"2024-04-26T07:57:24.567471+0000","last_clean":"2024-04-26T07:57:24.567471+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:57:24.567471+0000","last_undegraded":"2024-04-26T07:57:24.567471+0000","last_fullsized":"2024-04-26T07:57:24.567471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.132698+0000","last_change":"2024-04-26T07:54:15.028485+0000","last_active":"2024-04-26T07:57:31.132698+0000","last_peered":"2024-04-26T07:57:31.132698+0000","last_clean":"2024-04-26T07:57:31.132698+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:57:31.132698+0000","last_undegraded":"2024-04-26T07:57:31.132698+0000","last_fullsized":"2024-04-26T07:57:31.132698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.991288+0000","last_change":"2024-04-26T07:57:41.991316+0000","last_active":"2024-04-26T07:57:41.991288+0000","last_peered":"2024-04-26T07:57:41.991288+0000","last_clean":"2024-04-26T07:57:41.991288+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:57:41.991288+0000","last_undegraded":"2024-04-26T07:57:41.991288+0000","last_fullsized":"2024-04-26T07:57:41.991288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.991200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:30.282928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'33","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.214775+0000","last_change":"2024-04-26T07:54:21.023071+0000","last_active":"2024-04-26T07:57:31.214775+0000","last_peered":"2024-04-26T07:57:31.214775+0000","last_clean":"2024-04-26T07:57:31.214775+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:57:31.214775+0000","last_undegraded":"2024-04-26T07:57:31.214775+0000","last_fullsized":"2024-04-26T07:57:31.214775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.029246+0000","last_change":"2024-04-26T07:57:40.029273+0000","last_active":"2024-04-26T07:57:40.029246+0000","last_peered":"2024-04-26T07:57:40.029246+0000","last_clean":"2024-04-26T07:57:40.029246+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:57:40.029246+0000","last_undegraded":"2024-04-26T07:57:40.029246+0000","last_fullsized":"2024-04-26T07:57:40.029246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.029150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.153168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'11","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.629440+0000","last_change":"2024-04-26T07:54:25.029434+0000","last_active":"2024-04-26T07:57:24.629440+0000","last_peered":"2024-04-26T07:57:24.629440+0000","last_clean":"2024-04-26T07:57:24.629440+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:24.629440+0000","last_undegraded":"2024-04-26T07:57:24.629440+0000","last_fullsized":"2024-04-26T07:57:24.629440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567342+0000","last_change":"2024-04-26T07:54:17.010194+0000","last_active":"2024-04-26T07:57:24.567342+0000","last_peered":"2024-04-26T07:57:24.567342+0000","last_clean":"2024-04-26T07:57:24.567342+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:57:24.567342+0000","last_undegraded":"2024-04-26T07:57:24.567342+0000","last_fullsized":"2024-04-26T07:57:24.567342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892464+0000","last_change":"2024-04-26T07:54:15.018699+0000","last_active":"2024-04-26T07:56:34.892464+0000","last_peered":"2024-04-26T07:56:34.892464+0000","last_clean":"2024-04-26T07:56:34.892464+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:56:34.892464+0000","last_undegraded":"2024-04-26T07:56:34.892464+0000","last_fullsized":"2024-04-26T07:56:34.892464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'4","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.044186+0000","last_change":"2024-04-26T07:55:02.067003+0000","last_active":"2024-04-26T07:57:31.044186+0000","last_peered":"2024-04-26T07:57:31.044186+0000","last_clean":"2024-04-26T07:57:31.044186+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:57:31.044186+0000","last_undegraded":"2024-04-26T07:57:31.044186+0000","last_fullsized":"2024-04-26T07:57:31.044186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.951894+0000","last_change":"2024-04-26T07:57:42.951977+0000","last_active":"2024-04-26T07:57:42.951894+0000","last_peered":"2024-04-26T07:57:42.951894+0000","last_clean":"2024-04-26T07:57:42.951894+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:57:42.951894+0000","last_undegraded":"2024-04-26T07:57:42.951894+0000","last_fullsized":"2024-04-26T07:57:42.951894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.951788+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:25.400326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.943693+0000","last_change":"2024-04-26T07:57:47.943739+0000","last_active":"2024-04-26T07:57:47.943693+0000","last_peered":"2024-04-26T07:57:47.943693+0000","last_clean":"2024-04-26T07:57:47.943693+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:57:47.943693+0000","last_undegraded":"2024-04-26T07:57:47.943693+0000","last_fullsized":"2024-04-26T07:57:47.943693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.943578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:52.735911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.889976+0000","last_change":"2024-04-26T07:54:25.027104+0000","last_active":"2024-04-26T07:56:54.889976+0000","last_peered":"2024-04-26T07:56:54.889976+0000","last_clean":"2024-04-26T07:56:54.889976+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:56:54.889976+0000","last_undegraded":"2024-04-26T07:56:54.889976+0000","last_fullsized":"2024-04-26T07:56:54.889976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:29.900680+0000","last_change":"2024-04-26T07:55:02.065992+0000","last_active":"2024-04-26T07:57:29.900680+0000","last_peered":"2024-04-26T07:57:29.900680+0000","last_clean":"2024-04-26T07:57:29.900680+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:57:29.900680+0000","last_undegraded":"2024-04-26T07:57:29.900680+0000","last_fullsized":"2024-04-26T07:57:29.900680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892901+0000","last_change":"2024-04-26T07:54:15.028375+0000","last_active":"2024-04-26T07:56:34.892901+0000","last_peered":"2024-04-26T07:56:34.892901+0000","last_clean":"2024-04-26T07:56:34.892901+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:56:34.892901+0000","last_undegraded":"2024-04-26T07:56:34.892901+0000","last_fullsized":"2024-04-26T07:56:34.892901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.888399+0000","last_change":"2024-04-26T07:54:19.014182+0000","last_active":"2024-04-26T07:56:44.888399+0000","last_peered":"2024-04-26T07:56:44.888399+0000","last_clean":"2024-04-26T07:56:44.888399+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:56:44.888399+0000","last_undegraded":"2024-04-26T07:56:44.888399+0000","last_fullsized":"2024-04-26T07:56:44.888399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.282629+0000","last_change":"2024-04-26T07:57:38.282677+0000","last_active":"2024-04-26T07:57:38.282629+0000","last_peered":"2024-04-26T07:57:38.282629+0000","last_clean":"2024-04-26T07:57:38.282629+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:57:38.282629+0000","last_undegraded":"2024-04-26T07:57:38.282629+0000","last_fullsized":"2024-04-26T07:57:38.282629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.282530+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:49.848037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.230736+0000","last_change":"2024-04-26T07:54:23.036180+0000","last_active":"2024-04-26T07:57:31.230736+0000","last_peered":"2024-04-26T07:57:31.230736+0000","last_clean":"2024-04-26T07:57:31.230736+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:57:31.230736+0000","last_undegraded":"2024-04-26T07:57:31.230736+0000","last_fullsized":"2024-04-26T07:57:31.230736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.895805+0000","last_change":"2024-04-26T07:54:25.027799+0000","last_active":"2024-04-26T07:56:54.895805+0000","last_peered":"2024-04-26T07:56:54.895805+0000","last_clean":"2024-04-26T07:56:54.895805+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:56:54.895805+0000","last_undegraded":"2024-04-26T07:56:54.895805+0000","last_fullsized":"2024-04-26T07:56:54.895805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.445650+0000","last_change":"2024-04-26T07:54:17.006664+0000","last_active":"2024-04-26T07:57:24.445650+0000","last_peered":"2024-04-26T07:57:24.445650+0000","last_clean":"2024-04-26T07:57:24.445650+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:57:24.445650+0000","last_undegraded":"2024-04-26T07:57:24.445650+0000","last_fullsized":"2024-04-26T07:57:24.445650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892361+0000","last_change":"2024-04-26T07:54:15.020158+0000","last_active":"2024-04-26T07:56:34.892361+0000","last_peered":"2024-04-26T07:56:34.892361+0000","last_clean":"2024-04-26T07:56:34.892361+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:56:34.892361+0000","last_undegraded":"2024-04-26T07:56:34.892361+0000","last_fullsized":"2024-04-26T07:56:34.892361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894905+0000","last_change":"2024-04-26T07:55:02.059077+0000","last_active":"2024-04-26T07:56:44.894905+0000","last_peered":"2024-04-26T07:56:44.894905+0000","last_clean":"2024-04-26T07:56:44.894905+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:56:44.894905+0000","last_undegraded":"2024-04-26T07:56:44.894905+0000","last_fullsized":"2024-04-26T07:56:44.894905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.304015+0000","last_change":"2024-04-26T07:57:41.304062+0000","last_active":"2024-04-26T07:57:41.304015+0000","last_peered":"2024-04-26T07:57:41.304015+0000","last_clean":"2024-04-26T07:57:41.304015+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:57:41.304015+0000","last_undegraded":"2024-04-26T07:57:41.304015+0000","last_fullsized":"2024-04-26T07:57:41.304015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.303924+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:58.630899+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":405,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.235111+0000","last_change":"2024-04-26T07:54:23.029180+0000","last_active":"2024-04-26T07:57:31.235111+0000","last_peered":"2024-04-26T07:57:31.235111+0000","last_clean":"2024-04-26T07:57:31.235111+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:31.235111+0000","last_undegraded":"2024-04-26T07:57:31.235111+0000","last_fullsized":"2024-04-26T07:57:31.235111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567811+0000","last_change":"2024-04-26T07:54:17.018068+0000","last_active":"2024-04-26T07:57:24.567811+0000","last_peered":"2024-04-26T07:57:24.567811+0000","last_clean":"2024-04-26T07:57:24.567811+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:57:24.567811+0000","last_undegraded":"2024-04-26T07:57:24.567811+0000","last_fullsized":"2024-04-26T07:57:24.567811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891714+0000","last_change":"2024-04-26T07:54:15.021552+0000","last_active":"2024-04-26T07:56:29.891714+0000","last_peered":"2024-04-26T07:56:29.891714+0000","last_clean":"2024-04-26T07:56:29.891714+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:56:29.891714+0000","last_undegraded":"2024-04-26T07:56:29.891714+0000","last_fullsized":"2024-04-26T07:56:29.891714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.928603+0000","last_change":"2024-04-26T07:57:46.928630+0000","last_active":"2024-04-26T07:57:46.928603+0000","last_peered":"2024-04-26T07:57:46.928603+0000","last_clean":"2024-04-26T07:57:46.928603+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:57:46.928603+0000","last_undegraded":"2024-04-26T07:57:46.928603+0000","last_fullsized":"2024-04-26T07:57:46.928603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.928512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:13.316943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.275612+0000","last_change":"2024-04-26T07:57:46.275674+0000","last_active":"2024-04-26T07:57:46.275612+0000","last_peered":"2024-04-26T07:57:46.275612+0000","last_clean":"2024-04-26T07:57:46.275612+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:57:46.275612+0000","last_undegraded":"2024-04-26T07:57:46.275612+0000","last_fullsized":"2024-04-26T07:57:46.275612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.275508+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:20.381725+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.014944+0000","last_change":"2024-04-26T07:57:43.014970+0000","last_active":"2024-04-26T07:57:43.014944+0000","last_peered":"2024-04-26T07:57:43.014944+0000","last_clean":"2024-04-26T07:57:43.014944+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:57:43.014944+0000","last_undegraded":"2024-04-26T07:57:43.014944+0000","last_fullsized":"2024-04-26T07:57:43.014944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.014858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:09.403289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891555+0000","last_change":"2024-04-26T07:54:25.038132+0000","last_active":"2024-04-26T07:56:29.891555+0000","last_peered":"2024-04-26T07:56:29.891555+0000","last_clean":"2024-04-26T07:56:29.891555+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:56:29.891555+0000","last_undegraded":"2024-04-26T07:56:29.891555+0000","last_fullsized":"2024-04-26T07:56:29.891555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518408+0000","last_change":"2024-04-26T07:54:16.999342+0000","last_active":"2024-04-26T07:57:24.518408+0000","last_peered":"2024-04-26T07:57:24.518408+0000","last_clean":"2024-04-26T07:57:24.518408+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:57:24.518408+0000","last_undegraded":"2024-04-26T07:57:24.518408+0000","last_fullsized":"2024-04-26T07:57:24.518408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891644+0000","last_change":"2024-04-26T07:54:15.021572+0000","last_active":"2024-04-26T07:56:29.891644+0000","last_peered":"2024-04-26T07:56:29.891644+0000","last_clean":"2024-04-26T07:56:29.891644+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:56:29.891644+0000","last_undegraded":"2024-04-26T07:56:29.891644+0000","last_fullsized":"2024-04-26T07:56:29.891644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885842+0000","last_change":"2024-04-26T07:54:19.014010+0000","last_active":"2024-04-26T07:56:29.885842+0000","last_peered":"2024-04-26T07:56:29.885842+0000","last_clean":"2024-04-26T07:56:29.885842+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:56:29.885842+0000","last_undegraded":"2024-04-26T07:56:29.885842+0000","last_fullsized":"2024-04-26T07:56:29.885842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.163992+0000","last_change":"2024-04-26T07:54:21.021470+0000","last_active":"2024-04-26T07:57:31.163992+0000","last_peered":"2024-04-26T07:57:31.163992+0000","last_clean":"2024-04-26T07:57:31.163992+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:57:31.163992+0000","last_undegraded":"2024-04-26T07:57:31.163992+0000","last_fullsized":"2024-04-26T07:57:31.163992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.026924+0000","last_change":"2024-04-26T07:57:47.026951+0000","last_active":"2024-04-26T07:57:47.026924+0000","last_peered":"2024-04-26T07:57:47.026924+0000","last_clean":"2024-04-26T07:57:47.026924+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:57:47.026924+0000","last_undegraded":"2024-04-26T07:57:47.026924+0000","last_fullsized":"2024-04-26T07:57:47.026924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.026813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:06.280145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891597+0000","last_change":"2024-04-26T07:54:25.031077+0000","last_active":"2024-04-26T07:56:29.891597+0000","last_peered":"2024-04-26T07:56:29.891597+0000","last_clean":"2024-04-26T07:56:29.891597+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:56:29.891597+0000","last_undegraded":"2024-04-26T07:56:29.891597+0000","last_fullsized":"2024-04-26T07:56:29.891597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567527+0000","last_change":"2024-04-26T07:54:17.015501+0000","last_active":"2024-04-26T07:57:24.567527+0000","last_peered":"2024-04-26T07:57:24.567527+0000","last_clean":"2024-04-26T07:57:24.567527+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:57:24.567527+0000","last_undegraded":"2024-04-26T07:57:24.567527+0000","last_fullsized":"2024-04-26T07:57:24.567527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892260+0000","last_change":"2024-04-26T07:54:15.026188+0000","last_active":"2024-04-26T07:56:29.892260+0000","last_peered":"2024-04-26T07:56:29.892260+0000","last_clean":"2024-04-26T07:56:29.892260+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:56:29.892260+0000","last_undegraded":"2024-04-26T07:56:29.892260+0000","last_fullsized":"2024-04-26T07:56:29.892260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.886801+0000","last_change":"2024-04-26T07:54:19.014021+0000","last_active":"2024-04-26T07:56:34.886801+0000","last_peered":"2024-04-26T07:56:34.886801+0000","last_clean":"2024-04-26T07:56:34.886801+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:56:34.886801+0000","last_undegraded":"2024-04-26T07:56:34.886801+0000","last_fullsized":"2024-04-26T07:56:34.886801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'40","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.118060+0000","last_change":"2024-04-26T07:54:21.021799+0000","last_active":"2024-04-26T07:57:31.118060+0000","last_peered":"2024-04-26T07:57:31.118060+0000","last_clean":"2024-04-26T07:57:31.118060+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:57:31.118060+0000","last_undegraded":"2024-04-26T07:57:31.118060+0000","last_fullsized":"2024-04-26T07:57:31.118060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.078518+0000","last_change":"2024-04-26T07:57:36.078544+0000","last_active":"2024-04-26T07:57:36.078518+0000","last_peered":"2024-04-26T07:57:36.078518+0000","last_clean":"2024-04-26T07:57:36.078518+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:36.078518+0000","last_undegraded":"2024-04-26T07:57:36.078518+0000","last_fullsized":"2024-04-26T07:57:36.078518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.078443+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:00.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.886854+0000","last_change":"2024-04-26T07:54:25.030802+0000","last_active":"2024-04-26T07:56:34.886854+0000","last_peered":"2024-04-26T07:56:34.886854+0000","last_clean":"2024-04-26T07:56:34.886854+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:56:34.886854+0000","last_undegraded":"2024-04-26T07:56:34.886854+0000","last_fullsized":"2024-04-26T07:56:34.886854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'7","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567519+0000","last_change":"2024-04-26T07:54:17.003162+0000","last_active":"2024-04-26T07:57:24.567519+0000","last_peered":"2024-04-26T07:57:24.567519+0000","last_clean":"2024-04-26T07:57:24.567519+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:24.567519+0000","last_undegraded":"2024-04-26T07:57:24.567519+0000","last_fullsized":"2024-04-26T07:57:24.567519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892189+0000","last_change":"2024-04-26T07:54:15.029358+0000","last_active":"2024-04-26T07:56:29.892189+0000","last_peered":"2024-04-26T07:56:29.892189+0000","last_clean":"2024-04-26T07:56:29.892189+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:56:29.892189+0000","last_undegraded":"2024-04-26T07:56:29.892189+0000","last_fullsized":"2024-04-26T07:56:29.892189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885900+0000","last_change":"2024-04-26T07:54:19.011909+0000","last_active":"2024-04-26T07:56:29.885900+0000","last_peered":"2024-04-26T07:56:29.885900+0000","last_clean":"2024-04-26T07:56:29.885900+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:56:29.885900+0000","last_undegraded":"2024-04-26T07:56:29.885900+0000","last_fullsized":"2024-04-26T07:56:29.885900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'64","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.962316+0000","last_change":"2024-04-26T07:57:46.962369+0000","last_active":"2024-04-26T07:57:46.962316+0000","last_peered":"2024-04-26T07:57:46.962316+0000","last_clean":"2024-04-26T07:57:46.962316+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:57:46.962316+0000","last_undegraded":"2024-04-26T07:57:46.962316+0000","last_fullsized":"2024-04-26T07:57:46.962316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.962228+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:34.331613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.099064+0000","last_change":"2024-04-26T07:57:35.099115+0000","last_active":"2024-04-26T07:57:35.099064+0000","last_peered":"2024-04-26T07:57:35.099064+0000","last_clean":"2024-04-26T07:57:35.099064+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:57:35.099064+0000","last_undegraded":"2024-04-26T07:57:35.099064+0000","last_fullsized":"2024-04-26T07:57:35.099064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.098977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:27.568866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.618553+0000","last_change":"2024-04-26T07:54:25.034316+0000","last_active":"2024-04-26T07:57:24.618553+0000","last_peered":"2024-04-26T07:57:24.618553+0000","last_clean":"2024-04-26T07:57:24.618553+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:57:24.618553+0000","last_undegraded":"2024-04-26T07:57:24.618553+0000","last_fullsized":"2024-04-26T07:57:24.618553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892532+0000","last_change":"2024-04-26T07:54:17.013013+0000","last_active":"2024-04-26T07:56:34.892532+0000","last_peered":"2024-04-26T07:56:34.892532+0000","last_clean":"2024-04-26T07:56:34.892532+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:56:34.892532+0000","last_undegraded":"2024-04-26T07:56:34.892532+0000","last_fullsized":"2024-04-26T07:56:34.892532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885926+0000","last_change":"2024-04-26T07:54:15.001977+0000","last_active":"2024-04-26T07:56:29.885926+0000","last_peered":"2024-04-26T07:56:29.885926+0000","last_clean":"2024-04-26T07:56:29.885926+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:56:29.885926+0000","last_undegraded":"2024-04-26T07:56:29.885926+0000","last_fullsized":"2024-04-26T07:56:29.885926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.292948+0000","last_change":"2024-04-26T07:57:48.292998+0000","last_active":"2024-04-26T07:57:48.292948+0000","last_peered":"2024-04-26T07:57:48.292948+0000","last_clean":"2024-04-26T07:57:48.292948+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:57:48.292948+0000","last_undegraded":"2024-04-26T07:57:48.292948+0000","last_fullsized":"2024-04-26T07:57:48.292948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.292808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:10.416826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.928685+0000","last_change":"2024-04-26T07:57:44.928755+0000","last_active":"2024-04-26T07:57:44.928685+0000","last_peered":"2024-04-26T07:57:44.928685+0000","last_clean":"2024-04-26T07:57:44.928685+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:57:44.928685+0000","last_undegraded":"2024-04-26T07:57:44.928685+0000","last_fullsized":"2024-04-26T07:57:44.928685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.928570+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.353478+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893986+0000","last_change":"2024-04-26T07:54:23.029968+0000","last_active":"2024-04-26T07:56:39.893986+0000","last_peered":"2024-04-26T07:56:39.893986+0000","last_clean":"2024-04-26T07:56:39.893986+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:56:39.893986+0000","last_undegraded":"2024-04-26T07:56:39.893986+0000","last_fullsized":"2024-04-26T07:56:39.893986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.572543+0000","last_change":"2024-04-26T07:54:25.037903+0000","last_active":"2024-04-26T07:57:24.572543+0000","last_peered":"2024-04-26T07:57:24.572543+0000","last_clean":"2024-04-26T07:57:24.572543+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:57:24.572543+0000","last_undegraded":"2024-04-26T07:57:24.572543+0000","last_fullsized":"2024-04-26T07:57:24.572543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489365+0000","last_change":"2024-04-26T07:54:17.018272+0000","last_active":"2024-04-26T07:57:24.489365+0000","last_peered":"2024-04-26T07:57:24.489365+0000","last_clean":"2024-04-26T07:57:24.489365+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:24.489365+0000","last_undegraded":"2024-04-26T07:57:24.489365+0000","last_fullsized":"2024-04-26T07:57:24.489365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891326+0000","last_change":"2024-04-26T07:54:15.023312+0000","last_active":"2024-04-26T07:56:24.891326+0000","last_peered":"2024-04-26T07:56:24.891326+0000","last_clean":"2024-04-26T07:56:24.891326+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:56:24.891326+0000","last_undegraded":"2024-04-26T07:56:24.891326+0000","last_fullsized":"2024-04-26T07:56:24.891326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.886812+0000","last_change":"2024-04-26T07:54:19.013889+0000","last_active":"2024-04-26T07:56:34.886812+0000","last_peered":"2024-04-26T07:56:34.886812+0000","last_clean":"2024-04-26T07:56:34.886812+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:56:34.886812+0000","last_undegraded":"2024-04-26T07:56:34.886812+0000","last_fullsized":"2024-04-26T07:56:34.886812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.289659+0000","last_change":"2024-04-26T07:57:45.289709+0000","last_active":"2024-04-26T07:57:45.289659+0000","last_peered":"2024-04-26T07:57:45.289659+0000","last_clean":"2024-04-26T07:57:45.289659+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:57:45.289659+0000","last_undegraded":"2024-04-26T07:57:45.289659+0000","last_fullsized":"2024-04-26T07:57:45.289659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.289560+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:24.532087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.293625+0000","last_change":"2024-04-26T07:57:39.293682+0000","last_active":"2024-04-26T07:57:39.293625+0000","last_peered":"2024-04-26T07:57:39.293625+0000","last_clean":"2024-04-26T07:57:39.293625+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:39.293625+0000","last_undegraded":"2024-04-26T07:57:39.293625+0000","last_fullsized":"2024-04-26T07:57:39.293625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.293505+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.009568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'12","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.574516+0000","last_change":"2024-04-26T07:54:25.029180+0000","last_active":"2024-04-26T07:57:24.574516+0000","last_peered":"2024-04-26T07:57:24.574516+0000","last_clean":"2024-04-26T07:57:24.574516+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:57:24.574516+0000","last_undegraded":"2024-04-26T07:57:24.574516+0000","last_fullsized":"2024-04-26T07:57:24.574516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892608+0000","last_change":"2024-04-26T07:54:17.015565+0000","last_active":"2024-04-26T07:56:34.892608+0000","last_peered":"2024-04-26T07:56:34.892608+0000","last_clean":"2024-04-26T07:56:34.892608+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:56:34.892608+0000","last_undegraded":"2024-04-26T07:56:34.892608+0000","last_fullsized":"2024-04-26T07:56:34.892608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891275+0000","last_change":"2024-04-26T07:54:15.028460+0000","last_active":"2024-04-26T07:56:24.891275+0000","last_peered":"2024-04-26T07:56:24.891275+0000","last_clean":"2024-04-26T07:56:24.891275+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:56:24.891275+0000","last_undegraded":"2024-04-26T07:56:24.891275+0000","last_fullsized":"2024-04-26T07:56:24.891275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.055729+0000","last_change":"2024-04-26T07:55:02.064457+0000","last_active":"2024-04-26T07:57:31.055729+0000","last_peered":"2024-04-26T07:57:31.055729+0000","last_clean":"2024-04-26T07:57:31.055729+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:57:31.055729+0000","last_undegraded":"2024-04-26T07:57:31.055729+0000","last_fullsized":"2024-04-26T07:57:31.055729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893917+0000","last_change":"2024-04-26T07:54:21.021896+0000","last_active":"2024-04-26T07:56:39.893917+0000","last_peered":"2024-04-26T07:56:39.893917+0000","last_clean":"2024-04-26T07:56:39.893917+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:56:39.893917+0000","last_undegraded":"2024-04-26T07:56:39.893917+0000","last_fullsized":"2024-04-26T07:56:39.893917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.160493+0000","last_change":"2024-04-26T07:57:36.160522+0000","last_active":"2024-04-26T07:57:36.160493+0000","last_peered":"2024-04-26T07:57:36.160493+0000","last_clean":"2024-04-26T07:57:36.160493+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:36.160493+0000","last_undegraded":"2024-04-26T07:57:36.160493+0000","last_fullsized":"2024-04-26T07:57:36.160493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.160401+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:38.276301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891472+0000","last_change":"2024-04-26T07:54:25.024615+0000","last_active":"2024-04-26T07:56:29.891472+0000","last_peered":"2024-04-26T07:56:29.891472+0000","last_clean":"2024-04-26T07:56:29.891472+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:56:29.891472+0000","last_undegraded":"2024-04-26T07:56:29.891472+0000","last_fullsized":"2024-04-26T07:56:29.891472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892639+0000","last_change":"2024-04-26T07:54:17.004296+0000","last_active":"2024-04-26T07:56:34.892639+0000","last_peered":"2024-04-26T07:56:34.892639+0000","last_clean":"2024-04-26T07:56:34.892639+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:56:34.892639+0000","last_undegraded":"2024-04-26T07:56:34.892639+0000","last_fullsized":"2024-04-26T07:56:34.892639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.134413+0000","last_change":"2024-04-26T07:54:15.030153+0000","last_active":"2024-04-26T07:57:31.134413+0000","last_peered":"2024-04-26T07:57:31.134413+0000","last_clean":"2024-04-26T07:57:31.134413+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:57:31.134413+0000","last_undegraded":"2024-04-26T07:57:31.134413+0000","last_fullsized":"2024-04-26T07:57:31.134413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.958182+0000","last_change":"2024-04-26T07:57:39.958217+0000","last_active":"2024-04-26T07:57:39.958182+0000","last_peered":"2024-04-26T07:57:39.958182+0000","last_clean":"2024-04-26T07:57:39.958182+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:57:39.958182+0000","last_undegraded":"2024-04-26T07:57:39.958182+0000","last_fullsized":"2024-04-26T07:57:39.958182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.958089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.571578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'50","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.994894+0000","last_change":"2024-04-26T07:57:40.994938+0000","last_active":"2024-04-26T07:57:40.994894+0000","last_peered":"2024-04-26T07:57:40.994894+0000","last_clean":"2024-04-26T07:57:40.994894+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:57:40.994894+0000","last_undegraded":"2024-04-26T07:57:40.994894+0000","last_fullsized":"2024-04-26T07:57:40.994894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.994806+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:36.917229+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893398+0000","last_change":"2024-04-26T07:54:23.031702+0000","last_active":"2024-04-26T07:56:39.893398+0000","last_peered":"2024-04-26T07:56:39.893398+0000","last_clean":"2024-04-26T07:56:39.893398+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:56:39.893398+0000","last_undegraded":"2024-04-26T07:56:39.893398+0000","last_fullsized":"2024-04-26T07:56:39.893398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.616838+0000","last_change":"2024-04-26T07:54:25.025544+0000","last_active":"2024-04-26T07:57:24.616838+0000","last_peered":"2024-04-26T07:57:24.616838+0000","last_clean":"2024-04-26T07:57:24.616838+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:24.616838+0000","last_undegraded":"2024-04-26T07:57:24.616838+0000","last_fullsized":"2024-04-26T07:57:24.616838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.445777+0000","last_change":"2024-04-26T07:54:17.016804+0000","last_active":"2024-04-26T07:57:24.445777+0000","last_peered":"2024-04-26T07:57:24.445777+0000","last_clean":"2024-04-26T07:57:24.445777+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:57:24.445777+0000","last_undegraded":"2024-04-26T07:57:24.445777+0000","last_fullsized":"2024-04-26T07:57:24.445777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:09.888378+0000","last_change":"2024-04-26T07:54:06.676207+0000","last_active":"2024-04-26T07:56:09.888378+0000","last_peered":"2024-04-26T07:56:09.888378+0000","last_clean":"2024-04-26T07:56:09.888378+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:56:09.888378+0000","last_undegraded":"2024-04-26T07:56:09.888378+0000","last_fullsized":"2024-04-26T07:56:09.888378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.889602+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:56:14.889602+0000","last_peered":"2024-04-26T07:56:14.889602+0000","last_clean":"2024-04-26T07:56:14.889602+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:56:14.889602+0000","last_undegraded":"2024-04-26T07:56:14.889602+0000","last_fullsized":"2024-04-26T07:56:14.889602+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.890420+0000","last_change":"2024-04-26T07:54:15.028934+0000","last_active":"2024-04-26T07:56:19.890420+0000","last_peered":"2024-04-26T07:56:19.890420+0000","last_clean":"2024-04-26T07:56:19.890420+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:56:19.890420+0000","last_undegraded":"2024-04-26T07:56:19.890420+0000","last_fullsized":"2024-04-26T07:56:19.890420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"20'1","reported_seq":221,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.056003+0000","last_change":"2024-04-26T07:54:19.011625+0000","last_active":"2024-04-26T07:57:31.056003+0000","last_peered":"2024-04-26T07:57:31.056003+0000","last_clean":"2024-04-26T07:57:31.056003+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:57:31.056003+0000","last_undegraded":"2024-04-26T07:57:31.056003+0000","last_fullsized":"2024-04-26T07:57:31.056003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.023082+0000","last_change":"2024-04-26T07:57:43.023139+0000","last_active":"2024-04-26T07:57:43.023082+0000","last_peered":"2024-04-26T07:57:43.023082+0000","last_clean":"2024-04-26T07:57:43.023082+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:57:43.023082+0000","last_undegraded":"2024-04-26T07:57:43.023082+0000","last_fullsized":"2024-04-26T07:57:43.023082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.022950+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:31.923488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.045605+0000","last_change":"2024-04-26T07:57:38.045637+0000","last_active":"2024-04-26T07:57:38.045605+0000","last_peered":"2024-04-26T07:57:38.045605+0000","last_clean":"2024-04-26T07:57:38.045605+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:57:38.045605+0000","last_undegraded":"2024-04-26T07:57:38.045605+0000","last_fullsized":"2024-04-26T07:57:38.045605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.045507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:26.957086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.526770+0000","last_change":"2024-04-26T07:54:25.027148+0000","last_active":"2024-04-26T07:57:24.526770+0000","last_peered":"2024-04-26T07:57:24.526770+0000","last_clean":"2024-04-26T07:57:24.526770+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:57:24.526770+0000","last_undegraded":"2024-04-26T07:57:24.526770+0000","last_fullsized":"2024-04-26T07:57:24.526770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.215729+0000","last_change":"2024-04-26T07:54:17.013632+0000","last_active":"2024-04-26T07:57:24.215729+0000","last_peered":"2024-04-26T07:57:24.215729+0000","last_clean":"2024-04-26T07:57:24.215729+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:57:24.215729+0000","last_undegraded":"2024-04-26T07:57:24.215729+0000","last_fullsized":"2024-04-26T07:57:24.215729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:09.888740+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:56:09.888740+0000","last_peered":"2024-04-26T07:56:09.888740+0000","last_clean":"2024-04-26T07:56:09.888740+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:56:09.888740+0000","last_undegraded":"2024-04-26T07:56:09.888740+0000","last_fullsized":"2024-04-26T07:56:09.888740+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.132634+0000","last_change":"2024-04-26T07:54:15.007057+0000","last_active":"2024-04-26T07:57:31.132634+0000","last_peered":"2024-04-26T07:57:31.132634+0000","last_clean":"2024-04-26T07:57:31.132634+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:57:31.132634+0000","last_undegraded":"2024-04-26T07:57:31.132634+0000","last_fullsized":"2024-04-26T07:57:31.132634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.922153+0000","last_change":"2024-04-26T07:57:37.922184+0000","last_active":"2024-04-26T07:57:37.922153+0000","last_peered":"2024-04-26T07:57:37.922153+0000","last_clean":"2024-04-26T07:57:37.922153+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:57:37.922153+0000","last_undegraded":"2024-04-26T07:57:37.922153+0000","last_fullsized":"2024-04-26T07:57:37.922153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.922054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:17.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.125119+0000","last_change":"2024-04-26T07:57:38.125161+0000","last_active":"2024-04-26T07:57:38.125119+0000","last_peered":"2024-04-26T07:57:38.125119+0000","last_clean":"2024-04-26T07:57:38.125119+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:38.125119+0000","last_undegraded":"2024-04-26T07:57:38.125119+0000","last_fullsized":"2024-04-26T07:57:38.125119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.125031+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:12.231248+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892221+0000","last_change":"2024-04-26T07:54:23.030052+0000","last_active":"2024-04-26T07:56:29.892221+0000","last_peered":"2024-04-26T07:56:29.892221+0000","last_clean":"2024-04-26T07:56:29.892221+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:56:29.892221+0000","last_undegraded":"2024-04-26T07:56:29.892221+0000","last_fullsized":"2024-04-26T07:56:29.892221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.515927+0000","last_change":"2024-04-26T07:54:25.030964+0000","last_active":"2024-04-26T07:57:24.515927+0000","last_peered":"2024-04-26T07:57:24.515927+0000","last_clean":"2024-04-26T07:57:24.515927+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:57:24.515927+0000","last_undegraded":"2024-04-26T07:57:24.515927+0000","last_fullsized":"2024-04-26T07:57:24.515927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.886015+0000","last_change":"2024-04-26T07:54:17.006840+0000","last_active":"2024-04-26T07:56:29.886015+0000","last_peered":"2024-04-26T07:56:29.886015+0000","last_clean":"2024-04-26T07:56:29.886015+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:56:29.886015+0000","last_undegraded":"2024-04-26T07:56:29.886015+0000","last_fullsized":"2024-04-26T07:56:29.886015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:09.888260+0000","last_change":"2024-04-26T07:54:06.674967+0000","last_active":"2024-04-26T07:56:09.888260+0000","last_peered":"2024-04-26T07:56:09.888260+0000","last_clean":"2024-04-26T07:56:09.888260+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:56:09.888260+0000","last_undegraded":"2024-04-26T07:56:09.888260+0000","last_fullsized":"2024-04-26T07:56:09.888260+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.132778+0000","last_change":"2024-04-26T07:54:15.008990+0000","last_active":"2024-04-26T07:57:31.132778+0000","last_peered":"2024-04-26T07:57:31.132778+0000","last_clean":"2024-04-26T07:57:31.132778+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:57:31.132778+0000","last_undegraded":"2024-04-26T07:57:31.132778+0000","last_fullsized":"2024-04-26T07:57:31.132778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891628+0000","last_change":"2024-04-26T07:54:19.010006+0000","last_active":"2024-04-26T07:56:29.891628+0000","last_peered":"2024-04-26T07:56:29.891628+0000","last_clean":"2024-04-26T07:56:29.891628+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:56:29.891628+0000","last_undegraded":"2024-04-26T07:56:29.891628+0000","last_fullsized":"2024-04-26T07:56:29.891628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.311964+0000","last_change":"2024-04-26T07:57:42.312009+0000","last_active":"2024-04-26T07:57:42.311964+0000","last_peered":"2024-04-26T07:57:42.311964+0000","last_clean":"2024-04-26T07:57:42.311964+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:42.311964+0000","last_undegraded":"2024-04-26T07:57:42.311964+0000","last_fullsized":"2024-04-26T07:57:42.311964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.311876+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:19:59.304320+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.073422+0000","last_change":"2024-04-26T07:57:37.073448+0000","last_active":"2024-04-26T07:57:37.073422+0000","last_peered":"2024-04-26T07:57:37.073422+0000","last_clean":"2024-04-26T07:57:37.073422+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:57:37.073422+0000","last_undegraded":"2024-04-26T07:57:37.073422+0000","last_fullsized":"2024-04-26T07:57:37.073422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.073329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:12.794354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893856+0000","last_change":"2024-04-26T07:54:25.038740+0000","last_active":"2024-04-26T07:56:39.893856+0000","last_peered":"2024-04-26T07:56:39.893856+0000","last_clean":"2024-04-26T07:56:39.893856+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:56:39.893856+0000","last_undegraded":"2024-04-26T07:56:39.893856+0000","last_fullsized":"2024-04-26T07:56:39.893856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885247+0000","last_change":"2024-04-26T07:54:17.009576+0000","last_active":"2024-04-26T07:56:24.885247+0000","last_peered":"2024-04-26T07:56:24.885247+0000","last_clean":"2024-04-26T07:56:24.885247+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:56:24.885247+0000","last_undegraded":"2024-04-26T07:56:24.885247+0000","last_fullsized":"2024-04-26T07:56:24.885247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:09.888823+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:56:09.888823+0000","last_peered":"2024-04-26T07:56:09.888823+0000","last_clean":"2024-04-26T07:56:09.888823+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:56:09.888823+0000","last_undegraded":"2024-04-26T07:56:09.888823+0000","last_fullsized":"2024-04-26T07:56:09.888823+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.889830+0000","last_change":"2024-04-26T07:54:15.006773+0000","last_active":"2024-04-26T07:56:19.889830+0000","last_peered":"2024-04-26T07:56:19.889830+0000","last_clean":"2024-04-26T07:56:19.889830+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:56:19.889830+0000","last_undegraded":"2024-04-26T07:56:19.889830+0000","last_fullsized":"2024-04-26T07:56:19.889830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885257+0000","last_change":"2024-04-26T07:54:19.014648+0000","last_active":"2024-04-26T07:56:24.885257+0000","last_peered":"2024-04-26T07:56:24.885257+0000","last_clean":"2024-04-26T07:56:24.885257+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:56:24.885257+0000","last_undegraded":"2024-04-26T07:56:24.885257+0000","last_fullsized":"2024-04-26T07:56:24.885257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:23.836673+0000","last_change":"2024-04-26T07:54:21.022796+0000","last_active":"2024-04-26T07:57:23.836673+0000","last_peered":"2024-04-26T07:57:23.836673+0000","last_clean":"2024-04-26T07:57:23.836673+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:57:23.836673+0000","last_undegraded":"2024-04-26T07:57:23.836673+0000","last_fullsized":"2024-04-26T07:57:23.836673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893123+0000","last_change":"2024-04-26T07:54:23.030753+0000","last_active":"2024-04-26T07:56:34.893123+0000","last_peered":"2024-04-26T07:56:34.893123+0000","last_clean":"2024-04-26T07:56:34.893123+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:56:34.893123+0000","last_undegraded":"2024-04-26T07:56:34.893123+0000","last_fullsized":"2024-04-26T07:56:34.893123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892402+0000","last_change":"2024-04-26T07:54:25.038410+0000","last_active":"2024-04-26T07:56:34.892402+0000","last_peered":"2024-04-26T07:56:34.892402+0000","last_clean":"2024-04-26T07:56:34.892402+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:56:34.892402+0000","last_undegraded":"2024-04-26T07:56:34.892402+0000","last_fullsized":"2024-04-26T07:56:34.892402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.890771+0000","last_change":"2024-04-26T07:54:17.011145+0000","last_active":"2024-04-26T07:56:24.890771+0000","last_peered":"2024-04-26T07:56:24.890771+0000","last_clean":"2024-04-26T07:56:24.890771+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:56:24.890771+0000","last_undegraded":"2024-04-26T07:56:24.890771+0000","last_fullsized":"2024-04-26T07:56:24.890771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.889873+0000","last_change":"2024-04-26T07:54:15.004789+0000","last_active":"2024-04-26T07:56:19.889873+0000","last_peered":"2024-04-26T07:56:19.889873+0000","last_clean":"2024-04-26T07:56:19.889873+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:56:19.889873+0000","last_undegraded":"2024-04-26T07:56:19.889873+0000","last_fullsized":"2024-04-26T07:56:19.889873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883598+0000","last_change":"2024-04-26T07:54:06.676454+0000","last_active":"2024-04-26T07:56:14.883598+0000","last_peered":"2024-04-26T07:56:14.883598+0000","last_clean":"2024-04-26T07:56:14.883598+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:56:14.883598+0000","last_undegraded":"2024-04-26T07:56:14.883598+0000","last_fullsized":"2024-04-26T07:56:14.883598+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.056509+0000","last_change":"2024-04-26T07:54:19.010150+0000","last_active":"2024-04-26T07:57:31.056509+0000","last_peered":"2024-04-26T07:57:31.056509+0000","last_clean":"2024-04-26T07:57:31.056509+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:57:31.056509+0000","last_undegraded":"2024-04-26T07:57:31.056509+0000","last_fullsized":"2024-04-26T07:57:31.056509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'76","reported_seq":152,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.090446+0000","last_change":"2024-04-26T07:57:45.090487+0000","last_active":"2024-04-26T07:57:45.090446+0000","last_peered":"2024-04-26T07:57:45.090446+0000","last_clean":"2024-04-26T07:57:45.090446+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:57:45.090446+0000","last_undegraded":"2024-04-26T07:57:45.090446+0000","last_fullsized":"2024-04-26T07:57:45.090446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'76","last_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_deep_scrub":"29'76","last_deep_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.090359+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:43.280370+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.248700+0000","last_change":"2024-04-26T07:57:37.248747+0000","last_active":"2024-04-26T07:57:37.248700+0000","last_peered":"2024-04-26T07:57:37.248700+0000","last_clean":"2024-04-26T07:57:37.248700+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:57:37.248700+0000","last_undegraded":"2024-04-26T07:57:37.248700+0000","last_fullsized":"2024-04-26T07:57:37.248700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.248591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:12.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.887646+0000","last_change":"2024-04-26T07:54:25.024577+0000","last_active":"2024-04-26T07:56:39.887646+0000","last_peered":"2024-04-26T07:56:39.887646+0000","last_clean":"2024-04-26T07:56:39.887646+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:56:39.887646+0000","last_undegraded":"2024-04-26T07:56:39.887646+0000","last_fullsized":"2024-04-26T07:56:39.887646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.301651+0000","last_change":"2024-04-26T07:55:02.058346+0000","last_active":"2024-04-26T07:57:24.301651+0000","last_peered":"2024-04-26T07:57:24.301651+0000","last_clean":"2024-04-26T07:57:24.301651+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:57:24.301651+0000","last_undegraded":"2024-04-26T07:57:24.301651+0000","last_fullsized":"2024-04-26T07:57:24.301651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884338+0000","last_change":"2024-04-26T07:54:15.005472+0000","last_active":"2024-04-26T07:56:19.884338+0000","last_peered":"2024-04-26T07:56:19.884338+0000","last_clean":"2024-04-26T07:56:19.884338+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:56:19.884338+0000","last_undegraded":"2024-04-26T07:56:19.884338+0000","last_fullsized":"2024-04-26T07:56:19.884338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.889652+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:56:14.889652+0000","last_peered":"2024-04-26T07:56:14.889652+0000","last_clean":"2024-04-26T07:56:14.889652+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:56:14.889652+0000","last_undegraded":"2024-04-26T07:56:14.889652+0000","last_fullsized":"2024-04-26T07:56:14.889652+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.944999+0000","last_change":"2024-04-26T07:57:44.945054+0000","last_active":"2024-04-26T07:57:44.944999+0000","last_peered":"2024-04-26T07:57:44.944999+0000","last_clean":"2024-04-26T07:57:44.944999+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:57:44.944999+0000","last_undegraded":"2024-04-26T07:57:44.944999+0000","last_fullsized":"2024-04-26T07:57:44.944999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.944890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:30.234498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.075298+0000","last_change":"2024-04-26T07:57:39.075367+0000","last_active":"2024-04-26T07:57:39.075298+0000","last_peered":"2024-04-26T07:57:39.075298+0000","last_clean":"2024-04-26T07:57:39.075298+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:57:39.075298+0000","last_undegraded":"2024-04-26T07:57:39.075298+0000","last_fullsized":"2024-04-26T07:57:39.075298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.075180+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:53.257286+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":367,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.140045+0000","last_change":"2024-04-26T07:57:35.140074+0000","last_active":"2024-04-26T07:57:35.140045+0000","last_peered":"2024-04-26T07:57:35.140045+0000","last_clean":"2024-04-26T07:57:35.140045+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:35.140045+0000","last_undegraded":"2024-04-26T07:57:35.140045+0000","last_fullsized":"2024-04-26T07:57:35.140045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.139950+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:52.425998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.442585+0000","last_change":"2024-04-26T07:54:25.036034+0000","last_active":"2024-04-26T07:57:24.442585+0000","last_peered":"2024-04-26T07:57:24.442585+0000","last_clean":"2024-04-26T07:57:24.442585+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:57:24.442585+0000","last_undegraded":"2024-04-26T07:57:24.442585+0000","last_fullsized":"2024-04-26T07:57:24.442585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.302506+0000","last_change":"2024-04-26T07:54:17.017609+0000","last_active":"2024-04-26T07:57:24.302506+0000","last_peered":"2024-04-26T07:57:24.302506+0000","last_clean":"2024-04-26T07:57:24.302506+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:57:24.302506+0000","last_undegraded":"2024-04-26T07:57:24.302506+0000","last_fullsized":"2024-04-26T07:57:24.302506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891478+0000","last_change":"2024-04-26T07:54:15.023916+0000","last_active":"2024-04-26T07:56:24.891478+0000","last_peered":"2024-04-26T07:56:24.891478+0000","last_clean":"2024-04-26T07:56:24.891478+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:56:24.891478+0000","last_undegraded":"2024-04-26T07:56:24.891478+0000","last_fullsized":"2024-04-26T07:56:24.891478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883641+0000","last_change":"2024-04-26T07:54:06.676954+0000","last_active":"2024-04-26T07:56:14.883641+0000","last_peered":"2024-04-26T07:56:14.883641+0000","last_clean":"2024-04-26T07:56:14.883641+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:56:14.883641+0000","last_undegraded":"2024-04-26T07:56:14.883641+0000","last_fullsized":"2024-04-26T07:56:14.883641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.927252+0000","last_change":"2024-04-26T07:57:35.927279+0000","last_active":"2024-04-26T07:57:35.927252+0000","last_peered":"2024-04-26T07:57:35.927252+0000","last_clean":"2024-04-26T07:57:35.927252+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:57:35.927252+0000","last_undegraded":"2024-04-26T07:57:35.927252+0000","last_fullsized":"2024-04-26T07:57:35.927252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.927147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:35.660610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892154+0000","last_change":"2024-04-26T07:54:21.023142+0000","last_active":"2024-04-26T07:56:29.892154+0000","last_peered":"2024-04-26T07:56:29.892154+0000","last_clean":"2024-04-26T07:56:29.892154+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:56:29.892154+0000","last_undegraded":"2024-04-26T07:56:29.892154+0000","last_fullsized":"2024-04-26T07:56:29.892154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":441,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.023094+0000","last_change":"2024-04-26T07:57:39.023125+0000","last_active":"2024-04-26T07:57:39.023094+0000","last_peered":"2024-04-26T07:57:39.023094+0000","last_clean":"2024-04-26T07:57:39.023094+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:39.023094+0000","last_undegraded":"2024-04-26T07:57:39.023094+0000","last_fullsized":"2024-04-26T07:57:39.023094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.023000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:21.471539+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893434+0000","last_change":"2024-04-26T07:54:25.036997+0000","last_active":"2024-04-26T07:56:39.893434+0000","last_peered":"2024-04-26T07:56:39.893434+0000","last_clean":"2024-04-26T07:56:39.893434+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:56:39.893434+0000","last_undegraded":"2024-04-26T07:56:39.893434+0000","last_fullsized":"2024-04-26T07:56:39.893434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489822+0000","last_change":"2024-04-26T07:54:17.009702+0000","last_active":"2024-04-26T07:57:24.489822+0000","last_peered":"2024-04-26T07:57:24.489822+0000","last_clean":"2024-04-26T07:57:24.489822+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:57:24.489822+0000","last_undegraded":"2024-04-26T07:57:24.489822+0000","last_fullsized":"2024-04-26T07:57:24.489822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.191638+0000","last_change":"2024-04-26T07:54:15.009811+0000","last_active":"2024-04-26T07:57:24.191638+0000","last_peered":"2024-04-26T07:57:24.191638+0000","last_clean":"2024-04-26T07:57:24.191638+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:57:24.191638+0000","last_undegraded":"2024-04-26T07:57:24.191638+0000","last_fullsized":"2024-04-26T07:57:24.191638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.889695+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:56:14.889695+0000","last_peered":"2024-04-26T07:56:14.889695+0000","last_clean":"2024-04-26T07:56:14.889695+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:56:14.889695+0000","last_undegraded":"2024-04-26T07:56:14.889695+0000","last_fullsized":"2024-04-26T07:56:14.889695+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.983896+0000","last_change":"2024-04-26T07:57:43.983919+0000","last_active":"2024-04-26T07:57:43.983896+0000","last_peered":"2024-04-26T07:57:43.983896+0000","last_clean":"2024-04-26T07:57:43.983896+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:57:43.983896+0000","last_undegraded":"2024-04-26T07:57:43.983896+0000","last_fullsized":"2024-04-26T07:57:43.983896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.983811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:02.584658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.313344+0000","last_change":"2024-04-26T07:57:40.313398+0000","last_active":"2024-04-26T07:57:40.313344+0000","last_peered":"2024-04-26T07:57:40.313344+0000","last_clean":"2024-04-26T07:57:40.313344+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:57:40.313344+0000","last_undegraded":"2024-04-26T07:57:40.313344+0000","last_fullsized":"2024-04-26T07:57:40.313344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.313247+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:44.555766+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.130585+0000","last_change":"2024-04-26T07:57:34.130608+0000","last_active":"2024-04-26T07:57:34.130585+0000","last_peered":"2024-04-26T07:57:34.130585+0000","last_clean":"2024-04-26T07:57:34.130585+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:57:34.130585+0000","last_undegraded":"2024-04-26T07:57:34.130585+0000","last_fullsized":"2024-04-26T07:57:34.130585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_clean_scrub_stamp":"2024-04-26T07:57:34.130497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:01.130219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893453+0000","last_change":"2024-04-26T07:54:25.027810+0000","last_active":"2024-04-26T07:56:39.893453+0000","last_peered":"2024-04-26T07:56:39.893453+0000","last_clean":"2024-04-26T07:56:39.893453+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:56:39.893453+0000","last_undegraded":"2024-04-26T07:56:39.893453+0000","last_fullsized":"2024-04-26T07:56:39.893453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891676+0000","last_change":"2024-04-26T07:54:25.026977+0000","last_active":"2024-04-26T07:56:29.891676+0000","last_peered":"2024-04-26T07:56:29.891676+0000","last_clean":"2024-04-26T07:56:29.891676+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:56:29.891676+0000","last_undegraded":"2024-04-26T07:56:29.891676+0000","last_fullsized":"2024-04-26T07:56:29.891676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489621+0000","last_change":"2024-04-26T07:54:17.012273+0000","last_active":"2024-04-26T07:57:24.489621+0000","last_peered":"2024-04-26T07:57:24.489621+0000","last_clean":"2024-04-26T07:57:24.489621+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:57:24.489621+0000","last_undegraded":"2024-04-26T07:57:24.489621+0000","last_fullsized":"2024-04-26T07:57:24.489621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893033+0000","last_change":"2024-04-26T07:54:15.030451+0000","last_active":"2024-04-26T07:56:34.893033+0000","last_peered":"2024-04-26T07:56:34.893033+0000","last_clean":"2024-04-26T07:56:34.893033+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:56:34.893033+0000","last_undegraded":"2024-04-26T07:56:34.893033+0000","last_fullsized":"2024-04-26T07:56:34.893033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893403+0000","last_change":"2024-04-26T07:54:19.011757+0000","last_active":"2024-04-26T07:56:39.893403+0000","last_peered":"2024-04-26T07:56:39.893403+0000","last_clean":"2024-04-26T07:56:39.893403+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:56:39.893403+0000","last_undegraded":"2024-04-26T07:56:39.893403+0000","last_fullsized":"2024-04-26T07:56:39.893403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.959591+0000","last_change":"2024-04-26T07:57:38.959627+0000","last_active":"2024-04-26T07:57:38.959591+0000","last_peered":"2024-04-26T07:57:38.959591+0000","last_clean":"2024-04-26T07:57:38.959591+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:57:38.959591+0000","last_undegraded":"2024-04-26T07:57:38.959591+0000","last_fullsized":"2024-04-26T07:57:38.959591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.959495+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:02.058520+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894588+0000","last_change":"2024-04-26T07:54:23.032745+0000","last_active":"2024-04-26T07:56:44.894588+0000","last_peered":"2024-04-26T07:56:44.894588+0000","last_clean":"2024-04-26T07:56:44.894588+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:56:44.894588+0000","last_undegraded":"2024-04-26T07:56:44.894588+0000","last_fullsized":"2024-04-26T07:56:44.894588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885268+0000","last_change":"2024-04-26T07:54:25.036781+0000","last_active":"2024-04-26T07:56:24.885268+0000","last_peered":"2024-04-26T07:56:24.885268+0000","last_clean":"2024-04-26T07:56:24.885268+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:56:24.885268+0000","last_undegraded":"2024-04-26T07:56:24.885268+0000","last_fullsized":"2024-04-26T07:56:24.885268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.519719+0000","last_change":"2024-04-26T07:54:17.011329+0000","last_active":"2024-04-26T07:57:24.519719+0000","last_peered":"2024-04-26T07:57:24.519719+0000","last_clean":"2024-04-26T07:57:24.519719+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:24.519719+0000","last_undegraded":"2024-04-26T07:57:24.519719+0000","last_fullsized":"2024-04-26T07:57:24.519719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893427+0000","last_change":"2024-04-26T07:54:15.016903+0000","last_active":"2024-04-26T07:56:39.893427+0000","last_peered":"2024-04-26T07:56:39.893427+0000","last_clean":"2024-04-26T07:56:39.893427+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:56:39.893427+0000","last_undegraded":"2024-04-26T07:56:39.893427+0000","last_fullsized":"2024-04-26T07:56:39.893427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.982361+0000","last_change":"2024-04-26T07:57:45.982384+0000","last_active":"2024-04-26T07:57:45.982361+0000","last_peered":"2024-04-26T07:57:45.982361+0000","last_clean":"2024-04-26T07:57:45.982361+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:57:45.982361+0000","last_undegraded":"2024-04-26T07:57:45.982361+0000","last_fullsized":"2024-04-26T07:57:45.982361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.982268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:08.199956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.056129+0000","last_change":"2024-04-26T07:57:49.056205+0000","last_active":"2024-04-26T07:57:49.056129+0000","last_peered":"2024-04-26T07:57:49.056129+0000","last_clean":"2024-04-26T07:57:49.056129+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:49.056129+0000","last_undegraded":"2024-04-26T07:57:49.056129+0000","last_fullsized":"2024-04-26T07:57:49.056129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.056026+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:29.927433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.282662+0000","last_change":"2024-04-26T07:57:47.282688+0000","last_active":"2024-04-26T07:57:47.282662+0000","last_peered":"2024-04-26T07:57:47.282662+0000","last_clean":"2024-04-26T07:57:47.282662+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:57:47.282662+0000","last_undegraded":"2024-04-26T07:57:47.282662+0000","last_fullsized":"2024-04-26T07:57:47.282662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.282574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.890046+0000","last_change":"2024-04-26T07:54:25.029345+0000","last_active":"2024-04-26T07:56:54.890046+0000","last_peered":"2024-04-26T07:56:54.890046+0000","last_clean":"2024-04-26T07:56:54.890046+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:56:54.890046+0000","last_undegraded":"2024-04-26T07:56:54.890046+0000","last_fullsized":"2024-04-26T07:56:54.890046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'5","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567388+0000","last_change":"2024-04-26T07:55:02.054995+0000","last_active":"2024-04-26T07:57:24.567388+0000","last_peered":"2024-04-26T07:57:24.567388+0000","last_clean":"2024-04-26T07:57:24.567388+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:57:24.567388+0000","last_undegraded":"2024-04-26T07:57:24.567388+0000","last_fullsized":"2024-04-26T07:57:24.567388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893493+0000","last_change":"2024-04-26T07:54:15.021860+0000","last_active":"2024-04-26T07:56:39.893493+0000","last_peered":"2024-04-26T07:56:39.893493+0000","last_clean":"2024-04-26T07:56:39.893493+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:56:39.893493+0000","last_undegraded":"2024-04-26T07:56:39.893493+0000","last_fullsized":"2024-04-26T07:56:39.893493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893285+0000","last_change":"2024-04-26T07:54:19.014096+0000","last_active":"2024-04-26T07:56:39.893285+0000","last_peered":"2024-04-26T07:56:39.893285+0000","last_clean":"2024-04-26T07:56:39.893285+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:56:39.893285+0000","last_undegraded":"2024-04-26T07:56:39.893285+0000","last_fullsized":"2024-04-26T07:56:39.893285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.027530+0000","last_change":"2024-04-26T07:57:48.027568+0000","last_active":"2024-04-26T07:57:48.027530+0000","last_peered":"2024-04-26T07:57:48.027530+0000","last_clean":"2024-04-26T07:57:48.027530+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:48.027530+0000","last_undegraded":"2024-04-26T07:57:48.027530+0000","last_fullsized":"2024-04-26T07:57:48.027530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.027433+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:59.750634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.116012+0000","last_change":"2024-04-26T07:57:37.116071+0000","last_active":"2024-04-26T07:57:37.116012+0000","last_peered":"2024-04-26T07:57:37.116012+0000","last_clean":"2024-04-26T07:57:37.116012+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:57:37.116012+0000","last_undegraded":"2024-04-26T07:57:37.116012+0000","last_fullsized":"2024-04-26T07:57:37.116012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.115909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:16.358436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.896475+0000","last_change":"2024-04-26T07:54:25.040358+0000","last_active":"2024-04-26T07:56:54.896475+0000","last_peered":"2024-04-26T07:56:54.896475+0000","last_clean":"2024-04-26T07:56:54.896475+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:56:54.896475+0000","last_undegraded":"2024-04-26T07:56:54.896475+0000","last_fullsized":"2024-04-26T07:56:54.896475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'7","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567771+0000","last_change":"2024-04-26T07:54:17.017717+0000","last_active":"2024-04-26T07:57:24.567771+0000","last_peered":"2024-04-26T07:57:24.567771+0000","last_clean":"2024-04-26T07:57:24.567771+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:57:24.567771+0000","last_undegraded":"2024-04-26T07:57:24.567771+0000","last_fullsized":"2024-04-26T07:57:24.567771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893576+0000","last_change":"2024-04-26T07:54:15.016622+0000","last_active":"2024-04-26T07:56:39.893576+0000","last_peered":"2024-04-26T07:56:39.893576+0000","last_clean":"2024-04-26T07:56:39.893576+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:56:39.893576+0000","last_undegraded":"2024-04-26T07:56:39.893576+0000","last_fullsized":"2024-04-26T07:56:39.893576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.947053+0000","last_change":"2024-04-26T07:57:36.947105+0000","last_active":"2024-04-26T07:57:36.947053+0000","last_peered":"2024-04-26T07:57:36.947053+0000","last_clean":"2024-04-26T07:57:36.947053+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:57:36.947053+0000","last_undegraded":"2024-04-26T07:57:36.947053+0000","last_fullsized":"2024-04-26T07:57:36.947053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.946930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.547838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.306049+0000","last_change":"2024-04-26T07:57:44.306091+0000","last_active":"2024-04-26T07:57:44.306049+0000","last_peered":"2024-04-26T07:57:44.306049+0000","last_clean":"2024-04-26T07:57:44.306049+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:57:44.306049+0000","last_undegraded":"2024-04-26T07:57:44.306049+0000","last_fullsized":"2024-04-26T07:57:44.306049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.305938+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:46.421838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.210692+0000","last_change":"2024-04-26T07:57:36.210716+0000","last_active":"2024-04-26T07:57:36.210692+0000","last_peered":"2024-04-26T07:57:36.210692+0000","last_clean":"2024-04-26T07:57:36.210692+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:57:36.210692+0000","last_undegraded":"2024-04-26T07:57:36.210692+0000","last_fullsized":"2024-04-26T07:57:36.210692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.210600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:49.401154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.215684+0000","last_change":"2024-04-26T07:54:17.009497+0000","last_active":"2024-04-26T07:57:24.215684+0000","last_peered":"2024-04-26T07:57:24.215684+0000","last_clean":"2024-04-26T07:57:24.215684+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:57:24.215684+0000","last_undegraded":"2024-04-26T07:57:24.215684+0000","last_fullsized":"2024-04-26T07:57:24.215684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893750+0000","last_change":"2024-04-26T07:54:15.030594+0000","last_active":"2024-04-26T07:56:39.893750+0000","last_peered":"2024-04-26T07:56:39.893750+0000","last_clean":"2024-04-26T07:56:39.893750+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:56:39.893750+0000","last_undegraded":"2024-04-26T07:56:39.893750+0000","last_fullsized":"2024-04-26T07:56:39.893750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884386+0000","last_change":"2024-04-26T07:54:19.014571+0000","last_active":"2024-04-26T07:56:19.884386+0000","last_peered":"2024-04-26T07:56:19.884386+0000","last_clean":"2024-04-26T07:56:19.884386+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:56:19.884386+0000","last_undegraded":"2024-04-26T07:56:19.884386+0000","last_fullsized":"2024-04-26T07:56:19.884386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.077254+0000","last_change":"2024-04-26T07:57:46.077293+0000","last_active":"2024-04-26T07:57:46.077254+0000","last_peered":"2024-04-26T07:57:46.077254+0000","last_clean":"2024-04-26T07:57:46.077254+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:57:46.077254+0000","last_undegraded":"2024-04-26T07:57:46.077254+0000","last_fullsized":"2024-04-26T07:57:46.077254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.077156+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:26.087961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.249784+0000","last_change":"2024-04-26T07:57:35.249823+0000","last_active":"2024-04-26T07:57:35.249784+0000","last_peered":"2024-04-26T07:57:35.249784+0000","last_clean":"2024-04-26T07:57:35.249784+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:57:35.249784+0000","last_undegraded":"2024-04-26T07:57:35.249784+0000","last_fullsized":"2024-04-26T07:57:35.249784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.249689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:56.788608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.888285+0000","last_change":"2024-04-26T07:54:25.029358+0000","last_active":"2024-04-26T07:56:44.888285+0000","last_peered":"2024-04-26T07:56:44.888285+0000","last_clean":"2024-04-26T07:56:44.888285+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:56:44.888285+0000","last_undegraded":"2024-04-26T07:56:44.888285+0000","last_fullsized":"2024-04-26T07:56:44.888285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884379+0000","last_change":"2024-04-26T07:54:17.006732+0000","last_active":"2024-04-26T07:56:19.884379+0000","last_peered":"2024-04-26T07:56:19.884379+0000","last_clean":"2024-04-26T07:56:19.884379+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:56:19.884379+0000","last_undegraded":"2024-04-26T07:56:19.884379+0000","last_fullsized":"2024-04-26T07:56:19.884379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893300+0000","last_change":"2024-04-26T07:54:15.016457+0000","last_active":"2024-04-26T07:56:39.893300+0000","last_peered":"2024-04-26T07:56:39.893300+0000","last_clean":"2024-04-26T07:56:39.893300+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:56:39.893300+0000","last_undegraded":"2024-04-26T07:56:39.893300+0000","last_fullsized":"2024-04-26T07:56:39.893300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.890912+0000","last_change":"2024-04-26T07:54:19.010468+0000","last_active":"2024-04-26T07:56:24.890912+0000","last_peered":"2024-04-26T07:56:24.890912+0000","last_clean":"2024-04-26T07:56:24.890912+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:56:24.890912+0000","last_undegraded":"2024-04-26T07:56:24.890912+0000","last_fullsized":"2024-04-26T07:56:24.890912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.958887+0000","last_change":"2024-04-26T07:57:48.958926+0000","last_active":"2024-04-26T07:57:48.958887+0000","last_peered":"2024-04-26T07:57:48.958887+0000","last_clean":"2024-04-26T07:57:48.958887+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:57:48.958887+0000","last_undegraded":"2024-04-26T07:57:48.958887+0000","last_fullsized":"2024-04-26T07:57:48.958887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.958790+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:19.997051+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.961696+0000","last_change":"2024-04-26T07:57:43.961722+0000","last_active":"2024-04-26T07:57:43.961696+0000","last_peered":"2024-04-26T07:57:43.961696+0000","last_clean":"2024-04-26T07:57:43.961696+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:57:43.961696+0000","last_undegraded":"2024-04-26T07:57:43.961696+0000","last_fullsized":"2024-04-26T07:57:43.961696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.961597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:55.126179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894677+0000","last_change":"2024-04-26T07:54:25.040148+0000","last_active":"2024-04-26T07:56:44.894677+0000","last_peered":"2024-04-26T07:56:44.894677+0000","last_clean":"2024-04-26T07:56:44.894677+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:56:44.894677+0000","last_undegraded":"2024-04-26T07:56:44.894677+0000","last_fullsized":"2024-04-26T07:56:44.894677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.901326+0000","last_change":"2024-04-26T07:55:02.061611+0000","last_active":"2024-04-26T07:57:34.901326+0000","last_peered":"2024-04-26T07:57:34.901326+0000","last_clean":"2024-04-26T07:57:34.901326+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:57:34.901326+0000","last_undegraded":"2024-04-26T07:57:34.901326+0000","last_fullsized":"2024-04-26T07:57:34.901326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894233+0000","last_change":"2024-04-26T07:54:15.009041+0000","last_active":"2024-04-26T07:56:44.894233+0000","last_peered":"2024-04-26T07:56:44.894233+0000","last_clean":"2024-04-26T07:56:44.894233+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:56:44.894233+0000","last_undegraded":"2024-04-26T07:56:44.894233+0000","last_fullsized":"2024-04-26T07:56:44.894233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895075+0000","last_change":"2024-04-26T07:54:19.006121+0000","last_active":"2024-04-26T07:56:49.895075+0000","last_peered":"2024-04-26T07:56:49.895075+0000","last_clean":"2024-04-26T07:56:49.895075+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:56:49.895075+0000","last_undegraded":"2024-04-26T07:56:49.895075+0000","last_fullsized":"2024-04-26T07:56:49.895075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.036494+0000","last_change":"2024-04-26T07:57:42.036534+0000","last_active":"2024-04-26T07:57:42.036494+0000","last_peered":"2024-04-26T07:57:42.036494+0000","last_clean":"2024-04-26T07:57:42.036494+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:57:42.036494+0000","last_undegraded":"2024-04-26T07:57:42.036494+0000","last_fullsized":"2024-04-26T07:57:42.036494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.036391+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:51.097848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885279+0000","last_change":"2024-04-26T07:54:23.035770+0000","last_active":"2024-04-26T07:56:24.885279+0000","last_peered":"2024-04-26T07:56:24.885279+0000","last_clean":"2024-04-26T07:56:24.885279+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:56:24.885279+0000","last_undegraded":"2024-04-26T07:56:24.885279+0000","last_fullsized":"2024-04-26T07:56:24.885279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894650+0000","last_change":"2024-04-26T07:54:25.039740+0000","last_active":"2024-04-26T07:56:44.894650+0000","last_peered":"2024-04-26T07:56:44.894650+0000","last_clean":"2024-04-26T07:56:44.894650+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:56:44.894650+0000","last_undegraded":"2024-04-26T07:56:44.894650+0000","last_fullsized":"2024-04-26T07:56:44.894650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.301782+0000","last_change":"2024-04-26T07:54:17.009954+0000","last_active":"2024-04-26T07:57:24.301782+0000","last_peered":"2024-04-26T07:57:24.301782+0000","last_clean":"2024-04-26T07:57:24.301782+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:57:24.301782+0000","last_undegraded":"2024-04-26T07:57:24.301782+0000","last_fullsized":"2024-04-26T07:57:24.301782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.423569+0000","last_change":"2024-04-26T07:54:15.028318+0000","last_active":"2024-04-26T07:57:24.423569+0000","last_peered":"2024-04-26T07:57:24.423569+0000","last_clean":"2024-04-26T07:57:24.423569+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:57:24.423569+0000","last_undegraded":"2024-04-26T07:57:24.423569+0000","last_fullsized":"2024-04-26T07:57:24.423569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895190+0000","last_change":"2024-04-26T07:54:19.011607+0000","last_active":"2024-04-26T07:56:49.895190+0000","last_peered":"2024-04-26T07:56:49.895190+0000","last_clean":"2024-04-26T07:56:49.895190+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:56:49.895190+0000","last_undegraded":"2024-04-26T07:56:49.895190+0000","last_fullsized":"2024-04-26T07:56:49.895190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891439+0000","last_change":"2024-04-26T07:54:21.024776+0000","last_active":"2024-04-26T07:56:24.891439+0000","last_peered":"2024-04-26T07:56:24.891439+0000","last_clean":"2024-04-26T07:56:24.891439+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:56:24.891439+0000","last_undegraded":"2024-04-26T07:56:24.891439+0000","last_fullsized":"2024-04-26T07:56:24.891439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.315346+0000","last_change":"2024-04-26T07:57:43.315390+0000","last_active":"2024-04-26T07:57:43.315346+0000","last_peered":"2024-04-26T07:57:43.315346+0000","last_clean":"2024-04-26T07:57:43.315346+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:43.315346+0000","last_undegraded":"2024-04-26T07:57:43.315346+0000","last_fullsized":"2024-04-26T07:57:43.315346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.315236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:00.601284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894547+0000","last_change":"2024-04-26T07:54:25.037610+0000","last_active":"2024-04-26T07:56:44.894547+0000","last_peered":"2024-04-26T07:56:44.894547+0000","last_clean":"2024-04-26T07:56:44.894547+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:56:44.894547+0000","last_undegraded":"2024-04-26T07:56:44.894547+0000","last_fullsized":"2024-04-26T07:56:44.894547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895014+0000","last_change":"2024-04-26T07:54:17.009270+0000","last_active":"2024-04-26T07:56:49.895014+0000","last_peered":"2024-04-26T07:56:49.895014+0000","last_clean":"2024-04-26T07:56:49.895014+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:56:49.895014+0000","last_undegraded":"2024-04-26T07:56:49.895014+0000","last_fullsized":"2024-04-26T07:56:49.895014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894282+0000","last_change":"2024-04-26T07:54:15.017919+0000","last_active":"2024-04-26T07:56:44.894282+0000","last_peered":"2024-04-26T07:56:44.894282+0000","last_clean":"2024-04-26T07:56:44.894282+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:56:44.894282+0000","last_undegraded":"2024-04-26T07:56:44.894282+0000","last_fullsized":"2024-04-26T07:56:44.894282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.947474+0000","last_change":"2024-04-26T07:57:48.947503+0000","last_active":"2024-04-26T07:57:48.947474+0000","last_peered":"2024-04-26T07:57:48.947474+0000","last_clean":"2024-04-26T07:57:48.947474+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:57:48.947474+0000","last_undegraded":"2024-04-26T07:57:48.947474+0000","last_fullsized":"2024-04-26T07:57:48.947474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.947377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:11.025758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.943225+0000","last_change":"2024-04-26T07:57:41.943262+0000","last_active":"2024-04-26T07:57:41.943225+0000","last_peered":"2024-04-26T07:57:41.943225+0000","last_clean":"2024-04-26T07:57:41.943225+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:57:41.943225+0000","last_undegraded":"2024-04-26T07:57:41.943225+0000","last_fullsized":"2024-04-26T07:57:41.943225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.943141+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:28.179647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.021097+0000","last_change":"2024-04-26T07:57:41.021136+0000","last_active":"2024-04-26T07:57:41.021097+0000","last_peered":"2024-04-26T07:57:41.021097+0000","last_clean":"2024-04-26T07:57:41.021097+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:57:41.021097+0000","last_undegraded":"2024-04-26T07:57:41.021097+0000","last_fullsized":"2024-04-26T07:57:41.021097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.021008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895250+0000","last_change":"2024-04-26T07:54:25.030663+0000","last_active":"2024-04-26T07:56:49.895250+0000","last_peered":"2024-04-26T07:56:49.895250+0000","last_clean":"2024-04-26T07:56:49.895250+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:56:49.895250+0000","last_undegraded":"2024-04-26T07:56:49.895250+0000","last_fullsized":"2024-04-26T07:56:49.895250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'18","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.569783+0000","last_change":"2024-04-26T07:54:17.006502+0000","last_active":"2024-04-26T07:57:24.569783+0000","last_peered":"2024-04-26T07:57:24.569783+0000","last_clean":"2024-04-26T07:57:24.569783+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:24.569783+0000","last_undegraded":"2024-04-26T07:57:24.569783+0000","last_fullsized":"2024-04-26T07:57:24.569783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894840+0000","last_change":"2024-04-26T07:54:15.028304+0000","last_active":"2024-04-26T07:56:44.894840+0000","last_peered":"2024-04-26T07:56:44.894840+0000","last_clean":"2024-04-26T07:56:44.894840+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:56:44.894840+0000","last_undegraded":"2024-04-26T07:56:44.894840+0000","last_fullsized":"2024-04-26T07:56:44.894840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.256297+0000","last_change":"2024-04-26T07:57:49.256322+0000","last_active":"2024-04-26T07:57:49.256297+0000","last_peered":"2024-04-26T07:57:49.256297+0000","last_clean":"2024-04-26T07:57:49.256297+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:57:49.256297+0000","last_undegraded":"2024-04-26T07:57:49.256297+0000","last_fullsized":"2024-04-26T07:57:49.256297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.256204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:45.178627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.053585+0000","last_change":"2024-04-26T07:57:44.053621+0000","last_active":"2024-04-26T07:57:44.053585+0000","last_peered":"2024-04-26T07:57:44.053585+0000","last_clean":"2024-04-26T07:57:44.053585+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:57:44.053585+0000","last_undegraded":"2024-04-26T07:57:44.053585+0000","last_fullsized":"2024-04-26T07:57:44.053585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.053488+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:48.845821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895533+0000","last_change":"2024-04-26T07:54:23.035765+0000","last_active":"2024-04-26T07:56:49.895533+0000","last_peered":"2024-04-26T07:56:49.895533+0000","last_clean":"2024-04-26T07:56:49.895533+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:56:49.895533+0000","last_undegraded":"2024-04-26T07:56:49.895533+0000","last_fullsized":"2024-04-26T07:56:49.895533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.491013+0000","last_change":"2024-04-26T07:54:25.035955+0000","last_active":"2024-04-26T07:57:24.491013+0000","last_peered":"2024-04-26T07:57:24.491013+0000","last_clean":"2024-04-26T07:57:24.491013+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:57:24.491013+0000","last_undegraded":"2024-04-26T07:57:24.491013+0000","last_fullsized":"2024-04-26T07:57:24.491013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489775+0000","last_change":"2024-04-26T07:54:17.010362+0000","last_active":"2024-04-26T07:57:24.489775+0000","last_peered":"2024-04-26T07:57:24.489775+0000","last_clean":"2024-04-26T07:57:24.489775+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:57:24.489775+0000","last_undegraded":"2024-04-26T07:57:24.489775+0000","last_fullsized":"2024-04-26T07:57:24.489775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883651+0000","last_change":"2024-04-26T07:54:15.009093+0000","last_active":"2024-04-26T07:56:14.883651+0000","last_peered":"2024-04-26T07:56:14.883651+0000","last_clean":"2024-04-26T07:56:14.883651+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:56:14.883651+0000","last_undegraded":"2024-04-26T07:56:14.883651+0000","last_fullsized":"2024-04-26T07:56:14.883651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894164+0000","last_change":"2024-04-26T07:54:19.010756+0000","last_active":"2024-04-26T07:56:44.894164+0000","last_peered":"2024-04-26T07:56:44.894164+0000","last_clean":"2024-04-26T07:56:44.894164+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:56:44.894164+0000","last_undegraded":"2024-04-26T07:56:44.894164+0000","last_fullsized":"2024-04-26T07:56:44.894164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.976695+0000","last_change":"2024-04-26T07:57:40.976750+0000","last_active":"2024-04-26T07:57:40.976695+0000","last_peered":"2024-04-26T07:57:40.976695+0000","last_clean":"2024-04-26T07:57:40.976695+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:57:40.976695+0000","last_undegraded":"2024-04-26T07:57:40.976695+0000","last_fullsized":"2024-04-26T07:57:40.976695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.976569+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:47.248039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.896364+0000","last_change":"2024-04-26T07:54:23.036351+0000","last_active":"2024-04-26T07:56:54.896364+0000","last_peered":"2024-04-26T07:56:54.896364+0000","last_clean":"2024-04-26T07:56:54.896364+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:56:54.896364+0000","last_undegraded":"2024-04-26T07:56:54.896364+0000","last_fullsized":"2024-04-26T07:56:54.896364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.213315+0000","last_change":"2024-04-26T07:54:25.039985+0000","last_active":"2024-04-26T07:57:24.213315+0000","last_peered":"2024-04-26T07:57:24.213315+0000","last_clean":"2024-04-26T07:57:24.213315+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:57:24.213315+0000","last_undegraded":"2024-04-26T07:57:24.213315+0000","last_fullsized":"2024-04-26T07:57:24.213315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894055+0000","last_change":"2024-04-26T07:54:17.003817+0000","last_active":"2024-04-26T07:56:44.894055+0000","last_peered":"2024-04-26T07:56:44.894055+0000","last_clean":"2024-04-26T07:56:44.894055+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:56:44.894055+0000","last_undegraded":"2024-04-26T07:56:44.894055+0000","last_fullsized":"2024-04-26T07:56:44.894055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.889985+0000","last_change":"2024-04-26T07:54:15.019611+0000","last_active":"2024-04-26T07:56:19.889985+0000","last_peered":"2024-04-26T07:56:19.889985+0000","last_clean":"2024-04-26T07:56:19.889985+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:56:19.889985+0000","last_undegraded":"2024-04-26T07:56:19.889985+0000","last_fullsized":"2024-04-26T07:56:19.889985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.971170+0000","last_change":"2024-04-26T07:57:45.971199+0000","last_active":"2024-04-26T07:57:45.971170+0000","last_peered":"2024-04-26T07:57:45.971170+0000","last_clean":"2024-04-26T07:57:45.971170+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:57:45.971170+0000","last_undegraded":"2024-04-26T07:57:45.971170+0000","last_fullsized":"2024-04-26T07:57:45.971170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.971081+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.019853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'37","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.140673+0000","last_change":"2024-04-26T07:54:21.021890+0000","last_active":"2024-04-26T07:57:31.140673+0000","last_peered":"2024-04-26T07:57:31.140673+0000","last_clean":"2024-04-26T07:57:31.140673+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:57:31.140673+0000","last_undegraded":"2024-04-26T07:57:31.140673+0000","last_fullsized":"2024-04-26T07:57:31.140673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:19.996749+0000","last_clean_scrub_stamp":"2024-04-26T07:54:19.996749+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.018075+0000","last_change":"2024-04-26T07:57:40.018100+0000","last_active":"2024-04-26T07:57:40.018075+0000","last_peered":"2024-04-26T07:57:40.018075+0000","last_clean":"2024-04-26T07:57:40.018075+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:57:40.018075+0000","last_undegraded":"2024-04-26T07:57:40.018075+0000","last_fullsized":"2024-04-26T07:57:40.018075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.017985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:33.200374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894775+0000","last_change":"2024-04-26T07:54:25.040953+0000","last_active":"2024-04-26T07:56:44.894775+0000","last_peered":"2024-04-26T07:56:44.894775+0000","last_clean":"2024-04-26T07:56:44.894775+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:56:44.894775+0000","last_undegraded":"2024-04-26T07:56:44.894775+0000","last_fullsized":"2024-04-26T07:56:44.894775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891633+0000","last_change":"2024-04-26T07:54:17.004457+0000","last_active":"2024-04-26T07:56:29.891633+0000","last_peered":"2024-04-26T07:56:29.891633+0000","last_clean":"2024-04-26T07:56:29.891633+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:56:29.891633+0000","last_undegraded":"2024-04-26T07:56:29.891633+0000","last_fullsized":"2024-04-26T07:56:29.891633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.889763+0000","last_change":"2024-04-26T07:54:15.022353+0000","last_active":"2024-04-26T07:56:19.889763+0000","last_peered":"2024-04-26T07:56:19.889763+0000","last_clean":"2024-04-26T07:56:19.889763+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:56:19.889763+0000","last_undegraded":"2024-04-26T07:56:19.889763+0000","last_fullsized":"2024-04-26T07:56:19.889763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885993+0000","last_change":"2024-04-26T07:54:17.015322+0000","last_active":"2024-04-26T07:56:29.885993+0000","last_peered":"2024-04-26T07:56:29.885993+0000","last_clean":"2024-04-26T07:56:29.885993+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:56:29.885993+0000","last_undegraded":"2024-04-26T07:56:29.885993+0000","last_fullsized":"2024-04-26T07:56:29.885993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.427600+0000","last_change":"2024-04-26T07:54:15.001522+0000","last_active":"2024-04-26T07:57:24.427600+0000","last_peered":"2024-04-26T07:57:24.427600+0000","last_clean":"2024-04-26T07:57:24.427600+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:57:24.427600+0000","last_undegraded":"2024-04-26T07:57:24.427600+0000","last_fullsized":"2024-04-26T07:57:24.427600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892237+0000","last_change":"2024-04-26T07:54:17.010190+0000","last_active":"2024-04-26T07:56:29.892237+0000","last_peered":"2024-04-26T07:56:29.892237+0000","last_clean":"2024-04-26T07:56:29.892237+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:56:29.892237+0000","last_undegraded":"2024-04-26T07:56:29.892237+0000","last_fullsized":"2024-04-26T07:56:29.892237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.890398+0000","last_change":"2024-04-26T07:54:15.025512+0000","last_active":"2024-04-26T07:56:19.890398+0000","last_peered":"2024-04-26T07:56:19.890398+0000","last_clean":"2024-04-26T07:56:19.890398+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:56:19.890398+0000","last_undegraded":"2024-04-26T07:56:19.890398+0000","last_fullsized":"2024-04-26T07:56:19.890398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885958+0000","last_change":"2024-04-26T07:54:17.009848+0000","last_active":"2024-04-26T07:56:29.885958+0000","last_peered":"2024-04-26T07:56:29.885958+0000","last_clean":"2024-04-26T07:56:29.885958+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:56:29.885958+0000","last_undegraded":"2024-04-26T07:56:29.885958+0000","last_fullsized":"2024-04-26T07:56:29.885958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.133860+0000","last_change":"2024-04-26T07:54:15.005595+0000","last_active":"2024-04-26T07:57:31.133860+0000","last_peered":"2024-04-26T07:57:31.133860+0000","last_clean":"2024-04-26T07:57:31.133860+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:57:31.133860+0000","last_undegraded":"2024-04-26T07:57:31.133860+0000","last_fullsized":"2024-04-26T07:57:31.133860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885201+0000","last_change":"2024-04-26T07:54:16.999767+0000","last_active":"2024-04-26T07:56:24.885201+0000","last_peered":"2024-04-26T07:56:24.885201+0000","last_clean":"2024-04-26T07:56:24.885201+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:56:24.885201+0000","last_undegraded":"2024-04-26T07:56:24.885201+0000","last_fullsized":"2024-04-26T07:56:24.885201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885237+0000","last_change":"2024-04-26T07:54:15.003280+0000","last_active":"2024-04-26T07:56:24.885237+0000","last_peered":"2024-04-26T07:56:24.885237+0000","last_clean":"2024-04-26T07:56:24.885237+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:56:24.885237+0000","last_undegraded":"2024-04-26T07:56:24.885237+0000","last_fullsized":"2024-04-26T07:56:24.885237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.519746+0000","last_change":"2024-04-26T07:54:17.003908+0000","last_active":"2024-04-26T07:57:24.519746+0000","last_peered":"2024-04-26T07:57:24.519746+0000","last_clean":"2024-04-26T07:57:24.519746+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:57:24.519746+0000","last_undegraded":"2024-04-26T07:57:24.519746+0000","last_fullsized":"2024-04-26T07:57:24.519746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.890880+0000","last_change":"2024-04-26T07:54:15.017747+0000","last_active":"2024-04-26T07:56:24.890880+0000","last_peered":"2024-04-26T07:56:24.890880+0000","last_clean":"2024-04-26T07:56:24.890880+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:56:24.890880+0000","last_undegraded":"2024-04-26T07:56:24.890880+0000","last_fullsized":"2024-04-26T07:56:24.890880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567793+0000","last_change":"2024-04-26T07:54:17.006648+0000","last_active":"2024-04-26T07:57:24.567793+0000","last_peered":"2024-04-26T07:57:24.567793+0000","last_clean":"2024-04-26T07:57:24.567793+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:57:24.567793+0000","last_undegraded":"2024-04-26T07:57:24.567793+0000","last_fullsized":"2024-04-26T07:57:24.567793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.890835+0000","last_change":"2024-04-26T07:54:15.022184+0000","last_active":"2024-04-26T07:56:24.890835+0000","last_peered":"2024-04-26T07:56:24.890835+0000","last_clean":"2024-04-26T07:56:24.890835+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:56:24.890835+0000","last_undegraded":"2024-04-26T07:56:24.890835+0000","last_fullsized":"2024-04-26T07:56:24.890835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.302338+0000","last_change":"2024-04-26T07:54:16.999609+0000","last_active":"2024-04-26T07:57:24.302338+0000","last_peered":"2024-04-26T07:57:24.302338+0000","last_clean":"2024-04-26T07:57:24.302338+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:57:24.302338+0000","last_undegraded":"2024-04-26T07:57:24.302338+0000","last_fullsized":"2024-04-26T07:57:24.302338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885299+0000","last_change":"2024-04-26T07:54:15.005424+0000","last_active":"2024-04-26T07:56:24.885299+0000","last_peered":"2024-04-26T07:56:24.885299+0000","last_clean":"2024-04-26T07:56:24.885299+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:56:24.885299+0000","last_undegraded":"2024-04-26T07:56:24.885299+0000","last_fullsized":"2024-04-26T07:56:24.885299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.445569+0000","last_change":"2024-04-26T07:54:17.006417+0000","last_active":"2024-04-26T07:57:24.445569+0000","last_peered":"2024-04-26T07:57:24.445569+0000","last_clean":"2024-04-26T07:57:24.445569+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:57:24.445569+0000","last_undegraded":"2024-04-26T07:57:24.445569+0000","last_fullsized":"2024-04-26T07:57:24.445569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891197+0000","last_change":"2024-04-26T07:54:15.029863+0000","last_active":"2024-04-26T07:56:24.891197+0000","last_peered":"2024-04-26T07:56:24.891197+0000","last_clean":"2024-04-26T07:56:24.891197+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:56:24.891197+0000","last_undegraded":"2024-04-26T07:56:24.891197+0000","last_fullsized":"2024-04-26T07:56:24.891197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893958+0000","last_change":"2024-04-26T07:54:17.018186+0000","last_active":"2024-04-26T07:56:39.893958+0000","last_peered":"2024-04-26T07:56:39.893958+0000","last_clean":"2024-04-26T07:56:39.893958+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:56:39.893958+0000","last_undegraded":"2024-04-26T07:56:39.893958+0000","last_fullsized":"2024-04-26T07:56:39.893958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885877+0000","last_change":"2024-04-26T07:54:15.007396+0000","last_active":"2024-04-26T07:56:29.885877+0000","last_peered":"2024-04-26T07:56:29.885877+0000","last_clean":"2024-04-26T07:56:29.885877+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:56:29.885877+0000","last_undegraded":"2024-04-26T07:56:29.885877+0000","last_fullsized":"2024-04-26T07:56:29.885877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.886840+0000","last_change":"2024-04-26T07:54:17.011327+0000","last_active":"2024-04-26T07:56:34.886840+0000","last_peered":"2024-04-26T07:56:34.886840+0000","last_clean":"2024-04-26T07:56:34.886840+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:56:34.886840+0000","last_undegraded":"2024-04-26T07:56:34.886840+0000","last_fullsized":"2024-04-26T07:56:34.886840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.132721+0000","last_change":"2024-04-26T07:54:15.017542+0000","last_active":"2024-04-26T07:57:31.132721+0000","last_peered":"2024-04-26T07:57:31.132721+0000","last_clean":"2024-04-26T07:57:31.132721+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:57:31.132721+0000","last_undegraded":"2024-04-26T07:57:31.132721+0000","last_fullsized":"2024-04-26T07:57:31.132721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.445197+0000","last_change":"2024-04-26T07:54:17.003159+0000","last_active":"2024-04-26T07:57:24.445197+0000","last_peered":"2024-04-26T07:57:24.445197+0000","last_clean":"2024-04-26T07:57:24.445197+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:57:24.445197+0000","last_undegraded":"2024-04-26T07:57:24.445197+0000","last_fullsized":"2024-04-26T07:57:24.445197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.135077+0000","last_change":"2024-04-26T07:54:15.008754+0000","last_active":"2024-04-26T07:57:31.135077+0000","last_peered":"2024-04-26T07:57:31.135077+0000","last_clean":"2024-04-26T07:57:31.135077+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:57:31.135077+0000","last_undegraded":"2024-04-26T07:57:31.135077+0000","last_fullsized":"2024-04-26T07:57:31.135077+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.216435+0000","last_change":"2024-04-26T07:54:17.009514+0000","last_active":"2024-04-26T07:57:24.216435+0000","last_peered":"2024-04-26T07:57:24.216435+0000","last_clean":"2024-04-26T07:57:24.216435+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:57:24.216435+0000","last_undegraded":"2024-04-26T07:57:24.216435+0000","last_fullsized":"2024-04-26T07:57:24.216435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.436165+0000","last_change":"2024-04-26T07:54:15.022986+0000","last_active":"2024-04-26T07:57:24.436165+0000","last_peered":"2024-04-26T07:57:24.436165+0000","last_clean":"2024-04-26T07:57:24.436165+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:57:24.436165+0000","last_undegraded":"2024-04-26T07:57:24.436165+0000","last_fullsized":"2024-04-26T07:57:24.436165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518396+0000","last_change":"2024-04-26T07:54:17.007792+0000","last_active":"2024-04-26T07:57:24.518396+0000","last_peered":"2024-04-26T07:57:24.518396+0000","last_clean":"2024-04-26T07:57:24.518396+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:57:24.518396+0000","last_undegraded":"2024-04-26T07:57:24.518396+0000","last_fullsized":"2024-04-26T07:57:24.518396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892250+0000","last_change":"2024-04-26T07:54:15.026508+0000","last_active":"2024-04-26T07:56:29.892250+0000","last_peered":"2024-04-26T07:56:29.892250+0000","last_clean":"2024-04-26T07:56:29.892250+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:56:29.892250+0000","last_undegraded":"2024-04-26T07:56:29.892250+0000","last_fullsized":"2024-04-26T07:56:29.892250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892946+0000","last_change":"2024-04-26T07:54:17.016231+0000","last_active":"2024-04-26T07:56:34.892946+0000","last_peered":"2024-04-26T07:56:34.892946+0000","last_clean":"2024-04-26T07:56:34.892946+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:56:34.892946+0000","last_undegraded":"2024-04-26T07:56:34.892946+0000","last_fullsized":"2024-04-26T07:56:34.892946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892624+0000","last_change":"2024-04-26T07:54:15.022552+0000","last_active":"2024-04-26T07:56:34.892624+0000","last_peered":"2024-04-26T07:56:34.892624+0000","last_clean":"2024-04-26T07:56:34.892624+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:56:34.892624+0000","last_undegraded":"2024-04-26T07:56:34.892624+0000","last_fullsized":"2024-04-26T07:56:34.892624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891439+0000","last_change":"2024-04-26T07:54:17.000134+0000","last_active":"2024-04-26T07:56:29.891439+0000","last_peered":"2024-04-26T07:56:29.891439+0000","last_clean":"2024-04-26T07:56:29.891439+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:56:29.891439+0000","last_undegraded":"2024-04-26T07:56:29.891439+0000","last_fullsized":"2024-04-26T07:56:29.891439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893132+0000","last_change":"2024-04-26T07:54:15.025822+0000","last_active":"2024-04-26T07:56:34.893132+0000","last_peered":"2024-04-26T07:56:34.893132+0000","last_clean":"2024-04-26T07:56:34.893132+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:56:34.893132+0000","last_undegraded":"2024-04-26T07:56:34.893132+0000","last_fullsized":"2024-04-26T07:56:34.893132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892859+0000","last_change":"2024-04-26T07:54:15.029803+0000","last_active":"2024-04-26T07:56:34.892859+0000","last_peered":"2024-04-26T07:56:34.892859+0000","last_clean":"2024-04-26T07:56:34.892859+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:56:34.892859+0000","last_undegraded":"2024-04-26T07:56:34.892859+0000","last_fullsized":"2024-04-26T07:56:34.892859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518555+0000","last_change":"2024-04-26T07:54:17.001393+0000","last_active":"2024-04-26T07:57:24.518555+0000","last_peered":"2024-04-26T07:57:24.518555+0000","last_clean":"2024-04-26T07:57:24.518555+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:57:24.518555+0000","last_undegraded":"2024-04-26T07:57:24.518555+0000","last_fullsized":"2024-04-26T07:57:24.518555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.886732+0000","last_change":"2024-04-26T07:54:15.007421+0000","last_active":"2024-04-26T07:56:34.886732+0000","last_peered":"2024-04-26T07:56:34.886732+0000","last_clean":"2024-04-26T07:56:34.886732+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:56:34.886732+0000","last_undegraded":"2024-04-26T07:56:34.886732+0000","last_fullsized":"2024-04-26T07:56:34.886732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518862+0000","last_change":"2024-04-26T07:54:17.002953+0000","last_active":"2024-04-26T07:57:24.518862+0000","last_peered":"2024-04-26T07:57:24.518862+0000","last_clean":"2024-04-26T07:57:24.518862+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:57:24.518862+0000","last_undegraded":"2024-04-26T07:57:24.518862+0000","last_fullsized":"2024-04-26T07:57:24.518862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1483,"ondisk_log_size":1483,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705712,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705711,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":974848,"data_stored":723975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705713,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":999424,"data_stored":725076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":134133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:57:56.232 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.233 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.233 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.233 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.233 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.233 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.234 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.234 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.234 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.234 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.234 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.235 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.235 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.235 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.235 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.235 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.235 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.235 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.235 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.236 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.236 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.236 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.237 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.238 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.238 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.238 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.238 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.238 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.238 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.238 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.238 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.239 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.240 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.241 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.241 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.241 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.241 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.241 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.241 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.241 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.241 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.242 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.243 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.243 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.243 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.243 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.243 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.243 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.243 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.243 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.244 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.245 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.246 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.247 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.247 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.247 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.247 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.247 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.247 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.247 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.247 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.248 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.249 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.250 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.250 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.250 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.250 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.250 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.250 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.250 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.250 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.251 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.252 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-26T07:54:19.996749+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.253 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.254 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.255 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.256 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.257 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.257 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.257 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.257 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.257 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:57:56.257 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:58:16.258 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:58:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.375+0000 7f815ba5c640 1 Processor -- start 2024-04-26T07:58:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.375+0000 7f815ba5c640 1 -- start start 2024-04-26T07:58:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f815ba5c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f815412eba0 0x7f8154130f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f815ba5c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f815406da60 con 0x7f8154128920 2024-04-26T07:58:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f815ba5c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f8154073070 con 0x7f815412eba0 2024-04-26T07:58:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f8158ff7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f815412eba0 0x7f8154130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f81597f8640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8154128920 0x7f8154128d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53768/0 (socket says 172.21.15.1:53768) 2024-04-26T07:58:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f81597f8640 1 -- 172.21.15.1:0/2048468391 learned_addr learned my addr 172.21.15.1:0/2048468391 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:58:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f8158ff7640 1 -- 172.21.15.1:0/2048468391 >> v1:172.21.15.1:6789/0 conn(0x7f8154128920 legacy=0x7f8154128d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:16.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f814bfff640 1 -- 172.21.15.1:0/2048468391 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319669416 0 0) 0x7f8150001110 con 0x7f8154128920 2024-04-26T07:58:16.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.376+0000 7f8158ff7640 1 -- 172.21.15.1:0/2048468391 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8154094640 con 0x7f815412eba0 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.377+0000 7f8158ff7640 1 --2- 172.21.15.1:0/2048468391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f815412eba0 0x7f8154130f90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8144009720 tx=0x7f814402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb191471cab9c098 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.377+0000 7f814bfff640 1 -- 172.21.15.1:0/2048468391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81440316d0 con 0x7f815412eba0 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.377+0000 7f814bfff640 1 -- 172.21.15.1:0/2048468391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8144037070 con 0x7f815412eba0 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.377+0000 7f814bfff640 1 -- 172.21.15.1:0/2048468391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81440319c0 con 0x7f815412eba0 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.378+0000 7f815ba5c640 1 -- 172.21.15.1:0/2048468391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f815412eba0 msgr2=0x7f8154130f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.378+0000 7f815ba5c640 1 --2- 172.21.15.1:0/2048468391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f815412eba0 0x7f8154130f90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8144009720 tx=0x7f814402b840 comp rx=0 tx=0).stop 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.378+0000 7f815ba5c640 1 -- 172.21.15.1:0/2048468391 shutdown_connections 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.378+0000 7f815ba5c640 1 --2- 172.21.15.1:0/2048468391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f815412eba0 0x7f8154130f90 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.378+0000 7f815ba5c640 1 -- 172.21.15.1:0/2048468391 >> 172.21.15.1:0/2048468391 conn(0x7f815409add0 msgr2=0x7f815409b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:58:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.378+0000 7f815ba5c640 1 -- 172.21.15.1:0/2048468391 shutdown_connections 2024-04-26T07:58:16.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.378+0000 7f815ba5c640 1 -- 172.21.15.1:0/2048468391 wait complete. 2024-04-26T07:58:16.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.379+0000 7f815ba5c640 1 Processor -- start 2024-04-26T07:58:16.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.379+0000 7f815ba5c640 1 -- start start 2024-04-26T07:58:16.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.379+0000 7f815ba5c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154128920 0x7f81541be170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:16.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.379+0000 7f815ba5c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f815406d620 con 0x7f8154128920 2024-04-26T07:58:16.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.379+0000 7f81597f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154128920 0x7f81541be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:16.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.379+0000 7f81597f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154128920 0x7f81541be170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38508/0 (socket says 172.21.15.1:38508) 2024-04-26T07:58:16.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.379+0000 7f81597f8640 1 -- 172.21.15.1:0/593216080 learned_addr learned my addr 172.21.15.1:0/593216080 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:58:16.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.380+0000 7f81597f8640 1 -- 172.21.15.1:0/593216080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815406f3f0 con 0x7f8154128920 2024-04-26T07:58:16.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.380+0000 7f81597f8640 1 --2- 172.21.15.1:0/593216080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154128920 0x7f81541be170 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f815000c700 tx=0x7f815000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:16.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.380+0000 7f8149ffb640 1 -- 172.21.15.1:0/593216080 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8150018070 con 0x7f8154128920 2024-04-26T07:58:16.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.380+0000 7f8149ffb640 1 -- 172.21.15.1:0/593216080 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81500070d0 con 0x7f8154128920 2024-04-26T07:58:16.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.380+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8154098a70 con 0x7f8154128920 2024-04-26T07:58:16.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.380+0000 7f8149ffb640 1 -- 172.21.15.1:0/593216080 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81500073f0 con 0x7f8154128920 2024-04-26T07:58:16.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.380+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f815406f830 con 0x7f8154128920 2024-04-26T07:58:16.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.381+0000 7f8149ffb640 1 -- 172.21.15.1:0/593216080 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f815001b070 con 0x7f8154128920 2024-04-26T07:58:16.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.381+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81540636f0 con 0x7f8154128920 2024-04-26T07:58:16.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.381+0000 7f8149ffb640 1 --2- 172.21.15.1:0/593216080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f81380385c0 0x7f813803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:16.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.381+0000 7f8149ffb640 1 -- 172.21.15.1:0/593216080 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f815004b500 con 0x7f8154128920 2024-04-26T07:58:16.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.382+0000 7f8158ff7640 1 --2- 172.21.15.1:0/593216080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f81380385c0 0x7f813803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:16.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.382+0000 7f8158ff7640 1 --2- 172.21.15.1:0/593216080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f81380385c0 0x7f813803aa80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8144036000 tx=0x7f8144008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:16.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.386+0000 7f8149ffb640 1 -- 172.21.15.1:0/593216080 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f815406f3f0 con 0x7f8154128920 2024-04-26T07:58:16.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.567+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f815406b6f0 con 0x7f81380385c0 2024-04-26T07:58:16.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.583+0000 7f8149ffb640 1 -- 172.21.15.1:0/593216080 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661276 (secure 0 0 0) 0x7f815406b6f0 con 0x7f81380385c0 2024-04-26T07:58:16.587 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:58:16.592 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:58:16.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f81380385c0 msgr2=0x7f813803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:16.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 --2- 172.21.15.1:0/593216080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f81380385c0 0x7f813803aa80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8144036000 tx=0x7f8144008030 comp rx=0 tx=0).stop 2024-04-26T07:58:16.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154128920 msgr2=0x7f81541be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:16.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 --2- 172.21.15.1:0/593216080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154128920 0x7f81541be170 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f815000c700 tx=0x7f815000cbc0 comp rx=0 tx=0).stop 2024-04-26T07:58:16.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 shutdown_connections 2024-04-26T07:58:16.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 --2- 172.21.15.1:0/593216080 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f81380385c0 0x7f813803aa80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:16.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 --2- 172.21.15.1:0/593216080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154128920 0x7f81541be170 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:16.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 >> 172.21.15.1:0/593216080 conn(0x7f815409add0 msgr2=0x7f8154094c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:58:16.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 shutdown_connections 2024-04-26T07:58:16.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:16.588+0000 7f815ba5c640 1 -- 172.21.15.1:0/593216080 wait complete. 2024-04-26T07:58:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-04-26T07:58:14.883061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5103,"num_read_kb":4684,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4767,"ondisk_log_size":4767,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148248,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339112,"statfs":{"total":386547056640,"available":386395250688,"internally_reserved":0,"allocated":2809856,"data_stored":1718390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1664,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003802"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:23.636062+0000","last_change":"2024-04-26T07:54:15.021756+0000","last_active":"2024-04-26T07:56:23.636062+0000","last_peered":"2024-04-26T07:56:23.636062+0000","last_clean":"2024-04-26T07:56:23.636062+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:56:23.636062+0000","last_undegraded":"2024-04-26T07:56:23.636062+0000","last_fullsized":"2024-04-26T07:56:23.636062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.247641+0000","last_change":"2024-04-26T07:58:03.247677+0000","last_active":"2024-04-26T07:58:03.247641+0000","last_peered":"2024-04-26T07:58:03.247641+0000","last_clean":"2024-04-26T07:58:03.247641+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:58:03.247641+0000","last_undegraded":"2024-04-26T07:58:03.247641+0000","last_fullsized":"2024-04-26T07:58:03.247641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:03.247552+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:03.247552+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.247552+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:09.519023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.812132+0000","last_change":"2024-04-26T07:58:09.812158+0000","last_active":"2024-04-26T07:58:09.812132+0000","last_peered":"2024-04-26T07:58:09.812132+0000","last_clean":"2024-04-26T07:58:09.812132+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:58:09.812132+0000","last_undegraded":"2024-04-26T07:58:09.812132+0000","last_fullsized":"2024-04-26T07:58:09.812132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:09.812040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:09.812040+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.812040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:12.706861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.216222+0000","last_change":"2024-04-26T07:54:17.015486+0000","last_active":"2024-04-26T07:57:24.216222+0000","last_peered":"2024-04-26T07:57:24.216222+0000","last_clean":"2024-04-26T07:57:24.216222+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:57:24.216222+0000","last_undegraded":"2024-04-26T07:57:24.216222+0000","last_fullsized":"2024-04-26T07:57:24.216222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.890522+0000","last_change":"2024-04-26T07:54:15.026276+0000","last_active":"2024-04-26T07:56:19.890522+0000","last_peered":"2024-04-26T07:56:19.890522+0000","last_clean":"2024-04-26T07:56:19.890522+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:56:19.890522+0000","last_undegraded":"2024-04-26T07:56:19.890522+0000","last_fullsized":"2024-04-26T07:56:19.890522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.977839+0000","last_change":"2024-04-26T07:57:49.977898+0000","last_active":"2024-04-26T07:57:49.977839+0000","last_peered":"2024-04-26T07:57:49.977839+0000","last_clean":"2024-04-26T07:57:49.977839+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:49.977839+0000","last_undegraded":"2024-04-26T07:57:49.977839+0000","last_fullsized":"2024-04-26T07:57:49.977839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:57:49.977738+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:57:49.977738+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.977738+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:40.792346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.889138+0000","last_change":"2024-04-26T07:54:15.020803+0000","last_active":"2024-04-26T07:56:14.889138+0000","last_peered":"2024-04-26T07:56:14.889138+0000","last_clean":"2024-04-26T07:56:14.889138+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:56:14.889138+0000","last_undegraded":"2024-04-26T07:56:14.889138+0000","last_fullsized":"2024-04-26T07:56:14.889138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:49.895671+0000","last_change":"2024-04-26T07:54:17.011187+0000","last_active":"2024-04-26T07:56:49.895671+0000","last_peered":"2024-04-26T07:56:49.895671+0000","last_clean":"2024-04-26T07:56:49.895671+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:56:49.895671+0000","last_undegraded":"2024-04-26T07:56:49.895671+0000","last_fullsized":"2024-04-26T07:56:49.895671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894751+0000","last_change":"2024-04-26T07:54:15.025367+0000","last_active":"2024-04-26T07:56:44.894751+0000","last_peered":"2024-04-26T07:56:44.894751+0000","last_clean":"2024-04-26T07:56:44.894751+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:56:44.894751+0000","last_undegraded":"2024-04-26T07:56:44.894751+0000","last_fullsized":"2024-04-26T07:56:44.894751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.519026+0000","last_change":"2024-04-26T07:54:17.001492+0000","last_active":"2024-04-26T07:57:24.519026+0000","last_peered":"2024-04-26T07:57:24.519026+0000","last_clean":"2024-04-26T07:57:24.519026+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:57:24.519026+0000","last_undegraded":"2024-04-26T07:57:24.519026+0000","last_fullsized":"2024-04-26T07:57:24.519026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.508835+0000","last_change":"2024-04-26T07:54:15.019896+0000","last_active":"2024-04-26T07:57:24.508835+0000","last_peered":"2024-04-26T07:57:24.508835+0000","last_clean":"2024-04-26T07:57:24.508835+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:57:24.508835+0000","last_undegraded":"2024-04-26T07:57:24.508835+0000","last_fullsized":"2024-04-26T07:57:24.508835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.029669+0000","last_change":"2024-04-26T07:57:56.029718+0000","last_active":"2024-04-26T07:57:56.029669+0000","last_peered":"2024-04-26T07:57:56.029669+0000","last_clean":"2024-04-26T07:57:56.029669+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:56.029669+0000","last_undegraded":"2024-04-26T07:57:56.029669+0000","last_fullsized":"2024-04-26T07:57:56.029669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:56.029549+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:56.029549+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.029549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:42.743723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.173213+0000","last_change":"2024-04-26T07:54:15.021920+0000","last_active":"2024-04-26T07:57:24.173213+0000","last_peered":"2024-04-26T07:57:24.173213+0000","last_clean":"2024-04-26T07:57:24.173213+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:57:24.173213+0000","last_undegraded":"2024-04-26T07:57:24.173213+0000","last_fullsized":"2024-04-26T07:57:24.173213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.157051+0000","last_change":"2024-04-26T07:57:56.157085+0000","last_active":"2024-04-26T07:57:56.157051+0000","last_peered":"2024-04-26T07:57:56.157051+0000","last_clean":"2024-04-26T07:57:56.157051+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:57:56.157051+0000","last_undegraded":"2024-04-26T07:57:56.157051+0000","last_fullsized":"2024-04-26T07:57:56.157051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:56.156947+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:56.156947+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.156947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:28.587105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.888248+0000","last_change":"2024-04-26T07:54:15.008904+0000","last_active":"2024-04-26T07:56:44.888248+0000","last_peered":"2024-04-26T07:56:44.888248+0000","last_clean":"2024-04-26T07:56:44.888248+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:56:44.888248+0000","last_undegraded":"2024-04-26T07:56:44.888248+0000","last_fullsized":"2024-04-26T07:56:44.888248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.268064+0000","last_change":"2024-04-26T07:58:05.268091+0000","last_active":"2024-04-26T07:58:05.268064+0000","last_peered":"2024-04-26T07:58:05.268064+0000","last_clean":"2024-04-26T07:58:05.268064+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:58:05.268064+0000","last_undegraded":"2024-04-26T07:58:05.268064+0000","last_fullsized":"2024-04-26T07:58:05.268064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:05.267964+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:05.267964+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.267964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:56.976727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.952669+0000","last_change":"2024-04-26T07:57:47.952694+0000","last_active":"2024-04-26T07:57:47.952669+0000","last_peered":"2024-04-26T07:57:47.952669+0000","last_clean":"2024-04-26T07:57:47.952669+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:57:47.952669+0000","last_undegraded":"2024-04-26T07:57:47.952669+0000","last_fullsized":"2024-04-26T07:57:47.952669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.952578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:27.282056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893599+0000","last_change":"2024-04-26T07:54:15.020059+0000","last_active":"2024-04-26T07:56:39.893599+0000","last_peered":"2024-04-26T07:56:39.893599+0000","last_clean":"2024-04-26T07:56:39.893599+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:56:39.893599+0000","last_undegraded":"2024-04-26T07:56:39.893599+0000","last_fullsized":"2024-04-26T07:56:39.893599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.172488+0000","last_change":"2024-04-26T07:58:05.172540+0000","last_active":"2024-04-26T07:58:05.172488+0000","last_peered":"2024-04-26T07:58:05.172488+0000","last_clean":"2024-04-26T07:58:05.172488+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:58:05.172488+0000","last_undegraded":"2024-04-26T07:58:05.172488+0000","last_fullsized":"2024-04-26T07:58:05.172488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:05.172385+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:05.172385+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.172385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:54.072924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.182343+0000","last_change":"2024-04-26T07:58:00.182384+0000","last_active":"2024-04-26T07:58:00.182343+0000","last_peered":"2024-04-26T07:58:00.182343+0000","last_clean":"2024-04-26T07:58:00.182343+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:58:00.182343+0000","last_undegraded":"2024-04-26T07:58:00.182343+0000","last_fullsized":"2024-04-26T07:58:00.182343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:00.182243+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:00.182243+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.182243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:41.053649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.135895+0000","last_change":"2024-04-26T07:57:55.135919+0000","last_active":"2024-04-26T07:57:55.135895+0000","last_peered":"2024-04-26T07:57:55.135895+0000","last_clean":"2024-04-26T07:57:55.135895+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:55.135895+0000","last_undegraded":"2024-04-26T07:57:55.135895+0000","last_fullsized":"2024-04-26T07:57:55.135895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:55.135805+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:55.135805+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.135805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:24.905448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893509+0000","last_change":"2024-04-26T07:54:15.017989+0000","last_active":"2024-04-26T07:56:39.893509+0000","last_peered":"2024-04-26T07:56:39.893509+0000","last_clean":"2024-04-26T07:56:39.893509+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:56:39.893509+0000","last_undegraded":"2024-04-26T07:56:39.893509+0000","last_fullsized":"2024-04-26T07:56:39.893509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.866000+0000","last_change":"2024-04-26T07:58:01.866024+0000","last_active":"2024-04-26T07:58:01.866000+0000","last_peered":"2024-04-26T07:58:01.866000+0000","last_clean":"2024-04-26T07:58:01.866000+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:58:01.866000+0000","last_undegraded":"2024-04-26T07:58:01.866000+0000","last_fullsized":"2024-04-26T07:58:01.866000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:01.865908+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:01.865908+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.865908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:20.466755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893462+0000","last_change":"2024-04-26T07:54:15.017753+0000","last_active":"2024-04-26T07:56:39.893462+0000","last_peered":"2024-04-26T07:56:39.893462+0000","last_clean":"2024-04-26T07:56:39.893462+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:56:39.893462+0000","last_undegraded":"2024-04-26T07:56:39.893462+0000","last_fullsized":"2024-04-26T07:56:39.893462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.287922+0000","last_change":"2024-04-26T07:58:09.287952+0000","last_active":"2024-04-26T07:58:09.287922+0000","last_peered":"2024-04-26T07:58:09.287922+0000","last_clean":"2024-04-26T07:58:09.287922+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:58:09.287922+0000","last_undegraded":"2024-04-26T07:58:09.287922+0000","last_fullsized":"2024-04-26T07:58:09.287922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:09.287831+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:09.287831+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.287831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:30.576867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.887607+0000","last_change":"2024-04-26T07:54:15.008684+0000","last_active":"2024-04-26T07:56:39.887607+0000","last_peered":"2024-04-26T07:56:39.887607+0000","last_clean":"2024-04-26T07:56:39.887607+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:56:39.887607+0000","last_undegraded":"2024-04-26T07:56:39.887607+0000","last_fullsized":"2024-04-26T07:56:39.887607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.219214+0000","last_change":"2024-04-26T07:58:09.219242+0000","last_active":"2024-04-26T07:58:09.219214+0000","last_peered":"2024-04-26T07:58:09.219214+0000","last_clean":"2024-04-26T07:58:09.219214+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:58:09.219214+0000","last_undegraded":"2024-04-26T07:58:09.219214+0000","last_fullsized":"2024-04-26T07:58:09.219214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:09.219121+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:09.219121+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.219121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:31.436809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892974+0000","last_change":"2024-04-26T07:54:15.017883+0000","last_active":"2024-04-26T07:56:34.892974+0000","last_peered":"2024-04-26T07:56:34.892974+0000","last_clean":"2024-04-26T07:56:34.892974+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:56:34.892974+0000","last_undegraded":"2024-04-26T07:56:34.892974+0000","last_fullsized":"2024-04-26T07:56:34.892974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.528476+0000","last_change":"2024-04-26T07:54:25.037823+0000","last_active":"2024-04-26T07:57:24.528476+0000","last_peered":"2024-04-26T07:57:24.528476+0000","last_clean":"2024-04-26T07:57:24.528476+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:57:24.528476+0000","last_undegraded":"2024-04-26T07:57:24.528476+0000","last_fullsized":"2024-04-26T07:57:24.528476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'13","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567471+0000","last_change":"2024-04-26T07:54:17.010298+0000","last_active":"2024-04-26T07:57:24.567471+0000","last_peered":"2024-04-26T07:57:24.567471+0000","last_clean":"2024-04-26T07:57:24.567471+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:57:24.567471+0000","last_undegraded":"2024-04-26T07:57:24.567471+0000","last_fullsized":"2024-04-26T07:57:24.567471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.132698+0000","last_change":"2024-04-26T07:54:15.028485+0000","last_active":"2024-04-26T07:57:31.132698+0000","last_peered":"2024-04-26T07:57:31.132698+0000","last_clean":"2024-04-26T07:57:31.132698+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:57:31.132698+0000","last_undegraded":"2024-04-26T07:57:31.132698+0000","last_fullsized":"2024-04-26T07:57:31.132698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.991288+0000","last_change":"2024-04-26T07:57:41.991316+0000","last_active":"2024-04-26T07:57:41.991288+0000","last_peered":"2024-04-26T07:57:41.991288+0000","last_clean":"2024-04-26T07:57:41.991288+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:57:41.991288+0000","last_undegraded":"2024-04-26T07:57:41.991288+0000","last_fullsized":"2024-04-26T07:57:41.991288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.991200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:30.282928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.071582+0000","last_change":"2024-04-26T07:58:05.071616+0000","last_active":"2024-04-26T07:58:05.071582+0000","last_peered":"2024-04-26T07:58:05.071582+0000","last_clean":"2024-04-26T07:58:05.071582+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:58:05.071582+0000","last_undegraded":"2024-04-26T07:58:05.071582+0000","last_fullsized":"2024-04-26T07:58:05.071582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:58:05.071491+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:58:05.071491+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.071491+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:17.009024+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.029246+0000","last_change":"2024-04-26T07:57:40.029273+0000","last_active":"2024-04-26T07:57:40.029246+0000","last_peered":"2024-04-26T07:57:40.029246+0000","last_clean":"2024-04-26T07:57:40.029246+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:57:40.029246+0000","last_undegraded":"2024-04-26T07:57:40.029246+0000","last_fullsized":"2024-04-26T07:57:40.029246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.029150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.153168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.137596+0000","last_change":"2024-04-26T07:57:56.137657+0000","last_active":"2024-04-26T07:57:56.137596+0000","last_peered":"2024-04-26T07:57:56.137596+0000","last_clean":"2024-04-26T07:57:56.137596+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:56.137596+0000","last_undegraded":"2024-04-26T07:57:56.137596+0000","last_fullsized":"2024-04-26T07:57:56.137596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:57:56.137425+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:57:56.137425+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.137425+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:50.295566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567342+0000","last_change":"2024-04-26T07:54:17.010194+0000","last_active":"2024-04-26T07:57:24.567342+0000","last_peered":"2024-04-26T07:57:24.567342+0000","last_clean":"2024-04-26T07:57:24.567342+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:57:24.567342+0000","last_undegraded":"2024-04-26T07:57:24.567342+0000","last_fullsized":"2024-04-26T07:57:24.567342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892464+0000","last_change":"2024-04-26T07:54:15.018699+0000","last_active":"2024-04-26T07:56:34.892464+0000","last_peered":"2024-04-26T07:56:34.892464+0000","last_clean":"2024-04-26T07:56:34.892464+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:56:34.892464+0000","last_undegraded":"2024-04-26T07:56:34.892464+0000","last_fullsized":"2024-04-26T07:56:34.892464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'4","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.044186+0000","last_change":"2024-04-26T07:55:02.067003+0000","last_active":"2024-04-26T07:57:31.044186+0000","last_peered":"2024-04-26T07:57:31.044186+0000","last_clean":"2024-04-26T07:57:31.044186+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:57:31.044186+0000","last_undegraded":"2024-04-26T07:57:31.044186+0000","last_fullsized":"2024-04-26T07:57:31.044186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.951894+0000","last_change":"2024-04-26T07:57:42.951977+0000","last_active":"2024-04-26T07:57:42.951894+0000","last_peered":"2024-04-26T07:57:42.951894+0000","last_clean":"2024-04-26T07:57:42.951894+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:57:42.951894+0000","last_undegraded":"2024-04-26T07:57:42.951894+0000","last_fullsized":"2024-04-26T07:57:42.951894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.951788+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:25.400326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.943693+0000","last_change":"2024-04-26T07:57:47.943739+0000","last_active":"2024-04-26T07:57:47.943693+0000","last_peered":"2024-04-26T07:57:47.943693+0000","last_clean":"2024-04-26T07:57:47.943693+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:57:47.943693+0000","last_undegraded":"2024-04-26T07:57:47.943693+0000","last_fullsized":"2024-04-26T07:57:47.943693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.943578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:52.735911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.851905+0000","last_change":"2024-04-26T07:58:02.851935+0000","last_active":"2024-04-26T07:58:02.851905+0000","last_peered":"2024-04-26T07:58:02.851905+0000","last_clean":"2024-04-26T07:58:02.851905+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:58:02.851905+0000","last_undegraded":"2024-04-26T07:58:02.851905+0000","last_fullsized":"2024-04-26T07:58:02.851905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:02.851809+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:02.851809+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.851809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:48.141417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:29.900680+0000","last_change":"2024-04-26T07:55:02.065992+0000","last_active":"2024-04-26T07:57:29.900680+0000","last_peered":"2024-04-26T07:57:29.900680+0000","last_clean":"2024-04-26T07:57:29.900680+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:57:29.900680+0000","last_undegraded":"2024-04-26T07:57:29.900680+0000","last_fullsized":"2024-04-26T07:57:29.900680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892901+0000","last_change":"2024-04-26T07:54:15.028375+0000","last_active":"2024-04-26T07:56:34.892901+0000","last_peered":"2024-04-26T07:56:34.892901+0000","last_clean":"2024-04-26T07:56:34.892901+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:56:34.892901+0000","last_undegraded":"2024-04-26T07:56:34.892901+0000","last_fullsized":"2024-04-26T07:56:34.892901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.038571+0000","last_change":"2024-04-26T07:57:53.038594+0000","last_active":"2024-04-26T07:57:53.038571+0000","last_peered":"2024-04-26T07:57:53.038571+0000","last_clean":"2024-04-26T07:57:53.038571+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:57:53.038571+0000","last_undegraded":"2024-04-26T07:57:53.038571+0000","last_fullsized":"2024-04-26T07:57:53.038571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:53.038477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:53.038477+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.038477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.214477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.282629+0000","last_change":"2024-04-26T07:57:38.282677+0000","last_active":"2024-04-26T07:57:38.282629+0000","last_peered":"2024-04-26T07:57:38.282629+0000","last_clean":"2024-04-26T07:57:38.282629+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:57:38.282629+0000","last_undegraded":"2024-04-26T07:57:38.282629+0000","last_fullsized":"2024-04-26T07:57:38.282629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.282530+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:49.848037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":398,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.033916+0000","last_change":"2024-04-26T07:58:07.033968+0000","last_active":"2024-04-26T07:58:07.033916+0000","last_peered":"2024-04-26T07:58:07.033916+0000","last_clean":"2024-04-26T07:58:07.033916+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:58:07.033916+0000","last_undegraded":"2024-04-26T07:58:07.033916+0000","last_fullsized":"2024-04-26T07:58:07.033916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-04-26T07:58:07.033790+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-04-26T07:58:07.033790+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.033790+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:29.381421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.895805+0000","last_change":"2024-04-26T07:54:25.027799+0000","last_active":"2024-04-26T07:56:54.895805+0000","last_peered":"2024-04-26T07:56:54.895805+0000","last_clean":"2024-04-26T07:56:54.895805+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:56:54.895805+0000","last_undegraded":"2024-04-26T07:56:54.895805+0000","last_fullsized":"2024-04-26T07:56:54.895805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.445650+0000","last_change":"2024-04-26T07:54:17.006664+0000","last_active":"2024-04-26T07:57:24.445650+0000","last_peered":"2024-04-26T07:57:24.445650+0000","last_clean":"2024-04-26T07:57:24.445650+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:57:24.445650+0000","last_undegraded":"2024-04-26T07:57:24.445650+0000","last_fullsized":"2024-04-26T07:57:24.445650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892361+0000","last_change":"2024-04-26T07:54:15.020158+0000","last_active":"2024-04-26T07:56:34.892361+0000","last_peered":"2024-04-26T07:56:34.892361+0000","last_clean":"2024-04-26T07:56:34.892361+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:56:34.892361+0000","last_undegraded":"2024-04-26T07:56:34.892361+0000","last_fullsized":"2024-04-26T07:56:34.892361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894905+0000","last_change":"2024-04-26T07:55:02.059077+0000","last_active":"2024-04-26T07:56:44.894905+0000","last_peered":"2024-04-26T07:56:44.894905+0000","last_clean":"2024-04-26T07:56:44.894905+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:56:44.894905+0000","last_undegraded":"2024-04-26T07:56:44.894905+0000","last_fullsized":"2024-04-26T07:56:44.894905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.304015+0000","last_change":"2024-04-26T07:57:41.304062+0000","last_active":"2024-04-26T07:57:41.304015+0000","last_peered":"2024-04-26T07:57:41.304015+0000","last_clean":"2024-04-26T07:57:41.304015+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:57:41.304015+0000","last_undegraded":"2024-04-26T07:57:41.304015+0000","last_fullsized":"2024-04-26T07:57:41.304015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.303924+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:58.630899+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.961870+0000","last_change":"2024-04-26T07:57:50.961896+0000","last_active":"2024-04-26T07:57:50.961870+0000","last_peered":"2024-04-26T07:57:50.961870+0000","last_clean":"2024-04-26T07:57:50.961870+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:50.961870+0000","last_undegraded":"2024-04-26T07:57:50.961870+0000","last_fullsized":"2024-04-26T07:57:50.961870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:50.961766+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:50.961766+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.961766+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:57.082089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.066576+0000","last_change":"2024-04-26T07:57:54.066607+0000","last_active":"2024-04-26T07:57:54.066576+0000","last_peered":"2024-04-26T07:57:54.066576+0000","last_clean":"2024-04-26T07:57:54.066576+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:57:54.066576+0000","last_undegraded":"2024-04-26T07:57:54.066576+0000","last_fullsized":"2024-04-26T07:57:54.066576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:54.066484+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:54.066484+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.066484+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:39.845246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891714+0000","last_change":"2024-04-26T07:54:15.021552+0000","last_active":"2024-04-26T07:56:29.891714+0000","last_peered":"2024-04-26T07:56:29.891714+0000","last_clean":"2024-04-26T07:56:29.891714+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:56:29.891714+0000","last_undegraded":"2024-04-26T07:56:29.891714+0000","last_fullsized":"2024-04-26T07:56:29.891714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.928603+0000","last_change":"2024-04-26T07:57:46.928630+0000","last_active":"2024-04-26T07:57:46.928603+0000","last_peered":"2024-04-26T07:57:46.928603+0000","last_clean":"2024-04-26T07:57:46.928603+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:57:46.928603+0000","last_undegraded":"2024-04-26T07:57:46.928603+0000","last_fullsized":"2024-04-26T07:57:46.928603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.928512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:13.316943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.275612+0000","last_change":"2024-04-26T07:57:46.275674+0000","last_active":"2024-04-26T07:57:46.275612+0000","last_peered":"2024-04-26T07:57:46.275612+0000","last_clean":"2024-04-26T07:57:46.275612+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:57:46.275612+0000","last_undegraded":"2024-04-26T07:57:46.275612+0000","last_fullsized":"2024-04-26T07:57:46.275612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.275508+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:20.381725+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.014944+0000","last_change":"2024-04-26T07:57:43.014970+0000","last_active":"2024-04-26T07:57:43.014944+0000","last_peered":"2024-04-26T07:57:43.014944+0000","last_clean":"2024-04-26T07:57:43.014944+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:57:43.014944+0000","last_undegraded":"2024-04-26T07:57:43.014944+0000","last_fullsized":"2024-04-26T07:57:43.014944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.014858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:09.403289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891555+0000","last_change":"2024-04-26T07:54:25.038132+0000","last_active":"2024-04-26T07:56:29.891555+0000","last_peered":"2024-04-26T07:56:29.891555+0000","last_clean":"2024-04-26T07:56:29.891555+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:56:29.891555+0000","last_undegraded":"2024-04-26T07:56:29.891555+0000","last_fullsized":"2024-04-26T07:56:29.891555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.153589+0000","last_change":"2024-04-26T07:58:07.153649+0000","last_active":"2024-04-26T07:58:07.153589+0000","last_peered":"2024-04-26T07:58:07.153589+0000","last_clean":"2024-04-26T07:58:07.153589+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:58:07.153589+0000","last_undegraded":"2024-04-26T07:58:07.153589+0000","last_fullsized":"2024-04-26T07:58:07.153589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:07.153468+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:07.153468+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.153468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:52.443076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891644+0000","last_change":"2024-04-26T07:54:15.021572+0000","last_active":"2024-04-26T07:56:29.891644+0000","last_peered":"2024-04-26T07:56:29.891644+0000","last_clean":"2024-04-26T07:56:29.891644+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:56:29.891644+0000","last_undegraded":"2024-04-26T07:56:29.891644+0000","last_fullsized":"2024-04-26T07:56:29.891644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.938500+0000","last_change":"2024-04-26T07:57:55.938537+0000","last_active":"2024-04-26T07:57:55.938500+0000","last_peered":"2024-04-26T07:57:55.938500+0000","last_clean":"2024-04-26T07:57:55.938500+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:57:55.938500+0000","last_undegraded":"2024-04-26T07:57:55.938500+0000","last_fullsized":"2024-04-26T07:57:55.938500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:55.938404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:55.938404+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.938404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:35.339181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.018137+0000","last_change":"2024-04-26T07:57:51.018207+0000","last_active":"2024-04-26T07:57:51.018137+0000","last_peered":"2024-04-26T07:57:51.018137+0000","last_clean":"2024-04-26T07:57:51.018137+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:57:51.018137+0000","last_undegraded":"2024-04-26T07:57:51.018137+0000","last_fullsized":"2024-04-26T07:57:51.018137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:51.017960+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:51.017960+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.017960+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:39.406884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.026924+0000","last_change":"2024-04-26T07:57:47.026951+0000","last_active":"2024-04-26T07:57:47.026924+0000","last_peered":"2024-04-26T07:57:47.026924+0000","last_clean":"2024-04-26T07:57:47.026924+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:57:47.026924+0000","last_undegraded":"2024-04-26T07:57:47.026924+0000","last_fullsized":"2024-04-26T07:57:47.026924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.026813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:06.280145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891597+0000","last_change":"2024-04-26T07:54:25.031077+0000","last_active":"2024-04-26T07:56:29.891597+0000","last_peered":"2024-04-26T07:56:29.891597+0000","last_clean":"2024-04-26T07:56:29.891597+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:56:29.891597+0000","last_undegraded":"2024-04-26T07:56:29.891597+0000","last_fullsized":"2024-04-26T07:56:29.891597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567527+0000","last_change":"2024-04-26T07:54:17.015501+0000","last_active":"2024-04-26T07:57:24.567527+0000","last_peered":"2024-04-26T07:57:24.567527+0000","last_clean":"2024-04-26T07:57:24.567527+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:57:24.567527+0000","last_undegraded":"2024-04-26T07:57:24.567527+0000","last_fullsized":"2024-04-26T07:57:24.567527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892260+0000","last_change":"2024-04-26T07:54:15.026188+0000","last_active":"2024-04-26T07:56:29.892260+0000","last_peered":"2024-04-26T07:56:29.892260+0000","last_clean":"2024-04-26T07:56:29.892260+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:56:29.892260+0000","last_undegraded":"2024-04-26T07:56:29.892260+0000","last_fullsized":"2024-04-26T07:56:29.892260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.020112+0000","last_change":"2024-04-26T07:57:54.020138+0000","last_active":"2024-04-26T07:57:54.020112+0000","last_peered":"2024-04-26T07:57:54.020112+0000","last_clean":"2024-04-26T07:57:54.020112+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:57:54.020112+0000","last_undegraded":"2024-04-26T07:57:54.020112+0000","last_fullsized":"2024-04-26T07:57:54.020112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.020020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.020020+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.020020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:45.728783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.025894+0000","last_change":"2024-04-26T07:57:55.025939+0000","last_active":"2024-04-26T07:57:55.025894+0000","last_peered":"2024-04-26T07:57:55.025894+0000","last_clean":"2024-04-26T07:57:55.025894+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:57:55.025894+0000","last_undegraded":"2024-04-26T07:57:55.025894+0000","last_fullsized":"2024-04-26T07:57:55.025894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-04-26T07:57:55.025801+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-04-26T07:57:55.025801+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.025801+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:23.139148+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.078518+0000","last_change":"2024-04-26T07:57:36.078544+0000","last_active":"2024-04-26T07:57:36.078518+0000","last_peered":"2024-04-26T07:57:36.078518+0000","last_clean":"2024-04-26T07:57:36.078518+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:36.078518+0000","last_undegraded":"2024-04-26T07:57:36.078518+0000","last_fullsized":"2024-04-26T07:57:36.078518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.078443+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:00.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.886854+0000","last_change":"2024-04-26T07:54:25.030802+0000","last_active":"2024-04-26T07:56:34.886854+0000","last_peered":"2024-04-26T07:56:34.886854+0000","last_clean":"2024-04-26T07:56:34.886854+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:56:34.886854+0000","last_undegraded":"2024-04-26T07:56:34.886854+0000","last_fullsized":"2024-04-26T07:56:34.886854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.194772+0000","last_change":"2024-04-26T07:57:58.194805+0000","last_active":"2024-04-26T07:57:58.194772+0000","last_peered":"2024-04-26T07:57:58.194772+0000","last_clean":"2024-04-26T07:57:58.194772+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:58.194772+0000","last_undegraded":"2024-04-26T07:57:58.194772+0000","last_fullsized":"2024-04-26T07:57:58.194772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:58.194676+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:58.194676+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.194676+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:17.448008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892189+0000","last_change":"2024-04-26T07:54:15.029358+0000","last_active":"2024-04-26T07:56:29.892189+0000","last_peered":"2024-04-26T07:56:29.892189+0000","last_clean":"2024-04-26T07:56:29.892189+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:56:29.892189+0000","last_undegraded":"2024-04-26T07:56:29.892189+0000","last_fullsized":"2024-04-26T07:56:29.892189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.868496+0000","last_change":"2024-04-26T07:57:57.868520+0000","last_active":"2024-04-26T07:57:57.868496+0000","last_peered":"2024-04-26T07:57:57.868496+0000","last_clean":"2024-04-26T07:57:57.868496+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:57:57.868496+0000","last_undegraded":"2024-04-26T07:57:57.868496+0000","last_fullsized":"2024-04-26T07:57:57.868496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:57.868394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:57.868394+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.868394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.157429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'64","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.962316+0000","last_change":"2024-04-26T07:57:46.962369+0000","last_active":"2024-04-26T07:57:46.962316+0000","last_peered":"2024-04-26T07:57:46.962316+0000","last_clean":"2024-04-26T07:57:46.962316+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:57:46.962316+0000","last_undegraded":"2024-04-26T07:57:46.962316+0000","last_fullsized":"2024-04-26T07:57:46.962316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.962228+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:34.331613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.099064+0000","last_change":"2024-04-26T07:57:35.099115+0000","last_active":"2024-04-26T07:57:35.099064+0000","last_peered":"2024-04-26T07:57:35.099064+0000","last_clean":"2024-04-26T07:57:35.099064+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:57:35.099064+0000","last_undegraded":"2024-04-26T07:57:35.099064+0000","last_fullsized":"2024-04-26T07:57:35.099064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.098977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:27.568866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.618553+0000","last_change":"2024-04-26T07:54:25.034316+0000","last_active":"2024-04-26T07:57:24.618553+0000","last_peered":"2024-04-26T07:57:24.618553+0000","last_clean":"2024-04-26T07:57:24.618553+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:57:24.618553+0000","last_undegraded":"2024-04-26T07:57:24.618553+0000","last_fullsized":"2024-04-26T07:57:24.618553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.163908+0000","last_change":"2024-04-26T07:57:57.163967+0000","last_active":"2024-04-26T07:57:57.163908+0000","last_peered":"2024-04-26T07:57:57.163908+0000","last_clean":"2024-04-26T07:57:57.163908+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:57:57.163908+0000","last_undegraded":"2024-04-26T07:57:57.163908+0000","last_fullsized":"2024-04-26T07:57:57.163908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:57.163800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:57.163800+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.163800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:45.732682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885926+0000","last_change":"2024-04-26T07:54:15.001977+0000","last_active":"2024-04-26T07:56:29.885926+0000","last_peered":"2024-04-26T07:56:29.885926+0000","last_clean":"2024-04-26T07:56:29.885926+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:56:29.885926+0000","last_undegraded":"2024-04-26T07:56:29.885926+0000","last_fullsized":"2024-04-26T07:56:29.885926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.292948+0000","last_change":"2024-04-26T07:57:48.292998+0000","last_active":"2024-04-26T07:57:48.292948+0000","last_peered":"2024-04-26T07:57:48.292948+0000","last_clean":"2024-04-26T07:57:48.292948+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:57:48.292948+0000","last_undegraded":"2024-04-26T07:57:48.292948+0000","last_fullsized":"2024-04-26T07:57:48.292948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.292808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:10.416826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.928685+0000","last_change":"2024-04-26T07:57:44.928755+0000","last_active":"2024-04-26T07:57:44.928685+0000","last_peered":"2024-04-26T07:57:44.928685+0000","last_clean":"2024-04-26T07:57:44.928685+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:57:44.928685+0000","last_undegraded":"2024-04-26T07:57:44.928685+0000","last_fullsized":"2024-04-26T07:57:44.928685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.928570+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.353478+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.037343+0000","last_change":"2024-04-26T07:58:00.037367+0000","last_active":"2024-04-26T07:58:00.037343+0000","last_peered":"2024-04-26T07:58:00.037343+0000","last_clean":"2024-04-26T07:58:00.037343+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:58:00.037343+0000","last_undegraded":"2024-04-26T07:58:00.037343+0000","last_fullsized":"2024-04-26T07:58:00.037343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:00.037251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:00.037251+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.037251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:24.628418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.572543+0000","last_change":"2024-04-26T07:54:25.037903+0000","last_active":"2024-04-26T07:57:24.572543+0000","last_peered":"2024-04-26T07:57:24.572543+0000","last_clean":"2024-04-26T07:57:24.572543+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:57:24.572543+0000","last_undegraded":"2024-04-26T07:57:24.572543+0000","last_fullsized":"2024-04-26T07:57:24.572543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.008147+0000","last_change":"2024-04-26T07:57:52.008175+0000","last_active":"2024-04-26T07:57:52.008147+0000","last_peered":"2024-04-26T07:57:52.008147+0000","last_clean":"2024-04-26T07:57:52.008147+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:52.008147+0000","last_undegraded":"2024-04-26T07:57:52.008147+0000","last_fullsized":"2024-04-26T07:57:52.008147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:52.008051+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:52.008051+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.008051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:54.902871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891326+0000","last_change":"2024-04-26T07:54:15.023312+0000","last_active":"2024-04-26T07:56:24.891326+0000","last_peered":"2024-04-26T07:56:24.891326+0000","last_clean":"2024-04-26T07:56:24.891326+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:56:24.891326+0000","last_undegraded":"2024-04-26T07:56:24.891326+0000","last_fullsized":"2024-04-26T07:56:24.891326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.893092+0000","last_change":"2024-04-26T07:57:56.893157+0000","last_active":"2024-04-26T07:57:56.893092+0000","last_peered":"2024-04-26T07:57:56.893092+0000","last_clean":"2024-04-26T07:57:56.893092+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:57:56.893092+0000","last_undegraded":"2024-04-26T07:57:56.893092+0000","last_fullsized":"2024-04-26T07:57:56.893092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:56.892989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:56.892989+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.892989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:19.992014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.289659+0000","last_change":"2024-04-26T07:57:45.289709+0000","last_active":"2024-04-26T07:57:45.289659+0000","last_peered":"2024-04-26T07:57:45.289659+0000","last_clean":"2024-04-26T07:57:45.289659+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:57:45.289659+0000","last_undegraded":"2024-04-26T07:57:45.289659+0000","last_fullsized":"2024-04-26T07:57:45.289659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.289560+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:24.532087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.293625+0000","last_change":"2024-04-26T07:57:39.293682+0000","last_active":"2024-04-26T07:57:39.293625+0000","last_peered":"2024-04-26T07:57:39.293625+0000","last_clean":"2024-04-26T07:57:39.293625+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:39.293625+0000","last_undegraded":"2024-04-26T07:57:39.293625+0000","last_fullsized":"2024-04-26T07:57:39.293625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.293505+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.009568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'12","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.574516+0000","last_change":"2024-04-26T07:54:25.029180+0000","last_active":"2024-04-26T07:57:24.574516+0000","last_peered":"2024-04-26T07:57:24.574516+0000","last_clean":"2024-04-26T07:57:24.574516+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:57:24.574516+0000","last_undegraded":"2024-04-26T07:57:24.574516+0000","last_fullsized":"2024-04-26T07:57:24.574516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892608+0000","last_change":"2024-04-26T07:54:17.015565+0000","last_active":"2024-04-26T07:56:34.892608+0000","last_peered":"2024-04-26T07:56:34.892608+0000","last_clean":"2024-04-26T07:56:34.892608+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:56:34.892608+0000","last_undegraded":"2024-04-26T07:56:34.892608+0000","last_fullsized":"2024-04-26T07:56:34.892608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891275+0000","last_change":"2024-04-26T07:54:15.028460+0000","last_active":"2024-04-26T07:56:24.891275+0000","last_peered":"2024-04-26T07:56:24.891275+0000","last_clean":"2024-04-26T07:56:24.891275+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:56:24.891275+0000","last_undegraded":"2024-04-26T07:56:24.891275+0000","last_fullsized":"2024-04-26T07:56:24.891275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.055729+0000","last_change":"2024-04-26T07:55:02.064457+0000","last_active":"2024-04-26T07:57:31.055729+0000","last_peered":"2024-04-26T07:57:31.055729+0000","last_clean":"2024-04-26T07:57:31.055729+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:57:31.055729+0000","last_undegraded":"2024-04-26T07:57:31.055729+0000","last_fullsized":"2024-04-26T07:57:31.055729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.098118+0000","last_change":"2024-04-26T07:58:02.098164+0000","last_active":"2024-04-26T07:58:02.098118+0000","last_peered":"2024-04-26T07:58:02.098118+0000","last_clean":"2024-04-26T07:58:02.098118+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:58:02.098118+0000","last_undegraded":"2024-04-26T07:58:02.098118+0000","last_fullsized":"2024-04-26T07:58:02.098118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-04-26T07:58:02.098032+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-04-26T07:58:02.098032+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.098032+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:12.785928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.160493+0000","last_change":"2024-04-26T07:57:36.160522+0000","last_active":"2024-04-26T07:57:36.160493+0000","last_peered":"2024-04-26T07:57:36.160493+0000","last_clean":"2024-04-26T07:57:36.160493+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:36.160493+0000","last_undegraded":"2024-04-26T07:57:36.160493+0000","last_fullsized":"2024-04-26T07:57:36.160493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.160401+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:38.276301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.200682+0000","last_change":"2024-04-26T07:57:55.200716+0000","last_active":"2024-04-26T07:57:55.200682+0000","last_peered":"2024-04-26T07:57:55.200682+0000","last_clean":"2024-04-26T07:57:55.200682+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:57:55.200682+0000","last_undegraded":"2024-04-26T07:57:55.200682+0000","last_fullsized":"2024-04-26T07:57:55.200682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:55.200595+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:55.200595+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.200595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:09.542065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892639+0000","last_change":"2024-04-26T07:54:17.004296+0000","last_active":"2024-04-26T07:56:34.892639+0000","last_peered":"2024-04-26T07:56:34.892639+0000","last_clean":"2024-04-26T07:56:34.892639+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:56:34.892639+0000","last_undegraded":"2024-04-26T07:56:34.892639+0000","last_fullsized":"2024-04-26T07:56:34.892639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.134413+0000","last_change":"2024-04-26T07:54:15.030153+0000","last_active":"2024-04-26T07:57:31.134413+0000","last_peered":"2024-04-26T07:57:31.134413+0000","last_clean":"2024-04-26T07:57:31.134413+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:57:31.134413+0000","last_undegraded":"2024-04-26T07:57:31.134413+0000","last_fullsized":"2024-04-26T07:57:31.134413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.958182+0000","last_change":"2024-04-26T07:57:39.958217+0000","last_active":"2024-04-26T07:57:39.958182+0000","last_peered":"2024-04-26T07:57:39.958182+0000","last_clean":"2024-04-26T07:57:39.958182+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:57:39.958182+0000","last_undegraded":"2024-04-26T07:57:39.958182+0000","last_fullsized":"2024-04-26T07:57:39.958182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.958089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.571578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'50","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.994894+0000","last_change":"2024-04-26T07:57:40.994938+0000","last_active":"2024-04-26T07:57:40.994894+0000","last_peered":"2024-04-26T07:57:40.994894+0000","last_clean":"2024-04-26T07:57:40.994894+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:57:40.994894+0000","last_undegraded":"2024-04-26T07:57:40.994894+0000","last_fullsized":"2024-04-26T07:57:40.994894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.994806+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:36.917229+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.264978+0000","last_change":"2024-04-26T07:57:51.265003+0000","last_active":"2024-04-26T07:57:51.264978+0000","last_peered":"2024-04-26T07:57:51.264978+0000","last_clean":"2024-04-26T07:57:51.264978+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:57:51.264978+0000","last_undegraded":"2024-04-26T07:57:51.264978+0000","last_fullsized":"2024-04-26T07:57:51.264978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:51.264883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:51.264883+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.264883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.713422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.068167+0000","last_change":"2024-04-26T07:57:52.068192+0000","last_active":"2024-04-26T07:57:52.068167+0000","last_peered":"2024-04-26T07:57:52.068167+0000","last_clean":"2024-04-26T07:57:52.068167+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:52.068167+0000","last_undegraded":"2024-04-26T07:57:52.068167+0000","last_fullsized":"2024-04-26T07:57:52.068167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:52.068074+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:52.068074+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.068074+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:08.194548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.445777+0000","last_change":"2024-04-26T07:54:17.016804+0000","last_active":"2024-04-26T07:57:24.445777+0000","last_peered":"2024-04-26T07:57:24.445777+0000","last_clean":"2024-04-26T07:57:24.445777+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:57:24.445777+0000","last_undegraded":"2024-04-26T07:57:24.445777+0000","last_fullsized":"2024-04-26T07:57:24.445777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.557806+0000","last_change":"2024-04-26T07:54:06.676207+0000","last_active":"2024-04-26T07:57:34.557806+0000","last_peered":"2024-04-26T07:57:34.557806+0000","last_clean":"2024-04-26T07:57:34.557806+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:57:34.557806+0000","last_undegraded":"2024-04-26T07:57:34.557806+0000","last_fullsized":"2024-04-26T07:57:34.557806+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.889602+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:56:14.889602+0000","last_peered":"2024-04-26T07:56:14.889602+0000","last_clean":"2024-04-26T07:56:14.889602+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:56:14.889602+0000","last_undegraded":"2024-04-26T07:56:14.889602+0000","last_fullsized":"2024-04-26T07:56:14.889602+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.890420+0000","last_change":"2024-04-26T07:54:15.028934+0000","last_active":"2024-04-26T07:56:19.890420+0000","last_peered":"2024-04-26T07:56:19.890420+0000","last_clean":"2024-04-26T07:56:19.890420+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:56:19.890420+0000","last_undegraded":"2024-04-26T07:56:19.890420+0000","last_fullsized":"2024-04-26T07:56:19.890420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.019402+0000","last_change":"2024-04-26T07:57:51.019436+0000","last_active":"2024-04-26T07:57:51.019402+0000","last_peered":"2024-04-26T07:57:51.019402+0000","last_clean":"2024-04-26T07:57:51.019402+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:57:51.019402+0000","last_undegraded":"2024-04-26T07:57:51.019402+0000","last_fullsized":"2024-04-26T07:57:51.019402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:51.019305+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:51.019305+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.019305+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:10.272637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.023082+0000","last_change":"2024-04-26T07:57:43.023139+0000","last_active":"2024-04-26T07:57:43.023082+0000","last_peered":"2024-04-26T07:57:43.023082+0000","last_clean":"2024-04-26T07:57:43.023082+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:57:43.023082+0000","last_undegraded":"2024-04-26T07:57:43.023082+0000","last_fullsized":"2024-04-26T07:57:43.023082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.022950+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:31.923488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.045605+0000","last_change":"2024-04-26T07:57:38.045637+0000","last_active":"2024-04-26T07:57:38.045605+0000","last_peered":"2024-04-26T07:57:38.045605+0000","last_clean":"2024-04-26T07:57:38.045605+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:57:38.045605+0000","last_undegraded":"2024-04-26T07:57:38.045605+0000","last_fullsized":"2024-04-26T07:57:38.045605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.045507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:26.957086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.526770+0000","last_change":"2024-04-26T07:54:25.027148+0000","last_active":"2024-04-26T07:57:24.526770+0000","last_peered":"2024-04-26T07:57:24.526770+0000","last_clean":"2024-04-26T07:57:24.526770+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:57:24.526770+0000","last_undegraded":"2024-04-26T07:57:24.526770+0000","last_fullsized":"2024-04-26T07:57:24.526770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.215729+0000","last_change":"2024-04-26T07:54:17.013632+0000","last_active":"2024-04-26T07:57:24.215729+0000","last_peered":"2024-04-26T07:57:24.215729+0000","last_clean":"2024-04-26T07:57:24.215729+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:57:24.215729+0000","last_undegraded":"2024-04-26T07:57:24.215729+0000","last_fullsized":"2024-04-26T07:57:24.215729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448153+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:57:35.448153+0000","last_peered":"2024-04-26T07:57:35.448153+0000","last_clean":"2024-04-26T07:57:35.448153+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:57:35.448153+0000","last_undegraded":"2024-04-26T07:57:35.448153+0000","last_fullsized":"2024-04-26T07:57:35.448153+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.132634+0000","last_change":"2024-04-26T07:54:15.007057+0000","last_active":"2024-04-26T07:57:31.132634+0000","last_peered":"2024-04-26T07:57:31.132634+0000","last_clean":"2024-04-26T07:57:31.132634+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:57:31.132634+0000","last_undegraded":"2024-04-26T07:57:31.132634+0000","last_fullsized":"2024-04-26T07:57:31.132634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.922153+0000","last_change":"2024-04-26T07:57:37.922184+0000","last_active":"2024-04-26T07:57:37.922153+0000","last_peered":"2024-04-26T07:57:37.922153+0000","last_clean":"2024-04-26T07:57:37.922153+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:57:37.922153+0000","last_undegraded":"2024-04-26T07:57:37.922153+0000","last_fullsized":"2024-04-26T07:57:37.922153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.922054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:17.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.125119+0000","last_change":"2024-04-26T07:57:38.125161+0000","last_active":"2024-04-26T07:57:38.125119+0000","last_peered":"2024-04-26T07:57:38.125119+0000","last_clean":"2024-04-26T07:57:38.125119+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:38.125119+0000","last_undegraded":"2024-04-26T07:57:38.125119+0000","last_fullsized":"2024-04-26T07:57:38.125119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.125031+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:12.231248+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.031599+0000","last_change":"2024-04-26T07:57:58.031627+0000","last_active":"2024-04-26T07:57:58.031599+0000","last_peered":"2024-04-26T07:57:58.031599+0000","last_clean":"2024-04-26T07:57:58.031599+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:57:58.031599+0000","last_undegraded":"2024-04-26T07:57:58.031599+0000","last_fullsized":"2024-04-26T07:57:58.031599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:58.031507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:58.031507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.031507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:50.696106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.218409+0000","last_change":"2024-04-26T07:58:04.218474+0000","last_active":"2024-04-26T07:58:04.218409+0000","last_peered":"2024-04-26T07:58:04.218409+0000","last_clean":"2024-04-26T07:58:04.218409+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:58:04.218409+0000","last_undegraded":"2024-04-26T07:58:04.218409+0000","last_fullsized":"2024-04-26T07:58:04.218409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:04.218304+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:04.218304+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.218304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:25.813231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.886015+0000","last_change":"2024-04-26T07:54:17.006840+0000","last_active":"2024-04-26T07:56:29.886015+0000","last_peered":"2024-04-26T07:56:29.886015+0000","last_clean":"2024-04-26T07:56:29.886015+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:56:29.886015+0000","last_undegraded":"2024-04-26T07:56:29.886015+0000","last_fullsized":"2024-04-26T07:56:29.886015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:09.888260+0000","last_change":"2024-04-26T07:54:06.674967+0000","last_active":"2024-04-26T07:56:09.888260+0000","last_peered":"2024-04-26T07:56:09.888260+0000","last_clean":"2024-04-26T07:56:09.888260+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:56:09.888260+0000","last_undegraded":"2024-04-26T07:56:09.888260+0000","last_fullsized":"2024-04-26T07:56:09.888260+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.783951+0000","last_change":"2024-04-26T07:58:07.783978+0000","last_active":"2024-04-26T07:58:07.783951+0000","last_peered":"2024-04-26T07:58:07.783951+0000","last_clean":"2024-04-26T07:58:07.783951+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:58:07.783951+0000","last_undegraded":"2024-04-26T07:58:07.783951+0000","last_fullsized":"2024-04-26T07:58:07.783951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:07.783854+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:07.783854+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.783854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:58.598461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.191400+0000","last_change":"2024-04-26T07:57:53.191428+0000","last_active":"2024-04-26T07:57:53.191400+0000","last_peered":"2024-04-26T07:57:53.191400+0000","last_clean":"2024-04-26T07:57:53.191400+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:57:53.191400+0000","last_undegraded":"2024-04-26T07:57:53.191400+0000","last_fullsized":"2024-04-26T07:57:53.191400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:53.191310+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:53.191310+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.191310+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:50.616218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.311964+0000","last_change":"2024-04-26T07:57:42.312009+0000","last_active":"2024-04-26T07:57:42.311964+0000","last_peered":"2024-04-26T07:57:42.311964+0000","last_clean":"2024-04-26T07:57:42.311964+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:42.311964+0000","last_undegraded":"2024-04-26T07:57:42.311964+0000","last_fullsized":"2024-04-26T07:57:42.311964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.311876+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:19:59.304320+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.073422+0000","last_change":"2024-04-26T07:57:37.073448+0000","last_active":"2024-04-26T07:57:37.073422+0000","last_peered":"2024-04-26T07:57:37.073422+0000","last_clean":"2024-04-26T07:57:37.073422+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:57:37.073422+0000","last_undegraded":"2024-04-26T07:57:37.073422+0000","last_fullsized":"2024-04-26T07:57:37.073422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.073329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:12.794354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893856+0000","last_change":"2024-04-26T07:54:25.038740+0000","last_active":"2024-04-26T07:56:39.893856+0000","last_peered":"2024-04-26T07:56:39.893856+0000","last_clean":"2024-04-26T07:56:39.893856+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:56:39.893856+0000","last_undegraded":"2024-04-26T07:56:39.893856+0000","last_fullsized":"2024-04-26T07:56:39.893856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885247+0000","last_change":"2024-04-26T07:54:17.009576+0000","last_active":"2024-04-26T07:56:24.885247+0000","last_peered":"2024-04-26T07:56:24.885247+0000","last_clean":"2024-04-26T07:56:24.885247+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:56:24.885247+0000","last_undegraded":"2024-04-26T07:56:24.885247+0000","last_fullsized":"2024-04-26T07:56:24.885247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:09.888823+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:56:09.888823+0000","last_peered":"2024-04-26T07:56:09.888823+0000","last_clean":"2024-04-26T07:56:09.888823+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:56:09.888823+0000","last_undegraded":"2024-04-26T07:56:09.888823+0000","last_fullsized":"2024-04-26T07:56:09.888823+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.889830+0000","last_change":"2024-04-26T07:54:15.006773+0000","last_active":"2024-04-26T07:56:19.889830+0000","last_peered":"2024-04-26T07:56:19.889830+0000","last_clean":"2024-04-26T07:56:19.889830+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:56:19.889830+0000","last_undegraded":"2024-04-26T07:56:19.889830+0000","last_fullsized":"2024-04-26T07:56:19.889830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.004772+0000","last_change":"2024-04-26T07:57:50.004825+0000","last_active":"2024-04-26T07:57:50.004772+0000","last_peered":"2024-04-26T07:57:50.004772+0000","last_clean":"2024-04-26T07:57:50.004772+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:57:50.004772+0000","last_undegraded":"2024-04-26T07:57:50.004772+0000","last_fullsized":"2024-04-26T07:57:50.004772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:50.004662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:50.004662+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.004662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.926317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.047000+0000","last_change":"2024-04-26T07:58:06.047055+0000","last_active":"2024-04-26T07:58:06.047000+0000","last_peered":"2024-04-26T07:58:06.047000+0000","last_clean":"2024-04-26T07:58:06.047000+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:58:06.047000+0000","last_undegraded":"2024-04-26T07:58:06.047000+0000","last_fullsized":"2024-04-26T07:58:06.047000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:06.046909+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:06.046909+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.046909+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:20.722729+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.989174+0000","last_change":"2024-04-26T07:57:56.989200+0000","last_active":"2024-04-26T07:57:56.989174+0000","last_peered":"2024-04-26T07:57:56.989174+0000","last_clean":"2024-04-26T07:57:56.989174+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:57:56.989174+0000","last_undegraded":"2024-04-26T07:57:56.989174+0000","last_fullsized":"2024-04-26T07:57:56.989174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:56.989067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:56.989067+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.989067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:13.842088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892402+0000","last_change":"2024-04-26T07:54:25.038410+0000","last_active":"2024-04-26T07:56:34.892402+0000","last_peered":"2024-04-26T07:56:34.892402+0000","last_clean":"2024-04-26T07:56:34.892402+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:56:34.892402+0000","last_undegraded":"2024-04-26T07:56:34.892402+0000","last_fullsized":"2024-04-26T07:56:34.892402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.199115+0000","last_change":"2024-04-26T07:57:59.199146+0000","last_active":"2024-04-26T07:57:59.199115+0000","last_peered":"2024-04-26T07:57:59.199115+0000","last_clean":"2024-04-26T07:57:59.199115+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:57:59.199115+0000","last_undegraded":"2024-04-26T07:57:59.199115+0000","last_fullsized":"2024-04-26T07:57:59.199115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:59.199017+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:59.199017+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.199017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:50.799925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.889873+0000","last_change":"2024-04-26T07:54:15.004789+0000","last_active":"2024-04-26T07:56:19.889873+0000","last_peered":"2024-04-26T07:56:19.889873+0000","last_clean":"2024-04-26T07:56:19.889873+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:56:19.889873+0000","last_undegraded":"2024-04-26T07:56:19.889873+0000","last_fullsized":"2024-04-26T07:56:19.889873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883598+0000","last_change":"2024-04-26T07:54:06.676454+0000","last_active":"2024-04-26T07:56:14.883598+0000","last_peered":"2024-04-26T07:56:14.883598+0000","last_clean":"2024-04-26T07:56:14.883598+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:56:14.883598+0000","last_undegraded":"2024-04-26T07:56:14.883598+0000","last_fullsized":"2024-04-26T07:56:14.883598+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.897984+0000","last_change":"2024-04-26T07:57:59.898013+0000","last_active":"2024-04-26T07:57:59.897984+0000","last_peered":"2024-04-26T07:57:59.897984+0000","last_clean":"2024-04-26T07:57:59.897984+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:57:59.897984+0000","last_undegraded":"2024-04-26T07:57:59.897984+0000","last_fullsized":"2024-04-26T07:57:59.897984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:59.897890+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:59.897890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.897890+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:48.189618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'76","reported_seq":152,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.090446+0000","last_change":"2024-04-26T07:57:45.090487+0000","last_active":"2024-04-26T07:57:45.090446+0000","last_peered":"2024-04-26T07:57:45.090446+0000","last_clean":"2024-04-26T07:57:45.090446+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:57:45.090446+0000","last_undegraded":"2024-04-26T07:57:45.090446+0000","last_fullsized":"2024-04-26T07:57:45.090446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'76","last_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_deep_scrub":"29'76","last_deep_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.090359+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:43.280370+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.248700+0000","last_change":"2024-04-26T07:57:37.248747+0000","last_active":"2024-04-26T07:57:37.248700+0000","last_peered":"2024-04-26T07:57:37.248700+0000","last_clean":"2024-04-26T07:57:37.248700+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:57:37.248700+0000","last_undegraded":"2024-04-26T07:57:37.248700+0000","last_fullsized":"2024-04-26T07:57:37.248700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.248591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:12.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.905867+0000","last_change":"2024-04-26T07:57:58.905929+0000","last_active":"2024-04-26T07:57:58.905867+0000","last_peered":"2024-04-26T07:57:58.905867+0000","last_clean":"2024-04-26T07:57:58.905867+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:57:58.905867+0000","last_undegraded":"2024-04-26T07:57:58.905867+0000","last_fullsized":"2024-04-26T07:57:58.905867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:58.905750+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:58.905750+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.905750+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:46.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.301651+0000","last_change":"2024-04-26T07:55:02.058346+0000","last_active":"2024-04-26T07:57:24.301651+0000","last_peered":"2024-04-26T07:57:24.301651+0000","last_clean":"2024-04-26T07:57:24.301651+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:57:24.301651+0000","last_undegraded":"2024-04-26T07:57:24.301651+0000","last_fullsized":"2024-04-26T07:57:24.301651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884338+0000","last_change":"2024-04-26T07:54:15.005472+0000","last_active":"2024-04-26T07:56:19.884338+0000","last_peered":"2024-04-26T07:56:19.884338+0000","last_clean":"2024-04-26T07:56:19.884338+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:56:19.884338+0000","last_undegraded":"2024-04-26T07:56:19.884338+0000","last_fullsized":"2024-04-26T07:56:19.884338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.889652+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:56:14.889652+0000","last_peered":"2024-04-26T07:56:14.889652+0000","last_clean":"2024-04-26T07:56:14.889652+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:56:14.889652+0000","last_undegraded":"2024-04-26T07:56:14.889652+0000","last_fullsized":"2024-04-26T07:56:14.889652+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.944999+0000","last_change":"2024-04-26T07:57:44.945054+0000","last_active":"2024-04-26T07:57:44.944999+0000","last_peered":"2024-04-26T07:57:44.944999+0000","last_clean":"2024-04-26T07:57:44.944999+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:57:44.944999+0000","last_undegraded":"2024-04-26T07:57:44.944999+0000","last_fullsized":"2024-04-26T07:57:44.944999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.944890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:30.234498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.075298+0000","last_change":"2024-04-26T07:57:39.075367+0000","last_active":"2024-04-26T07:57:39.075298+0000","last_peered":"2024-04-26T07:57:39.075298+0000","last_clean":"2024-04-26T07:57:39.075298+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:57:39.075298+0000","last_undegraded":"2024-04-26T07:57:39.075298+0000","last_fullsized":"2024-04-26T07:57:39.075298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.075180+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:53.257286+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":367,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.140045+0000","last_change":"2024-04-26T07:57:35.140074+0000","last_active":"2024-04-26T07:57:35.140045+0000","last_peered":"2024-04-26T07:57:35.140045+0000","last_clean":"2024-04-26T07:57:35.140045+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:35.140045+0000","last_undegraded":"2024-04-26T07:57:35.140045+0000","last_fullsized":"2024-04-26T07:57:35.140045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.139950+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:52.425998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.442585+0000","last_change":"2024-04-26T07:54:25.036034+0000","last_active":"2024-04-26T07:57:24.442585+0000","last_peered":"2024-04-26T07:57:24.442585+0000","last_clean":"2024-04-26T07:57:24.442585+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:57:24.442585+0000","last_undegraded":"2024-04-26T07:57:24.442585+0000","last_fullsized":"2024-04-26T07:57:24.442585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.302506+0000","last_change":"2024-04-26T07:54:17.017609+0000","last_active":"2024-04-26T07:57:24.302506+0000","last_peered":"2024-04-26T07:57:24.302506+0000","last_clean":"2024-04-26T07:57:24.302506+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:57:24.302506+0000","last_undegraded":"2024-04-26T07:57:24.302506+0000","last_fullsized":"2024-04-26T07:57:24.302506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891478+0000","last_change":"2024-04-26T07:54:15.023916+0000","last_active":"2024-04-26T07:56:24.891478+0000","last_peered":"2024-04-26T07:56:24.891478+0000","last_clean":"2024-04-26T07:56:24.891478+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:56:24.891478+0000","last_undegraded":"2024-04-26T07:56:24.891478+0000","last_fullsized":"2024-04-26T07:56:24.891478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.883641+0000","last_change":"2024-04-26T07:54:06.676954+0000","last_active":"2024-04-26T07:56:14.883641+0000","last_peered":"2024-04-26T07:56:14.883641+0000","last_clean":"2024-04-26T07:56:14.883641+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:56:14.883641+0000","last_undegraded":"2024-04-26T07:56:14.883641+0000","last_fullsized":"2024-04-26T07:56:14.883641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.927252+0000","last_change":"2024-04-26T07:57:35.927279+0000","last_active":"2024-04-26T07:57:35.927252+0000","last_peered":"2024-04-26T07:57:35.927252+0000","last_clean":"2024-04-26T07:57:35.927252+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:57:35.927252+0000","last_undegraded":"2024-04-26T07:57:35.927252+0000","last_fullsized":"2024-04-26T07:57:35.927252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.927147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:35.660610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.109532+0000","last_change":"2024-04-26T07:58:04.109570+0000","last_active":"2024-04-26T07:58:04.109532+0000","last_peered":"2024-04-26T07:58:04.109532+0000","last_clean":"2024-04-26T07:58:04.109532+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:58:04.109532+0000","last_undegraded":"2024-04-26T07:58:04.109532+0000","last_fullsized":"2024-04-26T07:58:04.109532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:58:04.109417+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:58:04.109417+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.109417+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:41:43.464915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":441,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.023094+0000","last_change":"2024-04-26T07:57:39.023125+0000","last_active":"2024-04-26T07:57:39.023094+0000","last_peered":"2024-04-26T07:57:39.023094+0000","last_clean":"2024-04-26T07:57:39.023094+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:39.023094+0000","last_undegraded":"2024-04-26T07:57:39.023094+0000","last_fullsized":"2024-04-26T07:57:39.023094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.023000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:21.471539+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893434+0000","last_change":"2024-04-26T07:54:25.036997+0000","last_active":"2024-04-26T07:56:39.893434+0000","last_peered":"2024-04-26T07:56:39.893434+0000","last_clean":"2024-04-26T07:56:39.893434+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:56:39.893434+0000","last_undegraded":"2024-04-26T07:56:39.893434+0000","last_fullsized":"2024-04-26T07:56:39.893434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.223135+0000","last_change":"2024-04-26T07:58:03.223158+0000","last_active":"2024-04-26T07:58:03.223135+0000","last_peered":"2024-04-26T07:58:03.223135+0000","last_clean":"2024-04-26T07:58:03.223135+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:58:03.223135+0000","last_undegraded":"2024-04-26T07:58:03.223135+0000","last_fullsized":"2024-04-26T07:58:03.223135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:03.223053+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:03.223053+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.223053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:51.791934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.191638+0000","last_change":"2024-04-26T07:54:15.009811+0000","last_active":"2024-04-26T07:57:24.191638+0000","last_peered":"2024-04-26T07:57:24.191638+0000","last_clean":"2024-04-26T07:57:24.191638+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:57:24.191638+0000","last_undegraded":"2024-04-26T07:57:24.191638+0000","last_fullsized":"2024-04-26T07:57:24.191638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:14.889695+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:56:14.889695+0000","last_peered":"2024-04-26T07:56:14.889695+0000","last_clean":"2024-04-26T07:56:14.889695+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:56:14.889695+0000","last_undegraded":"2024-04-26T07:56:14.889695+0000","last_fullsized":"2024-04-26T07:56:14.889695+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.983896+0000","last_change":"2024-04-26T07:57:43.983919+0000","last_active":"2024-04-26T07:57:43.983896+0000","last_peered":"2024-04-26T07:57:43.983896+0000","last_clean":"2024-04-26T07:57:43.983896+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:57:43.983896+0000","last_undegraded":"2024-04-26T07:57:43.983896+0000","last_fullsized":"2024-04-26T07:57:43.983896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.983811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:02.584658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.313344+0000","last_change":"2024-04-26T07:57:40.313398+0000","last_active":"2024-04-26T07:57:40.313344+0000","last_peered":"2024-04-26T07:57:40.313344+0000","last_clean":"2024-04-26T07:57:40.313344+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:57:40.313344+0000","last_undegraded":"2024-04-26T07:57:40.313344+0000","last_fullsized":"2024-04-26T07:57:40.313344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.313247+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:44.555766+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.130585+0000","last_change":"2024-04-26T07:57:34.130608+0000","last_active":"2024-04-26T07:57:34.130585+0000","last_peered":"2024-04-26T07:57:34.130585+0000","last_clean":"2024-04-26T07:57:34.130585+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:57:34.130585+0000","last_undegraded":"2024-04-26T07:57:34.130585+0000","last_fullsized":"2024-04-26T07:57:34.130585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_clean_scrub_stamp":"2024-04-26T07:57:34.130497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:01.130219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893453+0000","last_change":"2024-04-26T07:54:25.027810+0000","last_active":"2024-04-26T07:56:39.893453+0000","last_peered":"2024-04-26T07:56:39.893453+0000","last_clean":"2024-04-26T07:56:39.893453+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:56:39.893453+0000","last_undegraded":"2024-04-26T07:56:39.893453+0000","last_fullsized":"2024-04-26T07:56:39.893453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891676+0000","last_change":"2024-04-26T07:54:25.026977+0000","last_active":"2024-04-26T07:56:29.891676+0000","last_peered":"2024-04-26T07:56:29.891676+0000","last_clean":"2024-04-26T07:56:29.891676+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:56:29.891676+0000","last_undegraded":"2024-04-26T07:56:29.891676+0000","last_fullsized":"2024-04-26T07:56:29.891676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.246787+0000","last_change":"2024-04-26T07:58:07.246815+0000","last_active":"2024-04-26T07:58:07.246787+0000","last_peered":"2024-04-26T07:58:07.246787+0000","last_clean":"2024-04-26T07:58:07.246787+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:58:07.246787+0000","last_undegraded":"2024-04-26T07:58:07.246787+0000","last_fullsized":"2024-04-26T07:58:07.246787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:07.246695+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:07.246695+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.246695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.647472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893033+0000","last_change":"2024-04-26T07:54:15.030451+0000","last_active":"2024-04-26T07:56:34.893033+0000","last_peered":"2024-04-26T07:56:34.893033+0000","last_clean":"2024-04-26T07:56:34.893033+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:56:34.893033+0000","last_undegraded":"2024-04-26T07:56:34.893033+0000","last_fullsized":"2024-04-26T07:56:34.893033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.997479+0000","last_change":"2024-04-26T07:57:49.997522+0000","last_active":"2024-04-26T07:57:49.997479+0000","last_peered":"2024-04-26T07:57:49.997479+0000","last_clean":"2024-04-26T07:57:49.997479+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:57:49.997479+0000","last_undegraded":"2024-04-26T07:57:49.997479+0000","last_fullsized":"2024-04-26T07:57:49.997479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.997377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.997377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.997377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:50.303288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.959591+0000","last_change":"2024-04-26T07:57:38.959627+0000","last_active":"2024-04-26T07:57:38.959591+0000","last_peered":"2024-04-26T07:57:38.959591+0000","last_clean":"2024-04-26T07:57:38.959591+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:57:38.959591+0000","last_undegraded":"2024-04-26T07:57:38.959591+0000","last_fullsized":"2024-04-26T07:57:38.959591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.959495+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:02.058520+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.004289+0000","last_change":"2024-04-26T07:57:59.004319+0000","last_active":"2024-04-26T07:57:59.004289+0000","last_peered":"2024-04-26T07:57:59.004289+0000","last_clean":"2024-04-26T07:57:59.004289+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:57:59.004289+0000","last_undegraded":"2024-04-26T07:57:59.004289+0000","last_fullsized":"2024-04-26T07:57:59.004289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:59.004197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:59.004197+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.004197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.386140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885268+0000","last_change":"2024-04-26T07:54:25.036781+0000","last_active":"2024-04-26T07:56:24.885268+0000","last_peered":"2024-04-26T07:56:24.885268+0000","last_clean":"2024-04-26T07:56:24.885268+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:56:24.885268+0000","last_undegraded":"2024-04-26T07:56:24.885268+0000","last_fullsized":"2024-04-26T07:56:24.885268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.212852+0000","last_change":"2024-04-26T07:57:58.212898+0000","last_active":"2024-04-26T07:57:58.212852+0000","last_peered":"2024-04-26T07:57:58.212852+0000","last_clean":"2024-04-26T07:57:58.212852+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:58.212852+0000","last_undegraded":"2024-04-26T07:57:58.212852+0000","last_fullsized":"2024-04-26T07:57:58.212852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:57:58.212714+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:57:58.212714+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.212714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:57.946177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893427+0000","last_change":"2024-04-26T07:54:15.016903+0000","last_active":"2024-04-26T07:56:39.893427+0000","last_peered":"2024-04-26T07:56:39.893427+0000","last_clean":"2024-04-26T07:56:39.893427+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:56:39.893427+0000","last_undegraded":"2024-04-26T07:56:39.893427+0000","last_fullsized":"2024-04-26T07:56:39.893427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.982361+0000","last_change":"2024-04-26T07:57:45.982384+0000","last_active":"2024-04-26T07:57:45.982361+0000","last_peered":"2024-04-26T07:57:45.982361+0000","last_clean":"2024-04-26T07:57:45.982361+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:57:45.982361+0000","last_undegraded":"2024-04-26T07:57:45.982361+0000","last_fullsized":"2024-04-26T07:57:45.982361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.982268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:08.199956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.056129+0000","last_change":"2024-04-26T07:57:49.056205+0000","last_active":"2024-04-26T07:57:49.056129+0000","last_peered":"2024-04-26T07:57:49.056129+0000","last_clean":"2024-04-26T07:57:49.056129+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:49.056129+0000","last_undegraded":"2024-04-26T07:57:49.056129+0000","last_fullsized":"2024-04-26T07:57:49.056129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.056026+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:29.927433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.282662+0000","last_change":"2024-04-26T07:57:47.282688+0000","last_active":"2024-04-26T07:57:47.282662+0000","last_peered":"2024-04-26T07:57:47.282662+0000","last_clean":"2024-04-26T07:57:47.282662+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:57:47.282662+0000","last_undegraded":"2024-04-26T07:57:47.282662+0000","last_fullsized":"2024-04-26T07:57:47.282662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.282574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.890046+0000","last_change":"2024-04-26T07:54:25.029345+0000","last_active":"2024-04-26T07:56:54.890046+0000","last_peered":"2024-04-26T07:56:54.890046+0000","last_clean":"2024-04-26T07:56:54.890046+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:56:54.890046+0000","last_undegraded":"2024-04-26T07:56:54.890046+0000","last_fullsized":"2024-04-26T07:56:54.890046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'5","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567388+0000","last_change":"2024-04-26T07:55:02.054995+0000","last_active":"2024-04-26T07:57:24.567388+0000","last_peered":"2024-04-26T07:57:24.567388+0000","last_clean":"2024-04-26T07:57:24.567388+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:57:24.567388+0000","last_undegraded":"2024-04-26T07:57:24.567388+0000","last_fullsized":"2024-04-26T07:57:24.567388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.238344+0000","last_change":"2024-04-26T07:58:08.238368+0000","last_active":"2024-04-26T07:58:08.238344+0000","last_peered":"2024-04-26T07:58:08.238344+0000","last_clean":"2024-04-26T07:58:08.238344+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:58:08.238344+0000","last_undegraded":"2024-04-26T07:58:08.238344+0000","last_fullsized":"2024-04-26T07:58:08.238344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:08.238248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:08.238248+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.238248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:31.337273+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.302541+0000","last_change":"2024-04-26T07:57:50.302582+0000","last_active":"2024-04-26T07:57:50.302541+0000","last_peered":"2024-04-26T07:57:50.302541+0000","last_clean":"2024-04-26T07:57:50.302541+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:57:50.302541+0000","last_undegraded":"2024-04-26T07:57:50.302541+0000","last_fullsized":"2024-04-26T07:57:50.302541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:50.302445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:50.302445+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.302445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:36.538951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.027530+0000","last_change":"2024-04-26T07:57:48.027568+0000","last_active":"2024-04-26T07:57:48.027530+0000","last_peered":"2024-04-26T07:57:48.027530+0000","last_clean":"2024-04-26T07:57:48.027530+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:48.027530+0000","last_undegraded":"2024-04-26T07:57:48.027530+0000","last_fullsized":"2024-04-26T07:57:48.027530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.027433+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:59.750634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.116012+0000","last_change":"2024-04-26T07:57:37.116071+0000","last_active":"2024-04-26T07:57:37.116012+0000","last_peered":"2024-04-26T07:57:37.116012+0000","last_clean":"2024-04-26T07:57:37.116012+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:57:37.116012+0000","last_undegraded":"2024-04-26T07:57:37.116012+0000","last_fullsized":"2024-04-26T07:57:37.116012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.115909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:16.358436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.896475+0000","last_change":"2024-04-26T07:54:25.040358+0000","last_active":"2024-04-26T07:56:54.896475+0000","last_peered":"2024-04-26T07:56:54.896475+0000","last_clean":"2024-04-26T07:56:54.896475+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:56:54.896475+0000","last_undegraded":"2024-04-26T07:56:54.896475+0000","last_fullsized":"2024-04-26T07:56:54.896475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.087168+0000","last_change":"2024-04-26T07:58:09.087254+0000","last_active":"2024-04-26T07:58:09.087168+0000","last_peered":"2024-04-26T07:58:09.087168+0000","last_clean":"2024-04-26T07:58:09.087168+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:58:09.087168+0000","last_undegraded":"2024-04-26T07:58:09.087168+0000","last_fullsized":"2024-04-26T07:58:09.087168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:09.087056+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:09.087056+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.087056+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:44.220939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893576+0000","last_change":"2024-04-26T07:54:15.016622+0000","last_active":"2024-04-26T07:56:39.893576+0000","last_peered":"2024-04-26T07:56:39.893576+0000","last_clean":"2024-04-26T07:56:39.893576+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:56:39.893576+0000","last_undegraded":"2024-04-26T07:56:39.893576+0000","last_fullsized":"2024-04-26T07:56:39.893576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.947053+0000","last_change":"2024-04-26T07:57:36.947105+0000","last_active":"2024-04-26T07:57:36.947053+0000","last_peered":"2024-04-26T07:57:36.947053+0000","last_clean":"2024-04-26T07:57:36.947053+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:57:36.947053+0000","last_undegraded":"2024-04-26T07:57:36.947053+0000","last_fullsized":"2024-04-26T07:57:36.947053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.946930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.547838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.306049+0000","last_change":"2024-04-26T07:57:44.306091+0000","last_active":"2024-04-26T07:57:44.306049+0000","last_peered":"2024-04-26T07:57:44.306049+0000","last_clean":"2024-04-26T07:57:44.306049+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:57:44.306049+0000","last_undegraded":"2024-04-26T07:57:44.306049+0000","last_fullsized":"2024-04-26T07:57:44.306049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.305938+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:46.421838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.210692+0000","last_change":"2024-04-26T07:57:36.210716+0000","last_active":"2024-04-26T07:57:36.210692+0000","last_peered":"2024-04-26T07:57:36.210692+0000","last_clean":"2024-04-26T07:57:36.210692+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:57:36.210692+0000","last_undegraded":"2024-04-26T07:57:36.210692+0000","last_fullsized":"2024-04-26T07:57:36.210692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.210600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:49.401154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.215684+0000","last_change":"2024-04-26T07:54:17.009497+0000","last_active":"2024-04-26T07:57:24.215684+0000","last_peered":"2024-04-26T07:57:24.215684+0000","last_clean":"2024-04-26T07:57:24.215684+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:57:24.215684+0000","last_undegraded":"2024-04-26T07:57:24.215684+0000","last_fullsized":"2024-04-26T07:57:24.215684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893750+0000","last_change":"2024-04-26T07:54:15.030594+0000","last_active":"2024-04-26T07:56:39.893750+0000","last_peered":"2024-04-26T07:56:39.893750+0000","last_clean":"2024-04-26T07:56:39.893750+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:56:39.893750+0000","last_undegraded":"2024-04-26T07:56:39.893750+0000","last_fullsized":"2024-04-26T07:56:39.893750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.995725+0000","last_change":"2024-04-26T07:57:51.995801+0000","last_active":"2024-04-26T07:57:51.995725+0000","last_peered":"2024-04-26T07:57:51.995725+0000","last_clean":"2024-04-26T07:57:51.995725+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:57:51.995725+0000","last_undegraded":"2024-04-26T07:57:51.995725+0000","last_fullsized":"2024-04-26T07:57:51.995725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:51.995599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:51.995599+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.995599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:40.564480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.077254+0000","last_change":"2024-04-26T07:57:46.077293+0000","last_active":"2024-04-26T07:57:46.077254+0000","last_peered":"2024-04-26T07:57:46.077254+0000","last_clean":"2024-04-26T07:57:46.077254+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:57:46.077254+0000","last_undegraded":"2024-04-26T07:57:46.077254+0000","last_fullsized":"2024-04-26T07:57:46.077254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.077156+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:26.087961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.249784+0000","last_change":"2024-04-26T07:57:35.249823+0000","last_active":"2024-04-26T07:57:35.249784+0000","last_peered":"2024-04-26T07:57:35.249784+0000","last_clean":"2024-04-26T07:57:35.249784+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:57:35.249784+0000","last_undegraded":"2024-04-26T07:57:35.249784+0000","last_fullsized":"2024-04-26T07:57:35.249784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.249689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:56.788608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.888285+0000","last_change":"2024-04-26T07:54:25.029358+0000","last_active":"2024-04-26T07:56:44.888285+0000","last_peered":"2024-04-26T07:56:44.888285+0000","last_clean":"2024-04-26T07:56:44.888285+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:56:44.888285+0000","last_undegraded":"2024-04-26T07:56:44.888285+0000","last_fullsized":"2024-04-26T07:56:44.888285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.884379+0000","last_change":"2024-04-26T07:54:17.006732+0000","last_active":"2024-04-26T07:56:19.884379+0000","last_peered":"2024-04-26T07:56:19.884379+0000","last_clean":"2024-04-26T07:56:19.884379+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:56:19.884379+0000","last_undegraded":"2024-04-26T07:56:19.884379+0000","last_fullsized":"2024-04-26T07:56:19.884379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893300+0000","last_change":"2024-04-26T07:54:15.016457+0000","last_active":"2024-04-26T07:56:39.893300+0000","last_peered":"2024-04-26T07:56:39.893300+0000","last_clean":"2024-04-26T07:56:39.893300+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:56:39.893300+0000","last_undegraded":"2024-04-26T07:56:39.893300+0000","last_fullsized":"2024-04-26T07:56:39.893300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.221946+0000","last_change":"2024-04-26T07:57:52.221980+0000","last_active":"2024-04-26T07:57:52.221946+0000","last_peered":"2024-04-26T07:57:52.221946+0000","last_clean":"2024-04-26T07:57:52.221946+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:57:52.221946+0000","last_undegraded":"2024-04-26T07:57:52.221946+0000","last_fullsized":"2024-04-26T07:57:52.221946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:52.221848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:52.221848+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.221848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.404236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.958887+0000","last_change":"2024-04-26T07:57:48.958926+0000","last_active":"2024-04-26T07:57:48.958887+0000","last_peered":"2024-04-26T07:57:48.958887+0000","last_clean":"2024-04-26T07:57:48.958887+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:57:48.958887+0000","last_undegraded":"2024-04-26T07:57:48.958887+0000","last_fullsized":"2024-04-26T07:57:48.958887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.958790+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:19.997051+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.961696+0000","last_change":"2024-04-26T07:57:43.961722+0000","last_active":"2024-04-26T07:57:43.961696+0000","last_peered":"2024-04-26T07:57:43.961696+0000","last_clean":"2024-04-26T07:57:43.961696+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:57:43.961696+0000","last_undegraded":"2024-04-26T07:57:43.961696+0000","last_fullsized":"2024-04-26T07:57:43.961696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.961597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:55.126179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894677+0000","last_change":"2024-04-26T07:54:25.040148+0000","last_active":"2024-04-26T07:56:44.894677+0000","last_peered":"2024-04-26T07:56:44.894677+0000","last_clean":"2024-04-26T07:56:44.894677+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:56:44.894677+0000","last_undegraded":"2024-04-26T07:56:44.894677+0000","last_fullsized":"2024-04-26T07:56:44.894677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.901326+0000","last_change":"2024-04-26T07:55:02.061611+0000","last_active":"2024-04-26T07:57:34.901326+0000","last_peered":"2024-04-26T07:57:34.901326+0000","last_clean":"2024-04-26T07:57:34.901326+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:57:34.901326+0000","last_undegraded":"2024-04-26T07:57:34.901326+0000","last_fullsized":"2024-04-26T07:57:34.901326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894233+0000","last_change":"2024-04-26T07:54:15.009041+0000","last_active":"2024-04-26T07:56:44.894233+0000","last_peered":"2024-04-26T07:56:44.894233+0000","last_clean":"2024-04-26T07:56:44.894233+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:56:44.894233+0000","last_undegraded":"2024-04-26T07:56:44.894233+0000","last_fullsized":"2024-04-26T07:56:44.894233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.182373+0000","last_change":"2024-04-26T07:57:54.182399+0000","last_active":"2024-04-26T07:57:54.182373+0000","last_peered":"2024-04-26T07:57:54.182373+0000","last_clean":"2024-04-26T07:57:54.182373+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:57:54.182373+0000","last_undegraded":"2024-04-26T07:57:54.182373+0000","last_fullsized":"2024-04-26T07:57:54.182373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.182281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.182281+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.182281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:41.982170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.036494+0000","last_change":"2024-04-26T07:57:42.036534+0000","last_active":"2024-04-26T07:57:42.036494+0000","last_peered":"2024-04-26T07:57:42.036494+0000","last_clean":"2024-04-26T07:57:42.036494+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:57:42.036494+0000","last_undegraded":"2024-04-26T07:57:42.036494+0000","last_fullsized":"2024-04-26T07:57:42.036494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.036391+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:51.097848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.970888+0000","last_change":"2024-04-26T07:57:54.970937+0000","last_active":"2024-04-26T07:57:54.970888+0000","last_peered":"2024-04-26T07:57:54.970888+0000","last_clean":"2024-04-26T07:57:54.970888+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:57:54.970888+0000","last_undegraded":"2024-04-26T07:57:54.970888+0000","last_fullsized":"2024-04-26T07:57:54.970888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.970780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.970780+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.970780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:03.765699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894650+0000","last_change":"2024-04-26T07:54:25.039740+0000","last_active":"2024-04-26T07:56:44.894650+0000","last_peered":"2024-04-26T07:56:44.894650+0000","last_clean":"2024-04-26T07:56:44.894650+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:56:44.894650+0000","last_undegraded":"2024-04-26T07:56:44.894650+0000","last_fullsized":"2024-04-26T07:56:44.894650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.301782+0000","last_change":"2024-04-26T07:54:17.009954+0000","last_active":"2024-04-26T07:57:24.301782+0000","last_peered":"2024-04-26T07:57:24.301782+0000","last_clean":"2024-04-26T07:57:24.301782+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:57:24.301782+0000","last_undegraded":"2024-04-26T07:57:24.301782+0000","last_fullsized":"2024-04-26T07:57:24.301782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.423569+0000","last_change":"2024-04-26T07:54:15.028318+0000","last_active":"2024-04-26T07:57:24.423569+0000","last_peered":"2024-04-26T07:57:24.423569+0000","last_clean":"2024-04-26T07:57:24.423569+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:57:24.423569+0000","last_undegraded":"2024-04-26T07:57:24.423569+0000","last_fullsized":"2024-04-26T07:57:24.423569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.053008+0000","last_change":"2024-04-26T07:57:53.053059+0000","last_active":"2024-04-26T07:57:53.053008+0000","last_peered":"2024-04-26T07:57:53.053008+0000","last_clean":"2024-04-26T07:57:53.053008+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:57:53.053008+0000","last_undegraded":"2024-04-26T07:57:53.053008+0000","last_fullsized":"2024-04-26T07:57:53.053008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:53.052892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:53.052892+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.052892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:33.924298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.067455+0000","last_change":"2024-04-26T07:58:01.067489+0000","last_active":"2024-04-26T07:58:01.067455+0000","last_peered":"2024-04-26T07:58:01.067455+0000","last_clean":"2024-04-26T07:58:01.067455+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:58:01.067455+0000","last_undegraded":"2024-04-26T07:58:01.067455+0000","last_fullsized":"2024-04-26T07:58:01.067455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-04-26T07:58:01.067368+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-04-26T07:58:01.067368+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.067368+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:37.830475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.315346+0000","last_change":"2024-04-26T07:57:43.315390+0000","last_active":"2024-04-26T07:57:43.315346+0000","last_peered":"2024-04-26T07:57:43.315346+0000","last_clean":"2024-04-26T07:57:43.315346+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:43.315346+0000","last_undegraded":"2024-04-26T07:57:43.315346+0000","last_fullsized":"2024-04-26T07:57:43.315346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.315236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:00.601284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894547+0000","last_change":"2024-04-26T07:54:25.037610+0000","last_active":"2024-04-26T07:56:44.894547+0000","last_peered":"2024-04-26T07:56:44.894547+0000","last_clean":"2024-04-26T07:56:44.894547+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:56:44.894547+0000","last_undegraded":"2024-04-26T07:56:44.894547+0000","last_fullsized":"2024-04-26T07:56:44.894547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.180634+0000","last_change":"2024-04-26T07:58:01.180680+0000","last_active":"2024-04-26T07:58:01.180634+0000","last_peered":"2024-04-26T07:58:01.180634+0000","last_clean":"2024-04-26T07:58:01.180634+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:58:01.180634+0000","last_undegraded":"2024-04-26T07:58:01.180634+0000","last_fullsized":"2024-04-26T07:58:01.180634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:01.180506+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:01.180506+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.180506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:09.102162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894282+0000","last_change":"2024-04-26T07:54:15.017919+0000","last_active":"2024-04-26T07:56:44.894282+0000","last_peered":"2024-04-26T07:56:44.894282+0000","last_clean":"2024-04-26T07:56:44.894282+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:56:44.894282+0000","last_undegraded":"2024-04-26T07:56:44.894282+0000","last_fullsized":"2024-04-26T07:56:44.894282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.947474+0000","last_change":"2024-04-26T07:57:48.947503+0000","last_active":"2024-04-26T07:57:48.947474+0000","last_peered":"2024-04-26T07:57:48.947474+0000","last_clean":"2024-04-26T07:57:48.947474+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:57:48.947474+0000","last_undegraded":"2024-04-26T07:57:48.947474+0000","last_fullsized":"2024-04-26T07:57:48.947474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.947377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:11.025758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.943225+0000","last_change":"2024-04-26T07:57:41.943262+0000","last_active":"2024-04-26T07:57:41.943225+0000","last_peered":"2024-04-26T07:57:41.943225+0000","last_clean":"2024-04-26T07:57:41.943225+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:57:41.943225+0000","last_undegraded":"2024-04-26T07:57:41.943225+0000","last_fullsized":"2024-04-26T07:57:41.943225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.943141+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:28.179647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.021097+0000","last_change":"2024-04-26T07:57:41.021136+0000","last_active":"2024-04-26T07:57:41.021097+0000","last_peered":"2024-04-26T07:57:41.021097+0000","last_clean":"2024-04-26T07:57:41.021097+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:57:41.021097+0000","last_undegraded":"2024-04-26T07:57:41.021097+0000","last_fullsized":"2024-04-26T07:57:41.021097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.021008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.165091+0000","last_change":"2024-04-26T07:58:00.165117+0000","last_active":"2024-04-26T07:58:00.165091+0000","last_peered":"2024-04-26T07:58:00.165091+0000","last_clean":"2024-04-26T07:58:00.165091+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:58:00.165091+0000","last_undegraded":"2024-04-26T07:58:00.165091+0000","last_fullsized":"2024-04-26T07:58:00.165091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:00.164987+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:00.164987+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.164987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:08.922542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'20","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.149371+0000","last_change":"2024-04-26T07:57:59.149404+0000","last_active":"2024-04-26T07:57:59.149371+0000","last_peered":"2024-04-26T07:57:59.149371+0000","last_clean":"2024-04-26T07:57:59.149371+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:59.149371+0000","last_undegraded":"2024-04-26T07:57:59.149371+0000","last_fullsized":"2024-04-26T07:57:59.149371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:57:59.149277+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:57:59.149277+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.149277+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:10.872478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894840+0000","last_change":"2024-04-26T07:54:15.028304+0000","last_active":"2024-04-26T07:56:44.894840+0000","last_peered":"2024-04-26T07:56:44.894840+0000","last_clean":"2024-04-26T07:56:44.894840+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:56:44.894840+0000","last_undegraded":"2024-04-26T07:56:44.894840+0000","last_fullsized":"2024-04-26T07:56:44.894840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.256297+0000","last_change":"2024-04-26T07:57:49.256322+0000","last_active":"2024-04-26T07:57:49.256297+0000","last_peered":"2024-04-26T07:57:49.256297+0000","last_clean":"2024-04-26T07:57:49.256297+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:57:49.256297+0000","last_undegraded":"2024-04-26T07:57:49.256297+0000","last_fullsized":"2024-04-26T07:57:49.256297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.256204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:45.178627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.053585+0000","last_change":"2024-04-26T07:57:44.053621+0000","last_active":"2024-04-26T07:57:44.053585+0000","last_peered":"2024-04-26T07:57:44.053585+0000","last_clean":"2024-04-26T07:57:44.053585+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:57:44.053585+0000","last_undegraded":"2024-04-26T07:57:44.053585+0000","last_fullsized":"2024-04-26T07:57:44.053585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.053488+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:48.845821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.141915+0000","last_change":"2024-04-26T07:58:03.141983+0000","last_active":"2024-04-26T07:58:03.141915+0000","last_peered":"2024-04-26T07:58:03.141915+0000","last_clean":"2024-04-26T07:58:03.141915+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:58:03.141915+0000","last_undegraded":"2024-04-26T07:58:03.141915+0000","last_fullsized":"2024-04-26T07:58:03.141915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:03.141810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:03.141810+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.141810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:54.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.491013+0000","last_change":"2024-04-26T07:54:25.035955+0000","last_active":"2024-04-26T07:57:24.491013+0000","last_peered":"2024-04-26T07:57:24.491013+0000","last_clean":"2024-04-26T07:57:24.491013+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:57:24.491013+0000","last_undegraded":"2024-04-26T07:57:24.491013+0000","last_fullsized":"2024-04-26T07:57:24.491013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.489775+0000","last_change":"2024-04-26T07:54:17.010362+0000","last_active":"2024-04-26T07:57:24.489775+0000","last_peered":"2024-04-26T07:57:24.489775+0000","last_clean":"2024-04-26T07:57:24.489775+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:57:24.489775+0000","last_undegraded":"2024-04-26T07:57:24.489775+0000","last_fullsized":"2024-04-26T07:57:24.489775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.763647+0000","last_change":"2024-04-26T07:58:05.763673+0000","last_active":"2024-04-26T07:58:05.763647+0000","last_peered":"2024-04-26T07:58:05.763647+0000","last_clean":"2024-04-26T07:58:05.763647+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:58:05.763647+0000","last_undegraded":"2024-04-26T07:58:05.763647+0000","last_fullsized":"2024-04-26T07:58:05.763647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:05.763543+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:05.763543+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.763543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:45.093021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.087876+0000","last_change":"2024-04-26T07:57:54.087902+0000","last_active":"2024-04-26T07:57:54.087876+0000","last_peered":"2024-04-26T07:57:54.087876+0000","last_clean":"2024-04-26T07:57:54.087876+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:57:54.087876+0000","last_undegraded":"2024-04-26T07:57:54.087876+0000","last_fullsized":"2024-04-26T07:57:54.087876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.087782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.087782+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.087782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:11.296546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.976695+0000","last_change":"2024-04-26T07:57:40.976750+0000","last_active":"2024-04-26T07:57:40.976695+0000","last_peered":"2024-04-26T07:57:40.976695+0000","last_clean":"2024-04-26T07:57:40.976695+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:57:40.976695+0000","last_undegraded":"2024-04-26T07:57:40.976695+0000","last_fullsized":"2024-04-26T07:57:40.976695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.976569+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:47.248039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.896364+0000","last_change":"2024-04-26T07:54:23.036351+0000","last_active":"2024-04-26T07:56:54.896364+0000","last_peered":"2024-04-26T07:56:54.896364+0000","last_clean":"2024-04-26T07:56:54.896364+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:56:54.896364+0000","last_undegraded":"2024-04-26T07:56:54.896364+0000","last_fullsized":"2024-04-26T07:56:54.896364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:22.002978+0000","last_clean_scrub_stamp":"2024-04-26T07:54:22.002978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.213315+0000","last_change":"2024-04-26T07:54:25.039985+0000","last_active":"2024-04-26T07:57:24.213315+0000","last_peered":"2024-04-26T07:57:24.213315+0000","last_clean":"2024-04-26T07:57:24.213315+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:57:24.213315+0000","last_undegraded":"2024-04-26T07:57:24.213315+0000","last_fullsized":"2024-04-26T07:57:24.213315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.198470+0000","last_change":"2024-04-26T07:57:57.198497+0000","last_active":"2024-04-26T07:57:57.198470+0000","last_peered":"2024-04-26T07:57:57.198470+0000","last_clean":"2024-04-26T07:57:57.198470+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:57:57.198470+0000","last_undegraded":"2024-04-26T07:57:57.198470+0000","last_fullsized":"2024-04-26T07:57:57.198470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:57:57.198375+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:57:57.198375+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.198375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:37.209180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.889985+0000","last_change":"2024-04-26T07:54:15.019611+0000","last_active":"2024-04-26T07:56:19.889985+0000","last_peered":"2024-04-26T07:56:19.889985+0000","last_clean":"2024-04-26T07:56:19.889985+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:56:19.889985+0000","last_undegraded":"2024-04-26T07:56:19.889985+0000","last_fullsized":"2024-04-26T07:56:19.889985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.971170+0000","last_change":"2024-04-26T07:57:45.971199+0000","last_active":"2024-04-26T07:57:45.971170+0000","last_peered":"2024-04-26T07:57:45.971170+0000","last_clean":"2024-04-26T07:57:45.971170+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:57:45.971170+0000","last_undegraded":"2024-04-26T07:57:45.971170+0000","last_fullsized":"2024-04-26T07:57:45.971170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.971081+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.019853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'42","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.079461+0000","last_change":"2024-04-26T07:58:08.079511+0000","last_active":"2024-04-26T07:58:08.079461+0000","last_peered":"2024-04-26T07:58:08.079461+0000","last_clean":"2024-04-26T07:58:08.079461+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:58:08.079461+0000","last_undegraded":"2024-04-26T07:58:08.079461+0000","last_fullsized":"2024-04-26T07:58:08.079461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-04-26T07:58:08.079369+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-04-26T07:58:08.079369+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.079369+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:26.015619+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.018075+0000","last_change":"2024-04-26T07:57:40.018100+0000","last_active":"2024-04-26T07:57:40.018075+0000","last_peered":"2024-04-26T07:57:40.018075+0000","last_clean":"2024-04-26T07:57:40.018075+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:57:40.018075+0000","last_undegraded":"2024-04-26T07:57:40.018075+0000","last_fullsized":"2024-04-26T07:57:40.018075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.017985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:33.200374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894775+0000","last_change":"2024-04-26T07:54:25.040953+0000","last_active":"2024-04-26T07:56:44.894775+0000","last_peered":"2024-04-26T07:56:44.894775+0000","last_clean":"2024-04-26T07:56:44.894775+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:56:44.894775+0000","last_undegraded":"2024-04-26T07:56:44.894775+0000","last_fullsized":"2024-04-26T07:56:44.894775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.891633+0000","last_change":"2024-04-26T07:54:17.004457+0000","last_active":"2024-04-26T07:56:29.891633+0000","last_peered":"2024-04-26T07:56:29.891633+0000","last_clean":"2024-04-26T07:56:29.891633+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:56:29.891633+0000","last_undegraded":"2024-04-26T07:56:29.891633+0000","last_fullsized":"2024-04-26T07:56:29.891633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.175168+0000","last_change":"2024-04-26T07:58:02.175200+0000","last_active":"2024-04-26T07:58:02.175168+0000","last_peered":"2024-04-26T07:58:02.175168+0000","last_clean":"2024-04-26T07:58:02.175168+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:58:02.175168+0000","last_undegraded":"2024-04-26T07:58:02.175168+0000","last_fullsized":"2024-04-26T07:58:02.175168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:02.175070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:02.175070+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.175070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:01:08.295392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.910834+0000","last_change":"2024-04-26T07:58:00.910862+0000","last_active":"2024-04-26T07:58:00.910834+0000","last_peered":"2024-04-26T07:58:00.910834+0000","last_clean":"2024-04-26T07:58:00.910834+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:58:00.910834+0000","last_undegraded":"2024-04-26T07:58:00.910834+0000","last_fullsized":"2024-04-26T07:58:00.910834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:00.910724+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:00.910724+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.910724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:49.811262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.427600+0000","last_change":"2024-04-26T07:54:15.001522+0000","last_active":"2024-04-26T07:57:24.427600+0000","last_peered":"2024-04-26T07:57:24.427600+0000","last_clean":"2024-04-26T07:57:24.427600+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:57:24.427600+0000","last_undegraded":"2024-04-26T07:57:24.427600+0000","last_fullsized":"2024-04-26T07:57:24.427600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892237+0000","last_change":"2024-04-26T07:54:17.010190+0000","last_active":"2024-04-26T07:56:29.892237+0000","last_peered":"2024-04-26T07:56:29.892237+0000","last_clean":"2024-04-26T07:56:29.892237+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:56:29.892237+0000","last_undegraded":"2024-04-26T07:56:29.892237+0000","last_fullsized":"2024-04-26T07:56:29.892237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:19.890398+0000","last_change":"2024-04-26T07:54:15.025512+0000","last_active":"2024-04-26T07:56:19.890398+0000","last_peered":"2024-04-26T07:56:19.890398+0000","last_clean":"2024-04-26T07:56:19.890398+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:56:19.890398+0000","last_undegraded":"2024-04-26T07:56:19.890398+0000","last_fullsized":"2024-04-26T07:56:19.890398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885958+0000","last_change":"2024-04-26T07:54:17.009848+0000","last_active":"2024-04-26T07:56:29.885958+0000","last_peered":"2024-04-26T07:56:29.885958+0000","last_clean":"2024-04-26T07:56:29.885958+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:56:29.885958+0000","last_undegraded":"2024-04-26T07:56:29.885958+0000","last_fullsized":"2024-04-26T07:56:29.885958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.133860+0000","last_change":"2024-04-26T07:54:15.005595+0000","last_active":"2024-04-26T07:57:31.133860+0000","last_peered":"2024-04-26T07:57:31.133860+0000","last_clean":"2024-04-26T07:57:31.133860+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:57:31.133860+0000","last_undegraded":"2024-04-26T07:57:31.133860+0000","last_fullsized":"2024-04-26T07:57:31.133860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.793051+0000","last_change":"2024-04-26T07:58:04.793079+0000","last_active":"2024-04-26T07:58:04.793051+0000","last_peered":"2024-04-26T07:58:04.793051+0000","last_clean":"2024-04-26T07:58:04.793051+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:58:04.793051+0000","last_undegraded":"2024-04-26T07:58:04.793051+0000","last_fullsized":"2024-04-26T07:58:04.793051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:04.792960+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:04.792960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.792960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:52.162345+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885237+0000","last_change":"2024-04-26T07:54:15.003280+0000","last_active":"2024-04-26T07:56:24.885237+0000","last_peered":"2024-04-26T07:56:24.885237+0000","last_clean":"2024-04-26T07:56:24.885237+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:56:24.885237+0000","last_undegraded":"2024-04-26T07:56:24.885237+0000","last_fullsized":"2024-04-26T07:56:24.885237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.519746+0000","last_change":"2024-04-26T07:54:17.003908+0000","last_active":"2024-04-26T07:57:24.519746+0000","last_peered":"2024-04-26T07:57:24.519746+0000","last_clean":"2024-04-26T07:57:24.519746+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:57:24.519746+0000","last_undegraded":"2024-04-26T07:57:24.519746+0000","last_fullsized":"2024-04-26T07:57:24.519746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.890880+0000","last_change":"2024-04-26T07:54:15.017747+0000","last_active":"2024-04-26T07:56:24.890880+0000","last_peered":"2024-04-26T07:56:24.890880+0000","last_clean":"2024-04-26T07:56:24.890880+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:56:24.890880+0000","last_undegraded":"2024-04-26T07:56:24.890880+0000","last_fullsized":"2024-04-26T07:56:24.890880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.829899+0000","last_change":"2024-04-26T07:58:08.829934+0000","last_active":"2024-04-26T07:58:08.829899+0000","last_peered":"2024-04-26T07:58:08.829899+0000","last_clean":"2024-04-26T07:58:08.829899+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:58:08.829899+0000","last_undegraded":"2024-04-26T07:58:08.829899+0000","last_fullsized":"2024-04-26T07:58:08.829899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:08.829797+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:08.829797+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.829797+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:57.218721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.246495+0000","last_change":"2024-04-26T07:58:06.246522+0000","last_active":"2024-04-26T07:58:06.246495+0000","last_peered":"2024-04-26T07:58:06.246495+0000","last_clean":"2024-04-26T07:58:06.246495+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:58:06.246495+0000","last_undegraded":"2024-04-26T07:58:06.246495+0000","last_fullsized":"2024-04-26T07:58:06.246495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:06.246402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:06.246402+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.246402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:15.041321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.144952+0000","last_change":"2024-04-26T07:58:06.144982+0000","last_active":"2024-04-26T07:58:06.144952+0000","last_peered":"2024-04-26T07:58:06.144952+0000","last_clean":"2024-04-26T07:58:06.144952+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:58:06.144952+0000","last_undegraded":"2024-04-26T07:58:06.144952+0000","last_fullsized":"2024-04-26T07:58:06.144952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:06.144859+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:06.144859+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.144859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:24.745706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.885299+0000","last_change":"2024-04-26T07:54:15.005424+0000","last_active":"2024-04-26T07:56:24.885299+0000","last_peered":"2024-04-26T07:56:24.885299+0000","last_clean":"2024-04-26T07:56:24.885299+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:56:24.885299+0000","last_undegraded":"2024-04-26T07:56:24.885299+0000","last_fullsized":"2024-04-26T07:56:24.885299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.445569+0000","last_change":"2024-04-26T07:54:17.006417+0000","last_active":"2024-04-26T07:57:24.445569+0000","last_peered":"2024-04-26T07:57:24.445569+0000","last_clean":"2024-04-26T07:57:24.445569+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:57:24.445569+0000","last_undegraded":"2024-04-26T07:57:24.445569+0000","last_fullsized":"2024-04-26T07:57:24.445569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:24.891197+0000","last_change":"2024-04-26T07:54:15.029863+0000","last_active":"2024-04-26T07:56:24.891197+0000","last_peered":"2024-04-26T07:56:24.891197+0000","last_clean":"2024-04-26T07:56:24.891197+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:56:24.891197+0000","last_undegraded":"2024-04-26T07:56:24.891197+0000","last_fullsized":"2024-04-26T07:56:24.891197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.034297+0000","last_change":"2024-04-26T07:57:53.034344+0000","last_active":"2024-04-26T07:57:53.034297+0000","last_peered":"2024-04-26T07:57:53.034297+0000","last_clean":"2024-04-26T07:57:53.034297+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:57:53.034297+0000","last_undegraded":"2024-04-26T07:57:53.034297+0000","last_fullsized":"2024-04-26T07:57:53.034297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:57:53.034175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:57:53.034175+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.034175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:17.218011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.885877+0000","last_change":"2024-04-26T07:54:15.007396+0000","last_active":"2024-04-26T07:56:29.885877+0000","last_peered":"2024-04-26T07:56:29.885877+0000","last_clean":"2024-04-26T07:56:29.885877+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:56:29.885877+0000","last_undegraded":"2024-04-26T07:56:29.885877+0000","last_fullsized":"2024-04-26T07:56:29.885877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.832289+0000","last_change":"2024-04-26T07:58:03.832314+0000","last_active":"2024-04-26T07:58:03.832289+0000","last_peered":"2024-04-26T07:58:03.832289+0000","last_clean":"2024-04-26T07:58:03.832289+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:58:03.832289+0000","last_undegraded":"2024-04-26T07:58:03.832289+0000","last_fullsized":"2024-04-26T07:58:03.832289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:03.832203+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:03.832203+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.832203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:26.049891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.132721+0000","last_change":"2024-04-26T07:54:15.017542+0000","last_active":"2024-04-26T07:57:31.132721+0000","last_peered":"2024-04-26T07:57:31.132721+0000","last_clean":"2024-04-26T07:57:31.132721+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:57:31.132721+0000","last_undegraded":"2024-04-26T07:57:31.132721+0000","last_fullsized":"2024-04-26T07:57:31.132721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.445197+0000","last_change":"2024-04-26T07:54:17.003159+0000","last_active":"2024-04-26T07:57:24.445197+0000","last_peered":"2024-04-26T07:57:24.445197+0000","last_clean":"2024-04-26T07:57:24.445197+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:57:24.445197+0000","last_undegraded":"2024-04-26T07:57:24.445197+0000","last_fullsized":"2024-04-26T07:57:24.445197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.135077+0000","last_change":"2024-04-26T07:54:15.008754+0000","last_active":"2024-04-26T07:57:31.135077+0000","last_peered":"2024-04-26T07:57:31.135077+0000","last_clean":"2024-04-26T07:57:31.135077+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:57:31.135077+0000","last_undegraded":"2024-04-26T07:57:31.135077+0000","last_fullsized":"2024-04-26T07:57:31.135077+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.177095+0000","last_change":"2024-04-26T07:58:01.177126+0000","last_active":"2024-04-26T07:58:01.177095+0000","last_peered":"2024-04-26T07:58:01.177095+0000","last_clean":"2024-04-26T07:58:01.177095+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:58:01.177095+0000","last_undegraded":"2024-04-26T07:58:01.177095+0000","last_fullsized":"2024-04-26T07:58:01.177095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:01.176988+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:01.176988+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.176988+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:36.360339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.436165+0000","last_change":"2024-04-26T07:54:15.022986+0000","last_active":"2024-04-26T07:57:24.436165+0000","last_peered":"2024-04-26T07:57:24.436165+0000","last_clean":"2024-04-26T07:57:24.436165+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:57:24.436165+0000","last_undegraded":"2024-04-26T07:57:24.436165+0000","last_fullsized":"2024-04-26T07:57:24.436165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.216743+0000","last_change":"2024-04-26T07:58:02.216774+0000","last_active":"2024-04-26T07:58:02.216743+0000","last_peered":"2024-04-26T07:58:02.216743+0000","last_clean":"2024-04-26T07:58:02.216743+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:58:02.216743+0000","last_undegraded":"2024-04-26T07:58:02.216743+0000","last_fullsized":"2024-04-26T07:58:02.216743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:02.216654+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:02.216654+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.216654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.409764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892250+0000","last_change":"2024-04-26T07:54:15.026508+0000","last_active":"2024-04-26T07:56:29.892250+0000","last_peered":"2024-04-26T07:56:29.892250+0000","last_clean":"2024-04-26T07:56:29.892250+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:56:29.892250+0000","last_undegraded":"2024-04-26T07:56:29.892250+0000","last_fullsized":"2024-04-26T07:56:29.892250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892946+0000","last_change":"2024-04-26T07:54:17.016231+0000","last_active":"2024-04-26T07:56:34.892946+0000","last_peered":"2024-04-26T07:56:34.892946+0000","last_clean":"2024-04-26T07:56:34.892946+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:56:34.892946+0000","last_undegraded":"2024-04-26T07:56:34.892946+0000","last_fullsized":"2024-04-26T07:56:34.892946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.250572+0000","last_change":"2024-04-26T07:58:04.250596+0000","last_active":"2024-04-26T07:58:04.250572+0000","last_peered":"2024-04-26T07:58:04.250572+0000","last_clean":"2024-04-26T07:58:04.250572+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:58:04.250572+0000","last_undegraded":"2024-04-26T07:58:04.250572+0000","last_fullsized":"2024-04-26T07:58:04.250572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:04.250456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:04.250456+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.250456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:58.426456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.175281+0000","last_change":"2024-04-26T07:58:08.175308+0000","last_active":"2024-04-26T07:58:08.175281+0000","last_peered":"2024-04-26T07:58:08.175281+0000","last_clean":"2024-04-26T07:58:08.175281+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:58:08.175281+0000","last_undegraded":"2024-04-26T07:58:08.175281+0000","last_fullsized":"2024-04-26T07:58:08.175281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:08.175191+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:08.175191+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.175191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:55.772232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893132+0000","last_change":"2024-04-26T07:54:15.025822+0000","last_active":"2024-04-26T07:56:34.893132+0000","last_peered":"2024-04-26T07:56:34.893132+0000","last_clean":"2024-04-26T07:56:34.893132+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:56:34.893132+0000","last_undegraded":"2024-04-26T07:56:34.893132+0000","last_fullsized":"2024-04-26T07:56:34.893132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892859+0000","last_change":"2024-04-26T07:54:15.029803+0000","last_active":"2024-04-26T07:56:34.892859+0000","last_peered":"2024-04-26T07:56:34.892859+0000","last_clean":"2024-04-26T07:56:34.892859+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:56:34.892859+0000","last_undegraded":"2024-04-26T07:56:34.892859+0000","last_fullsized":"2024-04-26T07:56:34.892859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.778125+0000","last_change":"2024-04-26T07:58:06.778152+0000","last_active":"2024-04-26T07:58:06.778125+0000","last_peered":"2024-04-26T07:58:06.778125+0000","last_clean":"2024-04-26T07:58:06.778125+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:58:06.778125+0000","last_undegraded":"2024-04-26T07:58:06.778125+0000","last_fullsized":"2024-04-26T07:58:06.778125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:06.778032+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:06.778032+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.778032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:37.816293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.886732+0000","last_change":"2024-04-26T07:54:15.007421+0000","last_active":"2024-04-26T07:56:34.886732+0000","last_peered":"2024-04-26T07:56:34.886732+0000","last_clean":"2024-04-26T07:56:34.886732+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:56:34.886732+0000","last_undegraded":"2024-04-26T07:56:34.886732+0000","last_fullsized":"2024-04-26T07:56:34.886732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.518862+0000","last_change":"2024-04-26T07:54:17.002953+0000","last_active":"2024-04-26T07:57:24.518862+0000","last_peered":"2024-04-26T07:57:24.518862+0000","last_clean":"2024-04-26T07:57:24.518862+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:57:24.518862+0000","last_undegraded":"2024-04-26T07:57:24.518862+0000","last_fullsized":"2024-04-26T07:57:24.518862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705716,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705715,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":974848,"data_stored":723975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705717,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":999424,"data_stored":725076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":134133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:58:16.608 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.608 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.608 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.609 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.609 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.609 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.609 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.609 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.609 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.609 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.610 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.610 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.610 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.610 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.610 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.610 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.610 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.610 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.611 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.612 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.612 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.612 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.612 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.612 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.612 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.612 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.613 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.613 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.613 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.613 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.613 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.613 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.613 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.613 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.614 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.614 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.614 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.614 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.614 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.614 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.614 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.615 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.616 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.616 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.616 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.616 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.616 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.616 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.616 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.616 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.617 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.617 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.617 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.617 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.617 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.617 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.617 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.617 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.618 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.618 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.618 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.618 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.618 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.618 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.618 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.619 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.619 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.619 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.619 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.619 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.619 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.619 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.619 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.620 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.620 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.620 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.620 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.620 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.620 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.620 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.620 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.621 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T07:54:22.002978+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.621 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.621 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.621 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.621 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.621 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.621 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.621 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.622 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.622 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.622 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.622 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.622 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.622 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.622 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.622 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.623 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.624 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.624 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:16.624 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:58:36.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:58:36.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.742+0000 7f08f5822640 1 Processor -- start 2024-04-26T07:58:36.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.742+0000 7f08f5822640 1 -- start start 2024-04-26T07:58:36.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.742+0000 7f08f5822640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f08f012d680 0x7f08f0131d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:36.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.742+0000 7f08f5822640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f0096c10 con 0x7f08f012c9e0 2024-04-26T07:58:36.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.742+0000 7f08f5822640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f08f0096de0 con 0x7f08f012d680 2024-04-26T07:58:36.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.743+0000 7f08ee7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f08f012d680 0x7f08f0131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:36.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.743+0000 7f08eeffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f08f012c9e0 0x7f08f012cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44260/0 (socket says 172.21.15.1:44260) 2024-04-26T07:58:36.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.743+0000 7f08eeffd640 1 -- 172.21.15.1:0/2722202674 learned_addr learned my addr 172.21.15.1:0/2722202674 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:58:36.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.743+0000 7f08ee7fc640 1 -- 172.21.15.1:0/2722202674 >> v1:172.21.15.1:6789/0 conn(0x7f08f012c9e0 legacy=0x7f08f012cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:36.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.743+0000 7f08ee7fc640 1 -- 172.21.15.1:0/2722202674 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f0096510 con 0x7f08f012d680 2024-04-26T07:58:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08ee7fc640 1 --2- 172.21.15.1:0/2722202674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012d680 0x7f08f0131d60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009720 tx=0x7f08e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bc1973c167c681 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08edffb640 1 -- 172.21.15.1:0/2722202674 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e40316d0 con 0x7f08f012d680 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08edffb640 1 -- 172.21.15.1:0/2722202674 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e4037070 con 0x7f08f012d680 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08edffb640 1 -- 172.21.15.1:0/2722202674 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e40319c0 con 0x7f08f012d680 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08f5822640 1 -- 172.21.15.1:0/2722202674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012d680 msgr2=0x7f08f0131d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08f5822640 1 --2- 172.21.15.1:0/2722202674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012d680 0x7f08f0131d60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009720 tx=0x7f08e402b840 comp rx=0 tx=0).stop 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08f5822640 1 -- 172.21.15.1:0/2722202674 shutdown_connections 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08f5822640 1 --2- 172.21.15.1:0/2722202674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012d680 0x7f08f0131d60 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08f5822640 1 -- 172.21.15.1:0/2722202674 >> 172.21.15.1:0/2722202674 conn(0x7f08f009add0 msgr2=0x7f08f009b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08f5822640 1 -- 172.21.15.1:0/2722202674 shutdown_connections 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.744+0000 7f08f5822640 1 -- 172.21.15.1:0/2722202674 wait complete. 2024-04-26T07:58:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.745+0000 7f08f5822640 1 Processor -- start 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.745+0000 7f08f5822640 1 -- start start 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.746+0000 7f08f5822640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012c9e0 0x7f08f0070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.746+0000 7f08f5822640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f08f01324b0 con 0x7f08f012c9e0 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.746+0000 7f08eeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012c9e0 0x7f08f0070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.746+0000 7f08eeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012c9e0 0x7f08f0070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48240/0 (socket says 172.21.15.1:48240) 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.746+0000 7f08eeffd640 1 -- 172.21.15.1:0/73699642 learned_addr learned my addr 172.21.15.1:0/73699642 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.746+0000 7f08eeffd640 1 -- 172.21.15.1:0/73699642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f01228d0 con 0x7f08f012c9e0 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.746+0000 7f08eeffd640 1 --2- 172.21.15.1:0/73699642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012c9e0 0x7f08f0070520 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c4a0 tx=0x7f08e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.746+0000 7f08d7fff640 1 -- 172.21.15.1:0/73699642 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e0017070 con 0x7f08f012c9e0 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.747+0000 7f08d7fff640 1 -- 172.21.15.1:0/73699642 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e0005c10 con 0x7f08f012c9e0 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.747+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f00715d0 con 0x7f08f012c9e0 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.747+0000 7f08d7fff640 1 -- 172.21.15.1:0/73699642 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e0007070 con 0x7f08f012c9e0 2024-04-26T07:58:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.747+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f0072690 con 0x7f08f012c9e0 2024-04-26T07:58:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.748+0000 7f08d7fff640 1 -- 172.21.15.1:0/73699642 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f08e001a070 con 0x7f08f012c9e0 2024-04-26T07:58:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.748+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f00636f0 con 0x7f08f012c9e0 2024-04-26T07:58:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.748+0000 7f08d7fff640 1 --2- 172.21.15.1:0/73699642 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f08dc0385c0 0x7f08dc03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.748+0000 7f08d7fff640 1 -- 172.21.15.1:0/73699642 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f08e004b390 con 0x7f08f012c9e0 2024-04-26T07:58:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.748+0000 7f08ee7fc640 1 --2- 172.21.15.1:0/73699642 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f08dc0385c0 0x7f08dc03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.749+0000 7f08ee7fc640 1 --2- 172.21.15.1:0/73699642 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f08dc0385c0 0x7f08dc03aa80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08e4036000 tx=0x7f08e4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.753+0000 7f08d7fff640 1 -- 172.21.15.1:0/73699642 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08e001b3b0 con 0x7f08f012c9e0 2024-04-26T07:58:36.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.934+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08f006b6f0 con 0x7f08dc0385c0 2024-04-26T07:58:36.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.950+0000 7f08d7fff640 1 -- 172.21.15.1:0/73699642 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664921 (secure 0 0 0) 0x7f08f006b6f0 con 0x7f08dc0385c0 2024-04-26T07:58:36.954 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:58:36.961 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:58:36.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f08dc0385c0 msgr2=0x7f08dc03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:36.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 --2- 172.21.15.1:0/73699642 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f08dc0385c0 0x7f08dc03aa80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08e4036000 tx=0x7f08e4008030 comp rx=0 tx=0).stop 2024-04-26T07:58:36.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012c9e0 msgr2=0x7f08f0070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:36.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 --2- 172.21.15.1:0/73699642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012c9e0 0x7f08f0070520 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c4a0 tx=0x7f08e000c960 comp rx=0 tx=0).stop 2024-04-26T07:58:36.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 shutdown_connections 2024-04-26T07:58:36.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 --2- 172.21.15.1:0/73699642 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f08dc0385c0 0x7f08dc03aa80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:36.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 --2- 172.21.15.1:0/73699642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08f012c9e0 0x7f08f0070520 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:36.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 >> 172.21.15.1:0/73699642 conn(0x7f08f009add0 msgr2=0x7f08f00978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:58:36.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 shutdown_connections 2024-04-26T07:58:36.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:36.955+0000 7f08f5822640 1 -- 172.21.15.1:0/73699642 wait complete. 2024-04-26T07:58:36.965 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-04-26T07:58:36.889568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5103,"num_read_kb":4684,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4779,"ondisk_log_size":4779,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152408,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334952,"statfs":{"total":386547056640,"available":386390990848,"internally_reserved":0,"allocated":2809856,"data_stored":1718390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003473"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.302775+0000","last_change":"2024-04-26T07:58:10.302775+0000","last_active":"2024-04-26T07:58:10.302775+0000","last_peered":"2024-04-26T07:58:10.302775+0000","last_clean":"2024-04-26T07:58:10.302775+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:58:10.302775+0000","last_undegraded":"2024-04-26T07:58:10.302775+0000","last_fullsized":"2024-04-26T07:58:10.302775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:10.302661+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:10.302661+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.302661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:57.926956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.247641+0000","last_change":"2024-04-26T07:58:03.247677+0000","last_active":"2024-04-26T07:58:03.247641+0000","last_peered":"2024-04-26T07:58:03.247641+0000","last_clean":"2024-04-26T07:58:03.247641+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:58:03.247641+0000","last_undegraded":"2024-04-26T07:58:03.247641+0000","last_fullsized":"2024-04-26T07:58:03.247641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:03.247552+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:03.247552+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.247552+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:09.519023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.812158+0000","last_change":"2024-04-26T07:58:09.812158+0000","last_active":"2024-04-26T07:58:09.812158+0000","last_peered":"2024-04-26T07:58:09.812158+0000","last_clean":"2024-04-26T07:58:09.812158+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:58:09.812158+0000","last_undegraded":"2024-04-26T07:58:09.812158+0000","last_fullsized":"2024-04-26T07:58:09.812158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:09.812040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:09.812040+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.812040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:12.706861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.118276+0000","last_change":"2024-04-26T07:58:14.118305+0000","last_active":"2024-04-26T07:58:14.118276+0000","last_peered":"2024-04-26T07:58:14.118276+0000","last_clean":"2024-04-26T07:58:14.118276+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:58:14.118276+0000","last_undegraded":"2024-04-26T07:58:14.118276+0000","last_fullsized":"2024-04-26T07:58:14.118276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:14.118188+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:14.118188+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.118188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:04.731893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.074869+0000","last_change":"2024-04-26T07:58:32.074896+0000","last_active":"2024-04-26T07:58:32.074869+0000","last_peered":"2024-04-26T07:58:32.074869+0000","last_clean":"2024-04-26T07:58:32.074869+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:58:32.074869+0000","last_undegraded":"2024-04-26T07:58:32.074869+0000","last_fullsized":"2024-04-26T07:58:32.074869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:32.074774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:32.074774+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.074774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:45.173628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.977839+0000","last_change":"2024-04-26T07:57:49.977898+0000","last_active":"2024-04-26T07:57:49.977839+0000","last_peered":"2024-04-26T07:57:49.977839+0000","last_clean":"2024-04-26T07:57:49.977839+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:49.977839+0000","last_undegraded":"2024-04-26T07:57:49.977839+0000","last_fullsized":"2024-04-26T07:57:49.977839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:57:49.977738+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:57:49.977738+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.977738+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:40.792346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.351059+0000","last_change":"2024-04-26T07:58:19.351088+0000","last_active":"2024-04-26T07:58:19.351059+0000","last_peered":"2024-04-26T07:58:19.351059+0000","last_clean":"2024-04-26T07:58:19.351059+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:58:19.351059+0000","last_undegraded":"2024-04-26T07:58:19.351059+0000","last_fullsized":"2024-04-26T07:58:19.351059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:19.350931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:19.350931+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.350931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:10.165539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.189672+0000","last_change":"2024-04-26T07:58:17.189714+0000","last_active":"2024-04-26T07:58:17.189672+0000","last_peered":"2024-04-26T07:58:17.189672+0000","last_clean":"2024-04-26T07:58:17.189672+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:58:17.189672+0000","last_undegraded":"2024-04-26T07:58:17.189672+0000","last_fullsized":"2024-04-26T07:58:17.189672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-26T07:58:17.189575+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-26T07:58:17.189575+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.189575+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:11.798519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894751+0000","last_change":"2024-04-26T07:54:15.025367+0000","last_active":"2024-04-26T07:56:44.894751+0000","last_peered":"2024-04-26T07:56:44.894751+0000","last_clean":"2024-04-26T07:56:44.894751+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:56:44.894751+0000","last_undegraded":"2024-04-26T07:56:44.894751+0000","last_fullsized":"2024-04-26T07:56:44.894751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.204031+0000","last_change":"2024-04-26T07:58:10.204031+0000","last_active":"2024-04-26T07:58:10.204031+0000","last_peered":"2024-04-26T07:58:10.204031+0000","last_clean":"2024-04-26T07:58:10.204031+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:58:10.204031+0000","last_undegraded":"2024-04-26T07:58:10.204031+0000","last_fullsized":"2024-04-26T07:58:10.204031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:10.203885+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:10.203885+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.203885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:57.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.336034+0000","last_change":"2024-04-26T07:58:18.336069+0000","last_active":"2024-04-26T07:58:18.336034+0000","last_peered":"2024-04-26T07:58:18.336034+0000","last_clean":"2024-04-26T07:58:18.336034+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:58:18.336034+0000","last_undegraded":"2024-04-26T07:58:18.336034+0000","last_fullsized":"2024-04-26T07:58:18.336034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:18.335918+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:18.335918+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.335918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:49.374179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.029718+0000","last_change":"2024-04-26T07:57:56.029718+0000","last_active":"2024-04-26T07:57:56.029718+0000","last_peered":"2024-04-26T07:57:56.029718+0000","last_clean":"2024-04-26T07:57:56.029718+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:56.029718+0000","last_undegraded":"2024-04-26T07:57:56.029718+0000","last_fullsized":"2024-04-26T07:57:56.029718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:56.029549+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:56.029549+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.029549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:42.743723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.173213+0000","last_change":"2024-04-26T07:54:15.021920+0000","last_active":"2024-04-26T07:57:24.173213+0000","last_peered":"2024-04-26T07:57:24.173213+0000","last_clean":"2024-04-26T07:57:24.173213+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:57:24.173213+0000","last_undegraded":"2024-04-26T07:57:24.173213+0000","last_fullsized":"2024-04-26T07:57:24.173213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.157085+0000","last_change":"2024-04-26T07:57:56.157085+0000","last_active":"2024-04-26T07:57:56.157085+0000","last_peered":"2024-04-26T07:57:56.157085+0000","last_clean":"2024-04-26T07:57:56.157085+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:57:56.157085+0000","last_undegraded":"2024-04-26T07:57:56.157085+0000","last_fullsized":"2024-04-26T07:57:56.157085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:56.156947+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:56.156947+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.156947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:28.587105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.849871+0000","last_change":"2024-04-26T07:58:11.849900+0000","last_active":"2024-04-26T07:58:11.849871+0000","last_peered":"2024-04-26T07:58:11.849871+0000","last_clean":"2024-04-26T07:58:11.849871+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:58:11.849871+0000","last_undegraded":"2024-04-26T07:58:11.849871+0000","last_fullsized":"2024-04-26T07:58:11.849871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.849756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.849756+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.849756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:57.628518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.268091+0000","last_change":"2024-04-26T07:58:05.268091+0000","last_active":"2024-04-26T07:58:05.268091+0000","last_peered":"2024-04-26T07:58:05.268091+0000","last_clean":"2024-04-26T07:58:05.268091+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:58:05.268091+0000","last_undegraded":"2024-04-26T07:58:05.268091+0000","last_fullsized":"2024-04-26T07:58:05.268091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:05.267964+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:05.267964+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.267964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:56.976727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.952669+0000","last_change":"2024-04-26T07:57:47.952694+0000","last_active":"2024-04-26T07:57:47.952669+0000","last_peered":"2024-04-26T07:57:47.952669+0000","last_clean":"2024-04-26T07:57:47.952669+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:57:47.952669+0000","last_undegraded":"2024-04-26T07:57:47.952669+0000","last_fullsized":"2024-04-26T07:57:47.952669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.952578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:27.282056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.214044+0000","last_change":"2024-04-26T07:58:13.214074+0000","last_active":"2024-04-26T07:58:13.214044+0000","last_peered":"2024-04-26T07:58:13.214044+0000","last_clean":"2024-04-26T07:58:13.214044+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:58:13.214044+0000","last_undegraded":"2024-04-26T07:58:13.214044+0000","last_fullsized":"2024-04-26T07:58:13.214044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:13.213935+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:13.213935+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.213935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:04.028543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.172488+0000","last_change":"2024-04-26T07:58:05.172540+0000","last_active":"2024-04-26T07:58:05.172488+0000","last_peered":"2024-04-26T07:58:05.172488+0000","last_clean":"2024-04-26T07:58:05.172488+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:58:05.172488+0000","last_undegraded":"2024-04-26T07:58:05.172488+0000","last_fullsized":"2024-04-26T07:58:05.172488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:05.172385+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:05.172385+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.172385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:54.072924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.182343+0000","last_change":"2024-04-26T07:58:00.182384+0000","last_active":"2024-04-26T07:58:00.182343+0000","last_peered":"2024-04-26T07:58:00.182343+0000","last_clean":"2024-04-26T07:58:00.182343+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:58:00.182343+0000","last_undegraded":"2024-04-26T07:58:00.182343+0000","last_fullsized":"2024-04-26T07:58:00.182343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:00.182243+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:00.182243+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.182243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:41.053649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.135895+0000","last_change":"2024-04-26T07:57:55.135919+0000","last_active":"2024-04-26T07:57:55.135895+0000","last_peered":"2024-04-26T07:57:55.135895+0000","last_clean":"2024-04-26T07:57:55.135895+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:55.135895+0000","last_undegraded":"2024-04-26T07:57:55.135895+0000","last_fullsized":"2024-04-26T07:57:55.135895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:55.135805+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:55.135805+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.135805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:24.905448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.128762+0000","last_change":"2024-04-26T07:58:19.128816+0000","last_active":"2024-04-26T07:58:19.128762+0000","last_peered":"2024-04-26T07:58:19.128762+0000","last_clean":"2024-04-26T07:58:19.128762+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:58:19.128762+0000","last_undegraded":"2024-04-26T07:58:19.128762+0000","last_fullsized":"2024-04-26T07:58:19.128762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:19.128653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:19.128653+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.128653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:05.842827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.866000+0000","last_change":"2024-04-26T07:58:01.866024+0000","last_active":"2024-04-26T07:58:01.866000+0000","last_peered":"2024-04-26T07:58:01.866000+0000","last_clean":"2024-04-26T07:58:01.866000+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:58:01.866000+0000","last_undegraded":"2024-04-26T07:58:01.866000+0000","last_fullsized":"2024-04-26T07:58:01.866000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:01.865908+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:01.865908+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.865908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:20.466755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.114184+0000","last_change":"2024-04-26T07:58:17.114214+0000","last_active":"2024-04-26T07:58:17.114184+0000","last_peered":"2024-04-26T07:58:17.114184+0000","last_clean":"2024-04-26T07:58:17.114184+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:58:17.114184+0000","last_undegraded":"2024-04-26T07:58:17.114184+0000","last_fullsized":"2024-04-26T07:58:17.114184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.114086+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.114086+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.114086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.892848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.287922+0000","last_change":"2024-04-26T07:58:09.287952+0000","last_active":"2024-04-26T07:58:09.287922+0000","last_peered":"2024-04-26T07:58:09.287922+0000","last_clean":"2024-04-26T07:58:09.287922+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:58:09.287922+0000","last_undegraded":"2024-04-26T07:58:09.287922+0000","last_fullsized":"2024-04-26T07:58:09.287922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:09.287831+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:09.287831+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.287831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:30.576867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.856343+0000","last_change":"2024-04-26T07:58:13.856371+0000","last_active":"2024-04-26T07:58:13.856343+0000","last_peered":"2024-04-26T07:58:13.856343+0000","last_clean":"2024-04-26T07:58:13.856343+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:58:13.856343+0000","last_undegraded":"2024-04-26T07:58:13.856343+0000","last_fullsized":"2024-04-26T07:58:13.856343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:13.856249+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:13.856249+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.856249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:00.570423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.219214+0000","last_change":"2024-04-26T07:58:09.219242+0000","last_active":"2024-04-26T07:58:09.219214+0000","last_peered":"2024-04-26T07:58:09.219214+0000","last_clean":"2024-04-26T07:58:09.219214+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:58:09.219214+0000","last_undegraded":"2024-04-26T07:58:09.219214+0000","last_fullsized":"2024-04-26T07:58:09.219214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:09.219121+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:09.219121+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.219121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:31.436809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892974+0000","last_change":"2024-04-26T07:54:15.017883+0000","last_active":"2024-04-26T07:56:34.892974+0000","last_peered":"2024-04-26T07:56:34.892974+0000","last_clean":"2024-04-26T07:56:34.892974+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:56:34.892974+0000","last_undegraded":"2024-04-26T07:56:34.892974+0000","last_fullsized":"2024-04-26T07:56:34.892974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.137093+0000","last_change":"2024-04-26T07:58:33.137132+0000","last_active":"2024-04-26T07:58:33.137093+0000","last_peered":"2024-04-26T07:58:33.137093+0000","last_clean":"2024-04-26T07:58:33.137093+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:58:33.137093+0000","last_undegraded":"2024-04-26T07:58:33.137093+0000","last_fullsized":"2024-04-26T07:58:33.137093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:58:33.136996+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:58:33.136996+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.136996+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:13.338437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'14","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.122491+0000","last_change":"2024-04-26T07:58:20.122525+0000","last_active":"2024-04-26T07:58:20.122491+0000","last_peered":"2024-04-26T07:58:20.122491+0000","last_clean":"2024-04-26T07:58:20.122491+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:58:20.122491+0000","last_undegraded":"2024-04-26T07:58:20.122491+0000","last_fullsized":"2024-04-26T07:58:20.122491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:20.122382+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:20.122382+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.122382+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:11.188914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.132698+0000","last_change":"2024-04-26T07:54:15.028485+0000","last_active":"2024-04-26T07:57:31.132698+0000","last_peered":"2024-04-26T07:57:31.132698+0000","last_clean":"2024-04-26T07:57:31.132698+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:57:31.132698+0000","last_undegraded":"2024-04-26T07:57:31.132698+0000","last_fullsized":"2024-04-26T07:57:31.132698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.991288+0000","last_change":"2024-04-26T07:57:41.991316+0000","last_active":"2024-04-26T07:57:41.991288+0000","last_peered":"2024-04-26T07:57:41.991288+0000","last_clean":"2024-04-26T07:57:41.991288+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:57:41.991288+0000","last_undegraded":"2024-04-26T07:57:41.991288+0000","last_fullsized":"2024-04-26T07:57:41.991288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.991200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:30.282928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.071582+0000","last_change":"2024-04-26T07:58:05.071616+0000","last_active":"2024-04-26T07:58:05.071582+0000","last_peered":"2024-04-26T07:58:05.071582+0000","last_clean":"2024-04-26T07:58:05.071582+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:58:05.071582+0000","last_undegraded":"2024-04-26T07:58:05.071582+0000","last_fullsized":"2024-04-26T07:58:05.071582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:58:05.071491+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:58:05.071491+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.071491+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:17.009024+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.029246+0000","last_change":"2024-04-26T07:57:40.029273+0000","last_active":"2024-04-26T07:57:40.029246+0000","last_peered":"2024-04-26T07:57:40.029246+0000","last_clean":"2024-04-26T07:57:40.029246+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:57:40.029246+0000","last_undegraded":"2024-04-26T07:57:40.029246+0000","last_fullsized":"2024-04-26T07:57:40.029246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.029150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.153168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.137596+0000","last_change":"2024-04-26T07:57:56.137657+0000","last_active":"2024-04-26T07:57:56.137596+0000","last_peered":"2024-04-26T07:57:56.137596+0000","last_clean":"2024-04-26T07:57:56.137596+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:56.137596+0000","last_undegraded":"2024-04-26T07:57:56.137596+0000","last_fullsized":"2024-04-26T07:57:56.137596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:57:56.137425+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:57:56.137425+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.137425+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:50.295566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.105177+0000","last_change":"2024-04-26T07:58:21.105205+0000","last_active":"2024-04-26T07:58:21.105177+0000","last_peered":"2024-04-26T07:58:21.105177+0000","last_clean":"2024-04-26T07:58:21.105177+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:58:21.105177+0000","last_undegraded":"2024-04-26T07:58:21.105177+0000","last_fullsized":"2024-04-26T07:58:21.105177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:21.105074+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:21.105074+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.105074+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:02.632583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.291711+0000","last_change":"2024-04-26T07:58:17.291740+0000","last_active":"2024-04-26T07:58:17.291711+0000","last_peered":"2024-04-26T07:58:17.291711+0000","last_clean":"2024-04-26T07:58:17.291711+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:58:17.291711+0000","last_undegraded":"2024-04-26T07:58:17.291711+0000","last_fullsized":"2024-04-26T07:58:17.291711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.291610+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.291610+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.291610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:56.621088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'4","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.044186+0000","last_change":"2024-04-26T07:55:02.067003+0000","last_active":"2024-04-26T07:57:31.044186+0000","last_peered":"2024-04-26T07:57:31.044186+0000","last_clean":"2024-04-26T07:57:31.044186+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:57:31.044186+0000","last_undegraded":"2024-04-26T07:57:31.044186+0000","last_fullsized":"2024-04-26T07:57:31.044186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.951894+0000","last_change":"2024-04-26T07:57:42.951977+0000","last_active":"2024-04-26T07:57:42.951894+0000","last_peered":"2024-04-26T07:57:42.951894+0000","last_clean":"2024-04-26T07:57:42.951894+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:57:42.951894+0000","last_undegraded":"2024-04-26T07:57:42.951894+0000","last_fullsized":"2024-04-26T07:57:42.951894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.951788+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:25.400326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.943693+0000","last_change":"2024-04-26T07:57:47.943739+0000","last_active":"2024-04-26T07:57:47.943693+0000","last_peered":"2024-04-26T07:57:47.943693+0000","last_clean":"2024-04-26T07:57:47.943693+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:57:47.943693+0000","last_undegraded":"2024-04-26T07:57:47.943693+0000","last_fullsized":"2024-04-26T07:57:47.943693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.943578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:52.735911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.851905+0000","last_change":"2024-04-26T07:58:02.851935+0000","last_active":"2024-04-26T07:58:02.851905+0000","last_peered":"2024-04-26T07:58:02.851905+0000","last_clean":"2024-04-26T07:58:02.851905+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:58:02.851905+0000","last_undegraded":"2024-04-26T07:58:02.851905+0000","last_fullsized":"2024-04-26T07:58:02.851905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:02.851809+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:02.851809+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.851809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:48.141417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.391865+0000","last_change":"2024-04-26T07:58:28.391912+0000","last_active":"2024-04-26T07:58:28.391865+0000","last_peered":"2024-04-26T07:58:28.391865+0000","last_clean":"2024-04-26T07:58:28.391865+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:58:28.391865+0000","last_undegraded":"2024-04-26T07:58:28.391865+0000","last_fullsized":"2024-04-26T07:58:28.391865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-26T07:58:28.391758+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-26T07:58:28.391758+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.391758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:11:14.773701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.123088+0000","last_change":"2024-04-26T07:58:31.123115+0000","last_active":"2024-04-26T07:58:31.123088+0000","last_peered":"2024-04-26T07:58:31.123088+0000","last_clean":"2024-04-26T07:58:31.123088+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:58:31.123088+0000","last_undegraded":"2024-04-26T07:58:31.123088+0000","last_fullsized":"2024-04-26T07:58:31.123088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:31.122960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:31.122960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.122960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:13.159615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.038571+0000","last_change":"2024-04-26T07:57:53.038594+0000","last_active":"2024-04-26T07:57:53.038571+0000","last_peered":"2024-04-26T07:57:53.038571+0000","last_clean":"2024-04-26T07:57:53.038571+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:57:53.038571+0000","last_undegraded":"2024-04-26T07:57:53.038571+0000","last_fullsized":"2024-04-26T07:57:53.038571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:53.038477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:53.038477+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.038477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.214477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.282629+0000","last_change":"2024-04-26T07:57:38.282677+0000","last_active":"2024-04-26T07:57:38.282629+0000","last_peered":"2024-04-26T07:57:38.282629+0000","last_clean":"2024-04-26T07:57:38.282629+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:57:38.282629+0000","last_undegraded":"2024-04-26T07:57:38.282629+0000","last_fullsized":"2024-04-26T07:57:38.282629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.282530+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:49.848037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":398,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.033916+0000","last_change":"2024-04-26T07:58:07.033968+0000","last_active":"2024-04-26T07:58:07.033916+0000","last_peered":"2024-04-26T07:58:07.033916+0000","last_clean":"2024-04-26T07:58:07.033916+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:58:07.033916+0000","last_undegraded":"2024-04-26T07:58:07.033916+0000","last_fullsized":"2024-04-26T07:58:07.033916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-04-26T07:58:07.033790+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-04-26T07:58:07.033790+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.033790+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:29.381421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.433072+0000","last_change":"2024-04-26T07:58:24.433119+0000","last_active":"2024-04-26T07:58:24.433072+0000","last_peered":"2024-04-26T07:58:24.433072+0000","last_clean":"2024-04-26T07:58:24.433072+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:58:24.433072+0000","last_undegraded":"2024-04-26T07:58:24.433072+0000","last_fullsized":"2024-04-26T07:58:24.433072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:24.432965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:24.432965+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.432965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:52.546312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.819079+0000","last_change":"2024-04-26T07:58:10.819106+0000","last_active":"2024-04-26T07:58:10.819079+0000","last_peered":"2024-04-26T07:58:10.819079+0000","last_clean":"2024-04-26T07:58:10.819079+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:58:10.819079+0000","last_undegraded":"2024-04-26T07:58:10.819079+0000","last_fullsized":"2024-04-26T07:58:10.819079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-04-26T07:58:10.818989+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-04-26T07:58:10.818989+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.818989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:35.002825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.221240+0000","last_change":"2024-04-26T07:58:11.221263+0000","last_active":"2024-04-26T07:58:11.221240+0000","last_peered":"2024-04-26T07:58:11.221240+0000","last_clean":"2024-04-26T07:58:11.221240+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:58:11.221240+0000","last_undegraded":"2024-04-26T07:58:11.221240+0000","last_fullsized":"2024-04-26T07:58:11.221240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.221148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.221148+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.221148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:50.550625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894905+0000","last_change":"2024-04-26T07:55:02.059077+0000","last_active":"2024-04-26T07:56:44.894905+0000","last_peered":"2024-04-26T07:56:44.894905+0000","last_clean":"2024-04-26T07:56:44.894905+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:56:44.894905+0000","last_undegraded":"2024-04-26T07:56:44.894905+0000","last_fullsized":"2024-04-26T07:56:44.894905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.304015+0000","last_change":"2024-04-26T07:57:41.304062+0000","last_active":"2024-04-26T07:57:41.304015+0000","last_peered":"2024-04-26T07:57:41.304015+0000","last_clean":"2024-04-26T07:57:41.304015+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:57:41.304015+0000","last_undegraded":"2024-04-26T07:57:41.304015+0000","last_fullsized":"2024-04-26T07:57:41.304015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.303924+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:58.630899+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.961870+0000","last_change":"2024-04-26T07:57:50.961896+0000","last_active":"2024-04-26T07:57:50.961870+0000","last_peered":"2024-04-26T07:57:50.961870+0000","last_clean":"2024-04-26T07:57:50.961870+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:50.961870+0000","last_undegraded":"2024-04-26T07:57:50.961870+0000","last_fullsized":"2024-04-26T07:57:50.961870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:50.961766+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:50.961766+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.961766+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:57.082089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.066576+0000","last_change":"2024-04-26T07:57:54.066607+0000","last_active":"2024-04-26T07:57:54.066576+0000","last_peered":"2024-04-26T07:57:54.066576+0000","last_clean":"2024-04-26T07:57:54.066576+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:57:54.066576+0000","last_undegraded":"2024-04-26T07:57:54.066576+0000","last_fullsized":"2024-04-26T07:57:54.066576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:54.066484+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:54.066484+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.066484+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:39.845246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.397650+0000","last_change":"2024-04-26T07:58:20.397690+0000","last_active":"2024-04-26T07:58:20.397650+0000","last_peered":"2024-04-26T07:58:20.397650+0000","last_clean":"2024-04-26T07:58:20.397650+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:58:20.397650+0000","last_undegraded":"2024-04-26T07:58:20.397650+0000","last_fullsized":"2024-04-26T07:58:20.397650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:20.397558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:20.397558+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.397558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:08.786482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.928603+0000","last_change":"2024-04-26T07:57:46.928630+0000","last_active":"2024-04-26T07:57:46.928603+0000","last_peered":"2024-04-26T07:57:46.928603+0000","last_clean":"2024-04-26T07:57:46.928603+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:57:46.928603+0000","last_undegraded":"2024-04-26T07:57:46.928603+0000","last_fullsized":"2024-04-26T07:57:46.928603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.928512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:13.316943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.275612+0000","last_change":"2024-04-26T07:57:46.275674+0000","last_active":"2024-04-26T07:57:46.275612+0000","last_peered":"2024-04-26T07:57:46.275612+0000","last_clean":"2024-04-26T07:57:46.275612+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:57:46.275612+0000","last_undegraded":"2024-04-26T07:57:46.275612+0000","last_fullsized":"2024-04-26T07:57:46.275612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.275508+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:20.381725+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.014944+0000","last_change":"2024-04-26T07:57:43.014970+0000","last_active":"2024-04-26T07:57:43.014944+0000","last_peered":"2024-04-26T07:57:43.014944+0000","last_clean":"2024-04-26T07:57:43.014944+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:57:43.014944+0000","last_undegraded":"2024-04-26T07:57:43.014944+0000","last_fullsized":"2024-04-26T07:57:43.014944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.014858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:09.403289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.451681+0000","last_change":"2024-04-26T07:58:26.451681+0000","last_active":"2024-04-26T07:58:26.451681+0000","last_peered":"2024-04-26T07:58:26.451681+0000","last_clean":"2024-04-26T07:58:26.451681+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:58:26.451681+0000","last_undegraded":"2024-04-26T07:58:26.451681+0000","last_fullsized":"2024-04-26T07:58:26.451681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:26.451562+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:26.451562+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.451562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:43.304584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.153589+0000","last_change":"2024-04-26T07:58:07.153649+0000","last_active":"2024-04-26T07:58:07.153589+0000","last_peered":"2024-04-26T07:58:07.153589+0000","last_clean":"2024-04-26T07:58:07.153589+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:58:07.153589+0000","last_undegraded":"2024-04-26T07:58:07.153589+0000","last_fullsized":"2024-04-26T07:58:07.153589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:07.153468+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:07.153468+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.153468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:52.443076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.260272+0000","last_change":"2024-04-26T07:58:12.260299+0000","last_active":"2024-04-26T07:58:12.260272+0000","last_peered":"2024-04-26T07:58:12.260272+0000","last_clean":"2024-04-26T07:58:12.260272+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:58:12.260272+0000","last_undegraded":"2024-04-26T07:58:12.260272+0000","last_fullsized":"2024-04-26T07:58:12.260272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:12.260175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:12.260175+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.260175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:01.160714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.938500+0000","last_change":"2024-04-26T07:57:55.938537+0000","last_active":"2024-04-26T07:57:55.938500+0000","last_peered":"2024-04-26T07:57:55.938500+0000","last_clean":"2024-04-26T07:57:55.938500+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:57:55.938500+0000","last_undegraded":"2024-04-26T07:57:55.938500+0000","last_fullsized":"2024-04-26T07:57:55.938500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:55.938404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:55.938404+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.938404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:35.339181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.018137+0000","last_change":"2024-04-26T07:57:51.018207+0000","last_active":"2024-04-26T07:57:51.018137+0000","last_peered":"2024-04-26T07:57:51.018137+0000","last_clean":"2024-04-26T07:57:51.018137+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:57:51.018137+0000","last_undegraded":"2024-04-26T07:57:51.018137+0000","last_fullsized":"2024-04-26T07:57:51.018137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:51.017960+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:51.017960+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.017960+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:39.406884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.026924+0000","last_change":"2024-04-26T07:57:47.026951+0000","last_active":"2024-04-26T07:57:47.026924+0000","last_peered":"2024-04-26T07:57:47.026924+0000","last_clean":"2024-04-26T07:57:47.026924+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:57:47.026924+0000","last_undegraded":"2024-04-26T07:57:47.026924+0000","last_fullsized":"2024-04-26T07:57:47.026924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.026813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:06.280145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.155890+0000","last_change":"2024-04-26T07:58:31.155890+0000","last_active":"2024-04-26T07:58:31.155890+0000","last_peered":"2024-04-26T07:58:31.155890+0000","last_clean":"2024-04-26T07:58:31.155890+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:58:31.155890+0000","last_undegraded":"2024-04-26T07:58:31.155890+0000","last_fullsized":"2024-04-26T07:58:31.155890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:31.155771+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:31.155771+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.155771+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:49.092021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.269746+0000","last_change":"2024-04-26T07:58:11.269801+0000","last_active":"2024-04-26T07:58:11.269746+0000","last_peered":"2024-04-26T07:58:11.269746+0000","last_clean":"2024-04-26T07:58:11.269746+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:58:11.269746+0000","last_undegraded":"2024-04-26T07:58:11.269746+0000","last_fullsized":"2024-04-26T07:58:11.269746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:11.269608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:11.269608+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.269608+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:59.561335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.154959+0000","last_change":"2024-04-26T07:58:34.154985+0000","last_active":"2024-04-26T07:58:34.154959+0000","last_peered":"2024-04-26T07:58:34.154959+0000","last_clean":"2024-04-26T07:58:34.154959+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:58:34.154959+0000","last_undegraded":"2024-04-26T07:58:34.154959+0000","last_fullsized":"2024-04-26T07:58:34.154959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:34.154871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:34.154871+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.154871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:48.785587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.020112+0000","last_change":"2024-04-26T07:57:54.020138+0000","last_active":"2024-04-26T07:57:54.020112+0000","last_peered":"2024-04-26T07:57:54.020112+0000","last_clean":"2024-04-26T07:57:54.020112+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:57:54.020112+0000","last_undegraded":"2024-04-26T07:57:54.020112+0000","last_fullsized":"2024-04-26T07:57:54.020112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.020020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.020020+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.020020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:45.728783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.025894+0000","last_change":"2024-04-26T07:57:55.025939+0000","last_active":"2024-04-26T07:57:55.025894+0000","last_peered":"2024-04-26T07:57:55.025894+0000","last_clean":"2024-04-26T07:57:55.025894+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:57:55.025894+0000","last_undegraded":"2024-04-26T07:57:55.025894+0000","last_fullsized":"2024-04-26T07:57:55.025894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-04-26T07:57:55.025801+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-04-26T07:57:55.025801+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.025801+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:23.139148+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.078518+0000","last_change":"2024-04-26T07:57:36.078544+0000","last_active":"2024-04-26T07:57:36.078518+0000","last_peered":"2024-04-26T07:57:36.078518+0000","last_clean":"2024-04-26T07:57:36.078518+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:36.078518+0000","last_undegraded":"2024-04-26T07:57:36.078518+0000","last_fullsized":"2024-04-26T07:57:36.078518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.078443+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:00.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.687157+0000","last_change":"2024-04-26T07:58:32.687186+0000","last_active":"2024-04-26T07:58:32.687157+0000","last_peered":"2024-04-26T07:58:32.687157+0000","last_clean":"2024-04-26T07:58:32.687157+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:58:32.687157+0000","last_undegraded":"2024-04-26T07:58:32.687157+0000","last_fullsized":"2024-04-26T07:58:32.687157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:32.687042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:32.687042+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.687042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:57:56.973895+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.194772+0000","last_change":"2024-04-26T07:57:58.194805+0000","last_active":"2024-04-26T07:57:58.194772+0000","last_peered":"2024-04-26T07:57:58.194772+0000","last_clean":"2024-04-26T07:57:58.194772+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:58.194772+0000","last_undegraded":"2024-04-26T07:57:58.194772+0000","last_fullsized":"2024-04-26T07:57:58.194772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:58.194676+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:58.194676+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.194676+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:17.448008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:29.892189+0000","last_change":"2024-04-26T07:54:15.029358+0000","last_active":"2024-04-26T07:56:29.892189+0000","last_peered":"2024-04-26T07:56:29.892189+0000","last_clean":"2024-04-26T07:56:29.892189+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:56:29.892189+0000","last_undegraded":"2024-04-26T07:56:29.892189+0000","last_fullsized":"2024-04-26T07:56:29.892189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.868496+0000","last_change":"2024-04-26T07:57:57.868520+0000","last_active":"2024-04-26T07:57:57.868496+0000","last_peered":"2024-04-26T07:57:57.868496+0000","last_clean":"2024-04-26T07:57:57.868496+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:57:57.868496+0000","last_undegraded":"2024-04-26T07:57:57.868496+0000","last_fullsized":"2024-04-26T07:57:57.868496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:57.868394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:57.868394+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.868394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.157429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'64","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.962316+0000","last_change":"2024-04-26T07:57:46.962369+0000","last_active":"2024-04-26T07:57:46.962316+0000","last_peered":"2024-04-26T07:57:46.962316+0000","last_clean":"2024-04-26T07:57:46.962316+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:57:46.962316+0000","last_undegraded":"2024-04-26T07:57:46.962316+0000","last_fullsized":"2024-04-26T07:57:46.962316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.962228+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:34.331613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.099064+0000","last_change":"2024-04-26T07:57:35.099115+0000","last_active":"2024-04-26T07:57:35.099064+0000","last_peered":"2024-04-26T07:57:35.099064+0000","last_clean":"2024-04-26T07:57:35.099064+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:57:35.099064+0000","last_undegraded":"2024-04-26T07:57:35.099064+0000","last_fullsized":"2024-04-26T07:57:35.099064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.098977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:27.568866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.665837+0000","last_change":"2024-04-26T07:58:33.665873+0000","last_active":"2024-04-26T07:58:33.665837+0000","last_peered":"2024-04-26T07:58:33.665837+0000","last_clean":"2024-04-26T07:58:33.665837+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:58:33.665837+0000","last_undegraded":"2024-04-26T07:58:33.665837+0000","last_fullsized":"2024-04-26T07:58:33.665837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-04-26T07:58:33.665731+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-04-26T07:58:33.665731+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.665731+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:32.080803+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.163908+0000","last_change":"2024-04-26T07:57:57.163967+0000","last_active":"2024-04-26T07:57:57.163908+0000","last_peered":"2024-04-26T07:57:57.163908+0000","last_clean":"2024-04-26T07:57:57.163908+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:57:57.163908+0000","last_undegraded":"2024-04-26T07:57:57.163908+0000","last_fullsized":"2024-04-26T07:57:57.163908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:57.163800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:57.163800+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.163800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:45.732682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.759667+0000","last_change":"2024-04-26T07:58:23.759703+0000","last_active":"2024-04-26T07:58:23.759667+0000","last_peered":"2024-04-26T07:58:23.759667+0000","last_clean":"2024-04-26T07:58:23.759667+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:58:23.759667+0000","last_undegraded":"2024-04-26T07:58:23.759667+0000","last_fullsized":"2024-04-26T07:58:23.759667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:23.759573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:23.759573+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.759573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:14.550610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.292948+0000","last_change":"2024-04-26T07:57:48.292998+0000","last_active":"2024-04-26T07:57:48.292948+0000","last_peered":"2024-04-26T07:57:48.292948+0000","last_clean":"2024-04-26T07:57:48.292948+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:57:48.292948+0000","last_undegraded":"2024-04-26T07:57:48.292948+0000","last_fullsized":"2024-04-26T07:57:48.292948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.292808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:10.416826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.928685+0000","last_change":"2024-04-26T07:57:44.928755+0000","last_active":"2024-04-26T07:57:44.928685+0000","last_peered":"2024-04-26T07:57:44.928685+0000","last_clean":"2024-04-26T07:57:44.928685+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:57:44.928685+0000","last_undegraded":"2024-04-26T07:57:44.928685+0000","last_fullsized":"2024-04-26T07:57:44.928685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.928570+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.353478+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.037343+0000","last_change":"2024-04-26T07:58:00.037367+0000","last_active":"2024-04-26T07:58:00.037343+0000","last_peered":"2024-04-26T07:58:00.037343+0000","last_clean":"2024-04-26T07:58:00.037343+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:58:00.037343+0000","last_undegraded":"2024-04-26T07:58:00.037343+0000","last_fullsized":"2024-04-26T07:58:00.037343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:00.037251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:00.037251+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.037251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:24.628418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.158421+0000","last_change":"2024-04-26T07:58:27.158448+0000","last_active":"2024-04-26T07:58:27.158421+0000","last_peered":"2024-04-26T07:58:27.158421+0000","last_clean":"2024-04-26T07:58:27.158421+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:58:27.158421+0000","last_undegraded":"2024-04-26T07:58:27.158421+0000","last_fullsized":"2024-04-26T07:58:27.158421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:27.158330+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:27.158330+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.158330+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:12.762499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.008147+0000","last_change":"2024-04-26T07:57:52.008175+0000","last_active":"2024-04-26T07:57:52.008147+0000","last_peered":"2024-04-26T07:57:52.008147+0000","last_clean":"2024-04-26T07:57:52.008147+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:52.008147+0000","last_undegraded":"2024-04-26T07:57:52.008147+0000","last_fullsized":"2024-04-26T07:57:52.008147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:52.008051+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:52.008051+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.008051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:54.902871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448344+0000","last_change":"2024-04-26T07:54:15.023312+0000","last_active":"2024-04-26T07:57:35.448344+0000","last_peered":"2024-04-26T07:57:35.448344+0000","last_clean":"2024-04-26T07:57:35.448344+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:57:35.448344+0000","last_undegraded":"2024-04-26T07:57:35.448344+0000","last_fullsized":"2024-04-26T07:57:35.448344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.893092+0000","last_change":"2024-04-26T07:57:56.893157+0000","last_active":"2024-04-26T07:57:56.893092+0000","last_peered":"2024-04-26T07:57:56.893092+0000","last_clean":"2024-04-26T07:57:56.893092+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:57:56.893092+0000","last_undegraded":"2024-04-26T07:57:56.893092+0000","last_fullsized":"2024-04-26T07:57:56.893092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:56.892989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:56.892989+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.892989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:19.992014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.289659+0000","last_change":"2024-04-26T07:57:45.289709+0000","last_active":"2024-04-26T07:57:45.289659+0000","last_peered":"2024-04-26T07:57:45.289659+0000","last_clean":"2024-04-26T07:57:45.289659+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:57:45.289659+0000","last_undegraded":"2024-04-26T07:57:45.289659+0000","last_fullsized":"2024-04-26T07:57:45.289659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.289560+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:24.532087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.293625+0000","last_change":"2024-04-26T07:57:39.293682+0000","last_active":"2024-04-26T07:57:39.293625+0000","last_peered":"2024-04-26T07:57:39.293625+0000","last_clean":"2024-04-26T07:57:39.293625+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:39.293625+0000","last_undegraded":"2024-04-26T07:57:39.293625+0000","last_fullsized":"2024-04-26T07:57:39.293625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.293505+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.009568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'13","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.649805+0000","last_change":"2024-04-26T07:58:29.649805+0000","last_active":"2024-04-26T07:58:29.649805+0000","last_peered":"2024-04-26T07:58:29.649805+0000","last_clean":"2024-04-26T07:58:29.649805+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:58:29.649805+0000","last_undegraded":"2024-04-26T07:58:29.649805+0000","last_fullsized":"2024-04-26T07:58:29.649805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-04-26T07:58:29.649659+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-04-26T07:58:29.649659+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.649659+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:41:47.366919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.432530+0000","last_change":"2024-04-26T07:58:21.432613+0000","last_active":"2024-04-26T07:58:21.432530+0000","last_peered":"2024-04-26T07:58:21.432530+0000","last_clean":"2024-04-26T07:58:21.432530+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:58:21.432530+0000","last_undegraded":"2024-04-26T07:58:21.432530+0000","last_fullsized":"2024-04-26T07:58:21.432530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-26T07:58:21.432427+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-26T07:58:21.432427+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.432427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:24.327247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448345+0000","last_change":"2024-04-26T07:54:15.028460+0000","last_active":"2024-04-26T07:57:35.448345+0000","last_peered":"2024-04-26T07:57:35.448345+0000","last_clean":"2024-04-26T07:57:35.448345+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:57:35.448345+0000","last_undegraded":"2024-04-26T07:57:35.448345+0000","last_fullsized":"2024-04-26T07:57:35.448345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:31.055729+0000","last_change":"2024-04-26T07:55:02.064457+0000","last_active":"2024-04-26T07:57:31.055729+0000","last_peered":"2024-04-26T07:57:31.055729+0000","last_clean":"2024-04-26T07:57:31.055729+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:57:31.055729+0000","last_undegraded":"2024-04-26T07:57:31.055729+0000","last_fullsized":"2024-04-26T07:57:31.055729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.098118+0000","last_change":"2024-04-26T07:58:02.098164+0000","last_active":"2024-04-26T07:58:02.098118+0000","last_peered":"2024-04-26T07:58:02.098118+0000","last_clean":"2024-04-26T07:58:02.098118+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:58:02.098118+0000","last_undegraded":"2024-04-26T07:58:02.098118+0000","last_fullsized":"2024-04-26T07:58:02.098118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-04-26T07:58:02.098032+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-04-26T07:58:02.098032+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.098032+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:12.785928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.160493+0000","last_change":"2024-04-26T07:57:36.160522+0000","last_active":"2024-04-26T07:57:36.160493+0000","last_peered":"2024-04-26T07:57:36.160493+0000","last_clean":"2024-04-26T07:57:36.160493+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:36.160493+0000","last_undegraded":"2024-04-26T07:57:36.160493+0000","last_fullsized":"2024-04-26T07:57:36.160493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.160401+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:38.276301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.200716+0000","last_change":"2024-04-26T07:57:55.200716+0000","last_active":"2024-04-26T07:57:55.200716+0000","last_peered":"2024-04-26T07:57:55.200716+0000","last_clean":"2024-04-26T07:57:55.200716+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:57:55.200716+0000","last_undegraded":"2024-04-26T07:57:55.200716+0000","last_fullsized":"2024-04-26T07:57:55.200716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:55.200595+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:55.200595+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.200595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:09.542065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.093408+0000","last_change":"2024-04-26T07:58:18.093446+0000","last_active":"2024-04-26T07:58:18.093408+0000","last_peered":"2024-04-26T07:58:18.093408+0000","last_clean":"2024-04-26T07:58:18.093408+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:58:18.093408+0000","last_undegraded":"2024-04-26T07:58:18.093408+0000","last_fullsized":"2024-04-26T07:58:18.093408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:18.093308+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:18.093308+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.093308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:46.206655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.131168+0000","last_change":"2024-04-26T07:58:28.131168+0000","last_active":"2024-04-26T07:58:28.131168+0000","last_peered":"2024-04-26T07:58:28.131168+0000","last_clean":"2024-04-26T07:58:28.131168+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:58:28.131168+0000","last_undegraded":"2024-04-26T07:58:28.131168+0000","last_fullsized":"2024-04-26T07:58:28.131168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:28.131035+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:28.131035+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.131035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.736994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.958182+0000","last_change":"2024-04-26T07:57:39.958217+0000","last_active":"2024-04-26T07:57:39.958182+0000","last_peered":"2024-04-26T07:57:39.958182+0000","last_clean":"2024-04-26T07:57:39.958182+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:57:39.958182+0000","last_undegraded":"2024-04-26T07:57:39.958182+0000","last_fullsized":"2024-04-26T07:57:39.958182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.958089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.571578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'50","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.994894+0000","last_change":"2024-04-26T07:57:40.994938+0000","last_active":"2024-04-26T07:57:40.994894+0000","last_peered":"2024-04-26T07:57:40.994894+0000","last_clean":"2024-04-26T07:57:40.994894+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:57:40.994894+0000","last_undegraded":"2024-04-26T07:57:40.994894+0000","last_fullsized":"2024-04-26T07:57:40.994894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.994806+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:36.917229+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.264978+0000","last_change":"2024-04-26T07:57:51.265003+0000","last_active":"2024-04-26T07:57:51.264978+0000","last_peered":"2024-04-26T07:57:51.264978+0000","last_clean":"2024-04-26T07:57:51.264978+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:57:51.264978+0000","last_undegraded":"2024-04-26T07:57:51.264978+0000","last_fullsized":"2024-04-26T07:57:51.264978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:51.264883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:51.264883+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.264883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.713422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.068192+0000","last_change":"2024-04-26T07:57:52.068192+0000","last_active":"2024-04-26T07:57:52.068192+0000","last_peered":"2024-04-26T07:57:52.068192+0000","last_clean":"2024-04-26T07:57:52.068192+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:52.068192+0000","last_undegraded":"2024-04-26T07:57:52.068192+0000","last_fullsized":"2024-04-26T07:57:52.068192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:52.068074+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:52.068074+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.068074+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:08.194548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.091526+0000","last_change":"2024-04-26T07:58:12.091526+0000","last_active":"2024-04-26T07:58:12.091526+0000","last_peered":"2024-04-26T07:58:12.091526+0000","last_clean":"2024-04-26T07:58:12.091526+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:58:12.091526+0000","last_undegraded":"2024-04-26T07:58:12.091526+0000","last_fullsized":"2024-04-26T07:58:12.091526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:12.091376+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:12.091376+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.091376+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:28.508324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.210467+0000","last_change":"2024-04-26T07:58:22.210499+0000","last_active":"2024-04-26T07:58:22.210467+0000","last_peered":"2024-04-26T07:58:22.210467+0000","last_clean":"2024-04-26T07:58:22.210467+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:58:22.210467+0000","last_undegraded":"2024-04-26T07:58:22.210467+0000","last_fullsized":"2024-04-26T07:58:22.210467+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-04-26T07:58:22.210379+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-04-26T07:58:22.210379+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.210379+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:11:08.592322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448172+0000","last_change":"2024-04-26T07:54:06.676909+0000","last_active":"2024-04-26T07:57:35.448172+0000","last_peered":"2024-04-26T07:57:35.448172+0000","last_clean":"2024-04-26T07:57:35.448172+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:57:35.448172+0000","last_undegraded":"2024-04-26T07:57:35.448172+0000","last_fullsized":"2024-04-26T07:57:35.448172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448226+0000","last_change":"2024-04-26T07:54:15.028934+0000","last_active":"2024-04-26T07:57:35.448226+0000","last_peered":"2024-04-26T07:57:35.448226+0000","last_clean":"2024-04-26T07:57:35.448226+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:57:35.448226+0000","last_undegraded":"2024-04-26T07:57:35.448226+0000","last_fullsized":"2024-04-26T07:57:35.448226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"29'2","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.019436+0000","last_change":"2024-04-26T07:57:51.019436+0000","last_active":"2024-04-26T07:57:51.019436+0000","last_peered":"2024-04-26T07:57:51.019436+0000","last_clean":"2024-04-26T07:57:51.019436+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:57:51.019436+0000","last_undegraded":"2024-04-26T07:57:51.019436+0000","last_fullsized":"2024-04-26T07:57:51.019436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:51.019305+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:51.019305+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.019305+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:10.272637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.023082+0000","last_change":"2024-04-26T07:57:43.023139+0000","last_active":"2024-04-26T07:57:43.023082+0000","last_peered":"2024-04-26T07:57:43.023082+0000","last_clean":"2024-04-26T07:57:43.023082+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:57:43.023082+0000","last_undegraded":"2024-04-26T07:57:43.023082+0000","last_fullsized":"2024-04-26T07:57:43.023082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.022950+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:31.923488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.045605+0000","last_change":"2024-04-26T07:57:38.045637+0000","last_active":"2024-04-26T07:57:38.045605+0000","last_peered":"2024-04-26T07:57:38.045605+0000","last_clean":"2024-04-26T07:57:38.045605+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:57:38.045605+0000","last_undegraded":"2024-04-26T07:57:38.045605+0000","last_fullsized":"2024-04-26T07:57:38.045605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.045507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:26.957086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.449437+0000","last_change":"2024-04-26T07:58:23.449465+0000","last_active":"2024-04-26T07:58:23.449437+0000","last_peered":"2024-04-26T07:58:23.449437+0000","last_clean":"2024-04-26T07:58:23.449437+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:58:23.449437+0000","last_undegraded":"2024-04-26T07:58:23.449437+0000","last_fullsized":"2024-04-26T07:58:23.449437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'81","last_scrub_stamp":"2024-04-26T07:58:23.449328+0000","last_deep_scrub":"29'81","last_deep_scrub_stamp":"2024-04-26T07:58:23.449328+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.449328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:09.228090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.172879+0000","last_change":"2024-04-26T07:58:16.172908+0000","last_active":"2024-04-26T07:58:16.172879+0000","last_peered":"2024-04-26T07:58:16.172879+0000","last_clean":"2024-04-26T07:58:16.172879+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:58:16.172879+0000","last_undegraded":"2024-04-26T07:58:16.172879+0000","last_fullsized":"2024-04-26T07:58:16.172879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:16.172787+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:16.172787+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.172787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:16.279358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448153+0000","last_change":"2024-04-26T07:54:06.674945+0000","last_active":"2024-04-26T07:57:35.448153+0000","last_peered":"2024-04-26T07:57:35.448153+0000","last_clean":"2024-04-26T07:57:35.448153+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:57:35.448153+0000","last_undegraded":"2024-04-26T07:57:35.448153+0000","last_fullsized":"2024-04-26T07:57:35.448153+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.793998+0000","last_change":"2024-04-26T07:58:19.793998+0000","last_active":"2024-04-26T07:58:19.793998+0000","last_peered":"2024-04-26T07:58:19.793998+0000","last_clean":"2024-04-26T07:58:19.793998+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:58:19.793998+0000","last_undegraded":"2024-04-26T07:58:19.793998+0000","last_fullsized":"2024-04-26T07:58:19.793998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:19.793877+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:19.793877+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.793877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:27.595245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.922153+0000","last_change":"2024-04-26T07:57:37.922184+0000","last_active":"2024-04-26T07:57:37.922153+0000","last_peered":"2024-04-26T07:57:37.922153+0000","last_clean":"2024-04-26T07:57:37.922153+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:57:37.922153+0000","last_undegraded":"2024-04-26T07:57:37.922153+0000","last_fullsized":"2024-04-26T07:57:37.922153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.922054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:17.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.125161+0000","last_change":"2024-04-26T07:57:38.125161+0000","last_active":"2024-04-26T07:57:38.125161+0000","last_peered":"2024-04-26T07:57:38.125161+0000","last_clean":"2024-04-26T07:57:38.125161+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:38.125161+0000","last_undegraded":"2024-04-26T07:57:38.125161+0000","last_fullsized":"2024-04-26T07:57:38.125161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.125031+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:12.231248+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.031627+0000","last_change":"2024-04-26T07:57:58.031627+0000","last_active":"2024-04-26T07:57:58.031627+0000","last_peered":"2024-04-26T07:57:58.031627+0000","last_clean":"2024-04-26T07:57:58.031627+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:57:58.031627+0000","last_undegraded":"2024-04-26T07:57:58.031627+0000","last_fullsized":"2024-04-26T07:57:58.031627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:58.031507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:58.031507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.031507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:50.696106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.218409+0000","last_change":"2024-04-26T07:58:04.218474+0000","last_active":"2024-04-26T07:58:04.218409+0000","last_peered":"2024-04-26T07:58:04.218409+0000","last_clean":"2024-04-26T07:58:04.218409+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:58:04.218409+0000","last_undegraded":"2024-04-26T07:58:04.218409+0000","last_fullsized":"2024-04-26T07:58:04.218409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:04.218304+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:04.218304+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.218304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:25.813231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.817774+0000","last_change":"2024-04-26T07:58:14.817842+0000","last_active":"2024-04-26T07:58:14.817774+0000","last_peered":"2024-04-26T07:58:14.817774+0000","last_clean":"2024-04-26T07:58:14.817774+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:58:14.817774+0000","last_undegraded":"2024-04-26T07:58:14.817774+0000","last_fullsized":"2024-04-26T07:58:14.817774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:58:14.817630+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:58:14.817630+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.817630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:31.670652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.234012+0000","last_change":"2024-04-26T07:58:13.234012+0000","last_active":"2024-04-26T07:58:13.234012+0000","last_peered":"2024-04-26T07:58:13.234012+0000","last_clean":"2024-04-26T07:58:13.234012+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:58:13.234012+0000","last_undegraded":"2024-04-26T07:58:13.234012+0000","last_fullsized":"2024-04-26T07:58:13.234012+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:13.233897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:13.233897+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.233897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:31.834744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.783978+0000","last_change":"2024-04-26T07:58:07.783978+0000","last_active":"2024-04-26T07:58:07.783978+0000","last_peered":"2024-04-26T07:58:07.783978+0000","last_clean":"2024-04-26T07:58:07.783978+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:58:07.783978+0000","last_undegraded":"2024-04-26T07:58:07.783978+0000","last_fullsized":"2024-04-26T07:58:07.783978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:07.783854+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:07.783854+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.783854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:58.598461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.191400+0000","last_change":"2024-04-26T07:57:53.191428+0000","last_active":"2024-04-26T07:57:53.191400+0000","last_peered":"2024-04-26T07:57:53.191400+0000","last_clean":"2024-04-26T07:57:53.191400+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:57:53.191400+0000","last_undegraded":"2024-04-26T07:57:53.191400+0000","last_fullsized":"2024-04-26T07:57:53.191400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:53.191310+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:53.191310+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.191310+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:50.616218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.312009+0000","last_change":"2024-04-26T07:57:42.312009+0000","last_active":"2024-04-26T07:57:42.312009+0000","last_peered":"2024-04-26T07:57:42.312009+0000","last_clean":"2024-04-26T07:57:42.312009+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:42.312009+0000","last_undegraded":"2024-04-26T07:57:42.312009+0000","last_fullsized":"2024-04-26T07:57:42.312009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.311876+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:19:59.304320+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.073448+0000","last_change":"2024-04-26T07:57:37.073448+0000","last_active":"2024-04-26T07:57:37.073448+0000","last_peered":"2024-04-26T07:57:37.073448+0000","last_clean":"2024-04-26T07:57:37.073448+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:57:37.073448+0000","last_undegraded":"2024-04-26T07:57:37.073448+0000","last_fullsized":"2024-04-26T07:57:37.073448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.073329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:12.794354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:39.893856+0000","last_change":"2024-04-26T07:54:25.038740+0000","last_active":"2024-04-26T07:56:39.893856+0000","last_peered":"2024-04-26T07:56:39.893856+0000","last_clean":"2024-04-26T07:56:39.893856+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:56:39.893856+0000","last_undegraded":"2024-04-26T07:56:39.893856+0000","last_fullsized":"2024-04-26T07:56:39.893856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.775067+0000","last_change":"2024-04-26T07:58:16.775067+0000","last_active":"2024-04-26T07:58:16.775067+0000","last_peered":"2024-04-26T07:58:16.775067+0000","last_clean":"2024-04-26T07:58:16.775067+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:58:16.775067+0000","last_undegraded":"2024-04-26T07:58:16.775067+0000","last_fullsized":"2024-04-26T07:58:16.775067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:16.774960+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:16.774960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.774960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:22:18.154848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448165+0000","last_change":"2024-04-26T07:54:06.675466+0000","last_active":"2024-04-26T07:57:35.448165+0000","last_peered":"2024-04-26T07:57:35.448165+0000","last_clean":"2024-04-26T07:57:35.448165+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:57:35.448165+0000","last_undegraded":"2024-04-26T07:57:35.448165+0000","last_fullsized":"2024-04-26T07:57:35.448165+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.260678+0000","last_change":"2024-04-26T07:58:15.260678+0000","last_active":"2024-04-26T07:58:15.260678+0000","last_peered":"2024-04-26T07:58:15.260678+0000","last_clean":"2024-04-26T07:58:15.260678+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:58:15.260678+0000","last_undegraded":"2024-04-26T07:58:15.260678+0000","last_fullsized":"2024-04-26T07:58:15.260678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.260556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.260556+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.260556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:37.478244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.004825+0000","last_change":"2024-04-26T07:57:50.004825+0000","last_active":"2024-04-26T07:57:50.004825+0000","last_peered":"2024-04-26T07:57:50.004825+0000","last_clean":"2024-04-26T07:57:50.004825+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:57:50.004825+0000","last_undegraded":"2024-04-26T07:57:50.004825+0000","last_fullsized":"2024-04-26T07:57:50.004825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:50.004662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:50.004662+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.004662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.926317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.047000+0000","last_change":"2024-04-26T07:58:06.047055+0000","last_active":"2024-04-26T07:58:06.047000+0000","last_peered":"2024-04-26T07:58:06.047000+0000","last_clean":"2024-04-26T07:58:06.047000+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:58:06.047000+0000","last_undegraded":"2024-04-26T07:58:06.047000+0000","last_fullsized":"2024-04-26T07:58:06.047000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:06.046909+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:06.046909+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.046909+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:20.722729+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.989174+0000","last_change":"2024-04-26T07:57:56.989200+0000","last_active":"2024-04-26T07:57:56.989174+0000","last_peered":"2024-04-26T07:57:56.989174+0000","last_clean":"2024-04-26T07:57:56.989174+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:57:56.989174+0000","last_undegraded":"2024-04-26T07:57:56.989174+0000","last_fullsized":"2024-04-26T07:57:56.989174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:56.989067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:56.989067+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.989067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:13.842088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.160919+0000","last_change":"2024-04-26T07:58:34.160947+0000","last_active":"2024-04-26T07:58:34.160919+0000","last_peered":"2024-04-26T07:58:34.160919+0000","last_clean":"2024-04-26T07:58:34.160919+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:58:34.160919+0000","last_undegraded":"2024-04-26T07:58:34.160919+0000","last_fullsized":"2024-04-26T07:58:34.160919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:34.160829+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:34.160829+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.160829+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:50.498180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.199146+0000","last_change":"2024-04-26T07:57:59.199146+0000","last_active":"2024-04-26T07:57:59.199146+0000","last_peered":"2024-04-26T07:57:59.199146+0000","last_clean":"2024-04-26T07:57:59.199146+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:57:59.199146+0000","last_undegraded":"2024-04-26T07:57:59.199146+0000","last_fullsized":"2024-04-26T07:57:59.199146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:59.199017+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:59.199017+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.199017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:50.799925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.278734+0000","last_change":"2024-04-26T07:58:14.278734+0000","last_active":"2024-04-26T07:58:14.278734+0000","last_peered":"2024-04-26T07:58:14.278734+0000","last_clean":"2024-04-26T07:58:14.278734+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:58:14.278734+0000","last_undegraded":"2024-04-26T07:58:14.278734+0000","last_fullsized":"2024-04-26T07:58:14.278734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:14.278592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:14.278592+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.278592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:59.568200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.823453+0000","last_change":"2024-04-26T07:58:20.823477+0000","last_active":"2024-04-26T07:58:20.823453+0000","last_peered":"2024-04-26T07:58:20.823453+0000","last_clean":"2024-04-26T07:58:20.823453+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:58:20.823453+0000","last_undegraded":"2024-04-26T07:58:20.823453+0000","last_fullsized":"2024-04-26T07:58:20.823453+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:20.823362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:20.823362+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.823362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:22.325865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.898013+0000","last_change":"2024-04-26T07:57:59.898013+0000","last_active":"2024-04-26T07:57:59.898013+0000","last_peered":"2024-04-26T07:57:59.898013+0000","last_clean":"2024-04-26T07:57:59.898013+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:57:59.898013+0000","last_undegraded":"2024-04-26T07:57:59.898013+0000","last_fullsized":"2024-04-26T07:57:59.898013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:59.897890+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:59.897890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.897890+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:48.189618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'76","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.090487+0000","last_change":"2024-04-26T07:57:45.090487+0000","last_active":"2024-04-26T07:57:45.090487+0000","last_peered":"2024-04-26T07:57:45.090487+0000","last_clean":"2024-04-26T07:57:45.090487+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:57:45.090487+0000","last_undegraded":"2024-04-26T07:57:45.090487+0000","last_fullsized":"2024-04-26T07:57:45.090487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'76","last_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_deep_scrub":"29'76","last_deep_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.090359+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:43.280370+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.248747+0000","last_change":"2024-04-26T07:57:37.248747+0000","last_active":"2024-04-26T07:57:37.248747+0000","last_peered":"2024-04-26T07:57:37.248747+0000","last_clean":"2024-04-26T07:57:37.248747+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:57:37.248747+0000","last_undegraded":"2024-04-26T07:57:37.248747+0000","last_fullsized":"2024-04-26T07:57:37.248747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.248591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:12.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.905867+0000","last_change":"2024-04-26T07:57:58.905929+0000","last_active":"2024-04-26T07:57:58.905867+0000","last_peered":"2024-04-26T07:57:58.905867+0000","last_clean":"2024-04-26T07:57:58.905867+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:57:58.905867+0000","last_undegraded":"2024-04-26T07:57:58.905867+0000","last_fullsized":"2024-04-26T07:57:58.905867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:58.905750+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:58.905750+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.905750+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:46.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.558052+0000","last_change":"2024-04-26T07:55:02.058346+0000","last_active":"2024-04-26T07:57:34.558052+0000","last_peered":"2024-04-26T07:57:34.558052+0000","last_clean":"2024-04-26T07:57:34.558052+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:57:34.558052+0000","last_undegraded":"2024-04-26T07:57:34.558052+0000","last_fullsized":"2024-04-26T07:57:34.558052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.737929+0000","last_change":"2024-04-26T07:58:26.737959+0000","last_active":"2024-04-26T07:58:26.737929+0000","last_peered":"2024-04-26T07:58:26.737929+0000","last_clean":"2024-04-26T07:58:26.737929+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:58:26.737929+0000","last_undegraded":"2024-04-26T07:58:26.737929+0000","last_fullsized":"2024-04-26T07:58:26.737929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:26.737834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:26.737834+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.737834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:16.237516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448180+0000","last_change":"2024-04-26T07:54:06.674864+0000","last_active":"2024-04-26T07:57:35.448180+0000","last_peered":"2024-04-26T07:57:35.448180+0000","last_clean":"2024-04-26T07:57:35.448180+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:57:35.448180+0000","last_undegraded":"2024-04-26T07:57:35.448180+0000","last_fullsized":"2024-04-26T07:57:35.448180+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.945054+0000","last_change":"2024-04-26T07:57:44.945054+0000","last_active":"2024-04-26T07:57:44.945054+0000","last_peered":"2024-04-26T07:57:44.945054+0000","last_clean":"2024-04-26T07:57:44.945054+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:57:44.945054+0000","last_undegraded":"2024-04-26T07:57:44.945054+0000","last_fullsized":"2024-04-26T07:57:44.945054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.944890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:30.234498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.075367+0000","last_change":"2024-04-26T07:57:39.075367+0000","last_active":"2024-04-26T07:57:39.075367+0000","last_peered":"2024-04-26T07:57:39.075367+0000","last_clean":"2024-04-26T07:57:39.075367+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:57:39.075367+0000","last_undegraded":"2024-04-26T07:57:39.075367+0000","last_fullsized":"2024-04-26T07:57:39.075367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.075180+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:53.257286+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":368,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.140074+0000","last_change":"2024-04-26T07:57:35.140074+0000","last_active":"2024-04-26T07:57:35.140074+0000","last_peered":"2024-04-26T07:57:35.140074+0000","last_clean":"2024-04-26T07:57:35.140074+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:35.140074+0000","last_undegraded":"2024-04-26T07:57:35.140074+0000","last_fullsized":"2024-04-26T07:57:35.140074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.139950+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:52.425998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.144739+0000","last_change":"2024-04-26T07:58:19.144773+0000","last_active":"2024-04-26T07:58:19.144739+0000","last_peered":"2024-04-26T07:58:19.144739+0000","last_clean":"2024-04-26T07:58:19.144739+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:58:19.144739+0000","last_undegraded":"2024-04-26T07:58:19.144739+0000","last_fullsized":"2024-04-26T07:58:19.144739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:19.144629+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:19.144629+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.144629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:47.863551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.070209+0000","last_change":"2024-04-26T07:58:10.070209+0000","last_active":"2024-04-26T07:58:10.070209+0000","last_peered":"2024-04-26T07:58:10.070209+0000","last_clean":"2024-04-26T07:58:10.070209+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:58:10.070209+0000","last_undegraded":"2024-04-26T07:58:10.070209+0000","last_fullsized":"2024-04-26T07:58:10.070209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:10.070084+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:10.070084+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.070084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:47.245235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448228+0000","last_change":"2024-04-26T07:54:15.023916+0000","last_active":"2024-04-26T07:57:35.448228+0000","last_peered":"2024-04-26T07:57:35.448228+0000","last_clean":"2024-04-26T07:57:35.448228+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:57:35.448228+0000","last_undegraded":"2024-04-26T07:57:35.448228+0000","last_fullsized":"2024-04-26T07:57:35.448228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.774140+0000","last_change":"2024-04-26T07:58:21.774140+0000","last_active":"2024-04-26T07:58:21.774140+0000","last_peered":"2024-04-26T07:58:21.774140+0000","last_clean":"2024-04-26T07:58:21.774140+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:58:21.774140+0000","last_undegraded":"2024-04-26T07:58:21.774140+0000","last_fullsized":"2024-04-26T07:58:21.774140+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:21.774021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:21.774021+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.774021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:49.274483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.927279+0000","last_change":"2024-04-26T07:57:35.927279+0000","last_active":"2024-04-26T07:57:35.927279+0000","last_peered":"2024-04-26T07:57:35.927279+0000","last_clean":"2024-04-26T07:57:35.927279+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:57:35.927279+0000","last_undegraded":"2024-04-26T07:57:35.927279+0000","last_fullsized":"2024-04-26T07:57:35.927279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.927147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:35.660610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.109570+0000","last_change":"2024-04-26T07:58:04.109570+0000","last_active":"2024-04-26T07:58:04.109570+0000","last_peered":"2024-04-26T07:58:04.109570+0000","last_clean":"2024-04-26T07:58:04.109570+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:58:04.109570+0000","last_undegraded":"2024-04-26T07:58:04.109570+0000","last_fullsized":"2024-04-26T07:58:04.109570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:58:04.109417+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:58:04.109417+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.109417+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:41:43.464915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.023125+0000","last_change":"2024-04-26T07:57:39.023125+0000","last_active":"2024-04-26T07:57:39.023125+0000","last_peered":"2024-04-26T07:57:39.023125+0000","last_clean":"2024-04-26T07:57:39.023125+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:39.023125+0000","last_undegraded":"2024-04-26T07:57:39.023125+0000","last_fullsized":"2024-04-26T07:57:39.023125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.023000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:21.471539+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.141947+0000","last_change":"2024-04-26T07:58:32.141975+0000","last_active":"2024-04-26T07:58:32.141947+0000","last_peered":"2024-04-26T07:58:32.141947+0000","last_clean":"2024-04-26T07:58:32.141947+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:58:32.141947+0000","last_undegraded":"2024-04-26T07:58:32.141947+0000","last_fullsized":"2024-04-26T07:58:32.141947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-26T07:58:32.141831+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-26T07:58:32.141831+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.141831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:07.275715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.223158+0000","last_change":"2024-04-26T07:58:03.223158+0000","last_active":"2024-04-26T07:58:03.223158+0000","last_peered":"2024-04-26T07:58:03.223158+0000","last_clean":"2024-04-26T07:58:03.223158+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:58:03.223158+0000","last_undegraded":"2024-04-26T07:58:03.223158+0000","last_fullsized":"2024-04-26T07:58:03.223158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:03.223053+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:03.223053+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.223053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:51.791934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.150682+0000","last_change":"2024-04-26T07:58:25.150682+0000","last_active":"2024-04-26T07:58:25.150682+0000","last_peered":"2024-04-26T07:58:25.150682+0000","last_clean":"2024-04-26T07:58:25.150682+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:58:25.150682+0000","last_undegraded":"2024-04-26T07:58:25.150682+0000","last_fullsized":"2024-04-26T07:58:25.150682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:25.150561+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:25.150561+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.150561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:35.838457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448209+0000","last_change":"2024-04-26T07:54:06.675403+0000","last_active":"2024-04-26T07:57:35.448209+0000","last_peered":"2024-04-26T07:57:35.448209+0000","last_clean":"2024-04-26T07:57:35.448209+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:57:35.448209+0000","last_undegraded":"2024-04-26T07:57:35.448209+0000","last_fullsized":"2024-04-26T07:57:35.448209+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:05.666873+0000","last_clean_scrub_stamp":"2024-04-26T07:54:05.666873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.983919+0000","last_change":"2024-04-26T07:57:43.983919+0000","last_active":"2024-04-26T07:57:43.983919+0000","last_peered":"2024-04-26T07:57:43.983919+0000","last_clean":"2024-04-26T07:57:43.983919+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:57:43.983919+0000","last_undegraded":"2024-04-26T07:57:43.983919+0000","last_fullsized":"2024-04-26T07:57:43.983919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.983811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:02.584658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.313398+0000","last_change":"2024-04-26T07:57:40.313398+0000","last_active":"2024-04-26T07:57:40.313398+0000","last_peered":"2024-04-26T07:57:40.313398+0000","last_clean":"2024-04-26T07:57:40.313398+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:57:40.313398+0000","last_undegraded":"2024-04-26T07:57:40.313398+0000","last_fullsized":"2024-04-26T07:57:40.313398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.313247+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:44.555766+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.130608+0000","last_change":"2024-04-26T07:57:34.130608+0000","last_active":"2024-04-26T07:57:34.130608+0000","last_peered":"2024-04-26T07:57:34.130608+0000","last_clean":"2024-04-26T07:57:34.130608+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:57:34.130608+0000","last_undegraded":"2024-04-26T07:57:34.130608+0000","last_fullsized":"2024-04-26T07:57:34.130608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_clean_scrub_stamp":"2024-04-26T07:57:34.130497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:01.130219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.483278+0000","last_change":"2024-04-26T07:58:25.483303+0000","last_active":"2024-04-26T07:58:25.483278+0000","last_peered":"2024-04-26T07:58:25.483278+0000","last_clean":"2024-04-26T07:58:25.483278+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:58:25.483278+0000","last_undegraded":"2024-04-26T07:58:25.483278+0000","last_fullsized":"2024-04-26T07:58:25.483278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.483179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.483179+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.483179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:12.197354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.417868+0000","last_change":"2024-04-26T07:58:22.417868+0000","last_active":"2024-04-26T07:58:22.417868+0000","last_peered":"2024-04-26T07:58:22.417868+0000","last_clean":"2024-04-26T07:58:22.417868+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:58:22.417868+0000","last_undegraded":"2024-04-26T07:58:22.417868+0000","last_fullsized":"2024-04-26T07:58:22.417868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:22.417750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:22.417750+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.417750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:46.601587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.246787+0000","last_change":"2024-04-26T07:58:07.246815+0000","last_active":"2024-04-26T07:58:07.246787+0000","last_peered":"2024-04-26T07:58:07.246787+0000","last_clean":"2024-04-26T07:58:07.246787+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:58:07.246787+0000","last_undegraded":"2024-04-26T07:58:07.246787+0000","last_fullsized":"2024-04-26T07:58:07.246787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:07.246695+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:07.246695+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.246695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.647472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.155003+0000","last_change":"2024-04-26T07:58:26.155042+0000","last_active":"2024-04-26T07:58:26.155003+0000","last_peered":"2024-04-26T07:58:26.155003+0000","last_clean":"2024-04-26T07:58:26.155003+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:58:26.155003+0000","last_undegraded":"2024-04-26T07:58:26.155003+0000","last_fullsized":"2024-04-26T07:58:26.155003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:26.154907+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:26.154907+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.154907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:13.155009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.997479+0000","last_change":"2024-04-26T07:57:49.997522+0000","last_active":"2024-04-26T07:57:49.997479+0000","last_peered":"2024-04-26T07:57:49.997479+0000","last_clean":"2024-04-26T07:57:49.997479+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:57:49.997479+0000","last_undegraded":"2024-04-26T07:57:49.997479+0000","last_fullsized":"2024-04-26T07:57:49.997479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.997377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.997377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.997377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:50.303288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.959591+0000","last_change":"2024-04-26T07:57:38.959627+0000","last_active":"2024-04-26T07:57:38.959591+0000","last_peered":"2024-04-26T07:57:38.959591+0000","last_clean":"2024-04-26T07:57:38.959591+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:57:38.959591+0000","last_undegraded":"2024-04-26T07:57:38.959591+0000","last_fullsized":"2024-04-26T07:57:38.959591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.959495+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:02.058520+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.004289+0000","last_change":"2024-04-26T07:57:59.004319+0000","last_active":"2024-04-26T07:57:59.004289+0000","last_peered":"2024-04-26T07:57:59.004289+0000","last_clean":"2024-04-26T07:57:59.004289+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:57:59.004289+0000","last_undegraded":"2024-04-26T07:57:59.004289+0000","last_fullsized":"2024-04-26T07:57:59.004289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:59.004197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:59.004197+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.004197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.386140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.711972+0000","last_change":"2024-04-26T07:58:34.712003+0000","last_active":"2024-04-26T07:58:34.711972+0000","last_peered":"2024-04-26T07:58:34.711972+0000","last_clean":"2024-04-26T07:58:34.711972+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:58:34.711972+0000","last_undegraded":"2024-04-26T07:58:34.711972+0000","last_fullsized":"2024-04-26T07:58:34.711972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:34.711869+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:34.711869+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.711869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:20.724124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.212852+0000","last_change":"2024-04-26T07:57:58.212898+0000","last_active":"2024-04-26T07:57:58.212852+0000","last_peered":"2024-04-26T07:57:58.212852+0000","last_clean":"2024-04-26T07:57:58.212852+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:58.212852+0000","last_undegraded":"2024-04-26T07:57:58.212852+0000","last_fullsized":"2024-04-26T07:57:58.212852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:57:58.212714+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:57:58.212714+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.212714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:57.946177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.269048+0000","last_change":"2024-04-26T07:58:16.269076+0000","last_active":"2024-04-26T07:58:16.269048+0000","last_peered":"2024-04-26T07:58:16.269048+0000","last_clean":"2024-04-26T07:58:16.269048+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:58:16.269048+0000","last_undegraded":"2024-04-26T07:58:16.269048+0000","last_fullsized":"2024-04-26T07:58:16.269048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:16.268935+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:16.268935+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.268935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:03.638319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.982361+0000","last_change":"2024-04-26T07:57:45.982384+0000","last_active":"2024-04-26T07:57:45.982361+0000","last_peered":"2024-04-26T07:57:45.982361+0000","last_clean":"2024-04-26T07:57:45.982361+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:57:45.982361+0000","last_undegraded":"2024-04-26T07:57:45.982361+0000","last_fullsized":"2024-04-26T07:57:45.982361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.982268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:08.199956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.056129+0000","last_change":"2024-04-26T07:57:49.056205+0000","last_active":"2024-04-26T07:57:49.056129+0000","last_peered":"2024-04-26T07:57:49.056129+0000","last_clean":"2024-04-26T07:57:49.056129+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:49.056129+0000","last_undegraded":"2024-04-26T07:57:49.056129+0000","last_fullsized":"2024-04-26T07:57:49.056129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.056026+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:29.927433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.282662+0000","last_change":"2024-04-26T07:57:47.282688+0000","last_active":"2024-04-26T07:57:47.282662+0000","last_peered":"2024-04-26T07:57:47.282662+0000","last_clean":"2024-04-26T07:57:47.282662+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:57:47.282662+0000","last_undegraded":"2024-04-26T07:57:47.282662+0000","last_fullsized":"2024-04-26T07:57:47.282662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.282574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.631333+0000","last_change":"2024-04-26T07:58:30.631360+0000","last_active":"2024-04-26T07:58:30.631333+0000","last_peered":"2024-04-26T07:58:30.631333+0000","last_clean":"2024-04-26T07:58:30.631333+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:58:30.631333+0000","last_undegraded":"2024-04-26T07:58:30.631333+0000","last_fullsized":"2024-04-26T07:58:30.631333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:30.631242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:30.631242+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.631242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:44.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'5","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.567388+0000","last_change":"2024-04-26T07:55:02.054995+0000","last_active":"2024-04-26T07:57:24.567388+0000","last_peered":"2024-04-26T07:57:24.567388+0000","last_clean":"2024-04-26T07:57:24.567388+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:57:24.567388+0000","last_undegraded":"2024-04-26T07:57:24.567388+0000","last_fullsized":"2024-04-26T07:57:24.567388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:15.982718+0000","last_clean_scrub_stamp":"2024-04-26T07:54:15.982718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.238344+0000","last_change":"2024-04-26T07:58:08.238368+0000","last_active":"2024-04-26T07:58:08.238344+0000","last_peered":"2024-04-26T07:58:08.238344+0000","last_clean":"2024-04-26T07:58:08.238344+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:58:08.238344+0000","last_undegraded":"2024-04-26T07:58:08.238344+0000","last_fullsized":"2024-04-26T07:58:08.238344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:08.238248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:08.238248+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.238248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:31.337273+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.302541+0000","last_change":"2024-04-26T07:57:50.302582+0000","last_active":"2024-04-26T07:57:50.302541+0000","last_peered":"2024-04-26T07:57:50.302541+0000","last_clean":"2024-04-26T07:57:50.302541+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:57:50.302541+0000","last_undegraded":"2024-04-26T07:57:50.302541+0000","last_fullsized":"2024-04-26T07:57:50.302541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:50.302445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:50.302445+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.302445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:36.538951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.027530+0000","last_change":"2024-04-26T07:57:48.027568+0000","last_active":"2024-04-26T07:57:48.027530+0000","last_peered":"2024-04-26T07:57:48.027530+0000","last_clean":"2024-04-26T07:57:48.027530+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:48.027530+0000","last_undegraded":"2024-04-26T07:57:48.027530+0000","last_fullsized":"2024-04-26T07:57:48.027530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.027433+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:59.750634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.116012+0000","last_change":"2024-04-26T07:57:37.116071+0000","last_active":"2024-04-26T07:57:37.116012+0000","last_peered":"2024-04-26T07:57:37.116012+0000","last_clean":"2024-04-26T07:57:37.116012+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:57:37.116012+0000","last_undegraded":"2024-04-26T07:57:37.116012+0000","last_fullsized":"2024-04-26T07:57:37.116012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.115909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:16.358436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.896475+0000","last_change":"2024-04-26T07:54:25.040358+0000","last_active":"2024-04-26T07:56:54.896475+0000","last_peered":"2024-04-26T07:56:54.896475+0000","last_clean":"2024-04-26T07:56:54.896475+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:56:54.896475+0000","last_undegraded":"2024-04-26T07:56:54.896475+0000","last_fullsized":"2024-04-26T07:56:54.896475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.087168+0000","last_change":"2024-04-26T07:58:09.087254+0000","last_active":"2024-04-26T07:58:09.087168+0000","last_peered":"2024-04-26T07:58:09.087168+0000","last_clean":"2024-04-26T07:58:09.087168+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:58:09.087168+0000","last_undegraded":"2024-04-26T07:58:09.087168+0000","last_fullsized":"2024-04-26T07:58:09.087168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:09.087056+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:09.087056+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.087056+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:44.220939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.182152+0000","last_change":"2024-04-26T07:58:27.182175+0000","last_active":"2024-04-26T07:58:27.182152+0000","last_peered":"2024-04-26T07:58:27.182152+0000","last_clean":"2024-04-26T07:58:27.182152+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:58:27.182152+0000","last_undegraded":"2024-04-26T07:58:27.182152+0000","last_fullsized":"2024-04-26T07:58:27.182152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:27.182060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:27.182060+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.182060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:06.537558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.947053+0000","last_change":"2024-04-26T07:57:36.947105+0000","last_active":"2024-04-26T07:57:36.947053+0000","last_peered":"2024-04-26T07:57:36.947053+0000","last_clean":"2024-04-26T07:57:36.947053+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:57:36.947053+0000","last_undegraded":"2024-04-26T07:57:36.947053+0000","last_fullsized":"2024-04-26T07:57:36.947053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.946930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.547838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.306049+0000","last_change":"2024-04-26T07:57:44.306091+0000","last_active":"2024-04-26T07:57:44.306049+0000","last_peered":"2024-04-26T07:57:44.306049+0000","last_clean":"2024-04-26T07:57:44.306049+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:57:44.306049+0000","last_undegraded":"2024-04-26T07:57:44.306049+0000","last_fullsized":"2024-04-26T07:57:44.306049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.305938+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:46.421838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.210692+0000","last_change":"2024-04-26T07:57:36.210716+0000","last_active":"2024-04-26T07:57:36.210692+0000","last_peered":"2024-04-26T07:57:36.210692+0000","last_clean":"2024-04-26T07:57:36.210692+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:57:36.210692+0000","last_undegraded":"2024-04-26T07:57:36.210692+0000","last_fullsized":"2024-04-26T07:57:36.210692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.210600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:49.401154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.081951+0000","last_change":"2024-04-26T07:58:24.081951+0000","last_active":"2024-04-26T07:58:24.081951+0000","last_peered":"2024-04-26T07:58:24.081951+0000","last_clean":"2024-04-26T07:58:24.081951+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:58:24.081951+0000","last_undegraded":"2024-04-26T07:58:24.081951+0000","last_fullsized":"2024-04-26T07:58:24.081951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:24.081820+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:24.081820+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.081820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:51.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.109899+0000","last_change":"2024-04-26T07:58:25.109930+0000","last_active":"2024-04-26T07:58:25.109899+0000","last_peered":"2024-04-26T07:58:25.109899+0000","last_clean":"2024-04-26T07:58:25.109899+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:58:25.109899+0000","last_undegraded":"2024-04-26T07:58:25.109899+0000","last_fullsized":"2024-04-26T07:58:25.109899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.109768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.109768+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.109768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:24.193718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.995801+0000","last_change":"2024-04-26T07:57:51.995801+0000","last_active":"2024-04-26T07:57:51.995801+0000","last_peered":"2024-04-26T07:57:51.995801+0000","last_clean":"2024-04-26T07:57:51.995801+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:57:51.995801+0000","last_undegraded":"2024-04-26T07:57:51.995801+0000","last_fullsized":"2024-04-26T07:57:51.995801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:51.995599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:51.995599+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.995599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:40.564480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.077254+0000","last_change":"2024-04-26T07:57:46.077293+0000","last_active":"2024-04-26T07:57:46.077254+0000","last_peered":"2024-04-26T07:57:46.077254+0000","last_clean":"2024-04-26T07:57:46.077254+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:57:46.077254+0000","last_undegraded":"2024-04-26T07:57:46.077254+0000","last_fullsized":"2024-04-26T07:57:46.077254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.077156+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:26.087961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.249784+0000","last_change":"2024-04-26T07:57:35.249823+0000","last_active":"2024-04-26T07:57:35.249784+0000","last_peered":"2024-04-26T07:57:35.249784+0000","last_clean":"2024-04-26T07:57:35.249784+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:57:35.249784+0000","last_undegraded":"2024-04-26T07:57:35.249784+0000","last_fullsized":"2024-04-26T07:57:35.249784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.249689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:56.788608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.639013+0000","last_change":"2024-04-26T07:58:31.639045+0000","last_active":"2024-04-26T07:58:31.639013+0000","last_peered":"2024-04-26T07:58:31.639013+0000","last_clean":"2024-04-26T07:58:31.639013+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:58:31.639013+0000","last_undegraded":"2024-04-26T07:58:31.639013+0000","last_fullsized":"2024-04-26T07:58:31.639013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:31.638915+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:31.638915+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.638915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:19.555087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.880431+0000","last_change":"2024-04-26T07:58:12.880431+0000","last_active":"2024-04-26T07:58:12.880431+0000","last_peered":"2024-04-26T07:58:12.880431+0000","last_clean":"2024-04-26T07:58:12.880431+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:58:12.880431+0000","last_undegraded":"2024-04-26T07:58:12.880431+0000","last_fullsized":"2024-04-26T07:58:12.880431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:12.880313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:12.880313+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.880313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:40.993660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.139452+0000","last_change":"2024-04-26T07:58:26.139498+0000","last_active":"2024-04-26T07:58:26.139452+0000","last_peered":"2024-04-26T07:58:26.139452+0000","last_clean":"2024-04-26T07:58:26.139452+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:58:26.139452+0000","last_undegraded":"2024-04-26T07:58:26.139452+0000","last_fullsized":"2024-04-26T07:58:26.139452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:26.139349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:26.139349+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.139349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:17.105942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.221980+0000","last_change":"2024-04-26T07:57:52.221980+0000","last_active":"2024-04-26T07:57:52.221980+0000","last_peered":"2024-04-26T07:57:52.221980+0000","last_clean":"2024-04-26T07:57:52.221980+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:57:52.221980+0000","last_undegraded":"2024-04-26T07:57:52.221980+0000","last_fullsized":"2024-04-26T07:57:52.221980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:52.221848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:52.221848+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.221848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.404236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.958887+0000","last_change":"2024-04-26T07:57:48.958926+0000","last_active":"2024-04-26T07:57:48.958887+0000","last_peered":"2024-04-26T07:57:48.958887+0000","last_clean":"2024-04-26T07:57:48.958887+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:57:48.958887+0000","last_undegraded":"2024-04-26T07:57:48.958887+0000","last_fullsized":"2024-04-26T07:57:48.958887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.958790+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:19.997051+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.961696+0000","last_change":"2024-04-26T07:57:43.961722+0000","last_active":"2024-04-26T07:57:43.961696+0000","last_peered":"2024-04-26T07:57:43.961696+0000","last_clean":"2024-04-26T07:57:43.961696+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:57:43.961696+0000","last_undegraded":"2024-04-26T07:57:43.961696+0000","last_fullsized":"2024-04-26T07:57:43.961696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.961597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:55.126179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894677+0000","last_change":"2024-04-26T07:54:25.040148+0000","last_active":"2024-04-26T07:56:44.894677+0000","last_peered":"2024-04-26T07:56:44.894677+0000","last_clean":"2024-04-26T07:56:44.894677+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:56:44.894677+0000","last_undegraded":"2024-04-26T07:56:44.894677+0000","last_fullsized":"2024-04-26T07:56:44.894677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.423150+0000","last_change":"2024-04-26T07:58:27.423177+0000","last_active":"2024-04-26T07:58:27.423150+0000","last_peered":"2024-04-26T07:58:27.423150+0000","last_clean":"2024-04-26T07:58:27.423150+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:58:27.423150+0000","last_undegraded":"2024-04-26T07:58:27.423150+0000","last_fullsized":"2024-04-26T07:58:27.423150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:27.423063+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:27.423063+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.423063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:20.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.180253+0000","last_change":"2024-04-26T07:58:24.180306+0000","last_active":"2024-04-26T07:58:24.180253+0000","last_peered":"2024-04-26T07:58:24.180253+0000","last_clean":"2024-04-26T07:58:24.180253+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:58:24.180253+0000","last_undegraded":"2024-04-26T07:58:24.180253+0000","last_fullsized":"2024-04-26T07:58:24.180253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:24.180151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:24.180151+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.180151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:00.943258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.182373+0000","last_change":"2024-04-26T07:57:54.182399+0000","last_active":"2024-04-26T07:57:54.182373+0000","last_peered":"2024-04-26T07:57:54.182373+0000","last_clean":"2024-04-26T07:57:54.182373+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:57:54.182373+0000","last_undegraded":"2024-04-26T07:57:54.182373+0000","last_fullsized":"2024-04-26T07:57:54.182373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.182281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.182281+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.182281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:41.982170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.036534+0000","last_change":"2024-04-26T07:57:42.036534+0000","last_active":"2024-04-26T07:57:42.036534+0000","last_peered":"2024-04-26T07:57:42.036534+0000","last_clean":"2024-04-26T07:57:42.036534+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:57:42.036534+0000","last_undegraded":"2024-04-26T07:57:42.036534+0000","last_fullsized":"2024-04-26T07:57:42.036534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.036391+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:51.097848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.970937+0000","last_change":"2024-04-26T07:57:54.970937+0000","last_active":"2024-04-26T07:57:54.970937+0000","last_peered":"2024-04-26T07:57:54.970937+0000","last_clean":"2024-04-26T07:57:54.970937+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:57:54.970937+0000","last_undegraded":"2024-04-26T07:57:54.970937+0000","last_fullsized":"2024-04-26T07:57:54.970937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.970780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.970780+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.970780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:03.765699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894650+0000","last_change":"2024-04-26T07:54:25.039740+0000","last_active":"2024-04-26T07:56:44.894650+0000","last_peered":"2024-04-26T07:56:44.894650+0000","last_clean":"2024-04-26T07:56:44.894650+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:56:44.894650+0000","last_undegraded":"2024-04-26T07:56:44.894650+0000","last_fullsized":"2024-04-26T07:56:44.894650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.689461+0000","last_change":"2024-04-26T07:58:28.689488+0000","last_active":"2024-04-26T07:58:28.689461+0000","last_peered":"2024-04-26T07:58:28.689461+0000","last_clean":"2024-04-26T07:58:28.689461+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:58:28.689461+0000","last_undegraded":"2024-04-26T07:58:28.689461+0000","last_fullsized":"2024-04-26T07:58:28.689461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:28.689372+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:28.689372+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.689372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.555413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.115433+0000","last_change":"2024-04-26T07:58:33.115459+0000","last_active":"2024-04-26T07:58:33.115433+0000","last_peered":"2024-04-26T07:58:33.115433+0000","last_clean":"2024-04-26T07:58:33.115433+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:58:33.115433+0000","last_undegraded":"2024-04-26T07:58:33.115433+0000","last_fullsized":"2024-04-26T07:58:33.115433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:33.115339+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:33.115339+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.115339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:08.868947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.053008+0000","last_change":"2024-04-26T07:57:53.053059+0000","last_active":"2024-04-26T07:57:53.053008+0000","last_peered":"2024-04-26T07:57:53.053008+0000","last_clean":"2024-04-26T07:57:53.053008+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:57:53.053008+0000","last_undegraded":"2024-04-26T07:57:53.053008+0000","last_fullsized":"2024-04-26T07:57:53.053008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:53.052892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:53.052892+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.052892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:33.924298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.067489+0000","last_change":"2024-04-26T07:58:01.067489+0000","last_active":"2024-04-26T07:58:01.067489+0000","last_peered":"2024-04-26T07:58:01.067489+0000","last_clean":"2024-04-26T07:58:01.067489+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:58:01.067489+0000","last_undegraded":"2024-04-26T07:58:01.067489+0000","last_fullsized":"2024-04-26T07:58:01.067489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-04-26T07:58:01.067368+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-04-26T07:58:01.067368+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.067368+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:37.830475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.315390+0000","last_change":"2024-04-26T07:57:43.315390+0000","last_active":"2024-04-26T07:57:43.315390+0000","last_peered":"2024-04-26T07:57:43.315390+0000","last_clean":"2024-04-26T07:57:43.315390+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:43.315390+0000","last_undegraded":"2024-04-26T07:57:43.315390+0000","last_fullsized":"2024-04-26T07:57:43.315390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.315236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:00.601284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.066525+0000","last_change":"2024-04-26T07:58:23.066548+0000","last_active":"2024-04-26T07:58:23.066525+0000","last_peered":"2024-04-26T07:58:23.066525+0000","last_clean":"2024-04-26T07:58:23.066525+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:58:23.066525+0000","last_undegraded":"2024-04-26T07:58:23.066525+0000","last_fullsized":"2024-04-26T07:58:23.066525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:23.066431+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:23.066431+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.066431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:58.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.180634+0000","last_change":"2024-04-26T07:58:01.180680+0000","last_active":"2024-04-26T07:58:01.180634+0000","last_peered":"2024-04-26T07:58:01.180634+0000","last_clean":"2024-04-26T07:58:01.180634+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:58:01.180634+0000","last_undegraded":"2024-04-26T07:58:01.180634+0000","last_fullsized":"2024-04-26T07:58:01.180634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:01.180506+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:01.180506+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.180506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:09.102162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.193351+0000","last_change":"2024-04-26T07:58:21.193377+0000","last_active":"2024-04-26T07:58:21.193351+0000","last_peered":"2024-04-26T07:58:21.193351+0000","last_clean":"2024-04-26T07:58:21.193351+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:58:21.193351+0000","last_undegraded":"2024-04-26T07:58:21.193351+0000","last_fullsized":"2024-04-26T07:58:21.193351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:21.193259+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:21.193259+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.193259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:13.857858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.947474+0000","last_change":"2024-04-26T07:57:48.947503+0000","last_active":"2024-04-26T07:57:48.947474+0000","last_peered":"2024-04-26T07:57:48.947474+0000","last_clean":"2024-04-26T07:57:48.947474+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:57:48.947474+0000","last_undegraded":"2024-04-26T07:57:48.947474+0000","last_fullsized":"2024-04-26T07:57:48.947474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.947377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:11.025758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.943225+0000","last_change":"2024-04-26T07:57:41.943262+0000","last_active":"2024-04-26T07:57:41.943225+0000","last_peered":"2024-04-26T07:57:41.943225+0000","last_clean":"2024-04-26T07:57:41.943225+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:57:41.943225+0000","last_undegraded":"2024-04-26T07:57:41.943225+0000","last_fullsized":"2024-04-26T07:57:41.943225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.943141+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:28.179647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.021097+0000","last_change":"2024-04-26T07:57:41.021136+0000","last_active":"2024-04-26T07:57:41.021097+0000","last_peered":"2024-04-26T07:57:41.021097+0000","last_clean":"2024-04-26T07:57:41.021097+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:57:41.021097+0000","last_undegraded":"2024-04-26T07:57:41.021097+0000","last_fullsized":"2024-04-26T07:57:41.021097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.021008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.165091+0000","last_change":"2024-04-26T07:58:00.165117+0000","last_active":"2024-04-26T07:58:00.165091+0000","last_peered":"2024-04-26T07:58:00.165091+0000","last_clean":"2024-04-26T07:58:00.165091+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:58:00.165091+0000","last_undegraded":"2024-04-26T07:58:00.165091+0000","last_fullsized":"2024-04-26T07:58:00.165091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:00.164987+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:00.164987+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.164987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:08.922542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'20","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.149371+0000","last_change":"2024-04-26T07:57:59.149404+0000","last_active":"2024-04-26T07:57:59.149371+0000","last_peered":"2024-04-26T07:57:59.149371+0000","last_clean":"2024-04-26T07:57:59.149371+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:59.149371+0000","last_undegraded":"2024-04-26T07:57:59.149371+0000","last_fullsized":"2024-04-26T07:57:59.149371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:57:59.149277+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:57:59.149277+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.149277+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:10.872478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.164857+0000","last_change":"2024-04-26T07:58:29.164884+0000","last_active":"2024-04-26T07:58:29.164857+0000","last_peered":"2024-04-26T07:58:29.164857+0000","last_clean":"2024-04-26T07:58:29.164857+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:58:29.164857+0000","last_undegraded":"2024-04-26T07:58:29.164857+0000","last_fullsized":"2024-04-26T07:58:29.164857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:29.164766+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:29.164766+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.164766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:45.599435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.256297+0000","last_change":"2024-04-26T07:57:49.256322+0000","last_active":"2024-04-26T07:57:49.256297+0000","last_peered":"2024-04-26T07:57:49.256297+0000","last_clean":"2024-04-26T07:57:49.256297+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:57:49.256297+0000","last_undegraded":"2024-04-26T07:57:49.256297+0000","last_fullsized":"2024-04-26T07:57:49.256297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.256204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:45.178627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.053585+0000","last_change":"2024-04-26T07:57:44.053621+0000","last_active":"2024-04-26T07:57:44.053585+0000","last_peered":"2024-04-26T07:57:44.053585+0000","last_clean":"2024-04-26T07:57:44.053585+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:57:44.053585+0000","last_undegraded":"2024-04-26T07:57:44.053585+0000","last_fullsized":"2024-04-26T07:57:44.053585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.053488+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:48.845821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.141915+0000","last_change":"2024-04-26T07:58:03.141983+0000","last_active":"2024-04-26T07:58:03.141915+0000","last_peered":"2024-04-26T07:58:03.141915+0000","last_clean":"2024-04-26T07:58:03.141915+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:58:03.141915+0000","last_undegraded":"2024-04-26T07:58:03.141915+0000","last_fullsized":"2024-04-26T07:58:03.141915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:03.141810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:03.141810+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.141810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:54.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.140872+0000","last_change":"2024-04-26T07:58:15.140931+0000","last_active":"2024-04-26T07:58:15.140872+0000","last_peered":"2024-04-26T07:58:15.140872+0000","last_clean":"2024-04-26T07:58:15.140872+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:58:15.140872+0000","last_undegraded":"2024-04-26T07:58:15.140872+0000","last_fullsized":"2024-04-26T07:58:15.140872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:15.140763+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:15.140763+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.140763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.744811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.149403+0000","last_change":"2024-04-26T07:58:18.149431+0000","last_active":"2024-04-26T07:58:18.149403+0000","last_peered":"2024-04-26T07:58:18.149403+0000","last_clean":"2024-04-26T07:58:18.149403+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:58:18.149403+0000","last_undegraded":"2024-04-26T07:58:18.149403+0000","last_fullsized":"2024-04-26T07:58:18.149403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:18.149315+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:18.149315+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.149315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:54.653554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.763673+0000","last_change":"2024-04-26T07:58:05.763673+0000","last_active":"2024-04-26T07:58:05.763673+0000","last_peered":"2024-04-26T07:58:05.763673+0000","last_clean":"2024-04-26T07:58:05.763673+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:58:05.763673+0000","last_undegraded":"2024-04-26T07:58:05.763673+0000","last_fullsized":"2024-04-26T07:58:05.763673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:05.763543+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:05.763543+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.763543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:45.093021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.087876+0000","last_change":"2024-04-26T07:57:54.087902+0000","last_active":"2024-04-26T07:57:54.087876+0000","last_peered":"2024-04-26T07:57:54.087876+0000","last_clean":"2024-04-26T07:57:54.087876+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:57:54.087876+0000","last_undegraded":"2024-04-26T07:57:54.087876+0000","last_fullsized":"2024-04-26T07:57:54.087876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.087782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.087782+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.087782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:11.296546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.976695+0000","last_change":"2024-04-26T07:57:40.976750+0000","last_active":"2024-04-26T07:57:40.976695+0000","last_peered":"2024-04-26T07:57:40.976695+0000","last_clean":"2024-04-26T07:57:40.976695+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:57:40.976695+0000","last_undegraded":"2024-04-26T07:57:40.976695+0000","last_fullsized":"2024-04-26T07:57:40.976695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.976569+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:47.248039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.081910+0000","last_change":"2024-04-26T07:58:11.081938+0000","last_active":"2024-04-26T07:58:11.081910+0000","last_peered":"2024-04-26T07:58:11.081910+0000","last_clean":"2024-04-26T07:58:11.081910+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:58:11.081910+0000","last_undegraded":"2024-04-26T07:58:11.081910+0000","last_fullsized":"2024-04-26T07:58:11.081910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.081811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.081811+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.081811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.419163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.213315+0000","last_change":"2024-04-26T07:54:25.039985+0000","last_active":"2024-04-26T07:57:24.213315+0000","last_peered":"2024-04-26T07:57:24.213315+0000","last_clean":"2024-04-26T07:57:24.213315+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:57:24.213315+0000","last_undegraded":"2024-04-26T07:57:24.213315+0000","last_fullsized":"2024-04-26T07:57:24.213315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.198470+0000","last_change":"2024-04-26T07:57:57.198497+0000","last_active":"2024-04-26T07:57:57.198470+0000","last_peered":"2024-04-26T07:57:57.198470+0000","last_clean":"2024-04-26T07:57:57.198470+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:57:57.198470+0000","last_undegraded":"2024-04-26T07:57:57.198470+0000","last_fullsized":"2024-04-26T07:57:57.198470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:57:57.198375+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:57:57.198375+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.198375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:37.209180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.127003+0000","last_change":"2024-04-26T07:58:15.127003+0000","last_active":"2024-04-26T07:58:15.127003+0000","last_peered":"2024-04-26T07:58:15.127003+0000","last_clean":"2024-04-26T07:58:15.127003+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:58:15.127003+0000","last_undegraded":"2024-04-26T07:58:15.127003+0000","last_fullsized":"2024-04-26T07:58:15.127003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.126867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.126867+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.126867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:18.021688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.971170+0000","last_change":"2024-04-26T07:57:45.971199+0000","last_active":"2024-04-26T07:57:45.971170+0000","last_peered":"2024-04-26T07:57:45.971170+0000","last_clean":"2024-04-26T07:57:45.971170+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:57:45.971170+0000","last_undegraded":"2024-04-26T07:57:45.971170+0000","last_fullsized":"2024-04-26T07:57:45.971170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.971081+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.019853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'42","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.079461+0000","last_change":"2024-04-26T07:58:08.079511+0000","last_active":"2024-04-26T07:58:08.079461+0000","last_peered":"2024-04-26T07:58:08.079461+0000","last_clean":"2024-04-26T07:58:08.079461+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:58:08.079461+0000","last_undegraded":"2024-04-26T07:58:08.079461+0000","last_fullsized":"2024-04-26T07:58:08.079461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-04-26T07:58:08.079369+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-04-26T07:58:08.079369+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.079369+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:26.015619+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.018075+0000","last_change":"2024-04-26T07:57:40.018100+0000","last_active":"2024-04-26T07:57:40.018075+0000","last_peered":"2024-04-26T07:57:40.018075+0000","last_clean":"2024-04-26T07:57:40.018075+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:57:40.018075+0000","last_undegraded":"2024-04-26T07:57:40.018075+0000","last_fullsized":"2024-04-26T07:57:40.018075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.017985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:33.200374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894775+0000","last_change":"2024-04-26T07:54:25.040953+0000","last_active":"2024-04-26T07:56:44.894775+0000","last_peered":"2024-04-26T07:56:44.894775+0000","last_clean":"2024-04-26T07:56:44.894775+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:56:44.894775+0000","last_undegraded":"2024-04-26T07:56:44.894775+0000","last_fullsized":"2024-04-26T07:56:44.894775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.168583+0000","last_change":"2024-04-26T07:58:20.168674+0000","last_active":"2024-04-26T07:58:20.168583+0000","last_peered":"2024-04-26T07:58:20.168583+0000","last_clean":"2024-04-26T07:58:20.168583+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:58:20.168583+0000","last_undegraded":"2024-04-26T07:58:20.168583+0000","last_fullsized":"2024-04-26T07:58:20.168583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:20.168478+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:20.168478+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.168478+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:37.021499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.175200+0000","last_change":"2024-04-26T07:58:02.175200+0000","last_active":"2024-04-26T07:58:02.175200+0000","last_peered":"2024-04-26T07:58:02.175200+0000","last_clean":"2024-04-26T07:58:02.175200+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:58:02.175200+0000","last_undegraded":"2024-04-26T07:58:02.175200+0000","last_fullsized":"2024-04-26T07:58:02.175200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:02.175070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:02.175070+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.175070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:01:08.295392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.910834+0000","last_change":"2024-04-26T07:58:00.910862+0000","last_active":"2024-04-26T07:58:00.910834+0000","last_peered":"2024-04-26T07:58:00.910834+0000","last_clean":"2024-04-26T07:58:00.910834+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:58:00.910834+0000","last_undegraded":"2024-04-26T07:58:00.910834+0000","last_fullsized":"2024-04-26T07:58:00.910834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:00.910724+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:00.910724+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.910724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:49.811262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.749080+0000","last_change":"2024-04-26T07:58:22.749080+0000","last_active":"2024-04-26T07:58:22.749080+0000","last_peered":"2024-04-26T07:58:22.749080+0000","last_clean":"2024-04-26T07:58:22.749080+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:58:22.749080+0000","last_undegraded":"2024-04-26T07:58:22.749080+0000","last_fullsized":"2024-04-26T07:58:22.749080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:22.748961+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:22.748961+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.748961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:34.686493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.093529+0000","last_change":"2024-04-26T07:58:22.093555+0000","last_active":"2024-04-26T07:58:22.093529+0000","last_peered":"2024-04-26T07:58:22.093529+0000","last_clean":"2024-04-26T07:58:22.093529+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:58:22.093529+0000","last_undegraded":"2024-04-26T07:58:22.093529+0000","last_fullsized":"2024-04-26T07:58:22.093529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:22.093436+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:22.093436+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.093436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:40.796077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448491+0000","last_change":"2024-04-26T07:54:15.025512+0000","last_active":"2024-04-26T07:57:35.448491+0000","last_peered":"2024-04-26T07:57:35.448491+0000","last_clean":"2024-04-26T07:57:35.448491+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:57:35.448491+0000","last_undegraded":"2024-04-26T07:57:35.448491+0000","last_fullsized":"2024-04-26T07:57:35.448491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.759363+0000","last_change":"2024-04-26T07:58:18.759392+0000","last_active":"2024-04-26T07:58:18.759363+0000","last_peered":"2024-04-26T07:58:18.759363+0000","last_clean":"2024-04-26T07:58:18.759363+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:58:18.759363+0000","last_undegraded":"2024-04-26T07:58:18.759363+0000","last_fullsized":"2024-04-26T07:58:18.759363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:18.759273+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:18.759273+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.759273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:55.522380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.713666+0000","last_change":"2024-04-26T07:58:27.713720+0000","last_active":"2024-04-26T07:58:27.713666+0000","last_peered":"2024-04-26T07:58:27.713666+0000","last_clean":"2024-04-26T07:58:27.713666+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:58:27.713666+0000","last_undegraded":"2024-04-26T07:58:27.713666+0000","last_fullsized":"2024-04-26T07:58:27.713666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:27.713552+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:27.713552+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.713552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:07.914993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.793079+0000","last_change":"2024-04-26T07:58:04.793079+0000","last_active":"2024-04-26T07:58:04.793079+0000","last_peered":"2024-04-26T07:58:04.793079+0000","last_clean":"2024-04-26T07:58:04.793079+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:58:04.793079+0000","last_undegraded":"2024-04-26T07:58:04.793079+0000","last_fullsized":"2024-04-26T07:58:04.793079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:04.792960+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:04.792960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.792960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:52.162345+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.790981+0000","last_change":"2024-04-26T07:58:24.790981+0000","last_active":"2024-04-26T07:58:24.790981+0000","last_peered":"2024-04-26T07:58:24.790981+0000","last_clean":"2024-04-26T07:58:24.790981+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:58:24.790981+0000","last_undegraded":"2024-04-26T07:58:24.790981+0000","last_fullsized":"2024-04-26T07:58:24.790981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:24.790843+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:24.790843+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.790843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:25.245426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.134728+0000","last_change":"2024-04-26T07:58:16.134728+0000","last_active":"2024-04-26T07:58:16.134728+0000","last_peered":"2024-04-26T07:58:16.134728+0000","last_clean":"2024-04-26T07:58:16.134728+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:58:16.134728+0000","last_undegraded":"2024-04-26T07:58:16.134728+0000","last_fullsized":"2024-04-26T07:58:16.134728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:16.134605+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:16.134605+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.134605+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:40.318441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.133764+0000","last_change":"2024-04-26T07:58:29.133764+0000","last_active":"2024-04-26T07:58:29.133764+0000","last_peered":"2024-04-26T07:58:29.133764+0000","last_clean":"2024-04-26T07:58:29.133764+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:58:29.133764+0000","last_undegraded":"2024-04-26T07:58:29.133764+0000","last_fullsized":"2024-04-26T07:58:29.133764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:29.133607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:29.133607+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.133607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:43.809427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.829934+0000","last_change":"2024-04-26T07:58:08.829934+0000","last_active":"2024-04-26T07:58:08.829934+0000","last_peered":"2024-04-26T07:58:08.829934+0000","last_clean":"2024-04-26T07:58:08.829934+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:58:08.829934+0000","last_undegraded":"2024-04-26T07:58:08.829934+0000","last_fullsized":"2024-04-26T07:58:08.829934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:08.829797+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:08.829797+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.829797+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:57.218721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.246522+0000","last_change":"2024-04-26T07:58:06.246522+0000","last_active":"2024-04-26T07:58:06.246522+0000","last_peered":"2024-04-26T07:58:06.246522+0000","last_clean":"2024-04-26T07:58:06.246522+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:58:06.246522+0000","last_undegraded":"2024-04-26T07:58:06.246522+0000","last_fullsized":"2024-04-26T07:58:06.246522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:06.246402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:06.246402+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.246402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:15.041321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.144982+0000","last_change":"2024-04-26T07:58:06.144982+0000","last_active":"2024-04-26T07:58:06.144982+0000","last_peered":"2024-04-26T07:58:06.144982+0000","last_clean":"2024-04-26T07:58:06.144982+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:58:06.144982+0000","last_undegraded":"2024-04-26T07:58:06.144982+0000","last_fullsized":"2024-04-26T07:58:06.144982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:06.144859+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:06.144859+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.144859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:24.745706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.759373+0000","last_change":"2024-04-26T07:58:25.759373+0000","last_active":"2024-04-26T07:58:25.759373+0000","last_peered":"2024-04-26T07:58:25.759373+0000","last_clean":"2024-04-26T07:58:25.759373+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:58:25.759373+0000","last_undegraded":"2024-04-26T07:58:25.759373+0000","last_fullsized":"2024-04-26T07:58:25.759373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.759257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.759257+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.759257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:16.220235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.113406+0000","last_change":"2024-04-26T07:58:30.113446+0000","last_active":"2024-04-26T07:58:30.113406+0000","last_peered":"2024-04-26T07:58:30.113406+0000","last_clean":"2024-04-26T07:58:30.113406+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:58:30.113406+0000","last_undegraded":"2024-04-26T07:58:30.113406+0000","last_fullsized":"2024-04-26T07:58:30.113406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:30.113312+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:30.113312+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.113312+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:52.460942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.448566+0000","last_change":"2024-04-26T07:54:15.029863+0000","last_active":"2024-04-26T07:57:35.448566+0000","last_peered":"2024-04-26T07:57:35.448566+0000","last_clean":"2024-04-26T07:57:35.448566+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:57:35.448566+0000","last_undegraded":"2024-04-26T07:57:35.448566+0000","last_fullsized":"2024-04-26T07:57:35.448566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.034297+0000","last_change":"2024-04-26T07:57:53.034344+0000","last_active":"2024-04-26T07:57:53.034297+0000","last_peered":"2024-04-26T07:57:53.034297+0000","last_clean":"2024-04-26T07:57:53.034297+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:57:53.034297+0000","last_undegraded":"2024-04-26T07:57:53.034297+0000","last_fullsized":"2024-04-26T07:57:53.034297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:57:53.034175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:57:53.034175+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.034175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:17.218011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.822340+0000","last_change":"2024-04-26T07:58:15.822410+0000","last_active":"2024-04-26T07:58:15.822340+0000","last_peered":"2024-04-26T07:58:15.822340+0000","last_clean":"2024-04-26T07:58:15.822340+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:58:15.822340+0000","last_undegraded":"2024-04-26T07:58:15.822340+0000","last_fullsized":"2024-04-26T07:58:15.822340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.822233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.822233+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.822233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:08.486833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.832289+0000","last_change":"2024-04-26T07:58:03.832314+0000","last_active":"2024-04-26T07:58:03.832289+0000","last_peered":"2024-04-26T07:58:03.832289+0000","last_clean":"2024-04-26T07:58:03.832289+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:58:03.832289+0000","last_undegraded":"2024-04-26T07:58:03.832289+0000","last_fullsized":"2024-04-26T07:58:03.832289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:03.832203+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:03.832203+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.832203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:26.049891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.138717+0000","last_change":"2024-04-26T07:58:28.138745+0000","last_active":"2024-04-26T07:58:28.138717+0000","last_peered":"2024-04-26T07:58:28.138717+0000","last_clean":"2024-04-26T07:58:28.138717+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:58:28.138717+0000","last_undegraded":"2024-04-26T07:58:28.138717+0000","last_fullsized":"2024-04-26T07:58:28.138717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:28.138628+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:28.138628+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.138628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:40.076160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.174527+0000","last_change":"2024-04-26T07:58:14.174553+0000","last_active":"2024-04-26T07:58:14.174527+0000","last_peered":"2024-04-26T07:58:14.174527+0000","last_clean":"2024-04-26T07:58:14.174527+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:58:14.174527+0000","last_undegraded":"2024-04-26T07:58:14.174527+0000","last_fullsized":"2024-04-26T07:58:14.174527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:14.174439+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:14.174439+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.174439+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:02.563364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.195882+0000","last_change":"2024-04-26T07:58:23.195915+0000","last_active":"2024-04-26T07:58:23.195882+0000","last_peered":"2024-04-26T07:58:23.195882+0000","last_clean":"2024-04-26T07:58:23.195882+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:58:23.195882+0000","last_undegraded":"2024-04-26T07:58:23.195882+0000","last_fullsized":"2024-04-26T07:58:23.195882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:23.195793+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:23.195793+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.195793+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:47.786960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.177095+0000","last_change":"2024-04-26T07:58:01.177126+0000","last_active":"2024-04-26T07:58:01.177095+0000","last_peered":"2024-04-26T07:58:01.177095+0000","last_clean":"2024-04-26T07:58:01.177095+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:58:01.177095+0000","last_undegraded":"2024-04-26T07:58:01.177095+0000","last_fullsized":"2024-04-26T07:58:01.177095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:01.176988+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:01.176988+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.176988+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:36.360339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.436165+0000","last_change":"2024-04-26T07:54:15.022986+0000","last_active":"2024-04-26T07:57:24.436165+0000","last_peered":"2024-04-26T07:57:24.436165+0000","last_clean":"2024-04-26T07:57:24.436165+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:57:24.436165+0000","last_undegraded":"2024-04-26T07:57:24.436165+0000","last_fullsized":"2024-04-26T07:57:24.436165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.216743+0000","last_change":"2024-04-26T07:58:02.216774+0000","last_active":"2024-04-26T07:58:02.216743+0000","last_peered":"2024-04-26T07:58:02.216743+0000","last_clean":"2024-04-26T07:58:02.216743+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:58:02.216743+0000","last_undegraded":"2024-04-26T07:58:02.216743+0000","last_fullsized":"2024-04-26T07:58:02.216743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:02.216654+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:02.216654+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.216654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.409764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.147945+0000","last_change":"2024-04-26T07:58:30.147970+0000","last_active":"2024-04-26T07:58:30.147945+0000","last_peered":"2024-04-26T07:58:30.147945+0000","last_clean":"2024-04-26T07:58:30.147945+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:58:30.147945+0000","last_undegraded":"2024-04-26T07:58:30.147945+0000","last_fullsized":"2024-04-26T07:58:30.147945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:30.147857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:30.147857+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.147857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:43.465610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.104158+0000","last_change":"2024-04-26T07:58:13.104189+0000","last_active":"2024-04-26T07:58:13.104158+0000","last_peered":"2024-04-26T07:58:13.104158+0000","last_clean":"2024-04-26T07:58:13.104158+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:58:13.104158+0000","last_undegraded":"2024-04-26T07:58:13.104158+0000","last_fullsized":"2024-04-26T07:58:13.104158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:13.104056+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:13.104056+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.104056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:55.412463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.250572+0000","last_change":"2024-04-26T07:58:04.250596+0000","last_active":"2024-04-26T07:58:04.250572+0000","last_peered":"2024-04-26T07:58:04.250572+0000","last_clean":"2024-04-26T07:58:04.250572+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:58:04.250572+0000","last_undegraded":"2024-04-26T07:58:04.250572+0000","last_fullsized":"2024-04-26T07:58:04.250572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:04.250456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:04.250456+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.250456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:58.426456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.175281+0000","last_change":"2024-04-26T07:58:08.175308+0000","last_active":"2024-04-26T07:58:08.175281+0000","last_peered":"2024-04-26T07:58:08.175281+0000","last_clean":"2024-04-26T07:58:08.175281+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:58:08.175281+0000","last_undegraded":"2024-04-26T07:58:08.175281+0000","last_fullsized":"2024-04-26T07:58:08.175281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:08.175191+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:08.175191+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.175191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:55.772232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.893132+0000","last_change":"2024-04-26T07:54:15.025822+0000","last_active":"2024-04-26T07:56:34.893132+0000","last_peered":"2024-04-26T07:56:34.893132+0000","last_clean":"2024-04-26T07:56:34.893132+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:56:34.893132+0000","last_undegraded":"2024-04-26T07:56:34.893132+0000","last_fullsized":"2024-04-26T07:56:34.893132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:34.892859+0000","last_change":"2024-04-26T07:54:15.029803+0000","last_active":"2024-04-26T07:56:34.892859+0000","last_peered":"2024-04-26T07:56:34.892859+0000","last_clean":"2024-04-26T07:56:34.892859+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:56:34.892859+0000","last_undegraded":"2024-04-26T07:56:34.892859+0000","last_fullsized":"2024-04-26T07:56:34.892859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:13.975280+0000","last_clean_scrub_stamp":"2024-04-26T07:54:13.975280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.778125+0000","last_change":"2024-04-26T07:58:06.778152+0000","last_active":"2024-04-26T07:58:06.778125+0000","last_peered":"2024-04-26T07:58:06.778125+0000","last_clean":"2024-04-26T07:58:06.778125+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:58:06.778125+0000","last_undegraded":"2024-04-26T07:58:06.778125+0000","last_fullsized":"2024-04-26T07:58:06.778125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:06.778032+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:06.778032+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.778032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:37.816293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.768203+0000","last_change":"2024-04-26T07:58:17.768230+0000","last_active":"2024-04-26T07:58:17.768203+0000","last_peered":"2024-04-26T07:58:17.768203+0000","last_clean":"2024-04-26T07:58:17.768203+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:58:17.768203+0000","last_undegraded":"2024-04-26T07:58:17.768203+0000","last_fullsized":"2024-04-26T07:58:17.768203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.768099+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.768099+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.768099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:42.359267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.179722+0000","last_change":"2024-04-26T07:58:12.179748+0000","last_active":"2024-04-26T07:58:12.179722+0000","last_peered":"2024-04-26T07:58:12.179722+0000","last_clean":"2024-04-26T07:58:12.179722+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:58:12.179722+0000","last_undegraded":"2024-04-26T07:58:12.179722+0000","last_fullsized":"2024-04-26T07:58:12.179722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:12.179635+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:12.179635+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.179635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:43.217896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705721,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705720,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":974848,"data_stored":723975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705722,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":999424,"data_stored":725076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":134133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:58:36.977 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.977 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.977 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.977 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.977 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.978 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.978 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.978 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.978 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.979 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.979 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.979 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.979 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.979 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.980 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.980 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.980 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.980 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.980 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T07:54:05.666873+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.981 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:54:15.982718+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.981 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.981 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.981 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.982 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.982 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.982 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.982 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.982 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.983 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.983 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T07:54:13.975280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:36.983 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:58:56.984 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:58:57.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.101+0000 7f49beaa7640 1 Processor -- start 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.101+0000 7f49beaa7640 1 -- start start 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.101+0000 7f49beaa7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49b812eba0 0x7f49b8130f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.101+0000 7f49beaa7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49b806da60 con 0x7f49b8128920 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.101+0000 7f49beaa7640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f49b8073070 con 0x7f49b812eba0 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.102+0000 7f49b7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49b812eba0 0x7f49b8130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.102+0000 7f49bc843640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f49b8128920 0x7f49b8128d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58158/0 (socket says 172.21.15.1:58158) 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.102+0000 7f49bc843640 1 -- 172.21.15.1:0/2491084695 learned_addr learned my addr 172.21.15.1:0/2491084695 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.102+0000 7f49b7fff640 1 -- 172.21.15.1:0/2491084695 >> v1:172.21.15.1:6789/0 conn(0x7f49b8128920 legacy=0x7f49b8128d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.102+0000 7f49b7fff640 1 -- 172.21.15.1:0/2491084695 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b8094640 con 0x7f49b812eba0 2024-04-26T07:58:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.102+0000 7f49b77fe640 1 -- 172.21.15.1:0/2491084695 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269096752 0 0) 0x7f49a8001110 con 0x7f49b8128920 2024-04-26T07:58:57.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.103+0000 7f49b7fff640 1 --2- 172.21.15.1:0/2491084695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b812eba0 0x7f49b8130f90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009720 tx=0x7f49ac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59df1bb825aecf9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.103+0000 7f49b77fe640 1 -- 172.21.15.1:0/2491084695 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac0316d0 con 0x7f49b812eba0 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.103+0000 7f49b77fe640 1 -- 172.21.15.1:0/2491084695 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac037070 con 0x7f49b812eba0 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.103+0000 7f49b77fe640 1 -- 172.21.15.1:0/2491084695 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac0319c0 con 0x7f49b812eba0 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.103+0000 7f49beaa7640 1 -- 172.21.15.1:0/2491084695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b812eba0 msgr2=0x7f49b8130f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.103+0000 7f49beaa7640 1 --2- 172.21.15.1:0/2491084695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b812eba0 0x7f49b8130f90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009720 tx=0x7f49ac02b840 comp rx=0 tx=0).stop 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.103+0000 7f49beaa7640 1 -- 172.21.15.1:0/2491084695 shutdown_connections 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.103+0000 7f49beaa7640 1 --2- 172.21.15.1:0/2491084695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b812eba0 0x7f49b8130f90 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.104+0000 7f49beaa7640 1 -- 172.21.15.1:0/2491084695 >> 172.21.15.1:0/2491084695 conn(0x7f49b809add0 msgr2=0x7f49b809b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.104+0000 7f49beaa7640 1 -- 172.21.15.1:0/2491084695 shutdown_connections 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.104+0000 7f49beaa7640 1 -- 172.21.15.1:0/2491084695 wait complete. 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.104+0000 7f49beaa7640 1 Processor -- start 2024-04-26T07:58:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.104+0000 7f49beaa7640 1 -- start start 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.105+0000 7f49beaa7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b8128920 0x7f49b81c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.105+0000 7f49beaa7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f49b806d620 con 0x7f49b8128920 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.105+0000 7f49bc843640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b8128920 0x7f49b81c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.105+0000 7f49bc843640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b8128920 0x7f49b81c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41610/0 (socket says 172.21.15.1:41610) 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.105+0000 7f49bc843640 1 -- 172.21.15.1:0/2725011870 learned_addr learned my addr 172.21.15.1:0/2725011870 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.105+0000 7f49bc843640 1 -- 172.21.15.1:0/2725011870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b80724e0 con 0x7f49b8128920 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.106+0000 7f49bc843640 1 --2- 172.21.15.1:0/2725011870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b8128920 0x7f49b81c3a80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f49a800c700 tx=0x7f49a800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.106+0000 7f49b57fa640 1 -- 172.21.15.1:0/2725011870 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49a8018070 con 0x7f49b8128920 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.106+0000 7f49b57fa640 1 -- 172.21.15.1:0/2725011870 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a80070d0 con 0x7f49b8128920 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.106+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b8129b40 con 0x7f49b8128920 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.106+0000 7f49b57fa640 1 -- 172.21.15.1:0/2725011870 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49a80073f0 con 0x7f49b8128920 2024-04-26T07:58:57.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.106+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b81c3fc0 con 0x7f49b8128920 2024-04-26T07:58:57.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.107+0000 7f49b57fa640 1 -- 172.21.15.1:0/2725011870 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f49a801b070 con 0x7f49b8128920 2024-04-26T07:58:57.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.107+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b80636f0 con 0x7f49b8128920 2024-04-26T07:58:57.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.107+0000 7f49b57fa640 1 --2- 172.21.15.1:0/2725011870 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49a40385c0 0x7f49a403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:58:57.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.107+0000 7f49b57fa640 1 -- 172.21.15.1:0/2725011870 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f49a804b500 con 0x7f49b8128920 2024-04-26T07:58:57.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.107+0000 7f49b7fff640 1 --2- 172.21.15.1:0/2725011870 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49a40385c0 0x7f49a403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:58:57.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.108+0000 7f49b7fff640 1 --2- 172.21.15.1:0/2725011870 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49a40385c0 0x7f49a403aa80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f49ac036000 tx=0x7f49ac008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:58:57.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.112+0000 7f49b57fa640 1 -- 172.21.15.1:0/2725011870 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49b806da60 con 0x7f49b8128920 2024-04-26T07:58:57.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.297+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49b806b6f0 con 0x7f49a40385c0 2024-04-26T07:58:57.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.313+0000 7f49b57fa640 1 -- 172.21.15.1:0/2725011870 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665831 (secure 0 0 0) 0x7f49b806b6f0 con 0x7f49a40385c0 2024-04-26T07:58:57.317 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:58:57.323 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:58:57.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.317+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49a40385c0 msgr2=0x7f49a403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.317+0000 7f49beaa7640 1 --2- 172.21.15.1:0/2725011870 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49a40385c0 0x7f49a403aa80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f49ac036000 tx=0x7f49ac008030 comp rx=0 tx=0).stop 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.317+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b8128920 msgr2=0x7f49b81c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.317+0000 7f49beaa7640 1 --2- 172.21.15.1:0/2725011870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b8128920 0x7f49b81c3a80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f49a800c700 tx=0x7f49a800cbc0 comp rx=0 tx=0).stop 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.317+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 shutdown_connections 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.317+0000 7f49beaa7640 1 --2- 172.21.15.1:0/2725011870 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49a40385c0 0x7f49a403aa80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.317+0000 7f49beaa7640 1 --2- 172.21.15.1:0/2725011870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49b8128920 0x7f49b81c3a80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.317+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 >> 172.21.15.1:0/2725011870 conn(0x7f49b809add0 msgr2=0x7f49b8130f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.318+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 shutdown_connections 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:58:57.318+0000 7f49beaa7640 1 -- 172.21.15.1:0/2725011870 wait complete. 2024-04-26T07:58:57.326 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-04-26T07:58:56.895918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5103,"num_read_kb":4684,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152408,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334952,"statfs":{"total":386547056640,"available":386390990848,"internally_reserved":0,"allocated":2809856,"data_stored":1718390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003682"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.302775+0000","last_change":"2024-04-26T07:58:10.302775+0000","last_active":"2024-04-26T07:58:10.302775+0000","last_peered":"2024-04-26T07:58:10.302775+0000","last_clean":"2024-04-26T07:58:10.302775+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:58:10.302775+0000","last_undegraded":"2024-04-26T07:58:10.302775+0000","last_fullsized":"2024-04-26T07:58:10.302775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:10.302661+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:10.302661+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.302661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:57.926956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.247641+0000","last_change":"2024-04-26T07:58:03.247677+0000","last_active":"2024-04-26T07:58:03.247641+0000","last_peered":"2024-04-26T07:58:03.247641+0000","last_clean":"2024-04-26T07:58:03.247641+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:58:03.247641+0000","last_undegraded":"2024-04-26T07:58:03.247641+0000","last_fullsized":"2024-04-26T07:58:03.247641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:03.247552+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:03.247552+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.247552+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:09.519023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.812158+0000","last_change":"2024-04-26T07:58:09.812158+0000","last_active":"2024-04-26T07:58:09.812158+0000","last_peered":"2024-04-26T07:58:09.812158+0000","last_clean":"2024-04-26T07:58:09.812158+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:58:09.812158+0000","last_undegraded":"2024-04-26T07:58:09.812158+0000","last_fullsized":"2024-04-26T07:58:09.812158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:09.812040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:09.812040+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.812040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:12.706861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.118276+0000","last_change":"2024-04-26T07:58:14.118305+0000","last_active":"2024-04-26T07:58:14.118276+0000","last_peered":"2024-04-26T07:58:14.118276+0000","last_clean":"2024-04-26T07:58:14.118276+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:58:14.118276+0000","last_undegraded":"2024-04-26T07:58:14.118276+0000","last_fullsized":"2024-04-26T07:58:14.118276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:14.118188+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:14.118188+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.118188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:04.731893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.074869+0000","last_change":"2024-04-26T07:58:32.074896+0000","last_active":"2024-04-26T07:58:32.074869+0000","last_peered":"2024-04-26T07:58:32.074869+0000","last_clean":"2024-04-26T07:58:32.074869+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:58:32.074869+0000","last_undegraded":"2024-04-26T07:58:32.074869+0000","last_fullsized":"2024-04-26T07:58:32.074869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:32.074774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:32.074774+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.074774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:45.173628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.977839+0000","last_change":"2024-04-26T07:57:49.977898+0000","last_active":"2024-04-26T07:57:49.977839+0000","last_peered":"2024-04-26T07:57:49.977839+0000","last_clean":"2024-04-26T07:57:49.977839+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:49.977839+0000","last_undegraded":"2024-04-26T07:57:49.977839+0000","last_fullsized":"2024-04-26T07:57:49.977839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:57:49.977738+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:57:49.977738+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.977738+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:40.792346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.351059+0000","last_change":"2024-04-26T07:58:19.351088+0000","last_active":"2024-04-26T07:58:19.351059+0000","last_peered":"2024-04-26T07:58:19.351059+0000","last_clean":"2024-04-26T07:58:19.351059+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:58:19.351059+0000","last_undegraded":"2024-04-26T07:58:19.351059+0000","last_fullsized":"2024-04-26T07:58:19.351059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:19.350931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:19.350931+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.350931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:10.165539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.189672+0000","last_change":"2024-04-26T07:58:17.189714+0000","last_active":"2024-04-26T07:58:17.189672+0000","last_peered":"2024-04-26T07:58:17.189672+0000","last_clean":"2024-04-26T07:58:17.189672+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:58:17.189672+0000","last_undegraded":"2024-04-26T07:58:17.189672+0000","last_fullsized":"2024-04-26T07:58:17.189672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-26T07:58:17.189575+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-26T07:58:17.189575+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.189575+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:11.798519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:40.131848+0000","last_change":"2024-04-26T07:58:40.131883+0000","last_active":"2024-04-26T07:58:40.131848+0000","last_peered":"2024-04-26T07:58:40.131848+0000","last_clean":"2024-04-26T07:58:40.131848+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:58:40.131848+0000","last_undegraded":"2024-04-26T07:58:40.131848+0000","last_fullsized":"2024-04-26T07:58:40.131848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:40.131748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:40.131748+0000","last_clean_scrub_stamp":"2024-04-26T07:58:40.131748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:05.347998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.204031+0000","last_change":"2024-04-26T07:58:10.204031+0000","last_active":"2024-04-26T07:58:10.204031+0000","last_peered":"2024-04-26T07:58:10.204031+0000","last_clean":"2024-04-26T07:58:10.204031+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:58:10.204031+0000","last_undegraded":"2024-04-26T07:58:10.204031+0000","last_fullsized":"2024-04-26T07:58:10.204031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:10.203885+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:10.203885+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.203885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:57.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.336034+0000","last_change":"2024-04-26T07:58:18.336069+0000","last_active":"2024-04-26T07:58:18.336034+0000","last_peered":"2024-04-26T07:58:18.336034+0000","last_clean":"2024-04-26T07:58:18.336034+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:58:18.336034+0000","last_undegraded":"2024-04-26T07:58:18.336034+0000","last_fullsized":"2024-04-26T07:58:18.336034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:18.335918+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:18.335918+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.335918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:49.374179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.029718+0000","last_change":"2024-04-26T07:57:56.029718+0000","last_active":"2024-04-26T07:57:56.029718+0000","last_peered":"2024-04-26T07:57:56.029718+0000","last_clean":"2024-04-26T07:57:56.029718+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:56.029718+0000","last_undegraded":"2024-04-26T07:57:56.029718+0000","last_fullsized":"2024-04-26T07:57:56.029718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:56.029549+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:56.029549+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.029549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:42.743723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:51.191778+0000","last_change":"2024-04-26T07:58:51.191807+0000","last_active":"2024-04-26T07:58:51.191778+0000","last_peered":"2024-04-26T07:58:51.191778+0000","last_clean":"2024-04-26T07:58:51.191778+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:58:51.191778+0000","last_undegraded":"2024-04-26T07:58:51.191778+0000","last_fullsized":"2024-04-26T07:58:51.191778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:51.191678+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:51.191678+0000","last_clean_scrub_stamp":"2024-04-26T07:58:51.191678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.027409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.157085+0000","last_change":"2024-04-26T07:57:56.157085+0000","last_active":"2024-04-26T07:57:56.157085+0000","last_peered":"2024-04-26T07:57:56.157085+0000","last_clean":"2024-04-26T07:57:56.157085+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:57:56.157085+0000","last_undegraded":"2024-04-26T07:57:56.157085+0000","last_fullsized":"2024-04-26T07:57:56.157085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:56.156947+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:56.156947+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.156947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:28.587105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.849871+0000","last_change":"2024-04-26T07:58:11.849900+0000","last_active":"2024-04-26T07:58:11.849871+0000","last_peered":"2024-04-26T07:58:11.849871+0000","last_clean":"2024-04-26T07:58:11.849871+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:58:11.849871+0000","last_undegraded":"2024-04-26T07:58:11.849871+0000","last_fullsized":"2024-04-26T07:58:11.849871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.849756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.849756+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.849756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:57.628518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.268091+0000","last_change":"2024-04-26T07:58:05.268091+0000","last_active":"2024-04-26T07:58:05.268091+0000","last_peered":"2024-04-26T07:58:05.268091+0000","last_clean":"2024-04-26T07:58:05.268091+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:58:05.268091+0000","last_undegraded":"2024-04-26T07:58:05.268091+0000","last_fullsized":"2024-04-26T07:58:05.268091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:05.267964+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:05.267964+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.267964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:56.976727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.952669+0000","last_change":"2024-04-26T07:57:47.952694+0000","last_active":"2024-04-26T07:57:47.952669+0000","last_peered":"2024-04-26T07:57:47.952669+0000","last_clean":"2024-04-26T07:57:47.952669+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:57:47.952669+0000","last_undegraded":"2024-04-26T07:57:47.952669+0000","last_fullsized":"2024-04-26T07:57:47.952669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.952578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:27.282056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.214044+0000","last_change":"2024-04-26T07:58:13.214074+0000","last_active":"2024-04-26T07:58:13.214044+0000","last_peered":"2024-04-26T07:58:13.214044+0000","last_clean":"2024-04-26T07:58:13.214044+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:58:13.214044+0000","last_undegraded":"2024-04-26T07:58:13.214044+0000","last_fullsized":"2024-04-26T07:58:13.214044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:13.213935+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:13.213935+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.213935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:04.028543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.172488+0000","last_change":"2024-04-26T07:58:05.172540+0000","last_active":"2024-04-26T07:58:05.172488+0000","last_peered":"2024-04-26T07:58:05.172488+0000","last_clean":"2024-04-26T07:58:05.172488+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:58:05.172488+0000","last_undegraded":"2024-04-26T07:58:05.172488+0000","last_fullsized":"2024-04-26T07:58:05.172488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:05.172385+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:05.172385+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.172385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:54.072924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.182343+0000","last_change":"2024-04-26T07:58:00.182384+0000","last_active":"2024-04-26T07:58:00.182343+0000","last_peered":"2024-04-26T07:58:00.182343+0000","last_clean":"2024-04-26T07:58:00.182343+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:58:00.182343+0000","last_undegraded":"2024-04-26T07:58:00.182343+0000","last_fullsized":"2024-04-26T07:58:00.182343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:00.182243+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:00.182243+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.182243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:41.053649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.135895+0000","last_change":"2024-04-26T07:57:55.135919+0000","last_active":"2024-04-26T07:57:55.135895+0000","last_peered":"2024-04-26T07:57:55.135895+0000","last_clean":"2024-04-26T07:57:55.135895+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:55.135895+0000","last_undegraded":"2024-04-26T07:57:55.135895+0000","last_fullsized":"2024-04-26T07:57:55.135895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:55.135805+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:55.135805+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.135805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:24.905448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.128762+0000","last_change":"2024-04-26T07:58:19.128816+0000","last_active":"2024-04-26T07:58:19.128762+0000","last_peered":"2024-04-26T07:58:19.128762+0000","last_clean":"2024-04-26T07:58:19.128762+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:58:19.128762+0000","last_undegraded":"2024-04-26T07:58:19.128762+0000","last_fullsized":"2024-04-26T07:58:19.128762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:19.128653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:19.128653+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.128653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:05.842827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.866000+0000","last_change":"2024-04-26T07:58:01.866024+0000","last_active":"2024-04-26T07:58:01.866000+0000","last_peered":"2024-04-26T07:58:01.866000+0000","last_clean":"2024-04-26T07:58:01.866000+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:58:01.866000+0000","last_undegraded":"2024-04-26T07:58:01.866000+0000","last_fullsized":"2024-04-26T07:58:01.866000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:01.865908+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:01.865908+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.865908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:20.466755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.114184+0000","last_change":"2024-04-26T07:58:17.114214+0000","last_active":"2024-04-26T07:58:17.114184+0000","last_peered":"2024-04-26T07:58:17.114184+0000","last_clean":"2024-04-26T07:58:17.114184+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:58:17.114184+0000","last_undegraded":"2024-04-26T07:58:17.114184+0000","last_fullsized":"2024-04-26T07:58:17.114184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.114086+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.114086+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.114086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.892848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.287922+0000","last_change":"2024-04-26T07:58:09.287952+0000","last_active":"2024-04-26T07:58:09.287922+0000","last_peered":"2024-04-26T07:58:09.287922+0000","last_clean":"2024-04-26T07:58:09.287922+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:58:09.287922+0000","last_undegraded":"2024-04-26T07:58:09.287922+0000","last_fullsized":"2024-04-26T07:58:09.287922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:09.287831+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:09.287831+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.287831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:30.576867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.856343+0000","last_change":"2024-04-26T07:58:13.856371+0000","last_active":"2024-04-26T07:58:13.856343+0000","last_peered":"2024-04-26T07:58:13.856343+0000","last_clean":"2024-04-26T07:58:13.856343+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:58:13.856343+0000","last_undegraded":"2024-04-26T07:58:13.856343+0000","last_fullsized":"2024-04-26T07:58:13.856343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:13.856249+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:13.856249+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.856249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:00.570423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.219214+0000","last_change":"2024-04-26T07:58:09.219242+0000","last_active":"2024-04-26T07:58:09.219214+0000","last_peered":"2024-04-26T07:58:09.219214+0000","last_clean":"2024-04-26T07:58:09.219214+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:58:09.219214+0000","last_undegraded":"2024-04-26T07:58:09.219214+0000","last_fullsized":"2024-04-26T07:58:09.219214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:09.219121+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:09.219121+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.219121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:31.436809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:50.192836+0000","last_change":"2024-04-26T07:58:50.192836+0000","last_active":"2024-04-26T07:58:50.192836+0000","last_peered":"2024-04-26T07:58:50.192836+0000","last_clean":"2024-04-26T07:58:50.192836+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:58:50.192836+0000","last_undegraded":"2024-04-26T07:58:50.192836+0000","last_fullsized":"2024-04-26T07:58:50.192836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:50.192710+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:50.192710+0000","last_clean_scrub_stamp":"2024-04-26T07:58:50.192710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.714632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.137093+0000","last_change":"2024-04-26T07:58:33.137132+0000","last_active":"2024-04-26T07:58:33.137093+0000","last_peered":"2024-04-26T07:58:33.137093+0000","last_clean":"2024-04-26T07:58:33.137093+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:58:33.137093+0000","last_undegraded":"2024-04-26T07:58:33.137093+0000","last_fullsized":"2024-04-26T07:58:33.137093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:58:33.136996+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:58:33.136996+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.136996+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:13.338437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'14","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.122491+0000","last_change":"2024-04-26T07:58:20.122525+0000","last_active":"2024-04-26T07:58:20.122491+0000","last_peered":"2024-04-26T07:58:20.122491+0000","last_clean":"2024-04-26T07:58:20.122491+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:58:20.122491+0000","last_undegraded":"2024-04-26T07:58:20.122491+0000","last_fullsized":"2024-04-26T07:58:20.122491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:20.122382+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:20.122382+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.122382+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:11.188914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:37.179888+0000","last_change":"2024-04-26T07:58:37.179888+0000","last_active":"2024-04-26T07:58:37.179888+0000","last_peered":"2024-04-26T07:58:37.179888+0000","last_clean":"2024-04-26T07:58:37.179888+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:58:37.179888+0000","last_undegraded":"2024-04-26T07:58:37.179888+0000","last_fullsized":"2024-04-26T07:58:37.179888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:37.179720+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:37.179720+0000","last_clean_scrub_stamp":"2024-04-26T07:58:37.179720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:48.994952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.991288+0000","last_change":"2024-04-26T07:57:41.991316+0000","last_active":"2024-04-26T07:57:41.991288+0000","last_peered":"2024-04-26T07:57:41.991288+0000","last_clean":"2024-04-26T07:57:41.991288+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:57:41.991288+0000","last_undegraded":"2024-04-26T07:57:41.991288+0000","last_fullsized":"2024-04-26T07:57:41.991288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.991200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:30.282928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.071582+0000","last_change":"2024-04-26T07:58:05.071616+0000","last_active":"2024-04-26T07:58:05.071582+0000","last_peered":"2024-04-26T07:58:05.071582+0000","last_clean":"2024-04-26T07:58:05.071582+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:58:05.071582+0000","last_undegraded":"2024-04-26T07:58:05.071582+0000","last_fullsized":"2024-04-26T07:58:05.071582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:58:05.071491+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:58:05.071491+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.071491+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:17.009024+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.029246+0000","last_change":"2024-04-26T07:57:40.029273+0000","last_active":"2024-04-26T07:57:40.029246+0000","last_peered":"2024-04-26T07:57:40.029246+0000","last_clean":"2024-04-26T07:57:40.029246+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:57:40.029246+0000","last_undegraded":"2024-04-26T07:57:40.029246+0000","last_fullsized":"2024-04-26T07:57:40.029246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.029150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.153168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.137596+0000","last_change":"2024-04-26T07:57:56.137657+0000","last_active":"2024-04-26T07:57:56.137596+0000","last_peered":"2024-04-26T07:57:56.137596+0000","last_clean":"2024-04-26T07:57:56.137596+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:56.137596+0000","last_undegraded":"2024-04-26T07:57:56.137596+0000","last_fullsized":"2024-04-26T07:57:56.137596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:57:56.137425+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:57:56.137425+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.137425+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:50.295566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.105177+0000","last_change":"2024-04-26T07:58:21.105205+0000","last_active":"2024-04-26T07:58:21.105177+0000","last_peered":"2024-04-26T07:58:21.105177+0000","last_clean":"2024-04-26T07:58:21.105177+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:58:21.105177+0000","last_undegraded":"2024-04-26T07:58:21.105177+0000","last_fullsized":"2024-04-26T07:58:21.105177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:21.105074+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:21.105074+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.105074+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:02.632583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.291740+0000","last_change":"2024-04-26T07:58:17.291740+0000","last_active":"2024-04-26T07:58:17.291740+0000","last_peered":"2024-04-26T07:58:17.291740+0000","last_clean":"2024-04-26T07:58:17.291740+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:58:17.291740+0000","last_undegraded":"2024-04-26T07:58:17.291740+0000","last_fullsized":"2024-04-26T07:58:17.291740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.291610+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.291610+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.291610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:56.621088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'5","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:37.119914+0000","last_change":"2024-04-26T07:58:37.119988+0000","last_active":"2024-04-26T07:58:37.119914+0000","last_peered":"2024-04-26T07:58:37.119914+0000","last_clean":"2024-04-26T07:58:37.119914+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:58:37.119914+0000","last_undegraded":"2024-04-26T07:58:37.119914+0000","last_fullsized":"2024-04-26T07:58:37.119914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:37.119803+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:37.119803+0000","last_clean_scrub_stamp":"2024-04-26T07:58:37.119803+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:19.428209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.951894+0000","last_change":"2024-04-26T07:57:42.951977+0000","last_active":"2024-04-26T07:57:42.951894+0000","last_peered":"2024-04-26T07:57:42.951894+0000","last_clean":"2024-04-26T07:57:42.951894+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:57:42.951894+0000","last_undegraded":"2024-04-26T07:57:42.951894+0000","last_fullsized":"2024-04-26T07:57:42.951894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.951788+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:25.400326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.943693+0000","last_change":"2024-04-26T07:57:47.943739+0000","last_active":"2024-04-26T07:57:47.943693+0000","last_peered":"2024-04-26T07:57:47.943693+0000","last_clean":"2024-04-26T07:57:47.943693+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:57:47.943693+0000","last_undegraded":"2024-04-26T07:57:47.943693+0000","last_fullsized":"2024-04-26T07:57:47.943693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.943578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:52.735911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.851905+0000","last_change":"2024-04-26T07:58:02.851935+0000","last_active":"2024-04-26T07:58:02.851905+0000","last_peered":"2024-04-26T07:58:02.851905+0000","last_clean":"2024-04-26T07:58:02.851905+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:58:02.851905+0000","last_undegraded":"2024-04-26T07:58:02.851905+0000","last_fullsized":"2024-04-26T07:58:02.851905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:02.851809+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:02.851809+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.851809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:48.141417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.391865+0000","last_change":"2024-04-26T07:58:28.391912+0000","last_active":"2024-04-26T07:58:28.391865+0000","last_peered":"2024-04-26T07:58:28.391865+0000","last_clean":"2024-04-26T07:58:28.391865+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:58:28.391865+0000","last_undegraded":"2024-04-26T07:58:28.391865+0000","last_fullsized":"2024-04-26T07:58:28.391865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-26T07:58:28.391758+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-26T07:58:28.391758+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.391758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:11:14.773701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.123115+0000","last_change":"2024-04-26T07:58:31.123115+0000","last_active":"2024-04-26T07:58:31.123115+0000","last_peered":"2024-04-26T07:58:31.123115+0000","last_clean":"2024-04-26T07:58:31.123115+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:58:31.123115+0000","last_undegraded":"2024-04-26T07:58:31.123115+0000","last_fullsized":"2024-04-26T07:58:31.123115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:31.122960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:31.122960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.122960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:13.159615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.038571+0000","last_change":"2024-04-26T07:57:53.038594+0000","last_active":"2024-04-26T07:57:53.038571+0000","last_peered":"2024-04-26T07:57:53.038571+0000","last_clean":"2024-04-26T07:57:53.038571+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:57:53.038571+0000","last_undegraded":"2024-04-26T07:57:53.038571+0000","last_fullsized":"2024-04-26T07:57:53.038571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:53.038477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:53.038477+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.038477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.214477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.282629+0000","last_change":"2024-04-26T07:57:38.282677+0000","last_active":"2024-04-26T07:57:38.282629+0000","last_peered":"2024-04-26T07:57:38.282629+0000","last_clean":"2024-04-26T07:57:38.282629+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:57:38.282629+0000","last_undegraded":"2024-04-26T07:57:38.282629+0000","last_fullsized":"2024-04-26T07:57:38.282629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.282530+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:49.848037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":398,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.033916+0000","last_change":"2024-04-26T07:58:07.033968+0000","last_active":"2024-04-26T07:58:07.033916+0000","last_peered":"2024-04-26T07:58:07.033916+0000","last_clean":"2024-04-26T07:58:07.033916+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:58:07.033916+0000","last_undegraded":"2024-04-26T07:58:07.033916+0000","last_fullsized":"2024-04-26T07:58:07.033916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-04-26T07:58:07.033790+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-04-26T07:58:07.033790+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.033790+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:29.381421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.433072+0000","last_change":"2024-04-26T07:58:24.433119+0000","last_active":"2024-04-26T07:58:24.433072+0000","last_peered":"2024-04-26T07:58:24.433072+0000","last_clean":"2024-04-26T07:58:24.433072+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:58:24.433072+0000","last_undegraded":"2024-04-26T07:58:24.433072+0000","last_fullsized":"2024-04-26T07:58:24.433072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:24.432965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:24.432965+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.432965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:52.546312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.819079+0000","last_change":"2024-04-26T07:58:10.819106+0000","last_active":"2024-04-26T07:58:10.819079+0000","last_peered":"2024-04-26T07:58:10.819079+0000","last_clean":"2024-04-26T07:58:10.819079+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:58:10.819079+0000","last_undegraded":"2024-04-26T07:58:10.819079+0000","last_fullsized":"2024-04-26T07:58:10.819079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-04-26T07:58:10.818989+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-04-26T07:58:10.818989+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.818989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:35.002825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.221263+0000","last_change":"2024-04-26T07:58:11.221263+0000","last_active":"2024-04-26T07:58:11.221263+0000","last_peered":"2024-04-26T07:58:11.221263+0000","last_clean":"2024-04-26T07:58:11.221263+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:58:11.221263+0000","last_undegraded":"2024-04-26T07:58:11.221263+0000","last_fullsized":"2024-04-26T07:58:11.221263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.221148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.221148+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.221148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:50.550625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894905+0000","last_change":"2024-04-26T07:55:02.059077+0000","last_active":"2024-04-26T07:56:44.894905+0000","last_peered":"2024-04-26T07:56:44.894905+0000","last_clean":"2024-04-26T07:56:44.894905+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:56:44.894905+0000","last_undegraded":"2024-04-26T07:56:44.894905+0000","last_fullsized":"2024-04-26T07:56:44.894905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:17.989962+0000","last_clean_scrub_stamp":"2024-04-26T07:54:17.989962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.304015+0000","last_change":"2024-04-26T07:57:41.304062+0000","last_active":"2024-04-26T07:57:41.304015+0000","last_peered":"2024-04-26T07:57:41.304015+0000","last_clean":"2024-04-26T07:57:41.304015+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:57:41.304015+0000","last_undegraded":"2024-04-26T07:57:41.304015+0000","last_fullsized":"2024-04-26T07:57:41.304015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.303924+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:58.630899+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.961870+0000","last_change":"2024-04-26T07:57:50.961896+0000","last_active":"2024-04-26T07:57:50.961870+0000","last_peered":"2024-04-26T07:57:50.961870+0000","last_clean":"2024-04-26T07:57:50.961870+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:50.961870+0000","last_undegraded":"2024-04-26T07:57:50.961870+0000","last_fullsized":"2024-04-26T07:57:50.961870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:50.961766+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:50.961766+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.961766+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:57.082089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.066607+0000","last_change":"2024-04-26T07:57:54.066607+0000","last_active":"2024-04-26T07:57:54.066607+0000","last_peered":"2024-04-26T07:57:54.066607+0000","last_clean":"2024-04-26T07:57:54.066607+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:57:54.066607+0000","last_undegraded":"2024-04-26T07:57:54.066607+0000","last_fullsized":"2024-04-26T07:57:54.066607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:54.066484+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:54.066484+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.066484+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:39.845246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.397690+0000","last_change":"2024-04-26T07:58:20.397690+0000","last_active":"2024-04-26T07:58:20.397690+0000","last_peered":"2024-04-26T07:58:20.397690+0000","last_clean":"2024-04-26T07:58:20.397690+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:58:20.397690+0000","last_undegraded":"2024-04-26T07:58:20.397690+0000","last_fullsized":"2024-04-26T07:58:20.397690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:20.397558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:20.397558+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.397558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:08.786482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.928630+0000","last_change":"2024-04-26T07:57:46.928630+0000","last_active":"2024-04-26T07:57:46.928630+0000","last_peered":"2024-04-26T07:57:46.928630+0000","last_clean":"2024-04-26T07:57:46.928630+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:57:46.928630+0000","last_undegraded":"2024-04-26T07:57:46.928630+0000","last_fullsized":"2024-04-26T07:57:46.928630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.928512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:13.316943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.275674+0000","last_change":"2024-04-26T07:57:46.275674+0000","last_active":"2024-04-26T07:57:46.275674+0000","last_peered":"2024-04-26T07:57:46.275674+0000","last_clean":"2024-04-26T07:57:46.275674+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:57:46.275674+0000","last_undegraded":"2024-04-26T07:57:46.275674+0000","last_fullsized":"2024-04-26T07:57:46.275674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.275508+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:20.381725+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.014970+0000","last_change":"2024-04-26T07:57:43.014970+0000","last_active":"2024-04-26T07:57:43.014970+0000","last_peered":"2024-04-26T07:57:43.014970+0000","last_clean":"2024-04-26T07:57:43.014970+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:57:43.014970+0000","last_undegraded":"2024-04-26T07:57:43.014970+0000","last_fullsized":"2024-04-26T07:57:43.014970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.014858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:09.403289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.451681+0000","last_change":"2024-04-26T07:58:26.451681+0000","last_active":"2024-04-26T07:58:26.451681+0000","last_peered":"2024-04-26T07:58:26.451681+0000","last_clean":"2024-04-26T07:58:26.451681+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:58:26.451681+0000","last_undegraded":"2024-04-26T07:58:26.451681+0000","last_fullsized":"2024-04-26T07:58:26.451681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:26.451562+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:26.451562+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.451562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:43.304584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.153649+0000","last_change":"2024-04-26T07:58:07.153649+0000","last_active":"2024-04-26T07:58:07.153649+0000","last_peered":"2024-04-26T07:58:07.153649+0000","last_clean":"2024-04-26T07:58:07.153649+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:58:07.153649+0000","last_undegraded":"2024-04-26T07:58:07.153649+0000","last_fullsized":"2024-04-26T07:58:07.153649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:07.153468+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:07.153468+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.153468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:52.443076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.260299+0000","last_change":"2024-04-26T07:58:12.260299+0000","last_active":"2024-04-26T07:58:12.260299+0000","last_peered":"2024-04-26T07:58:12.260299+0000","last_clean":"2024-04-26T07:58:12.260299+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:58:12.260299+0000","last_undegraded":"2024-04-26T07:58:12.260299+0000","last_fullsized":"2024-04-26T07:58:12.260299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:12.260175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:12.260175+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.260175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:01.160714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.938537+0000","last_change":"2024-04-26T07:57:55.938537+0000","last_active":"2024-04-26T07:57:55.938537+0000","last_peered":"2024-04-26T07:57:55.938537+0000","last_clean":"2024-04-26T07:57:55.938537+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:57:55.938537+0000","last_undegraded":"2024-04-26T07:57:55.938537+0000","last_fullsized":"2024-04-26T07:57:55.938537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:55.938404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:55.938404+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.938404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:35.339181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'37","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.018207+0000","last_change":"2024-04-26T07:57:51.018207+0000","last_active":"2024-04-26T07:57:51.018207+0000","last_peered":"2024-04-26T07:57:51.018207+0000","last_clean":"2024-04-26T07:57:51.018207+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:57:51.018207+0000","last_undegraded":"2024-04-26T07:57:51.018207+0000","last_fullsized":"2024-04-26T07:57:51.018207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:51.017960+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:51.017960+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.017960+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:39.406884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.026951+0000","last_change":"2024-04-26T07:57:47.026951+0000","last_active":"2024-04-26T07:57:47.026951+0000","last_peered":"2024-04-26T07:57:47.026951+0000","last_clean":"2024-04-26T07:57:47.026951+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:57:47.026951+0000","last_undegraded":"2024-04-26T07:57:47.026951+0000","last_fullsized":"2024-04-26T07:57:47.026951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.026813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:06.280145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.155890+0000","last_change":"2024-04-26T07:58:31.155890+0000","last_active":"2024-04-26T07:58:31.155890+0000","last_peered":"2024-04-26T07:58:31.155890+0000","last_clean":"2024-04-26T07:58:31.155890+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:58:31.155890+0000","last_undegraded":"2024-04-26T07:58:31.155890+0000","last_fullsized":"2024-04-26T07:58:31.155890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:31.155771+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:31.155771+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.155771+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:49.092021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.269801+0000","last_change":"2024-04-26T07:58:11.269801+0000","last_active":"2024-04-26T07:58:11.269801+0000","last_peered":"2024-04-26T07:58:11.269801+0000","last_clean":"2024-04-26T07:58:11.269801+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:58:11.269801+0000","last_undegraded":"2024-04-26T07:58:11.269801+0000","last_fullsized":"2024-04-26T07:58:11.269801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:11.269608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:11.269608+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.269608+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:59.561335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.154985+0000","last_change":"2024-04-26T07:58:34.154985+0000","last_active":"2024-04-26T07:58:34.154985+0000","last_peered":"2024-04-26T07:58:34.154985+0000","last_clean":"2024-04-26T07:58:34.154985+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:58:34.154985+0000","last_undegraded":"2024-04-26T07:58:34.154985+0000","last_fullsized":"2024-04-26T07:58:34.154985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:34.154871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:34.154871+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.154871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:48.785587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.020138+0000","last_change":"2024-04-26T07:57:54.020138+0000","last_active":"2024-04-26T07:57:54.020138+0000","last_peered":"2024-04-26T07:57:54.020138+0000","last_clean":"2024-04-26T07:57:54.020138+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:57:54.020138+0000","last_undegraded":"2024-04-26T07:57:54.020138+0000","last_fullsized":"2024-04-26T07:57:54.020138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.020020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.020020+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.020020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:45.728783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.025939+0000","last_change":"2024-04-26T07:57:55.025939+0000","last_active":"2024-04-26T07:57:55.025939+0000","last_peered":"2024-04-26T07:57:55.025939+0000","last_clean":"2024-04-26T07:57:55.025939+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:57:55.025939+0000","last_undegraded":"2024-04-26T07:57:55.025939+0000","last_fullsized":"2024-04-26T07:57:55.025939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-04-26T07:57:55.025801+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-04-26T07:57:55.025801+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.025801+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:23.139148+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":361,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.078544+0000","last_change":"2024-04-26T07:57:36.078544+0000","last_active":"2024-04-26T07:57:36.078544+0000","last_peered":"2024-04-26T07:57:36.078544+0000","last_clean":"2024-04-26T07:57:36.078544+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:36.078544+0000","last_undegraded":"2024-04-26T07:57:36.078544+0000","last_fullsized":"2024-04-26T07:57:36.078544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.078443+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:00.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.687186+0000","last_change":"2024-04-26T07:58:32.687186+0000","last_active":"2024-04-26T07:58:32.687186+0000","last_peered":"2024-04-26T07:58:32.687186+0000","last_clean":"2024-04-26T07:58:32.687186+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:58:32.687186+0000","last_undegraded":"2024-04-26T07:58:32.687186+0000","last_fullsized":"2024-04-26T07:58:32.687186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:32.687042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:32.687042+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.687042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:57:56.973895+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.194805+0000","last_change":"2024-04-26T07:57:58.194805+0000","last_active":"2024-04-26T07:57:58.194805+0000","last_peered":"2024-04-26T07:57:58.194805+0000","last_clean":"2024-04-26T07:57:58.194805+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:58.194805+0000","last_undegraded":"2024-04-26T07:57:58.194805+0000","last_fullsized":"2024-04-26T07:57:58.194805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:58.194676+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:58.194676+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.194676+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:17.448008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:41.088455+0000","last_change":"2024-04-26T07:58:41.088455+0000","last_active":"2024-04-26T07:58:41.088455+0000","last_peered":"2024-04-26T07:58:41.088455+0000","last_clean":"2024-04-26T07:58:41.088455+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:58:41.088455+0000","last_undegraded":"2024-04-26T07:58:41.088455+0000","last_fullsized":"2024-04-26T07:58:41.088455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:41.088330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:41.088330+0000","last_clean_scrub_stamp":"2024-04-26T07:58:41.088330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:02.104536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.868520+0000","last_change":"2024-04-26T07:57:57.868520+0000","last_active":"2024-04-26T07:57:57.868520+0000","last_peered":"2024-04-26T07:57:57.868520+0000","last_clean":"2024-04-26T07:57:57.868520+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:57:57.868520+0000","last_undegraded":"2024-04-26T07:57:57.868520+0000","last_fullsized":"2024-04-26T07:57:57.868520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:57.868394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:57.868394+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.868394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.157429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'64","reported_seq":138,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.962369+0000","last_change":"2024-04-26T07:57:46.962369+0000","last_active":"2024-04-26T07:57:46.962369+0000","last_peered":"2024-04-26T07:57:46.962369+0000","last_clean":"2024-04-26T07:57:46.962369+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:57:46.962369+0000","last_undegraded":"2024-04-26T07:57:46.962369+0000","last_fullsized":"2024-04-26T07:57:46.962369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.962228+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:34.331613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.099115+0000","last_change":"2024-04-26T07:57:35.099115+0000","last_active":"2024-04-26T07:57:35.099115+0000","last_peered":"2024-04-26T07:57:35.099115+0000","last_clean":"2024-04-26T07:57:35.099115+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:57:35.099115+0000","last_undegraded":"2024-04-26T07:57:35.099115+0000","last_fullsized":"2024-04-26T07:57:35.099115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.098977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:27.568866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.665873+0000","last_change":"2024-04-26T07:58:33.665873+0000","last_active":"2024-04-26T07:58:33.665873+0000","last_peered":"2024-04-26T07:58:33.665873+0000","last_clean":"2024-04-26T07:58:33.665873+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:58:33.665873+0000","last_undegraded":"2024-04-26T07:58:33.665873+0000","last_fullsized":"2024-04-26T07:58:33.665873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-04-26T07:58:33.665731+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-04-26T07:58:33.665731+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.665731+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:32.080803+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.163967+0000","last_change":"2024-04-26T07:57:57.163967+0000","last_active":"2024-04-26T07:57:57.163967+0000","last_peered":"2024-04-26T07:57:57.163967+0000","last_clean":"2024-04-26T07:57:57.163967+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:57:57.163967+0000","last_undegraded":"2024-04-26T07:57:57.163967+0000","last_fullsized":"2024-04-26T07:57:57.163967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:57.163800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:57.163800+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.163800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:45.732682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.759703+0000","last_change":"2024-04-26T07:58:23.759703+0000","last_active":"2024-04-26T07:58:23.759703+0000","last_peered":"2024-04-26T07:58:23.759703+0000","last_clean":"2024-04-26T07:58:23.759703+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:58:23.759703+0000","last_undegraded":"2024-04-26T07:58:23.759703+0000","last_fullsized":"2024-04-26T07:58:23.759703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:23.759573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:23.759573+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.759573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:14.550610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.292998+0000","last_change":"2024-04-26T07:57:48.292998+0000","last_active":"2024-04-26T07:57:48.292998+0000","last_peered":"2024-04-26T07:57:48.292998+0000","last_clean":"2024-04-26T07:57:48.292998+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:57:48.292998+0000","last_undegraded":"2024-04-26T07:57:48.292998+0000","last_fullsized":"2024-04-26T07:57:48.292998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.292808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:10.416826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.928755+0000","last_change":"2024-04-26T07:57:44.928755+0000","last_active":"2024-04-26T07:57:44.928755+0000","last_peered":"2024-04-26T07:57:44.928755+0000","last_clean":"2024-04-26T07:57:44.928755+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:57:44.928755+0000","last_undegraded":"2024-04-26T07:57:44.928755+0000","last_fullsized":"2024-04-26T07:57:44.928755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.928570+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.353478+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.037367+0000","last_change":"2024-04-26T07:58:00.037367+0000","last_active":"2024-04-26T07:58:00.037367+0000","last_peered":"2024-04-26T07:58:00.037367+0000","last_clean":"2024-04-26T07:58:00.037367+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:58:00.037367+0000","last_undegraded":"2024-04-26T07:58:00.037367+0000","last_fullsized":"2024-04-26T07:58:00.037367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:00.037251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:00.037251+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.037251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:24.628418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.158421+0000","last_change":"2024-04-26T07:58:27.158448+0000","last_active":"2024-04-26T07:58:27.158421+0000","last_peered":"2024-04-26T07:58:27.158421+0000","last_clean":"2024-04-26T07:58:27.158421+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:58:27.158421+0000","last_undegraded":"2024-04-26T07:58:27.158421+0000","last_fullsized":"2024-04-26T07:58:27.158421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:27.158330+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:27.158330+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.158330+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:12.762499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.008175+0000","last_change":"2024-04-26T07:57:52.008175+0000","last_active":"2024-04-26T07:57:52.008175+0000","last_peered":"2024-04-26T07:57:52.008175+0000","last_clean":"2024-04-26T07:57:52.008175+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:52.008175+0000","last_undegraded":"2024-04-26T07:57:52.008175+0000","last_fullsized":"2024-04-26T07:57:52.008175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:52.008051+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:52.008051+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.008051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:54.902871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:44.123274+0000","last_change":"2024-04-26T07:58:44.123307+0000","last_active":"2024-04-26T07:58:44.123274+0000","last_peered":"2024-04-26T07:58:44.123274+0000","last_clean":"2024-04-26T07:58:44.123274+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:58:44.123274+0000","last_undegraded":"2024-04-26T07:58:44.123274+0000","last_fullsized":"2024-04-26T07:58:44.123274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:44.123166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:44.123166+0000","last_clean_scrub_stamp":"2024-04-26T07:58:44.123166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:59.254077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.893157+0000","last_change":"2024-04-26T07:57:56.893157+0000","last_active":"2024-04-26T07:57:56.893157+0000","last_peered":"2024-04-26T07:57:56.893157+0000","last_clean":"2024-04-26T07:57:56.893157+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:57:56.893157+0000","last_undegraded":"2024-04-26T07:57:56.893157+0000","last_fullsized":"2024-04-26T07:57:56.893157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:56.892989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:56.892989+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.892989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:19.992014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.289709+0000","last_change":"2024-04-26T07:57:45.289709+0000","last_active":"2024-04-26T07:57:45.289709+0000","last_peered":"2024-04-26T07:57:45.289709+0000","last_clean":"2024-04-26T07:57:45.289709+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:57:45.289709+0000","last_undegraded":"2024-04-26T07:57:45.289709+0000","last_fullsized":"2024-04-26T07:57:45.289709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.289560+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:24.532087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":416,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.293682+0000","last_change":"2024-04-26T07:57:39.293682+0000","last_active":"2024-04-26T07:57:39.293682+0000","last_peered":"2024-04-26T07:57:39.293682+0000","last_clean":"2024-04-26T07:57:39.293682+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:39.293682+0000","last_undegraded":"2024-04-26T07:57:39.293682+0000","last_fullsized":"2024-04-26T07:57:39.293682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.293505+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.009568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'13","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.649805+0000","last_change":"2024-04-26T07:58:29.649805+0000","last_active":"2024-04-26T07:58:29.649805+0000","last_peered":"2024-04-26T07:58:29.649805+0000","last_clean":"2024-04-26T07:58:29.649805+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:58:29.649805+0000","last_undegraded":"2024-04-26T07:58:29.649805+0000","last_fullsized":"2024-04-26T07:58:29.649805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-04-26T07:58:29.649659+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-04-26T07:58:29.649659+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.649659+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:41:47.366919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.432613+0000","last_change":"2024-04-26T07:58:21.432613+0000","last_active":"2024-04-26T07:58:21.432613+0000","last_peered":"2024-04-26T07:58:21.432613+0000","last_clean":"2024-04-26T07:58:21.432613+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:58:21.432613+0000","last_undegraded":"2024-04-26T07:58:21.432613+0000","last_fullsized":"2024-04-26T07:58:21.432613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-26T07:58:21.432427+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-26T07:58:21.432427+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.432427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:24.327247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:35.155723+0000","last_change":"2024-04-26T07:58:35.155752+0000","last_active":"2024-04-26T07:58:35.155723+0000","last_peered":"2024-04-26T07:58:35.155723+0000","last_clean":"2024-04-26T07:58:35.155723+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:58:35.155723+0000","last_undegraded":"2024-04-26T07:58:35.155723+0000","last_fullsized":"2024-04-26T07:58:35.155723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:35.155623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:35.155623+0000","last_clean_scrub_stamp":"2024-04-26T07:58:35.155623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:08.488980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":440,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:36.130796+0000","last_change":"2024-04-26T07:58:36.130796+0000","last_active":"2024-04-26T07:58:36.130796+0000","last_peered":"2024-04-26T07:58:36.130796+0000","last_clean":"2024-04-26T07:58:36.130796+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:58:36.130796+0000","last_undegraded":"2024-04-26T07:58:36.130796+0000","last_fullsized":"2024-04-26T07:58:36.130796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:36.130657+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:36.130657+0000","last_clean_scrub_stamp":"2024-04-26T07:58:36.130657+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:55.378641+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.098164+0000","last_change":"2024-04-26T07:58:02.098164+0000","last_active":"2024-04-26T07:58:02.098164+0000","last_peered":"2024-04-26T07:58:02.098164+0000","last_clean":"2024-04-26T07:58:02.098164+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:58:02.098164+0000","last_undegraded":"2024-04-26T07:58:02.098164+0000","last_fullsized":"2024-04-26T07:58:02.098164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-04-26T07:58:02.098032+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-04-26T07:58:02.098032+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.098032+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:12.785928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":478,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.160522+0000","last_change":"2024-04-26T07:57:36.160522+0000","last_active":"2024-04-26T07:57:36.160522+0000","last_peered":"2024-04-26T07:57:36.160522+0000","last_clean":"2024-04-26T07:57:36.160522+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:36.160522+0000","last_undegraded":"2024-04-26T07:57:36.160522+0000","last_fullsized":"2024-04-26T07:57:36.160522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.160401+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:38.276301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.200716+0000","last_change":"2024-04-26T07:57:55.200716+0000","last_active":"2024-04-26T07:57:55.200716+0000","last_peered":"2024-04-26T07:57:55.200716+0000","last_clean":"2024-04-26T07:57:55.200716+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:57:55.200716+0000","last_undegraded":"2024-04-26T07:57:55.200716+0000","last_fullsized":"2024-04-26T07:57:55.200716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:55.200595+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:55.200595+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.200595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:09.542065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.093446+0000","last_change":"2024-04-26T07:58:18.093446+0000","last_active":"2024-04-26T07:58:18.093446+0000","last_peered":"2024-04-26T07:58:18.093446+0000","last_clean":"2024-04-26T07:58:18.093446+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:58:18.093446+0000","last_undegraded":"2024-04-26T07:58:18.093446+0000","last_fullsized":"2024-04-26T07:58:18.093446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:18.093308+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:18.093308+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.093308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:46.206655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.131168+0000","last_change":"2024-04-26T07:58:28.131168+0000","last_active":"2024-04-26T07:58:28.131168+0000","last_peered":"2024-04-26T07:58:28.131168+0000","last_clean":"2024-04-26T07:58:28.131168+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:58:28.131168+0000","last_undegraded":"2024-04-26T07:58:28.131168+0000","last_fullsized":"2024-04-26T07:58:28.131168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:28.131035+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:28.131035+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.131035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.736994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.958217+0000","last_change":"2024-04-26T07:57:39.958217+0000","last_active":"2024-04-26T07:57:39.958217+0000","last_peered":"2024-04-26T07:57:39.958217+0000","last_clean":"2024-04-26T07:57:39.958217+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:57:39.958217+0000","last_undegraded":"2024-04-26T07:57:39.958217+0000","last_fullsized":"2024-04-26T07:57:39.958217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.958089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.571578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'50","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.994938+0000","last_change":"2024-04-26T07:57:40.994938+0000","last_active":"2024-04-26T07:57:40.994938+0000","last_peered":"2024-04-26T07:57:40.994938+0000","last_clean":"2024-04-26T07:57:40.994938+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:57:40.994938+0000","last_undegraded":"2024-04-26T07:57:40.994938+0000","last_fullsized":"2024-04-26T07:57:40.994938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.994806+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:36.917229+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.265003+0000","last_change":"2024-04-26T07:57:51.265003+0000","last_active":"2024-04-26T07:57:51.265003+0000","last_peered":"2024-04-26T07:57:51.265003+0000","last_clean":"2024-04-26T07:57:51.265003+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:57:51.265003+0000","last_undegraded":"2024-04-26T07:57:51.265003+0000","last_fullsized":"2024-04-26T07:57:51.265003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:51.264883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:51.264883+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.264883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.713422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.068192+0000","last_change":"2024-04-26T07:57:52.068192+0000","last_active":"2024-04-26T07:57:52.068192+0000","last_peered":"2024-04-26T07:57:52.068192+0000","last_clean":"2024-04-26T07:57:52.068192+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:52.068192+0000","last_undegraded":"2024-04-26T07:57:52.068192+0000","last_fullsized":"2024-04-26T07:57:52.068192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:52.068074+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:52.068074+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.068074+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:08.194548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.091526+0000","last_change":"2024-04-26T07:58:12.091526+0000","last_active":"2024-04-26T07:58:12.091526+0000","last_peered":"2024-04-26T07:58:12.091526+0000","last_clean":"2024-04-26T07:58:12.091526+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:58:12.091526+0000","last_undegraded":"2024-04-26T07:58:12.091526+0000","last_fullsized":"2024-04-26T07:58:12.091526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:12.091376+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:12.091376+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.091376+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:28.508324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.210467+0000","last_change":"2024-04-26T07:58:22.210499+0000","last_active":"2024-04-26T07:58:22.210467+0000","last_peered":"2024-04-26T07:58:22.210467+0000","last_clean":"2024-04-26T07:58:22.210467+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:58:22.210467+0000","last_undegraded":"2024-04-26T07:58:22.210467+0000","last_fullsized":"2024-04-26T07:58:22.210467+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-04-26T07:58:22.210379+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-04-26T07:58:22.210379+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.210379+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:11:08.592322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:49.179872+0000","last_change":"2024-04-26T07:58:49.179902+0000","last_active":"2024-04-26T07:58:49.179872+0000","last_peered":"2024-04-26T07:58:49.179872+0000","last_clean":"2024-04-26T07:58:49.179872+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:58:49.179872+0000","last_undegraded":"2024-04-26T07:58:49.179872+0000","last_fullsized":"2024-04-26T07:58:49.179872+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:49.179772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:49.179772+0000","last_clean_scrub_stamp":"2024-04-26T07:58:49.179772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:26.078699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:39.142697+0000","last_change":"2024-04-26T07:58:39.142723+0000","last_active":"2024-04-26T07:58:39.142697+0000","last_peered":"2024-04-26T07:58:39.142697+0000","last_clean":"2024-04-26T07:58:39.142697+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:58:39.142697+0000","last_undegraded":"2024-04-26T07:58:39.142697+0000","last_fullsized":"2024-04-26T07:58:39.142697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:39.142593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:39.142593+0000","last_clean_scrub_stamp":"2024-04-26T07:58:39.142593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:15.338832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"29'2","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.019436+0000","last_change":"2024-04-26T07:57:51.019436+0000","last_active":"2024-04-26T07:57:51.019436+0000","last_peered":"2024-04-26T07:57:51.019436+0000","last_clean":"2024-04-26T07:57:51.019436+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:57:51.019436+0000","last_undegraded":"2024-04-26T07:57:51.019436+0000","last_fullsized":"2024-04-26T07:57:51.019436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:51.019305+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:51.019305+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.019305+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:10.272637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":179,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.023139+0000","last_change":"2024-04-26T07:57:43.023139+0000","last_active":"2024-04-26T07:57:43.023139+0000","last_peered":"2024-04-26T07:57:43.023139+0000","last_clean":"2024-04-26T07:57:43.023139+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:57:43.023139+0000","last_undegraded":"2024-04-26T07:57:43.023139+0000","last_fullsized":"2024-04-26T07:57:43.023139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.022950+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:31.923488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.045637+0000","last_change":"2024-04-26T07:57:38.045637+0000","last_active":"2024-04-26T07:57:38.045637+0000","last_peered":"2024-04-26T07:57:38.045637+0000","last_clean":"2024-04-26T07:57:38.045637+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:57:38.045637+0000","last_undegraded":"2024-04-26T07:57:38.045637+0000","last_fullsized":"2024-04-26T07:57:38.045637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.045507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:26.957086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.449465+0000","last_change":"2024-04-26T07:58:23.449465+0000","last_active":"2024-04-26T07:58:23.449465+0000","last_peered":"2024-04-26T07:58:23.449465+0000","last_clean":"2024-04-26T07:58:23.449465+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:58:23.449465+0000","last_undegraded":"2024-04-26T07:58:23.449465+0000","last_fullsized":"2024-04-26T07:58:23.449465+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'81","last_scrub_stamp":"2024-04-26T07:58:23.449328+0000","last_deep_scrub":"29'81","last_deep_scrub_stamp":"2024-04-26T07:58:23.449328+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.449328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:09.228090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.172908+0000","last_change":"2024-04-26T07:58:16.172908+0000","last_active":"2024-04-26T07:58:16.172908+0000","last_peered":"2024-04-26T07:58:16.172908+0000","last_clean":"2024-04-26T07:58:16.172908+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:58:16.172908+0000","last_undegraded":"2024-04-26T07:58:16.172908+0000","last_fullsized":"2024-04-26T07:58:16.172908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:16.172787+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:16.172787+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.172787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:16.279358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:46.116556+0000","last_change":"2024-04-26T07:58:46.116582+0000","last_active":"2024-04-26T07:58:46.116556+0000","last_peered":"2024-04-26T07:58:46.116556+0000","last_clean":"2024-04-26T07:58:46.116556+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:58:46.116556+0000","last_undegraded":"2024-04-26T07:58:46.116556+0000","last_fullsized":"2024-04-26T07:58:46.116556+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:46.116454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:46.116454+0000","last_clean_scrub_stamp":"2024-04-26T07:58:46.116454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:21.300974+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.793998+0000","last_change":"2024-04-26T07:58:19.793998+0000","last_active":"2024-04-26T07:58:19.793998+0000","last_peered":"2024-04-26T07:58:19.793998+0000","last_clean":"2024-04-26T07:58:19.793998+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:58:19.793998+0000","last_undegraded":"2024-04-26T07:58:19.793998+0000","last_fullsized":"2024-04-26T07:58:19.793998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:19.793877+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:19.793877+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.793877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:27.595245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.922184+0000","last_change":"2024-04-26T07:57:37.922184+0000","last_active":"2024-04-26T07:57:37.922184+0000","last_peered":"2024-04-26T07:57:37.922184+0000","last_clean":"2024-04-26T07:57:37.922184+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:57:37.922184+0000","last_undegraded":"2024-04-26T07:57:37.922184+0000","last_fullsized":"2024-04-26T07:57:37.922184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.922054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:17.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.125161+0000","last_change":"2024-04-26T07:57:38.125161+0000","last_active":"2024-04-26T07:57:38.125161+0000","last_peered":"2024-04-26T07:57:38.125161+0000","last_clean":"2024-04-26T07:57:38.125161+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:38.125161+0000","last_undegraded":"2024-04-26T07:57:38.125161+0000","last_fullsized":"2024-04-26T07:57:38.125161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.125031+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:12.231248+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.031627+0000","last_change":"2024-04-26T07:57:58.031627+0000","last_active":"2024-04-26T07:57:58.031627+0000","last_peered":"2024-04-26T07:57:58.031627+0000","last_clean":"2024-04-26T07:57:58.031627+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:57:58.031627+0000","last_undegraded":"2024-04-26T07:57:58.031627+0000","last_fullsized":"2024-04-26T07:57:58.031627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:58.031507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:58.031507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.031507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:50.696106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.218474+0000","last_change":"2024-04-26T07:58:04.218474+0000","last_active":"2024-04-26T07:58:04.218474+0000","last_peered":"2024-04-26T07:58:04.218474+0000","last_clean":"2024-04-26T07:58:04.218474+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:58:04.218474+0000","last_undegraded":"2024-04-26T07:58:04.218474+0000","last_fullsized":"2024-04-26T07:58:04.218474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:04.218304+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:04.218304+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.218304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:25.813231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.817842+0000","last_change":"2024-04-26T07:58:14.817842+0000","last_active":"2024-04-26T07:58:14.817842+0000","last_peered":"2024-04-26T07:58:14.817842+0000","last_clean":"2024-04-26T07:58:14.817842+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:58:14.817842+0000","last_undegraded":"2024-04-26T07:58:14.817842+0000","last_fullsized":"2024-04-26T07:58:14.817842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:58:14.817630+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:58:14.817630+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.817630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:31.670652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.234012+0000","last_change":"2024-04-26T07:58:13.234012+0000","last_active":"2024-04-26T07:58:13.234012+0000","last_peered":"2024-04-26T07:58:13.234012+0000","last_clean":"2024-04-26T07:58:13.234012+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:58:13.234012+0000","last_undegraded":"2024-04-26T07:58:13.234012+0000","last_fullsized":"2024-04-26T07:58:13.234012+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:13.233897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:13.233897+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.233897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:31.834744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.783978+0000","last_change":"2024-04-26T07:58:07.783978+0000","last_active":"2024-04-26T07:58:07.783978+0000","last_peered":"2024-04-26T07:58:07.783978+0000","last_clean":"2024-04-26T07:58:07.783978+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:58:07.783978+0000","last_undegraded":"2024-04-26T07:58:07.783978+0000","last_fullsized":"2024-04-26T07:58:07.783978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:07.783854+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:07.783854+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.783854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:58.598461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.191428+0000","last_change":"2024-04-26T07:57:53.191428+0000","last_active":"2024-04-26T07:57:53.191428+0000","last_peered":"2024-04-26T07:57:53.191428+0000","last_clean":"2024-04-26T07:57:53.191428+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:57:53.191428+0000","last_undegraded":"2024-04-26T07:57:53.191428+0000","last_fullsized":"2024-04-26T07:57:53.191428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:53.191310+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:53.191310+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.191310+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:50.616218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.312009+0000","last_change":"2024-04-26T07:57:42.312009+0000","last_active":"2024-04-26T07:57:42.312009+0000","last_peered":"2024-04-26T07:57:42.312009+0000","last_clean":"2024-04-26T07:57:42.312009+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:42.312009+0000","last_undegraded":"2024-04-26T07:57:42.312009+0000","last_fullsized":"2024-04-26T07:57:42.312009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.311876+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:19:59.304320+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.073448+0000","last_change":"2024-04-26T07:57:37.073448+0000","last_active":"2024-04-26T07:57:37.073448+0000","last_peered":"2024-04-26T07:57:37.073448+0000","last_clean":"2024-04-26T07:57:37.073448+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:57:37.073448+0000","last_undegraded":"2024-04-26T07:57:37.073448+0000","last_fullsized":"2024-04-26T07:57:37.073448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.073329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:12.794354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:54.126393+0000","last_change":"2024-04-26T07:58:54.126393+0000","last_active":"2024-04-26T07:58:54.126393+0000","last_peered":"2024-04-26T07:58:54.126393+0000","last_clean":"2024-04-26T07:58:54.126393+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:58:54.126393+0000","last_undegraded":"2024-04-26T07:58:54.126393+0000","last_fullsized":"2024-04-26T07:58:54.126393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:54.126254+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:54.126254+0000","last_clean_scrub_stamp":"2024-04-26T07:58:54.126254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:05.193343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.775067+0000","last_change":"2024-04-26T07:58:16.775067+0000","last_active":"2024-04-26T07:58:16.775067+0000","last_peered":"2024-04-26T07:58:16.775067+0000","last_clean":"2024-04-26T07:58:16.775067+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:58:16.775067+0000","last_undegraded":"2024-04-26T07:58:16.775067+0000","last_fullsized":"2024-04-26T07:58:16.775067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:16.774960+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:16.774960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.774960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:22:18.154848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:48.159078+0000","last_change":"2024-04-26T07:58:48.159103+0000","last_active":"2024-04-26T07:58:48.159078+0000","last_peered":"2024-04-26T07:58:48.159078+0000","last_clean":"2024-04-26T07:58:48.159078+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:58:48.159078+0000","last_undegraded":"2024-04-26T07:58:48.159078+0000","last_fullsized":"2024-04-26T07:58:48.159078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:48.158974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:48.158974+0000","last_clean_scrub_stamp":"2024-04-26T07:58:48.158974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:15.565863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.260678+0000","last_change":"2024-04-26T07:58:15.260678+0000","last_active":"2024-04-26T07:58:15.260678+0000","last_peered":"2024-04-26T07:58:15.260678+0000","last_clean":"2024-04-26T07:58:15.260678+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:58:15.260678+0000","last_undegraded":"2024-04-26T07:58:15.260678+0000","last_fullsized":"2024-04-26T07:58:15.260678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.260556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.260556+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.260556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:37.478244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.004825+0000","last_change":"2024-04-26T07:57:50.004825+0000","last_active":"2024-04-26T07:57:50.004825+0000","last_peered":"2024-04-26T07:57:50.004825+0000","last_clean":"2024-04-26T07:57:50.004825+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:57:50.004825+0000","last_undegraded":"2024-04-26T07:57:50.004825+0000","last_fullsized":"2024-04-26T07:57:50.004825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:50.004662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:50.004662+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.004662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.926317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.047055+0000","last_change":"2024-04-26T07:58:06.047055+0000","last_active":"2024-04-26T07:58:06.047055+0000","last_peered":"2024-04-26T07:58:06.047055+0000","last_clean":"2024-04-26T07:58:06.047055+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:58:06.047055+0000","last_undegraded":"2024-04-26T07:58:06.047055+0000","last_fullsized":"2024-04-26T07:58:06.047055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:06.046909+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:06.046909+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.046909+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:20.722729+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.989200+0000","last_change":"2024-04-26T07:57:56.989200+0000","last_active":"2024-04-26T07:57:56.989200+0000","last_peered":"2024-04-26T07:57:56.989200+0000","last_clean":"2024-04-26T07:57:56.989200+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:57:56.989200+0000","last_undegraded":"2024-04-26T07:57:56.989200+0000","last_fullsized":"2024-04-26T07:57:56.989200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:56.989067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:56.989067+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.989067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:13.842088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.160947+0000","last_change":"2024-04-26T07:58:34.160947+0000","last_active":"2024-04-26T07:58:34.160947+0000","last_peered":"2024-04-26T07:58:34.160947+0000","last_clean":"2024-04-26T07:58:34.160947+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:58:34.160947+0000","last_undegraded":"2024-04-26T07:58:34.160947+0000","last_fullsized":"2024-04-26T07:58:34.160947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:34.160829+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:34.160829+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.160829+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:50.498180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.199146+0000","last_change":"2024-04-26T07:57:59.199146+0000","last_active":"2024-04-26T07:57:59.199146+0000","last_peered":"2024-04-26T07:57:59.199146+0000","last_clean":"2024-04-26T07:57:59.199146+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:57:59.199146+0000","last_undegraded":"2024-04-26T07:57:59.199146+0000","last_fullsized":"2024-04-26T07:57:59.199146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:59.199017+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:59.199017+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.199017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:50.799925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.278734+0000","last_change":"2024-04-26T07:58:14.278734+0000","last_active":"2024-04-26T07:58:14.278734+0000","last_peered":"2024-04-26T07:58:14.278734+0000","last_clean":"2024-04-26T07:58:14.278734+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:58:14.278734+0000","last_undegraded":"2024-04-26T07:58:14.278734+0000","last_fullsized":"2024-04-26T07:58:14.278734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:14.278592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:14.278592+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.278592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:59.568200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.823453+0000","last_change":"2024-04-26T07:58:20.823477+0000","last_active":"2024-04-26T07:58:20.823453+0000","last_peered":"2024-04-26T07:58:20.823453+0000","last_clean":"2024-04-26T07:58:20.823453+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:58:20.823453+0000","last_undegraded":"2024-04-26T07:58:20.823453+0000","last_fullsized":"2024-04-26T07:58:20.823453+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:20.823362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:20.823362+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.823362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:22.325865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.898013+0000","last_change":"2024-04-26T07:57:59.898013+0000","last_active":"2024-04-26T07:57:59.898013+0000","last_peered":"2024-04-26T07:57:59.898013+0000","last_clean":"2024-04-26T07:57:59.898013+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:57:59.898013+0000","last_undegraded":"2024-04-26T07:57:59.898013+0000","last_fullsized":"2024-04-26T07:57:59.898013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:59.897890+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:59.897890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.897890+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:48.189618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'76","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.090487+0000","last_change":"2024-04-26T07:57:45.090487+0000","last_active":"2024-04-26T07:57:45.090487+0000","last_peered":"2024-04-26T07:57:45.090487+0000","last_clean":"2024-04-26T07:57:45.090487+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:57:45.090487+0000","last_undegraded":"2024-04-26T07:57:45.090487+0000","last_fullsized":"2024-04-26T07:57:45.090487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'76","last_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_deep_scrub":"29'76","last_deep_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.090359+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:43.280370+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.248747+0000","last_change":"2024-04-26T07:57:37.248747+0000","last_active":"2024-04-26T07:57:37.248747+0000","last_peered":"2024-04-26T07:57:37.248747+0000","last_clean":"2024-04-26T07:57:37.248747+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:57:37.248747+0000","last_undegraded":"2024-04-26T07:57:37.248747+0000","last_fullsized":"2024-04-26T07:57:37.248747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.248591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:12.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.905929+0000","last_change":"2024-04-26T07:57:58.905929+0000","last_active":"2024-04-26T07:57:58.905929+0000","last_peered":"2024-04-26T07:57:58.905929+0000","last_clean":"2024-04-26T07:57:58.905929+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:57:58.905929+0000","last_undegraded":"2024-04-26T07:57:58.905929+0000","last_fullsized":"2024-04-26T07:57:58.905929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:58.905750+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:58.905750+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.905750+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:46.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:35.162546+0000","last_change":"2024-04-26T07:58:35.162573+0000","last_active":"2024-04-26T07:58:35.162546+0000","last_peered":"2024-04-26T07:58:35.162546+0000","last_clean":"2024-04-26T07:58:35.162546+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:58:35.162546+0000","last_undegraded":"2024-04-26T07:58:35.162546+0000","last_fullsized":"2024-04-26T07:58:35.162546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-04-26T07:58:35.162449+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-04-26T07:58:35.162449+0000","last_clean_scrub_stamp":"2024-04-26T07:58:35.162449+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:51.579398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.737929+0000","last_change":"2024-04-26T07:58:26.737959+0000","last_active":"2024-04-26T07:58:26.737929+0000","last_peered":"2024-04-26T07:58:26.737929+0000","last_clean":"2024-04-26T07:58:26.737929+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:58:26.737929+0000","last_undegraded":"2024-04-26T07:58:26.737929+0000","last_fullsized":"2024-04-26T07:58:26.737929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:26.737834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:26.737834+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.737834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:16.237516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:45.159438+0000","last_change":"2024-04-26T07:58:45.159483+0000","last_active":"2024-04-26T07:58:45.159438+0000","last_peered":"2024-04-26T07:58:45.159438+0000","last_clean":"2024-04-26T07:58:45.159438+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:58:45.159438+0000","last_undegraded":"2024-04-26T07:58:45.159438+0000","last_fullsized":"2024-04-26T07:58:45.159438+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:45.159342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:45.159342+0000","last_clean_scrub_stamp":"2024-04-26T07:58:45.159342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:13:34.290550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.945054+0000","last_change":"2024-04-26T07:57:44.945054+0000","last_active":"2024-04-26T07:57:44.945054+0000","last_peered":"2024-04-26T07:57:44.945054+0000","last_clean":"2024-04-26T07:57:44.945054+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:57:44.945054+0000","last_undegraded":"2024-04-26T07:57:44.945054+0000","last_fullsized":"2024-04-26T07:57:44.945054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.944890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:30.234498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.075367+0000","last_change":"2024-04-26T07:57:39.075367+0000","last_active":"2024-04-26T07:57:39.075367+0000","last_peered":"2024-04-26T07:57:39.075367+0000","last_clean":"2024-04-26T07:57:39.075367+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:57:39.075367+0000","last_undegraded":"2024-04-26T07:57:39.075367+0000","last_fullsized":"2024-04-26T07:57:39.075367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.075180+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:53.257286+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":368,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.140074+0000","last_change":"2024-04-26T07:57:35.140074+0000","last_active":"2024-04-26T07:57:35.140074+0000","last_peered":"2024-04-26T07:57:35.140074+0000","last_clean":"2024-04-26T07:57:35.140074+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:35.140074+0000","last_undegraded":"2024-04-26T07:57:35.140074+0000","last_fullsized":"2024-04-26T07:57:35.140074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.139950+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:52.425998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.144773+0000","last_change":"2024-04-26T07:58:19.144773+0000","last_active":"2024-04-26T07:58:19.144773+0000","last_peered":"2024-04-26T07:58:19.144773+0000","last_clean":"2024-04-26T07:58:19.144773+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:58:19.144773+0000","last_undegraded":"2024-04-26T07:58:19.144773+0000","last_fullsized":"2024-04-26T07:58:19.144773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:19.144629+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:19.144629+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.144629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:47.863551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.070209+0000","last_change":"2024-04-26T07:58:10.070209+0000","last_active":"2024-04-26T07:58:10.070209+0000","last_peered":"2024-04-26T07:58:10.070209+0000","last_clean":"2024-04-26T07:58:10.070209+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:58:10.070209+0000","last_undegraded":"2024-04-26T07:58:10.070209+0000","last_fullsized":"2024-04-26T07:58:10.070209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:10.070084+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:10.070084+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.070084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:47.245235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:42.073241+0000","last_change":"2024-04-26T07:58:42.073272+0000","last_active":"2024-04-26T07:58:42.073241+0000","last_peered":"2024-04-26T07:58:42.073241+0000","last_clean":"2024-04-26T07:58:42.073241+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:58:42.073241+0000","last_undegraded":"2024-04-26T07:58:42.073241+0000","last_fullsized":"2024-04-26T07:58:42.073241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:42.073141+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:42.073141+0000","last_clean_scrub_stamp":"2024-04-26T07:58:42.073141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:48.800068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.774140+0000","last_change":"2024-04-26T07:58:21.774140+0000","last_active":"2024-04-26T07:58:21.774140+0000","last_peered":"2024-04-26T07:58:21.774140+0000","last_clean":"2024-04-26T07:58:21.774140+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:58:21.774140+0000","last_undegraded":"2024-04-26T07:58:21.774140+0000","last_fullsized":"2024-04-26T07:58:21.774140+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:21.774021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:21.774021+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.774021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:49.274483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.927279+0000","last_change":"2024-04-26T07:57:35.927279+0000","last_active":"2024-04-26T07:57:35.927279+0000","last_peered":"2024-04-26T07:57:35.927279+0000","last_clean":"2024-04-26T07:57:35.927279+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:57:35.927279+0000","last_undegraded":"2024-04-26T07:57:35.927279+0000","last_fullsized":"2024-04-26T07:57:35.927279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.927147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:35.660610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.109570+0000","last_change":"2024-04-26T07:58:04.109570+0000","last_active":"2024-04-26T07:58:04.109570+0000","last_peered":"2024-04-26T07:58:04.109570+0000","last_clean":"2024-04-26T07:58:04.109570+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:58:04.109570+0000","last_undegraded":"2024-04-26T07:58:04.109570+0000","last_fullsized":"2024-04-26T07:58:04.109570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:58:04.109417+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:58:04.109417+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.109417+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:41:43.464915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.023125+0000","last_change":"2024-04-26T07:57:39.023125+0000","last_active":"2024-04-26T07:57:39.023125+0000","last_peered":"2024-04-26T07:57:39.023125+0000","last_clean":"2024-04-26T07:57:39.023125+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:39.023125+0000","last_undegraded":"2024-04-26T07:57:39.023125+0000","last_fullsized":"2024-04-26T07:57:39.023125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.023000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:21.471539+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.141975+0000","last_change":"2024-04-26T07:58:32.141975+0000","last_active":"2024-04-26T07:58:32.141975+0000","last_peered":"2024-04-26T07:58:32.141975+0000","last_clean":"2024-04-26T07:58:32.141975+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:58:32.141975+0000","last_undegraded":"2024-04-26T07:58:32.141975+0000","last_fullsized":"2024-04-26T07:58:32.141975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-26T07:58:32.141831+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-26T07:58:32.141831+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.141831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:07.275715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.223158+0000","last_change":"2024-04-26T07:58:03.223158+0000","last_active":"2024-04-26T07:58:03.223158+0000","last_peered":"2024-04-26T07:58:03.223158+0000","last_clean":"2024-04-26T07:58:03.223158+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:58:03.223158+0000","last_undegraded":"2024-04-26T07:58:03.223158+0000","last_fullsized":"2024-04-26T07:58:03.223158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:03.223053+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:03.223053+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.223053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:51.791934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.150682+0000","last_change":"2024-04-26T07:58:25.150682+0000","last_active":"2024-04-26T07:58:25.150682+0000","last_peered":"2024-04-26T07:58:25.150682+0000","last_clean":"2024-04-26T07:58:25.150682+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:58:25.150682+0000","last_undegraded":"2024-04-26T07:58:25.150682+0000","last_fullsized":"2024-04-26T07:58:25.150682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:25.150561+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:25.150561+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.150561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:35.838457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:47.121882+0000","last_change":"2024-04-26T07:58:47.121924+0000","last_active":"2024-04-26T07:58:47.121882+0000","last_peered":"2024-04-26T07:58:47.121882+0000","last_clean":"2024-04-26T07:58:47.121882+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:58:47.121882+0000","last_undegraded":"2024-04-26T07:58:47.121882+0000","last_fullsized":"2024-04-26T07:58:47.121882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:47.121775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:47.121775+0000","last_clean_scrub_stamp":"2024-04-26T07:58:47.121775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:43.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.983919+0000","last_change":"2024-04-26T07:57:43.983919+0000","last_active":"2024-04-26T07:57:43.983919+0000","last_peered":"2024-04-26T07:57:43.983919+0000","last_clean":"2024-04-26T07:57:43.983919+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:57:43.983919+0000","last_undegraded":"2024-04-26T07:57:43.983919+0000","last_fullsized":"2024-04-26T07:57:43.983919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.983811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:02.584658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.313398+0000","last_change":"2024-04-26T07:57:40.313398+0000","last_active":"2024-04-26T07:57:40.313398+0000","last_peered":"2024-04-26T07:57:40.313398+0000","last_clean":"2024-04-26T07:57:40.313398+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:57:40.313398+0000","last_undegraded":"2024-04-26T07:57:40.313398+0000","last_fullsized":"2024-04-26T07:57:40.313398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.313247+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:44.555766+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.130608+0000","last_change":"2024-04-26T07:57:34.130608+0000","last_active":"2024-04-26T07:57:34.130608+0000","last_peered":"2024-04-26T07:57:34.130608+0000","last_clean":"2024-04-26T07:57:34.130608+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:57:34.130608+0000","last_undegraded":"2024-04-26T07:57:34.130608+0000","last_fullsized":"2024-04-26T07:57:34.130608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_clean_scrub_stamp":"2024-04-26T07:57:34.130497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:01.130219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.483303+0000","last_change":"2024-04-26T07:58:25.483303+0000","last_active":"2024-04-26T07:58:25.483303+0000","last_peered":"2024-04-26T07:58:25.483303+0000","last_clean":"2024-04-26T07:58:25.483303+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:58:25.483303+0000","last_undegraded":"2024-04-26T07:58:25.483303+0000","last_fullsized":"2024-04-26T07:58:25.483303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.483179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.483179+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.483179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:12.197354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.417868+0000","last_change":"2024-04-26T07:58:22.417868+0000","last_active":"2024-04-26T07:58:22.417868+0000","last_peered":"2024-04-26T07:58:22.417868+0000","last_clean":"2024-04-26T07:58:22.417868+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:58:22.417868+0000","last_undegraded":"2024-04-26T07:58:22.417868+0000","last_fullsized":"2024-04-26T07:58:22.417868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:22.417750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:22.417750+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.417750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:46.601587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.246787+0000","last_change":"2024-04-26T07:58:07.246815+0000","last_active":"2024-04-26T07:58:07.246787+0000","last_peered":"2024-04-26T07:58:07.246787+0000","last_clean":"2024-04-26T07:58:07.246787+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:58:07.246787+0000","last_undegraded":"2024-04-26T07:58:07.246787+0000","last_fullsized":"2024-04-26T07:58:07.246787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:07.246695+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:07.246695+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.246695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.647472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.155042+0000","last_change":"2024-04-26T07:58:26.155042+0000","last_active":"2024-04-26T07:58:26.155042+0000","last_peered":"2024-04-26T07:58:26.155042+0000","last_clean":"2024-04-26T07:58:26.155042+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:58:26.155042+0000","last_undegraded":"2024-04-26T07:58:26.155042+0000","last_fullsized":"2024-04-26T07:58:26.155042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:26.154907+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:26.154907+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.154907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:13.155009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.997479+0000","last_change":"2024-04-26T07:57:49.997522+0000","last_active":"2024-04-26T07:57:49.997479+0000","last_peered":"2024-04-26T07:57:49.997479+0000","last_clean":"2024-04-26T07:57:49.997479+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:57:49.997479+0000","last_undegraded":"2024-04-26T07:57:49.997479+0000","last_fullsized":"2024-04-26T07:57:49.997479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.997377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.997377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.997377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:50.303288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.959591+0000","last_change":"2024-04-26T07:57:38.959627+0000","last_active":"2024-04-26T07:57:38.959591+0000","last_peered":"2024-04-26T07:57:38.959591+0000","last_clean":"2024-04-26T07:57:38.959591+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:57:38.959591+0000","last_undegraded":"2024-04-26T07:57:38.959591+0000","last_fullsized":"2024-04-26T07:57:38.959591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.959495+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:02.058520+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.004289+0000","last_change":"2024-04-26T07:57:59.004319+0000","last_active":"2024-04-26T07:57:59.004289+0000","last_peered":"2024-04-26T07:57:59.004289+0000","last_clean":"2024-04-26T07:57:59.004289+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:57:59.004289+0000","last_undegraded":"2024-04-26T07:57:59.004289+0000","last_fullsized":"2024-04-26T07:57:59.004289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:59.004197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:59.004197+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.004197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.386140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.711972+0000","last_change":"2024-04-26T07:58:34.712003+0000","last_active":"2024-04-26T07:58:34.711972+0000","last_peered":"2024-04-26T07:58:34.711972+0000","last_clean":"2024-04-26T07:58:34.711972+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:58:34.711972+0000","last_undegraded":"2024-04-26T07:58:34.711972+0000","last_fullsized":"2024-04-26T07:58:34.711972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:34.711869+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:34.711869+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.711869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:20.724124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.212852+0000","last_change":"2024-04-26T07:57:58.212898+0000","last_active":"2024-04-26T07:57:58.212852+0000","last_peered":"2024-04-26T07:57:58.212852+0000","last_clean":"2024-04-26T07:57:58.212852+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:58.212852+0000","last_undegraded":"2024-04-26T07:57:58.212852+0000","last_fullsized":"2024-04-26T07:57:58.212852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:57:58.212714+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:57:58.212714+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.212714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:57.946177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.269048+0000","last_change":"2024-04-26T07:58:16.269076+0000","last_active":"2024-04-26T07:58:16.269048+0000","last_peered":"2024-04-26T07:58:16.269048+0000","last_clean":"2024-04-26T07:58:16.269048+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:58:16.269048+0000","last_undegraded":"2024-04-26T07:58:16.269048+0000","last_fullsized":"2024-04-26T07:58:16.269048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:16.268935+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:16.268935+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.268935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:03.638319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.982361+0000","last_change":"2024-04-26T07:57:45.982384+0000","last_active":"2024-04-26T07:57:45.982361+0000","last_peered":"2024-04-26T07:57:45.982361+0000","last_clean":"2024-04-26T07:57:45.982361+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:57:45.982361+0000","last_undegraded":"2024-04-26T07:57:45.982361+0000","last_fullsized":"2024-04-26T07:57:45.982361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.982268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:08.199956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.056129+0000","last_change":"2024-04-26T07:57:49.056205+0000","last_active":"2024-04-26T07:57:49.056129+0000","last_peered":"2024-04-26T07:57:49.056129+0000","last_clean":"2024-04-26T07:57:49.056129+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:49.056129+0000","last_undegraded":"2024-04-26T07:57:49.056129+0000","last_fullsized":"2024-04-26T07:57:49.056129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.056026+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:29.927433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.282662+0000","last_change":"2024-04-26T07:57:47.282688+0000","last_active":"2024-04-26T07:57:47.282662+0000","last_peered":"2024-04-26T07:57:47.282662+0000","last_clean":"2024-04-26T07:57:47.282662+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:57:47.282662+0000","last_undegraded":"2024-04-26T07:57:47.282662+0000","last_fullsized":"2024-04-26T07:57:47.282662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.282574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.631333+0000","last_change":"2024-04-26T07:58:30.631360+0000","last_active":"2024-04-26T07:58:30.631333+0000","last_peered":"2024-04-26T07:58:30.631333+0000","last_clean":"2024-04-26T07:58:30.631333+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:58:30.631333+0000","last_undegraded":"2024-04-26T07:58:30.631333+0000","last_fullsized":"2024-04-26T07:58:30.631333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:30.631242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:30.631242+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.631242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:44.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:35.742540+0000","last_change":"2024-04-26T07:58:35.742570+0000","last_active":"2024-04-26T07:58:35.742540+0000","last_peered":"2024-04-26T07:58:35.742540+0000","last_clean":"2024-04-26T07:58:35.742540+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:58:35.742540+0000","last_undegraded":"2024-04-26T07:58:35.742540+0000","last_fullsized":"2024-04-26T07:58:35.742540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:35.742453+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:35.742453+0000","last_clean_scrub_stamp":"2024-04-26T07:58:35.742453+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:03.349486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.238344+0000","last_change":"2024-04-26T07:58:08.238368+0000","last_active":"2024-04-26T07:58:08.238344+0000","last_peered":"2024-04-26T07:58:08.238344+0000","last_clean":"2024-04-26T07:58:08.238344+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:58:08.238344+0000","last_undegraded":"2024-04-26T07:58:08.238344+0000","last_fullsized":"2024-04-26T07:58:08.238344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:08.238248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:08.238248+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.238248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:31.337273+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.302541+0000","last_change":"2024-04-26T07:57:50.302582+0000","last_active":"2024-04-26T07:57:50.302541+0000","last_peered":"2024-04-26T07:57:50.302541+0000","last_clean":"2024-04-26T07:57:50.302541+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:57:50.302541+0000","last_undegraded":"2024-04-26T07:57:50.302541+0000","last_fullsized":"2024-04-26T07:57:50.302541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:50.302445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:50.302445+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.302445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:36.538951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.027530+0000","last_change":"2024-04-26T07:57:48.027568+0000","last_active":"2024-04-26T07:57:48.027530+0000","last_peered":"2024-04-26T07:57:48.027530+0000","last_clean":"2024-04-26T07:57:48.027530+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:48.027530+0000","last_undegraded":"2024-04-26T07:57:48.027530+0000","last_fullsized":"2024-04-26T07:57:48.027530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.027433+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:59.750634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.116012+0000","last_change":"2024-04-26T07:57:37.116071+0000","last_active":"2024-04-26T07:57:37.116012+0000","last_peered":"2024-04-26T07:57:37.116012+0000","last_clean":"2024-04-26T07:57:37.116012+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:57:37.116012+0000","last_undegraded":"2024-04-26T07:57:37.116012+0000","last_fullsized":"2024-04-26T07:57:37.116012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.115909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:16.358436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:54.896475+0000","last_change":"2024-04-26T07:54:25.040358+0000","last_active":"2024-04-26T07:56:54.896475+0000","last_peered":"2024-04-26T07:56:54.896475+0000","last_clean":"2024-04-26T07:56:54.896475+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:56:54.896475+0000","last_undegraded":"2024-04-26T07:56:54.896475+0000","last_fullsized":"2024-04-26T07:56:54.896475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.087168+0000","last_change":"2024-04-26T07:58:09.087254+0000","last_active":"2024-04-26T07:58:09.087168+0000","last_peered":"2024-04-26T07:58:09.087168+0000","last_clean":"2024-04-26T07:58:09.087168+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:58:09.087168+0000","last_undegraded":"2024-04-26T07:58:09.087168+0000","last_fullsized":"2024-04-26T07:58:09.087168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:09.087056+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:09.087056+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.087056+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:44.220939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.182152+0000","last_change":"2024-04-26T07:58:27.182175+0000","last_active":"2024-04-26T07:58:27.182152+0000","last_peered":"2024-04-26T07:58:27.182152+0000","last_clean":"2024-04-26T07:58:27.182152+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:58:27.182152+0000","last_undegraded":"2024-04-26T07:58:27.182152+0000","last_fullsized":"2024-04-26T07:58:27.182152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:27.182060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:27.182060+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.182060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:06.537558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.947053+0000","last_change":"2024-04-26T07:57:36.947105+0000","last_active":"2024-04-26T07:57:36.947053+0000","last_peered":"2024-04-26T07:57:36.947053+0000","last_clean":"2024-04-26T07:57:36.947053+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:57:36.947053+0000","last_undegraded":"2024-04-26T07:57:36.947053+0000","last_fullsized":"2024-04-26T07:57:36.947053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.946930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.547838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.306049+0000","last_change":"2024-04-26T07:57:44.306091+0000","last_active":"2024-04-26T07:57:44.306049+0000","last_peered":"2024-04-26T07:57:44.306049+0000","last_clean":"2024-04-26T07:57:44.306049+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:57:44.306049+0000","last_undegraded":"2024-04-26T07:57:44.306049+0000","last_fullsized":"2024-04-26T07:57:44.306049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.305938+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:46.421838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.210692+0000","last_change":"2024-04-26T07:57:36.210716+0000","last_active":"2024-04-26T07:57:36.210692+0000","last_peered":"2024-04-26T07:57:36.210692+0000","last_clean":"2024-04-26T07:57:36.210692+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:57:36.210692+0000","last_undegraded":"2024-04-26T07:57:36.210692+0000","last_fullsized":"2024-04-26T07:57:36.210692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.210600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:49.401154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.081951+0000","last_change":"2024-04-26T07:58:24.081951+0000","last_active":"2024-04-26T07:58:24.081951+0000","last_peered":"2024-04-26T07:58:24.081951+0000","last_clean":"2024-04-26T07:58:24.081951+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:58:24.081951+0000","last_undegraded":"2024-04-26T07:58:24.081951+0000","last_fullsized":"2024-04-26T07:58:24.081951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:24.081820+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:24.081820+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.081820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:51.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.109899+0000","last_change":"2024-04-26T07:58:25.109930+0000","last_active":"2024-04-26T07:58:25.109899+0000","last_peered":"2024-04-26T07:58:25.109899+0000","last_clean":"2024-04-26T07:58:25.109899+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:58:25.109899+0000","last_undegraded":"2024-04-26T07:58:25.109899+0000","last_fullsized":"2024-04-26T07:58:25.109899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.109768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.109768+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.109768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:24.193718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.995801+0000","last_change":"2024-04-26T07:57:51.995801+0000","last_active":"2024-04-26T07:57:51.995801+0000","last_peered":"2024-04-26T07:57:51.995801+0000","last_clean":"2024-04-26T07:57:51.995801+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:57:51.995801+0000","last_undegraded":"2024-04-26T07:57:51.995801+0000","last_fullsized":"2024-04-26T07:57:51.995801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:51.995599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:51.995599+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.995599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:40.564480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.077254+0000","last_change":"2024-04-26T07:57:46.077293+0000","last_active":"2024-04-26T07:57:46.077254+0000","last_peered":"2024-04-26T07:57:46.077254+0000","last_clean":"2024-04-26T07:57:46.077254+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:57:46.077254+0000","last_undegraded":"2024-04-26T07:57:46.077254+0000","last_fullsized":"2024-04-26T07:57:46.077254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.077156+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:26.087961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.249784+0000","last_change":"2024-04-26T07:57:35.249823+0000","last_active":"2024-04-26T07:57:35.249784+0000","last_peered":"2024-04-26T07:57:35.249784+0000","last_clean":"2024-04-26T07:57:35.249784+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:57:35.249784+0000","last_undegraded":"2024-04-26T07:57:35.249784+0000","last_fullsized":"2024-04-26T07:57:35.249784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.249689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:56.788608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.639013+0000","last_change":"2024-04-26T07:58:31.639045+0000","last_active":"2024-04-26T07:58:31.639013+0000","last_peered":"2024-04-26T07:58:31.639013+0000","last_clean":"2024-04-26T07:58:31.639013+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:58:31.639013+0000","last_undegraded":"2024-04-26T07:58:31.639013+0000","last_fullsized":"2024-04-26T07:58:31.639013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:31.638915+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:31.638915+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.638915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:19.555087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.880431+0000","last_change":"2024-04-26T07:58:12.880431+0000","last_active":"2024-04-26T07:58:12.880431+0000","last_peered":"2024-04-26T07:58:12.880431+0000","last_clean":"2024-04-26T07:58:12.880431+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:58:12.880431+0000","last_undegraded":"2024-04-26T07:58:12.880431+0000","last_fullsized":"2024-04-26T07:58:12.880431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:12.880313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:12.880313+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.880313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:40.993660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.139452+0000","last_change":"2024-04-26T07:58:26.139498+0000","last_active":"2024-04-26T07:58:26.139452+0000","last_peered":"2024-04-26T07:58:26.139452+0000","last_clean":"2024-04-26T07:58:26.139452+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:58:26.139452+0000","last_undegraded":"2024-04-26T07:58:26.139452+0000","last_fullsized":"2024-04-26T07:58:26.139452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:26.139349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:26.139349+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.139349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:17.105942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.221980+0000","last_change":"2024-04-26T07:57:52.221980+0000","last_active":"2024-04-26T07:57:52.221980+0000","last_peered":"2024-04-26T07:57:52.221980+0000","last_clean":"2024-04-26T07:57:52.221980+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:57:52.221980+0000","last_undegraded":"2024-04-26T07:57:52.221980+0000","last_fullsized":"2024-04-26T07:57:52.221980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:52.221848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:52.221848+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.221848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.404236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.958887+0000","last_change":"2024-04-26T07:57:48.958926+0000","last_active":"2024-04-26T07:57:48.958887+0000","last_peered":"2024-04-26T07:57:48.958887+0000","last_clean":"2024-04-26T07:57:48.958887+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:57:48.958887+0000","last_undegraded":"2024-04-26T07:57:48.958887+0000","last_fullsized":"2024-04-26T07:57:48.958887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.958790+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:19.997051+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.961696+0000","last_change":"2024-04-26T07:57:43.961722+0000","last_active":"2024-04-26T07:57:43.961696+0000","last_peered":"2024-04-26T07:57:43.961696+0000","last_clean":"2024-04-26T07:57:43.961696+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:57:43.961696+0000","last_undegraded":"2024-04-26T07:57:43.961696+0000","last_fullsized":"2024-04-26T07:57:43.961696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.961597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:55.126179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894677+0000","last_change":"2024-04-26T07:54:25.040148+0000","last_active":"2024-04-26T07:56:44.894677+0000","last_peered":"2024-04-26T07:56:44.894677+0000","last_clean":"2024-04-26T07:56:44.894677+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:56:44.894677+0000","last_undegraded":"2024-04-26T07:56:44.894677+0000","last_fullsized":"2024-04-26T07:56:44.894677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.423150+0000","last_change":"2024-04-26T07:58:27.423177+0000","last_active":"2024-04-26T07:58:27.423150+0000","last_peered":"2024-04-26T07:58:27.423150+0000","last_clean":"2024-04-26T07:58:27.423150+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:58:27.423150+0000","last_undegraded":"2024-04-26T07:58:27.423150+0000","last_fullsized":"2024-04-26T07:58:27.423150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:27.423063+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:27.423063+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.423063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:20.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.180253+0000","last_change":"2024-04-26T07:58:24.180306+0000","last_active":"2024-04-26T07:58:24.180253+0000","last_peered":"2024-04-26T07:58:24.180253+0000","last_clean":"2024-04-26T07:58:24.180253+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:58:24.180253+0000","last_undegraded":"2024-04-26T07:58:24.180253+0000","last_fullsized":"2024-04-26T07:58:24.180253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:24.180151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:24.180151+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.180151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:00.943258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.182373+0000","last_change":"2024-04-26T07:57:54.182399+0000","last_active":"2024-04-26T07:57:54.182373+0000","last_peered":"2024-04-26T07:57:54.182373+0000","last_clean":"2024-04-26T07:57:54.182373+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:57:54.182373+0000","last_undegraded":"2024-04-26T07:57:54.182373+0000","last_fullsized":"2024-04-26T07:57:54.182373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.182281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.182281+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.182281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:41.982170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.036534+0000","last_change":"2024-04-26T07:57:42.036534+0000","last_active":"2024-04-26T07:57:42.036534+0000","last_peered":"2024-04-26T07:57:42.036534+0000","last_clean":"2024-04-26T07:57:42.036534+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:57:42.036534+0000","last_undegraded":"2024-04-26T07:57:42.036534+0000","last_fullsized":"2024-04-26T07:57:42.036534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.036391+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:51.097848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.970937+0000","last_change":"2024-04-26T07:57:54.970937+0000","last_active":"2024-04-26T07:57:54.970937+0000","last_peered":"2024-04-26T07:57:54.970937+0000","last_clean":"2024-04-26T07:57:54.970937+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:57:54.970937+0000","last_undegraded":"2024-04-26T07:57:54.970937+0000","last_fullsized":"2024-04-26T07:57:54.970937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.970780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.970780+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.970780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:03.765699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894650+0000","last_change":"2024-04-26T07:54:25.039740+0000","last_active":"2024-04-26T07:56:44.894650+0000","last_peered":"2024-04-26T07:56:44.894650+0000","last_clean":"2024-04-26T07:56:44.894650+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:56:44.894650+0000","last_undegraded":"2024-04-26T07:56:44.894650+0000","last_fullsized":"2024-04-26T07:56:44.894650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.689461+0000","last_change":"2024-04-26T07:58:28.689488+0000","last_active":"2024-04-26T07:58:28.689461+0000","last_peered":"2024-04-26T07:58:28.689461+0000","last_clean":"2024-04-26T07:58:28.689461+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:58:28.689461+0000","last_undegraded":"2024-04-26T07:58:28.689461+0000","last_fullsized":"2024-04-26T07:58:28.689461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:28.689372+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:28.689372+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.689372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.555413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.115433+0000","last_change":"2024-04-26T07:58:33.115459+0000","last_active":"2024-04-26T07:58:33.115433+0000","last_peered":"2024-04-26T07:58:33.115433+0000","last_clean":"2024-04-26T07:58:33.115433+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:58:33.115433+0000","last_undegraded":"2024-04-26T07:58:33.115433+0000","last_fullsized":"2024-04-26T07:58:33.115433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:33.115339+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:33.115339+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.115339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:08.868947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.053008+0000","last_change":"2024-04-26T07:57:53.053059+0000","last_active":"2024-04-26T07:57:53.053008+0000","last_peered":"2024-04-26T07:57:53.053008+0000","last_clean":"2024-04-26T07:57:53.053008+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:57:53.053008+0000","last_undegraded":"2024-04-26T07:57:53.053008+0000","last_fullsized":"2024-04-26T07:57:53.053008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:53.052892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:53.052892+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.052892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:33.924298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.067489+0000","last_change":"2024-04-26T07:58:01.067489+0000","last_active":"2024-04-26T07:58:01.067489+0000","last_peered":"2024-04-26T07:58:01.067489+0000","last_clean":"2024-04-26T07:58:01.067489+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:58:01.067489+0000","last_undegraded":"2024-04-26T07:58:01.067489+0000","last_fullsized":"2024-04-26T07:58:01.067489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-04-26T07:58:01.067368+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-04-26T07:58:01.067368+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.067368+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:37.830475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.315390+0000","last_change":"2024-04-26T07:57:43.315390+0000","last_active":"2024-04-26T07:57:43.315390+0000","last_peered":"2024-04-26T07:57:43.315390+0000","last_clean":"2024-04-26T07:57:43.315390+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:43.315390+0000","last_undegraded":"2024-04-26T07:57:43.315390+0000","last_fullsized":"2024-04-26T07:57:43.315390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.315236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:00.601284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.066525+0000","last_change":"2024-04-26T07:58:23.066548+0000","last_active":"2024-04-26T07:58:23.066525+0000","last_peered":"2024-04-26T07:58:23.066525+0000","last_clean":"2024-04-26T07:58:23.066525+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:58:23.066525+0000","last_undegraded":"2024-04-26T07:58:23.066525+0000","last_fullsized":"2024-04-26T07:58:23.066525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:23.066431+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:23.066431+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.066431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:58.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.180634+0000","last_change":"2024-04-26T07:58:01.180680+0000","last_active":"2024-04-26T07:58:01.180634+0000","last_peered":"2024-04-26T07:58:01.180634+0000","last_clean":"2024-04-26T07:58:01.180634+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:58:01.180634+0000","last_undegraded":"2024-04-26T07:58:01.180634+0000","last_fullsized":"2024-04-26T07:58:01.180634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:01.180506+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:01.180506+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.180506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:09.102162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.193351+0000","last_change":"2024-04-26T07:58:21.193377+0000","last_active":"2024-04-26T07:58:21.193351+0000","last_peered":"2024-04-26T07:58:21.193351+0000","last_clean":"2024-04-26T07:58:21.193351+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:58:21.193351+0000","last_undegraded":"2024-04-26T07:58:21.193351+0000","last_fullsized":"2024-04-26T07:58:21.193351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:21.193259+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:21.193259+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.193259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:13.857858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.947474+0000","last_change":"2024-04-26T07:57:48.947503+0000","last_active":"2024-04-26T07:57:48.947474+0000","last_peered":"2024-04-26T07:57:48.947474+0000","last_clean":"2024-04-26T07:57:48.947474+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:57:48.947474+0000","last_undegraded":"2024-04-26T07:57:48.947474+0000","last_fullsized":"2024-04-26T07:57:48.947474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.947377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:11.025758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.943225+0000","last_change":"2024-04-26T07:57:41.943262+0000","last_active":"2024-04-26T07:57:41.943225+0000","last_peered":"2024-04-26T07:57:41.943225+0000","last_clean":"2024-04-26T07:57:41.943225+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:57:41.943225+0000","last_undegraded":"2024-04-26T07:57:41.943225+0000","last_fullsized":"2024-04-26T07:57:41.943225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.943141+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:28.179647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.021097+0000","last_change":"2024-04-26T07:57:41.021136+0000","last_active":"2024-04-26T07:57:41.021097+0000","last_peered":"2024-04-26T07:57:41.021097+0000","last_clean":"2024-04-26T07:57:41.021097+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:57:41.021097+0000","last_undegraded":"2024-04-26T07:57:41.021097+0000","last_fullsized":"2024-04-26T07:57:41.021097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.021008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.165091+0000","last_change":"2024-04-26T07:58:00.165117+0000","last_active":"2024-04-26T07:58:00.165091+0000","last_peered":"2024-04-26T07:58:00.165091+0000","last_clean":"2024-04-26T07:58:00.165091+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:58:00.165091+0000","last_undegraded":"2024-04-26T07:58:00.165091+0000","last_fullsized":"2024-04-26T07:58:00.165091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:00.164987+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:00.164987+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.164987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:08.922542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'20","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.149371+0000","last_change":"2024-04-26T07:57:59.149404+0000","last_active":"2024-04-26T07:57:59.149371+0000","last_peered":"2024-04-26T07:57:59.149371+0000","last_clean":"2024-04-26T07:57:59.149371+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:59.149371+0000","last_undegraded":"2024-04-26T07:57:59.149371+0000","last_fullsized":"2024-04-26T07:57:59.149371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:57:59.149277+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:57:59.149277+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.149277+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:10.872478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.164857+0000","last_change":"2024-04-26T07:58:29.164884+0000","last_active":"2024-04-26T07:58:29.164857+0000","last_peered":"2024-04-26T07:58:29.164857+0000","last_clean":"2024-04-26T07:58:29.164857+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:58:29.164857+0000","last_undegraded":"2024-04-26T07:58:29.164857+0000","last_fullsized":"2024-04-26T07:58:29.164857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:29.164766+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:29.164766+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.164766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:45.599435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.256297+0000","last_change":"2024-04-26T07:57:49.256322+0000","last_active":"2024-04-26T07:57:49.256297+0000","last_peered":"2024-04-26T07:57:49.256297+0000","last_clean":"2024-04-26T07:57:49.256297+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:57:49.256297+0000","last_undegraded":"2024-04-26T07:57:49.256297+0000","last_fullsized":"2024-04-26T07:57:49.256297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.256204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:45.178627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.053585+0000","last_change":"2024-04-26T07:57:44.053621+0000","last_active":"2024-04-26T07:57:44.053585+0000","last_peered":"2024-04-26T07:57:44.053585+0000","last_clean":"2024-04-26T07:57:44.053585+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:57:44.053585+0000","last_undegraded":"2024-04-26T07:57:44.053585+0000","last_fullsized":"2024-04-26T07:57:44.053585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.053488+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:48.845821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.141915+0000","last_change":"2024-04-26T07:58:03.141983+0000","last_active":"2024-04-26T07:58:03.141915+0000","last_peered":"2024-04-26T07:58:03.141915+0000","last_clean":"2024-04-26T07:58:03.141915+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:58:03.141915+0000","last_undegraded":"2024-04-26T07:58:03.141915+0000","last_fullsized":"2024-04-26T07:58:03.141915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:03.141810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:03.141810+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.141810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:54.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.140872+0000","last_change":"2024-04-26T07:58:15.140931+0000","last_active":"2024-04-26T07:58:15.140872+0000","last_peered":"2024-04-26T07:58:15.140872+0000","last_clean":"2024-04-26T07:58:15.140872+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:58:15.140872+0000","last_undegraded":"2024-04-26T07:58:15.140872+0000","last_fullsized":"2024-04-26T07:58:15.140872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:15.140763+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:15.140763+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.140763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.744811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.149403+0000","last_change":"2024-04-26T07:58:18.149431+0000","last_active":"2024-04-26T07:58:18.149403+0000","last_peered":"2024-04-26T07:58:18.149403+0000","last_clean":"2024-04-26T07:58:18.149403+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:58:18.149403+0000","last_undegraded":"2024-04-26T07:58:18.149403+0000","last_fullsized":"2024-04-26T07:58:18.149403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:18.149315+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:18.149315+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.149315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:54.653554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.763673+0000","last_change":"2024-04-26T07:58:05.763673+0000","last_active":"2024-04-26T07:58:05.763673+0000","last_peered":"2024-04-26T07:58:05.763673+0000","last_clean":"2024-04-26T07:58:05.763673+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:58:05.763673+0000","last_undegraded":"2024-04-26T07:58:05.763673+0000","last_fullsized":"2024-04-26T07:58:05.763673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:05.763543+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:05.763543+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.763543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:45.093021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.087876+0000","last_change":"2024-04-26T07:57:54.087902+0000","last_active":"2024-04-26T07:57:54.087876+0000","last_peered":"2024-04-26T07:57:54.087876+0000","last_clean":"2024-04-26T07:57:54.087876+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:57:54.087876+0000","last_undegraded":"2024-04-26T07:57:54.087876+0000","last_fullsized":"2024-04-26T07:57:54.087876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.087782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.087782+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.087782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:11.296546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.976695+0000","last_change":"2024-04-26T07:57:40.976750+0000","last_active":"2024-04-26T07:57:40.976695+0000","last_peered":"2024-04-26T07:57:40.976695+0000","last_clean":"2024-04-26T07:57:40.976695+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:57:40.976695+0000","last_undegraded":"2024-04-26T07:57:40.976695+0000","last_fullsized":"2024-04-26T07:57:40.976695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.976569+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:47.248039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.081910+0000","last_change":"2024-04-26T07:58:11.081938+0000","last_active":"2024-04-26T07:58:11.081910+0000","last_peered":"2024-04-26T07:58:11.081910+0000","last_clean":"2024-04-26T07:58:11.081910+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:58:11.081910+0000","last_undegraded":"2024-04-26T07:58:11.081910+0000","last_fullsized":"2024-04-26T07:58:11.081910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.081811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.081811+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.081811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.419163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:24.213315+0000","last_change":"2024-04-26T07:54:25.039985+0000","last_active":"2024-04-26T07:57:24.213315+0000","last_peered":"2024-04-26T07:57:24.213315+0000","last_clean":"2024-04-26T07:57:24.213315+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:57:24.213315+0000","last_undegraded":"2024-04-26T07:57:24.213315+0000","last_fullsized":"2024-04-26T07:57:24.213315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.198470+0000","last_change":"2024-04-26T07:57:57.198497+0000","last_active":"2024-04-26T07:57:57.198470+0000","last_peered":"2024-04-26T07:57:57.198470+0000","last_clean":"2024-04-26T07:57:57.198470+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:57:57.198470+0000","last_undegraded":"2024-04-26T07:57:57.198470+0000","last_fullsized":"2024-04-26T07:57:57.198470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:57:57.198375+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:57:57.198375+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.198375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:37.209180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.127003+0000","last_change":"2024-04-26T07:58:15.127003+0000","last_active":"2024-04-26T07:58:15.127003+0000","last_peered":"2024-04-26T07:58:15.127003+0000","last_clean":"2024-04-26T07:58:15.127003+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:58:15.127003+0000","last_undegraded":"2024-04-26T07:58:15.127003+0000","last_fullsized":"2024-04-26T07:58:15.127003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.126867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.126867+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.126867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:18.021688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.971170+0000","last_change":"2024-04-26T07:57:45.971199+0000","last_active":"2024-04-26T07:57:45.971170+0000","last_peered":"2024-04-26T07:57:45.971170+0000","last_clean":"2024-04-26T07:57:45.971170+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:57:45.971170+0000","last_undegraded":"2024-04-26T07:57:45.971170+0000","last_fullsized":"2024-04-26T07:57:45.971170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.971081+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.019853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'42","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.079461+0000","last_change":"2024-04-26T07:58:08.079511+0000","last_active":"2024-04-26T07:58:08.079461+0000","last_peered":"2024-04-26T07:58:08.079461+0000","last_clean":"2024-04-26T07:58:08.079461+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:58:08.079461+0000","last_undegraded":"2024-04-26T07:58:08.079461+0000","last_fullsized":"2024-04-26T07:58:08.079461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-04-26T07:58:08.079369+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-04-26T07:58:08.079369+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.079369+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:26.015619+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.018075+0000","last_change":"2024-04-26T07:57:40.018100+0000","last_active":"2024-04-26T07:57:40.018075+0000","last_peered":"2024-04-26T07:57:40.018075+0000","last_clean":"2024-04-26T07:57:40.018075+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:57:40.018075+0000","last_undegraded":"2024-04-26T07:57:40.018075+0000","last_fullsized":"2024-04-26T07:57:40.018075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.017985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:33.200374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:56:44.894775+0000","last_change":"2024-04-26T07:54:25.040953+0000","last_active":"2024-04-26T07:56:44.894775+0000","last_peered":"2024-04-26T07:56:44.894775+0000","last_clean":"2024-04-26T07:56:44.894775+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:56:44.894775+0000","last_undegraded":"2024-04-26T07:56:44.894775+0000","last_fullsized":"2024-04-26T07:56:44.894775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:54:24.010334+0000","last_clean_scrub_stamp":"2024-04-26T07:54:24.010334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.168674+0000","last_change":"2024-04-26T07:58:20.168674+0000","last_active":"2024-04-26T07:58:20.168674+0000","last_peered":"2024-04-26T07:58:20.168674+0000","last_clean":"2024-04-26T07:58:20.168674+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:58:20.168674+0000","last_undegraded":"2024-04-26T07:58:20.168674+0000","last_fullsized":"2024-04-26T07:58:20.168674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:20.168478+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:20.168478+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.168478+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:37.021499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.175200+0000","last_change":"2024-04-26T07:58:02.175200+0000","last_active":"2024-04-26T07:58:02.175200+0000","last_peered":"2024-04-26T07:58:02.175200+0000","last_clean":"2024-04-26T07:58:02.175200+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:58:02.175200+0000","last_undegraded":"2024-04-26T07:58:02.175200+0000","last_fullsized":"2024-04-26T07:58:02.175200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:02.175070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:02.175070+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.175070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:01:08.295392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.910862+0000","last_change":"2024-04-26T07:58:00.910862+0000","last_active":"2024-04-26T07:58:00.910862+0000","last_peered":"2024-04-26T07:58:00.910862+0000","last_clean":"2024-04-26T07:58:00.910862+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:58:00.910862+0000","last_undegraded":"2024-04-26T07:58:00.910862+0000","last_fullsized":"2024-04-26T07:58:00.910862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:00.910724+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:00.910724+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.910724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:49.811262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.749080+0000","last_change":"2024-04-26T07:58:22.749080+0000","last_active":"2024-04-26T07:58:22.749080+0000","last_peered":"2024-04-26T07:58:22.749080+0000","last_clean":"2024-04-26T07:58:22.749080+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:58:22.749080+0000","last_undegraded":"2024-04-26T07:58:22.749080+0000","last_fullsized":"2024-04-26T07:58:22.749080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:22.748961+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:22.748961+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.748961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:34.686493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.093555+0000","last_change":"2024-04-26T07:58:22.093555+0000","last_active":"2024-04-26T07:58:22.093555+0000","last_peered":"2024-04-26T07:58:22.093555+0000","last_clean":"2024-04-26T07:58:22.093555+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:58:22.093555+0000","last_undegraded":"2024-04-26T07:58:22.093555+0000","last_fullsized":"2024-04-26T07:58:22.093555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:22.093436+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:22.093436+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.093436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:40.796077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:38.188696+0000","last_change":"2024-04-26T07:58:38.188723+0000","last_active":"2024-04-26T07:58:38.188696+0000","last_peered":"2024-04-26T07:58:38.188696+0000","last_clean":"2024-04-26T07:58:38.188696+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:58:38.188696+0000","last_undegraded":"2024-04-26T07:58:38.188696+0000","last_fullsized":"2024-04-26T07:58:38.188696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:38.188591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:38.188591+0000","last_clean_scrub_stamp":"2024-04-26T07:58:38.188591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:26.600526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.759392+0000","last_change":"2024-04-26T07:58:18.759392+0000","last_active":"2024-04-26T07:58:18.759392+0000","last_peered":"2024-04-26T07:58:18.759392+0000","last_clean":"2024-04-26T07:58:18.759392+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:58:18.759392+0000","last_undegraded":"2024-04-26T07:58:18.759392+0000","last_fullsized":"2024-04-26T07:58:18.759392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:18.759273+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:18.759273+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.759273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:55.522380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.713666+0000","last_change":"2024-04-26T07:58:27.713720+0000","last_active":"2024-04-26T07:58:27.713666+0000","last_peered":"2024-04-26T07:58:27.713666+0000","last_clean":"2024-04-26T07:58:27.713666+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:58:27.713666+0000","last_undegraded":"2024-04-26T07:58:27.713666+0000","last_fullsized":"2024-04-26T07:58:27.713666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:27.713552+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:27.713552+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.713552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:07.914993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.793079+0000","last_change":"2024-04-26T07:58:04.793079+0000","last_active":"2024-04-26T07:58:04.793079+0000","last_peered":"2024-04-26T07:58:04.793079+0000","last_clean":"2024-04-26T07:58:04.793079+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:58:04.793079+0000","last_undegraded":"2024-04-26T07:58:04.793079+0000","last_fullsized":"2024-04-26T07:58:04.793079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:04.792960+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:04.792960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.792960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:52.162345+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.790981+0000","last_change":"2024-04-26T07:58:24.790981+0000","last_active":"2024-04-26T07:58:24.790981+0000","last_peered":"2024-04-26T07:58:24.790981+0000","last_clean":"2024-04-26T07:58:24.790981+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:58:24.790981+0000","last_undegraded":"2024-04-26T07:58:24.790981+0000","last_fullsized":"2024-04-26T07:58:24.790981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:24.790843+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:24.790843+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.790843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:25.245426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.134728+0000","last_change":"2024-04-26T07:58:16.134728+0000","last_active":"2024-04-26T07:58:16.134728+0000","last_peered":"2024-04-26T07:58:16.134728+0000","last_clean":"2024-04-26T07:58:16.134728+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:58:16.134728+0000","last_undegraded":"2024-04-26T07:58:16.134728+0000","last_fullsized":"2024-04-26T07:58:16.134728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:16.134605+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:16.134605+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.134605+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:40.318441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.133764+0000","last_change":"2024-04-26T07:58:29.133764+0000","last_active":"2024-04-26T07:58:29.133764+0000","last_peered":"2024-04-26T07:58:29.133764+0000","last_clean":"2024-04-26T07:58:29.133764+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:58:29.133764+0000","last_undegraded":"2024-04-26T07:58:29.133764+0000","last_fullsized":"2024-04-26T07:58:29.133764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:29.133607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:29.133607+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.133607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:43.809427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.829934+0000","last_change":"2024-04-26T07:58:08.829934+0000","last_active":"2024-04-26T07:58:08.829934+0000","last_peered":"2024-04-26T07:58:08.829934+0000","last_clean":"2024-04-26T07:58:08.829934+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:58:08.829934+0000","last_undegraded":"2024-04-26T07:58:08.829934+0000","last_fullsized":"2024-04-26T07:58:08.829934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:08.829797+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:08.829797+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.829797+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:57.218721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.246522+0000","last_change":"2024-04-26T07:58:06.246522+0000","last_active":"2024-04-26T07:58:06.246522+0000","last_peered":"2024-04-26T07:58:06.246522+0000","last_clean":"2024-04-26T07:58:06.246522+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:58:06.246522+0000","last_undegraded":"2024-04-26T07:58:06.246522+0000","last_fullsized":"2024-04-26T07:58:06.246522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:06.246402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:06.246402+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.246402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:15.041321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.144982+0000","last_change":"2024-04-26T07:58:06.144982+0000","last_active":"2024-04-26T07:58:06.144982+0000","last_peered":"2024-04-26T07:58:06.144982+0000","last_clean":"2024-04-26T07:58:06.144982+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:58:06.144982+0000","last_undegraded":"2024-04-26T07:58:06.144982+0000","last_fullsized":"2024-04-26T07:58:06.144982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:06.144859+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:06.144859+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.144859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:24.745706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.759373+0000","last_change":"2024-04-26T07:58:25.759373+0000","last_active":"2024-04-26T07:58:25.759373+0000","last_peered":"2024-04-26T07:58:25.759373+0000","last_clean":"2024-04-26T07:58:25.759373+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:58:25.759373+0000","last_undegraded":"2024-04-26T07:58:25.759373+0000","last_fullsized":"2024-04-26T07:58:25.759373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.759257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.759257+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.759257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:16.220235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.113406+0000","last_change":"2024-04-26T07:58:30.113446+0000","last_active":"2024-04-26T07:58:30.113406+0000","last_peered":"2024-04-26T07:58:30.113406+0000","last_clean":"2024-04-26T07:58:30.113406+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:58:30.113406+0000","last_undegraded":"2024-04-26T07:58:30.113406+0000","last_fullsized":"2024-04-26T07:58:30.113406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:30.113312+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:30.113312+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.113312+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:52.460942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:53.152461+0000","last_change":"2024-04-26T07:58:53.152489+0000","last_active":"2024-04-26T07:58:53.152461+0000","last_peered":"2024-04-26T07:58:53.152461+0000","last_clean":"2024-04-26T07:58:53.152461+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:58:53.152461+0000","last_undegraded":"2024-04-26T07:58:53.152461+0000","last_fullsized":"2024-04-26T07:58:53.152461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:53.152359+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:53.152359+0000","last_clean_scrub_stamp":"2024-04-26T07:58:53.152359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:43.203261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.034297+0000","last_change":"2024-04-26T07:57:53.034344+0000","last_active":"2024-04-26T07:57:53.034297+0000","last_peered":"2024-04-26T07:57:53.034297+0000","last_clean":"2024-04-26T07:57:53.034297+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:57:53.034297+0000","last_undegraded":"2024-04-26T07:57:53.034297+0000","last_fullsized":"2024-04-26T07:57:53.034297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:57:53.034175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:57:53.034175+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.034175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:17.218011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.822410+0000","last_change":"2024-04-26T07:58:15.822410+0000","last_active":"2024-04-26T07:58:15.822410+0000","last_peered":"2024-04-26T07:58:15.822410+0000","last_clean":"2024-04-26T07:58:15.822410+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:58:15.822410+0000","last_undegraded":"2024-04-26T07:58:15.822410+0000","last_fullsized":"2024-04-26T07:58:15.822410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.822233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.822233+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.822233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:08.486833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.832314+0000","last_change":"2024-04-26T07:58:03.832314+0000","last_active":"2024-04-26T07:58:03.832314+0000","last_peered":"2024-04-26T07:58:03.832314+0000","last_clean":"2024-04-26T07:58:03.832314+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:58:03.832314+0000","last_undegraded":"2024-04-26T07:58:03.832314+0000","last_fullsized":"2024-04-26T07:58:03.832314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:03.832203+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:03.832203+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.832203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:26.049891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.138745+0000","last_change":"2024-04-26T07:58:28.138745+0000","last_active":"2024-04-26T07:58:28.138745+0000","last_peered":"2024-04-26T07:58:28.138745+0000","last_clean":"2024-04-26T07:58:28.138745+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:58:28.138745+0000","last_undegraded":"2024-04-26T07:58:28.138745+0000","last_fullsized":"2024-04-26T07:58:28.138745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:28.138628+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:28.138628+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.138628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:40.076160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.174553+0000","last_change":"2024-04-26T07:58:14.174553+0000","last_active":"2024-04-26T07:58:14.174553+0000","last_peered":"2024-04-26T07:58:14.174553+0000","last_clean":"2024-04-26T07:58:14.174553+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:58:14.174553+0000","last_undegraded":"2024-04-26T07:58:14.174553+0000","last_fullsized":"2024-04-26T07:58:14.174553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:14.174439+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:14.174439+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.174439+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:02.563364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.195915+0000","last_change":"2024-04-26T07:58:23.195915+0000","last_active":"2024-04-26T07:58:23.195915+0000","last_peered":"2024-04-26T07:58:23.195915+0000","last_clean":"2024-04-26T07:58:23.195915+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:58:23.195915+0000","last_undegraded":"2024-04-26T07:58:23.195915+0000","last_fullsized":"2024-04-26T07:58:23.195915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:23.195793+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:23.195793+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.195793+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:47.786960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.177126+0000","last_change":"2024-04-26T07:58:01.177126+0000","last_active":"2024-04-26T07:58:01.177126+0000","last_peered":"2024-04-26T07:58:01.177126+0000","last_clean":"2024-04-26T07:58:01.177126+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:58:01.177126+0000","last_undegraded":"2024-04-26T07:58:01.177126+0000","last_fullsized":"2024-04-26T07:58:01.177126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:01.176988+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:01.176988+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.176988+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:36.360339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:52.182275+0000","last_change":"2024-04-26T07:58:52.182314+0000","last_active":"2024-04-26T07:58:52.182275+0000","last_peered":"2024-04-26T07:58:52.182275+0000","last_clean":"2024-04-26T07:58:52.182275+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:58:52.182275+0000","last_undegraded":"2024-04-26T07:58:52.182275+0000","last_fullsized":"2024-04-26T07:58:52.182275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:52.182177+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:52.182177+0000","last_clean_scrub_stamp":"2024-04-26T07:58:52.182177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:06.821044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.216774+0000","last_change":"2024-04-26T07:58:02.216774+0000","last_active":"2024-04-26T07:58:02.216774+0000","last_peered":"2024-04-26T07:58:02.216774+0000","last_clean":"2024-04-26T07:58:02.216774+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:58:02.216774+0000","last_undegraded":"2024-04-26T07:58:02.216774+0000","last_fullsized":"2024-04-26T07:58:02.216774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:02.216654+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:02.216654+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.216654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.409764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.147970+0000","last_change":"2024-04-26T07:58:30.147970+0000","last_active":"2024-04-26T07:58:30.147970+0000","last_peered":"2024-04-26T07:58:30.147970+0000","last_clean":"2024-04-26T07:58:30.147970+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:58:30.147970+0000","last_undegraded":"2024-04-26T07:58:30.147970+0000","last_fullsized":"2024-04-26T07:58:30.147970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:30.147857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:30.147857+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.147857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:43.465610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.104189+0000","last_change":"2024-04-26T07:58:13.104189+0000","last_active":"2024-04-26T07:58:13.104189+0000","last_peered":"2024-04-26T07:58:13.104189+0000","last_clean":"2024-04-26T07:58:13.104189+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:58:13.104189+0000","last_undegraded":"2024-04-26T07:58:13.104189+0000","last_fullsized":"2024-04-26T07:58:13.104189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:13.104056+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:13.104056+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.104056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:55.412463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.250596+0000","last_change":"2024-04-26T07:58:04.250596+0000","last_active":"2024-04-26T07:58:04.250596+0000","last_peered":"2024-04-26T07:58:04.250596+0000","last_clean":"2024-04-26T07:58:04.250596+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:58:04.250596+0000","last_undegraded":"2024-04-26T07:58:04.250596+0000","last_fullsized":"2024-04-26T07:58:04.250596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:04.250456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:04.250456+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.250456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:58.426456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.175308+0000","last_change":"2024-04-26T07:58:08.175308+0000","last_active":"2024-04-26T07:58:08.175308+0000","last_peered":"2024-04-26T07:58:08.175308+0000","last_clean":"2024-04-26T07:58:08.175308+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:58:08.175308+0000","last_undegraded":"2024-04-26T07:58:08.175308+0000","last_fullsized":"2024-04-26T07:58:08.175308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:08.175191+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:08.175191+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.175191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:55.772232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:36.205744+0000","last_change":"2024-04-26T07:58:36.205744+0000","last_active":"2024-04-26T07:58:36.205744+0000","last_peered":"2024-04-26T07:58:36.205744+0000","last_clean":"2024-04-26T07:58:36.205744+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:58:36.205744+0000","last_undegraded":"2024-04-26T07:58:36.205744+0000","last_fullsized":"2024-04-26T07:58:36.205744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:36.205563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:36.205563+0000","last_clean_scrub_stamp":"2024-04-26T07:58:36.205563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:20.477717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:43.086837+0000","last_change":"2024-04-26T07:58:43.086837+0000","last_active":"2024-04-26T07:58:43.086837+0000","last_peered":"2024-04-26T07:58:43.086837+0000","last_clean":"2024-04-26T07:58:43.086837+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:58:43.086837+0000","last_undegraded":"2024-04-26T07:58:43.086837+0000","last_fullsized":"2024-04-26T07:58:43.086837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:43.086717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:43.086717+0000","last_clean_scrub_stamp":"2024-04-26T07:58:43.086717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:03.131377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.778125+0000","last_change":"2024-04-26T07:58:06.778152+0000","last_active":"2024-04-26T07:58:06.778125+0000","last_peered":"2024-04-26T07:58:06.778125+0000","last_clean":"2024-04-26T07:58:06.778125+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:58:06.778125+0000","last_undegraded":"2024-04-26T07:58:06.778125+0000","last_fullsized":"2024-04-26T07:58:06.778125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:06.778032+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:06.778032+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.778032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:37.816293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.768230+0000","last_change":"2024-04-26T07:58:17.768230+0000","last_active":"2024-04-26T07:58:17.768230+0000","last_peered":"2024-04-26T07:58:17.768230+0000","last_clean":"2024-04-26T07:58:17.768230+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:58:17.768230+0000","last_undegraded":"2024-04-26T07:58:17.768230+0000","last_fullsized":"2024-04-26T07:58:17.768230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.768099+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.768099+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.768099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:42.359267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.179722+0000","last_change":"2024-04-26T07:58:12.179748+0000","last_active":"2024-04-26T07:58:12.179722+0000","last_peered":"2024-04-26T07:58:12.179722+0000","last_clean":"2024-04-26T07:58:12.179722+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:58:12.179722+0000","last_undegraded":"2024-04-26T07:58:12.179722+0000","last_fullsized":"2024-04-26T07:58:12.179722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:12.179635+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:12.179635+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.179635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:43.217896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705725,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705724,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":974848,"data_stored":723975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705726,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":999424,"data_stored":725076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":134133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:58:57.337 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T07:54:17.989962+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:57.339 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:57.339 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:57.339 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:57.340 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:57.340 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T07:54:24.010334+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=54, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=57, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:58:57.340 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:59:17.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:59:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.459+0000 7f4953c79640 1 Processor -- start 2024-04-26T07:59:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.459+0000 7f4953c79640 1 -- start start 2024-04-26T07:59:17.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.459+0000 7f4953c79640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f494c12e3c0 0x7f494c1307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:59:17.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.459+0000 7f4953c79640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494c096760 con 0x7f494c094ed0 2024-04-26T07:59:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.459+0000 7f4953c79640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f494c06d310 con 0x7f494c12e3c0 2024-04-26T07:59:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.459+0000 7f4951a15640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f494c094ed0 0x7f494c0952b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59360/0 (socket says 172.21.15.1:59360) 2024-04-26T07:59:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.459+0000 7f4951a15640 1 -- 172.21.15.1:0/2145820396 learned_addr learned my addr 172.21.15.1:0/2145820396 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:59:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.460+0000 7f4951214640 1 --2- 172.21.15.1:0/2145820396 >> v2:172.21.15.1:3300/0 conn(0x7f494c12e3c0 0x7f494c1307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:59:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.460+0000 7f4950a13640 1 -- 172.21.15.1:0/2145820396 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532144449 0 0) 0x7f494c096760 con 0x7f494c094ed0 2024-04-26T07:59:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.460+0000 7f4950a13640 1 -- 172.21.15.1:0/2145820396 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4938005730 con 0x7f494c094ed0 2024-04-26T07:59:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.460+0000 7f4951214640 1 -- 172.21.15.1:0/2145820396 >> v1:172.21.15.1:6789/0 conn(0x7f494c094ed0 legacy=0x7f494c0952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:59:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.460+0000 7f4951214640 1 -- 172.21.15.1:0/2145820396 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c0959c0 con 0x7f494c12e3c0 2024-04-26T07:59:17.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4951214640 1 --2- 172.21.15.1:0/2145820396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c12e3c0 0x7f494c1307b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f493c009720 tx=0x7f493c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7329b3d2a11470b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4950a13640 1 -- 172.21.15.1:0/2145820396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f493c0316d0 con 0x7f494c12e3c0 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4950a13640 1 -- 172.21.15.1:0/2145820396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493c037070 con 0x7f494c12e3c0 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4950a13640 1 -- 172.21.15.1:0/2145820396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f493c0319c0 con 0x7f494c12e3c0 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4953c79640 1 -- 172.21.15.1:0/2145820396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c12e3c0 msgr2=0x7f494c1307b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4953c79640 1 --2- 172.21.15.1:0/2145820396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c12e3c0 0x7f494c1307b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f493c009720 tx=0x7f493c02b840 comp rx=0 tx=0).stop 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4953c79640 1 -- 172.21.15.1:0/2145820396 shutdown_connections 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4953c79640 1 --2- 172.21.15.1:0/2145820396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c12e3c0 0x7f494c1307b0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4953c79640 1 -- 172.21.15.1:0/2145820396 >> 172.21.15.1:0/2145820396 conn(0x7f494c09add0 msgr2=0x7f494c09b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.461+0000 7f4953c79640 1 -- 172.21.15.1:0/2145820396 shutdown_connections 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.462+0000 7f4953c79640 1 -- 172.21.15.1:0/2145820396 wait complete. 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.462+0000 7f4953c79640 1 Processor -- start 2024-04-26T07:59:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.462+0000 7f4953c79640 1 -- start start 2024-04-26T07:59:17.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f4953c79640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c094ed0 0x7f494c121f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f4953c79640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f494c06ce10 con 0x7f494c094ed0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f4951a15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c094ed0 0x7f494c121f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f4951a15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c094ed0 0x7f494c121f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38418/0 (socket says 172.21.15.1:38418) 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f4951a15640 1 -- 172.21.15.1:0/4082077898 learned_addr learned my addr 172.21.15.1:0/4082077898 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f4951a15640 1 -- 172.21.15.1:0/4082077898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c127e10 con 0x7f494c094ed0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f4951a15640 1 --2- 172.21.15.1:0/4082077898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c094ed0 0x7f494c121f90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f494800c480 tx=0x7f494800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f49427fc640 1 -- 172.21.15.1:0/4082077898 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4948017070 con 0x7f494c094ed0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f49427fc640 1 -- 172.21.15.1:0/4082077898 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4948005c10 con 0x7f494c094ed0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.463+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494c1233f0 con 0x7f494c094ed0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.464+0000 7f49427fc640 1 -- 172.21.15.1:0/4082077898 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4948007070 con 0x7f494c094ed0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.464+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494c123c70 con 0x7f494c094ed0 2024-04-26T07:59:17.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.464+0000 7f49427fc640 1 -- 172.21.15.1:0/4082077898 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f494801a070 con 0x7f494c094ed0 2024-04-26T07:59:17.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.465+0000 7f49427fc640 1 --2- 172.21.15.1:0/4082077898 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49300385c0 0x7f493003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:59:17.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.465+0000 7f49427fc640 1 -- 172.21.15.1:0/4082077898 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7f494804b430 con 0x7f494c094ed0 2024-04-26T07:59:17.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.465+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494c0636f0 con 0x7f494c094ed0 2024-04-26T07:59:17.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.465+0000 7f4951214640 1 --2- 172.21.15.1:0/4082077898 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49300385c0 0x7f493003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:59:17.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.466+0000 7f4951214640 1 --2- 172.21.15.1:0/4082077898 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49300385c0 0x7f493003aa80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f493c036000 tx=0x7f493c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:59:17.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.470+0000 7f49427fc640 1 -- 172.21.15.1:0/4082077898 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f494801a790 con 0x7f494c094ed0 2024-04-26T07:59:17.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.652+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 --> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f494c12d890 con 0x7f49300385c0 2024-04-26T07:59:17.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.668+0000 7f49427fc640 1 -- 172.21.15.1:0/4082077898 <== mgr.4098 v2:172.21.15.62:6824/3728486338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666061 (secure 0 0 0) 0x7f493c037040 con 0x7f49300385c0 2024-04-26T07:59:17.672 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-04-26T07:59:17.678 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49300385c0 msgr2=0x7f493003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 --2- 172.21.15.1:0/4082077898 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49300385c0 0x7f493003aa80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f493c036000 tx=0x7f493c008030 comp rx=0 tx=0).stop 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c094ed0 msgr2=0x7f494c121f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 --2- 172.21.15.1:0/4082077898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c094ed0 0x7f494c121f90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f494800c480 tx=0x7f494800c940 comp rx=0 tx=0).stop 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 shutdown_connections 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 --2- 172.21.15.1:0/4082077898 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7f49300385c0 0x7f493003aa80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 --2- 172.21.15.1:0/4082077898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f494c094ed0 0x7f494c121f90 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 >> 172.21.15.1:0/4082077898 conn(0x7f494c09add0 msgr2=0x7f494c12b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 shutdown_connections 2024-04-26T07:59:17.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.673+0000 7f4953c79640 1 -- 172.21.15.1:0/4082077898 wait complete. 2024-04-26T07:59:17.682 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-04-26T07:59:16.902139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5103,"num_read_kb":4684,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152408,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334952,"statfs":{"total":386547056640,"available":386390990848,"internally_reserved":0,"allocated":2809856,"data_stored":1718390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003522"},"pg_stats":[{"pgid":"3.3f","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.302775+0000","last_change":"2024-04-26T07:58:10.302775+0000","last_active":"2024-04-26T07:58:10.302775+0000","last_peered":"2024-04-26T07:58:10.302775+0000","last_clean":"2024-04-26T07:58:10.302775+0000","last_became_active":"2024-04-26T07:54:15.021350+0000","last_became_peered":"2024-04-26T07:54:15.021350+0000","last_unstale":"2024-04-26T07:58:10.302775+0000","last_undegraded":"2024-04-26T07:58:10.302775+0000","last_fullsized":"2024-04-26T07:58:10.302775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:10.302661+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:10.302661+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.302661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:57.926956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.247641+0000","last_change":"2024-04-26T07:58:03.247677+0000","last_active":"2024-04-26T07:58:03.247641+0000","last_peered":"2024-04-26T07:58:03.247641+0000","last_clean":"2024-04-26T07:58:03.247641+0000","last_became_active":"2024-04-26T07:54:17.007304+0000","last_became_peered":"2024-04-26T07:54:17.007304+0000","last_unstale":"2024-04-26T07:58:03.247641+0000","last_undegraded":"2024-04-26T07:58:03.247641+0000","last_fullsized":"2024-04-26T07:58:03.247641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:03.247552+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:03.247552+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.247552+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:09.519023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.812158+0000","last_change":"2024-04-26T07:58:09.812158+0000","last_active":"2024-04-26T07:58:09.812158+0000","last_peered":"2024-04-26T07:58:09.812158+0000","last_clean":"2024-04-26T07:58:09.812158+0000","last_became_active":"2024-04-26T07:54:15.008580+0000","last_became_peered":"2024-04-26T07:54:15.008580+0000","last_unstale":"2024-04-26T07:58:09.812158+0000","last_undegraded":"2024-04-26T07:58:09.812158+0000","last_fullsized":"2024-04-26T07:58:09.812158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:09.812040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:09.812040+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.812040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:12.706861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.118276+0000","last_change":"2024-04-26T07:58:14.118305+0000","last_active":"2024-04-26T07:58:14.118276+0000","last_peered":"2024-04-26T07:58:14.118276+0000","last_clean":"2024-04-26T07:58:14.118276+0000","last_became_active":"2024-04-26T07:54:17.015192+0000","last_became_peered":"2024-04-26T07:54:17.015192+0000","last_unstale":"2024-04-26T07:58:14.118276+0000","last_undegraded":"2024-04-26T07:58:14.118276+0000","last_fullsized":"2024-04-26T07:58:14.118276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:14.118188+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:14.118188+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.118188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:04.731893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.074869+0000","last_change":"2024-04-26T07:58:32.074896+0000","last_active":"2024-04-26T07:58:32.074869+0000","last_peered":"2024-04-26T07:58:32.074869+0000","last_clean":"2024-04-26T07:58:32.074869+0000","last_became_active":"2024-04-26T07:54:15.025452+0000","last_became_peered":"2024-04-26T07:54:15.025452+0000","last_unstale":"2024-04-26T07:58:32.074869+0000","last_undegraded":"2024-04-26T07:58:32.074869+0000","last_fullsized":"2024-04-26T07:58:32.074869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:32.074774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:32.074774+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.074774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:45.173628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.977839+0000","last_change":"2024-04-26T07:57:49.977898+0000","last_active":"2024-04-26T07:57:49.977839+0000","last_peered":"2024-04-26T07:57:49.977839+0000","last_clean":"2024-04-26T07:57:49.977839+0000","last_became_active":"2024-04-26T07:54:17.018344+0000","last_became_peered":"2024-04-26T07:54:17.018344+0000","last_unstale":"2024-04-26T07:57:49.977839+0000","last_undegraded":"2024-04-26T07:57:49.977839+0000","last_fullsized":"2024-04-26T07:57:49.977839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:57:49.977738+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:57:49.977738+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.977738+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:40.792346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.351059+0000","last_change":"2024-04-26T07:58:19.351088+0000","last_active":"2024-04-26T07:58:19.351059+0000","last_peered":"2024-04-26T07:58:19.351059+0000","last_clean":"2024-04-26T07:58:19.351059+0000","last_became_active":"2024-04-26T07:54:15.020451+0000","last_became_peered":"2024-04-26T07:54:15.020451+0000","last_unstale":"2024-04-26T07:58:19.351059+0000","last_undegraded":"2024-04-26T07:58:19.351059+0000","last_fullsized":"2024-04-26T07:58:19.351059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:19.350931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:19.350931+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.350931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:10.165539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'8","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.189672+0000","last_change":"2024-04-26T07:58:17.189714+0000","last_active":"2024-04-26T07:58:17.189672+0000","last_peered":"2024-04-26T07:58:17.189672+0000","last_clean":"2024-04-26T07:58:17.189672+0000","last_became_active":"2024-04-26T07:54:17.010893+0000","last_became_peered":"2024-04-26T07:54:17.010893+0000","last_unstale":"2024-04-26T07:58:17.189672+0000","last_undegraded":"2024-04-26T07:58:17.189672+0000","last_fullsized":"2024-04-26T07:58:17.189672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-26T07:58:17.189575+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-26T07:58:17.189575+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.189575+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:11.798519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:40.131883+0000","last_change":"2024-04-26T07:58:40.131883+0000","last_active":"2024-04-26T07:58:40.131883+0000","last_peered":"2024-04-26T07:58:40.131883+0000","last_clean":"2024-04-26T07:58:40.131883+0000","last_became_active":"2024-04-26T07:54:15.024955+0000","last_became_peered":"2024-04-26T07:54:15.024955+0000","last_unstale":"2024-04-26T07:58:40.131883+0000","last_undegraded":"2024-04-26T07:58:40.131883+0000","last_fullsized":"2024-04-26T07:58:40.131883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:40.131748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:40.131748+0000","last_clean_scrub_stamp":"2024-04-26T07:58:40.131748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:05.347998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.204031+0000","last_change":"2024-04-26T07:58:10.204031+0000","last_active":"2024-04-26T07:58:10.204031+0000","last_peered":"2024-04-26T07:58:10.204031+0000","last_clean":"2024-04-26T07:58:10.204031+0000","last_became_active":"2024-04-26T07:54:17.001229+0000","last_became_peered":"2024-04-26T07:54:17.001229+0000","last_unstale":"2024-04-26T07:58:10.204031+0000","last_undegraded":"2024-04-26T07:58:10.204031+0000","last_fullsized":"2024-04-26T07:58:10.204031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:10.203885+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:10.203885+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.203885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:57.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.336069+0000","last_change":"2024-04-26T07:58:18.336069+0000","last_active":"2024-04-26T07:58:18.336069+0000","last_peered":"2024-04-26T07:58:18.336069+0000","last_clean":"2024-04-26T07:58:18.336069+0000","last_became_active":"2024-04-26T07:54:15.019534+0000","last_became_peered":"2024-04-26T07:54:15.019534+0000","last_unstale":"2024-04-26T07:58:18.336069+0000","last_undegraded":"2024-04-26T07:58:18.336069+0000","last_fullsized":"2024-04-26T07:58:18.336069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:18.335918+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:18.335918+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.335918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:49.374179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.029718+0000","last_change":"2024-04-26T07:57:56.029718+0000","last_active":"2024-04-26T07:57:56.029718+0000","last_peered":"2024-04-26T07:57:56.029718+0000","last_clean":"2024-04-26T07:57:56.029718+0000","last_became_active":"2024-04-26T07:54:17.016899+0000","last_became_peered":"2024-04-26T07:54:17.016899+0000","last_unstale":"2024-04-26T07:57:56.029718+0000","last_undegraded":"2024-04-26T07:57:56.029718+0000","last_fullsized":"2024-04-26T07:57:56.029718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:56.029549+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:56.029549+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.029549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:42.743723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:51.191807+0000","last_change":"2024-04-26T07:58:51.191807+0000","last_active":"2024-04-26T07:58:51.191807+0000","last_peered":"2024-04-26T07:58:51.191807+0000","last_clean":"2024-04-26T07:58:51.191807+0000","last_became_active":"2024-04-26T07:54:15.021607+0000","last_became_peered":"2024-04-26T07:54:15.021607+0000","last_unstale":"2024-04-26T07:58:51.191807+0000","last_undegraded":"2024-04-26T07:58:51.191807+0000","last_fullsized":"2024-04-26T07:58:51.191807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:51.191678+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:51.191678+0000","last_clean_scrub_stamp":"2024-04-26T07:58:51.191678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.027409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.157085+0000","last_change":"2024-04-26T07:57:56.157085+0000","last_active":"2024-04-26T07:57:56.157085+0000","last_peered":"2024-04-26T07:57:56.157085+0000","last_clean":"2024-04-26T07:57:56.157085+0000","last_became_active":"2024-04-26T07:54:17.016107+0000","last_became_peered":"2024-04-26T07:54:17.016107+0000","last_unstale":"2024-04-26T07:57:56.157085+0000","last_undegraded":"2024-04-26T07:57:56.157085+0000","last_fullsized":"2024-04-26T07:57:56.157085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:56.156947+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:56.156947+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.156947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:28.587105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.849900+0000","last_change":"2024-04-26T07:58:11.849900+0000","last_active":"2024-04-26T07:58:11.849900+0000","last_peered":"2024-04-26T07:58:11.849900+0000","last_clean":"2024-04-26T07:58:11.849900+0000","last_became_active":"2024-04-26T07:54:15.008450+0000","last_became_peered":"2024-04-26T07:54:15.008450+0000","last_unstale":"2024-04-26T07:58:11.849900+0000","last_undegraded":"2024-04-26T07:58:11.849900+0000","last_fullsized":"2024-04-26T07:58:11.849900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.849756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.849756+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.849756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:57.628518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'10","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.268091+0000","last_change":"2024-04-26T07:58:05.268091+0000","last_active":"2024-04-26T07:58:05.268091+0000","last_peered":"2024-04-26T07:58:05.268091+0000","last_clean":"2024-04-26T07:58:05.268091+0000","last_became_active":"2024-04-26T07:54:17.011272+0000","last_became_peered":"2024-04-26T07:54:17.011272+0000","last_unstale":"2024-04-26T07:58:05.268091+0000","last_undegraded":"2024-04-26T07:58:05.268091+0000","last_fullsized":"2024-04-26T07:58:05.268091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:05.267964+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:05.267964+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.267964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:56.976727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.952694+0000","last_change":"2024-04-26T07:57:47.952694+0000","last_active":"2024-04-26T07:57:47.952694+0000","last_peered":"2024-04-26T07:57:47.952694+0000","last_clean":"2024-04-26T07:57:47.952694+0000","last_became_active":"2024-04-26T07:54:17.017963+0000","last_became_peered":"2024-04-26T07:54:17.017963+0000","last_unstale":"2024-04-26T07:57:47.952694+0000","last_undegraded":"2024-04-26T07:57:47.952694+0000","last_fullsized":"2024-04-26T07:57:47.952694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:47.952578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.952578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:27.282056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.214074+0000","last_change":"2024-04-26T07:58:13.214074+0000","last_active":"2024-04-26T07:58:13.214074+0000","last_peered":"2024-04-26T07:58:13.214074+0000","last_clean":"2024-04-26T07:58:13.214074+0000","last_became_active":"2024-04-26T07:54:15.017004+0000","last_became_peered":"2024-04-26T07:54:15.017004+0000","last_unstale":"2024-04-26T07:58:13.214074+0000","last_undegraded":"2024-04-26T07:58:13.214074+0000","last_fullsized":"2024-04-26T07:58:13.214074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:13.213935+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:13.213935+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.213935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:04.028543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.172540+0000","last_change":"2024-04-26T07:58:05.172540+0000","last_active":"2024-04-26T07:58:05.172540+0000","last_peered":"2024-04-26T07:58:05.172540+0000","last_clean":"2024-04-26T07:58:05.172540+0000","last_became_active":"2024-04-26T07:54:17.006842+0000","last_became_peered":"2024-04-26T07:54:17.006842+0000","last_unstale":"2024-04-26T07:58:05.172540+0000","last_undegraded":"2024-04-26T07:58:05.172540+0000","last_fullsized":"2024-04-26T07:58:05.172540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:05.172385+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:05.172385+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.172385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:54.072924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.182384+0000","last_change":"2024-04-26T07:58:00.182384+0000","last_active":"2024-04-26T07:58:00.182384+0000","last_peered":"2024-04-26T07:58:00.182384+0000","last_clean":"2024-04-26T07:58:00.182384+0000","last_became_active":"2024-04-26T07:54:15.021205+0000","last_became_peered":"2024-04-26T07:54:15.021205+0000","last_unstale":"2024-04-26T07:58:00.182384+0000","last_undegraded":"2024-04-26T07:58:00.182384+0000","last_fullsized":"2024-04-26T07:58:00.182384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:00.182243+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:00.182243+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.182243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:41.053649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.135919+0000","last_change":"2024-04-26T07:57:55.135919+0000","last_active":"2024-04-26T07:57:55.135919+0000","last_peered":"2024-04-26T07:57:55.135919+0000","last_clean":"2024-04-26T07:57:55.135919+0000","last_became_active":"2024-04-26T07:54:17.016098+0000","last_became_peered":"2024-04-26T07:54:17.016098+0000","last_unstale":"2024-04-26T07:57:55.135919+0000","last_undegraded":"2024-04-26T07:57:55.135919+0000","last_fullsized":"2024-04-26T07:57:55.135919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:55.135805+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:55.135805+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.135805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:24.905448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.128816+0000","last_change":"2024-04-26T07:58:19.128816+0000","last_active":"2024-04-26T07:58:19.128816+0000","last_peered":"2024-04-26T07:58:19.128816+0000","last_clean":"2024-04-26T07:58:19.128816+0000","last_became_active":"2024-04-26T07:54:15.017362+0000","last_became_peered":"2024-04-26T07:54:15.017362+0000","last_unstale":"2024-04-26T07:58:19.128816+0000","last_undegraded":"2024-04-26T07:58:19.128816+0000","last_fullsized":"2024-04-26T07:58:19.128816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:19.128653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:19.128653+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.128653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:05.842827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'6","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.866024+0000","last_change":"2024-04-26T07:58:01.866024+0000","last_active":"2024-04-26T07:58:01.866024+0000","last_peered":"2024-04-26T07:58:01.866024+0000","last_clean":"2024-04-26T07:58:01.866024+0000","last_became_active":"2024-04-26T07:54:17.011516+0000","last_became_peered":"2024-04-26T07:54:17.011516+0000","last_unstale":"2024-04-26T07:58:01.866024+0000","last_undegraded":"2024-04-26T07:58:01.866024+0000","last_fullsized":"2024-04-26T07:58:01.866024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:01.865908+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:01.865908+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.865908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:20.466755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.114214+0000","last_change":"2024-04-26T07:58:17.114214+0000","last_active":"2024-04-26T07:58:17.114214+0000","last_peered":"2024-04-26T07:58:17.114214+0000","last_clean":"2024-04-26T07:58:17.114214+0000","last_became_active":"2024-04-26T07:54:15.016147+0000","last_became_peered":"2024-04-26T07:54:15.016147+0000","last_unstale":"2024-04-26T07:58:17.114214+0000","last_undegraded":"2024-04-26T07:58:17.114214+0000","last_fullsized":"2024-04-26T07:58:17.114214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.114086+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.114086+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.114086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.892848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.287952+0000","last_change":"2024-04-26T07:58:09.287952+0000","last_active":"2024-04-26T07:58:09.287952+0000","last_peered":"2024-04-26T07:58:09.287952+0000","last_clean":"2024-04-26T07:58:09.287952+0000","last_became_active":"2024-04-26T07:54:17.012089+0000","last_became_peered":"2024-04-26T07:54:17.012089+0000","last_unstale":"2024-04-26T07:58:09.287952+0000","last_undegraded":"2024-04-26T07:58:09.287952+0000","last_fullsized":"2024-04-26T07:58:09.287952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:09.287831+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:09.287831+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.287831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:30.576867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.856371+0000","last_change":"2024-04-26T07:58:13.856371+0000","last_active":"2024-04-26T07:58:13.856371+0000","last_peered":"2024-04-26T07:58:13.856371+0000","last_clean":"2024-04-26T07:58:13.856371+0000","last_became_active":"2024-04-26T07:54:15.008114+0000","last_became_peered":"2024-04-26T07:54:15.008114+0000","last_unstale":"2024-04-26T07:58:13.856371+0000","last_undegraded":"2024-04-26T07:58:13.856371+0000","last_fullsized":"2024-04-26T07:58:13.856371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:13.856249+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:13.856249+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.856249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:00.570423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.219242+0000","last_change":"2024-04-26T07:58:09.219242+0000","last_active":"2024-04-26T07:58:09.219242+0000","last_peered":"2024-04-26T07:58:09.219242+0000","last_clean":"2024-04-26T07:58:09.219242+0000","last_became_active":"2024-04-26T07:54:16.998438+0000","last_became_peered":"2024-04-26T07:54:16.998438+0000","last_unstale":"2024-04-26T07:58:09.219242+0000","last_undegraded":"2024-04-26T07:58:09.219242+0000","last_fullsized":"2024-04-26T07:58:09.219242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:09.219121+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:09.219121+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.219121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:31.436809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:50.192836+0000","last_change":"2024-04-26T07:58:50.192836+0000","last_active":"2024-04-26T07:58:50.192836+0000","last_peered":"2024-04-26T07:58:50.192836+0000","last_clean":"2024-04-26T07:58:50.192836+0000","last_became_active":"2024-04-26T07:54:15.017542+0000","last_became_peered":"2024-04-26T07:54:15.017542+0000","last_unstale":"2024-04-26T07:58:50.192836+0000","last_undegraded":"2024-04-26T07:58:50.192836+0000","last_fullsized":"2024-04-26T07:58:50.192836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:50.192710+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:50.192710+0000","last_clean_scrub_stamp":"2024-04-26T07:58:50.192710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:21.714632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.137132+0000","last_change":"2024-04-26T07:58:33.137132+0000","last_active":"2024-04-26T07:58:33.137132+0000","last_peered":"2024-04-26T07:58:33.137132+0000","last_clean":"2024-04-26T07:58:33.137132+0000","last_became_active":"2024-04-26T07:54:25.037547+0000","last_became_peered":"2024-04-26T07:54:25.037547+0000","last_unstale":"2024-04-26T07:58:33.137132+0000","last_undegraded":"2024-04-26T07:58:33.137132+0000","last_fullsized":"2024-04-26T07:58:33.137132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:58:33.136996+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:58:33.136996+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.136996+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:13.338437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'14","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.122525+0000","last_change":"2024-04-26T07:58:20.122525+0000","last_active":"2024-04-26T07:58:20.122525+0000","last_peered":"2024-04-26T07:58:20.122525+0000","last_clean":"2024-04-26T07:58:20.122525+0000","last_became_active":"2024-04-26T07:54:17.010000+0000","last_became_peered":"2024-04-26T07:54:17.010000+0000","last_unstale":"2024-04-26T07:58:20.122525+0000","last_undegraded":"2024-04-26T07:58:20.122525+0000","last_fullsized":"2024-04-26T07:58:20.122525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:20.122382+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:20.122382+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.122382+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:11.188914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:37.179888+0000","last_change":"2024-04-26T07:58:37.179888+0000","last_active":"2024-04-26T07:58:37.179888+0000","last_peered":"2024-04-26T07:58:37.179888+0000","last_clean":"2024-04-26T07:58:37.179888+0000","last_became_active":"2024-04-26T07:54:15.028101+0000","last_became_peered":"2024-04-26T07:54:15.028101+0000","last_unstale":"2024-04-26T07:58:37.179888+0000","last_undegraded":"2024-04-26T07:58:37.179888+0000","last_fullsized":"2024-04-26T07:58:37.179888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:37.179720+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:37.179720+0000","last_clean_scrub_stamp":"2024-04-26T07:58:37.179720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:48.994952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.991316+0000","last_change":"2024-04-26T07:57:41.991316+0000","last_active":"2024-04-26T07:57:41.991316+0000","last_peered":"2024-04-26T07:57:41.991316+0000","last_clean":"2024-04-26T07:57:41.991316+0000","last_became_active":"2024-04-26T07:54:19.012737+0000","last_became_peered":"2024-04-26T07:54:19.012737+0000","last_unstale":"2024-04-26T07:57:41.991316+0000","last_undegraded":"2024-04-26T07:57:41.991316+0000","last_fullsized":"2024-04-26T07:57:41.991316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.991200+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.991200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:30.282928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'37","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.071616+0000","last_change":"2024-04-26T07:58:05.071616+0000","last_active":"2024-04-26T07:58:05.071616+0000","last_peered":"2024-04-26T07:58:05.071616+0000","last_clean":"2024-04-26T07:58:05.071616+0000","last_became_active":"2024-04-26T07:54:21.022465+0000","last_became_peered":"2024-04-26T07:54:21.022465+0000","last_unstale":"2024-04-26T07:58:05.071616+0000","last_undegraded":"2024-04-26T07:58:05.071616+0000","last_fullsized":"2024-04-26T07:58:05.071616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:58:05.071491+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:58:05.071491+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.071491+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:17.009024+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.029273+0000","last_change":"2024-04-26T07:57:40.029273+0000","last_active":"2024-04-26T07:57:40.029273+0000","last_peered":"2024-04-26T07:57:40.029273+0000","last_clean":"2024-04-26T07:57:40.029273+0000","last_became_active":"2024-04-26T07:54:23.030512+0000","last_became_peered":"2024-04-26T07:54:23.030512+0000","last_unstale":"2024-04-26T07:57:40.029273+0000","last_undegraded":"2024-04-26T07:57:40.029273+0000","last_fullsized":"2024-04-26T07:57:40.029273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.029150+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.029150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.153168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'12","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.137657+0000","last_change":"2024-04-26T07:57:56.137657+0000","last_active":"2024-04-26T07:57:56.137657+0000","last_peered":"2024-04-26T07:57:56.137657+0000","last_clean":"2024-04-26T07:57:56.137657+0000","last_became_active":"2024-04-26T07:54:25.029131+0000","last_became_peered":"2024-04-26T07:54:25.029131+0000","last_unstale":"2024-04-26T07:57:56.137657+0000","last_undegraded":"2024-04-26T07:57:56.137657+0000","last_fullsized":"2024-04-26T07:57:56.137657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:57:56.137425+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:57:56.137425+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.137425+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:50.295566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.105205+0000","last_change":"2024-04-26T07:58:21.105205+0000","last_active":"2024-04-26T07:58:21.105205+0000","last_peered":"2024-04-26T07:58:21.105205+0000","last_clean":"2024-04-26T07:58:21.105205+0000","last_became_active":"2024-04-26T07:54:17.009908+0000","last_became_peered":"2024-04-26T07:54:17.009908+0000","last_unstale":"2024-04-26T07:58:21.105205+0000","last_undegraded":"2024-04-26T07:58:21.105205+0000","last_fullsized":"2024-04-26T07:58:21.105205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:21.105074+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:21.105074+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.105074+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:02.632583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.291740+0000","last_change":"2024-04-26T07:58:17.291740+0000","last_active":"2024-04-26T07:58:17.291740+0000","last_peered":"2024-04-26T07:58:17.291740+0000","last_clean":"2024-04-26T07:58:17.291740+0000","last_became_active":"2024-04-26T07:54:15.017292+0000","last_became_peered":"2024-04-26T07:54:15.017292+0000","last_unstale":"2024-04-26T07:58:17.291740+0000","last_undegraded":"2024-04-26T07:58:17.291740+0000","last_fullsized":"2024-04-26T07:58:17.291740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.291610+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.291610+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.291610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:56.621088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'5","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:37.119914+0000","last_change":"2024-04-26T07:58:37.119988+0000","last_active":"2024-04-26T07:58:37.119914+0000","last_peered":"2024-04-26T07:58:37.119914+0000","last_clean":"2024-04-26T07:58:37.119914+0000","last_became_active":"2024-04-26T07:55:02.059930+0000","last_became_peered":"2024-04-26T07:55:02.059930+0000","last_unstale":"2024-04-26T07:58:37.119914+0000","last_undegraded":"2024-04-26T07:58:37.119914+0000","last_fullsized":"2024-04-26T07:58:37.119914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:37.119803+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:37.119803+0000","last_clean_scrub_stamp":"2024-04-26T07:58:37.119803+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:19.428209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.951977+0000","last_change":"2024-04-26T07:57:42.951977+0000","last_active":"2024-04-26T07:57:42.951977+0000","last_peered":"2024-04-26T07:57:42.951977+0000","last_clean":"2024-04-26T07:57:42.951977+0000","last_became_active":"2024-04-26T07:54:21.015671+0000","last_became_peered":"2024-04-26T07:54:21.015671+0000","last_unstale":"2024-04-26T07:57:42.951977+0000","last_undegraded":"2024-04-26T07:57:42.951977+0000","last_fullsized":"2024-04-26T07:57:42.951977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:42.951788+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.951788+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:25.400326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.943739+0000","last_change":"2024-04-26T07:57:47.943739+0000","last_active":"2024-04-26T07:57:47.943739+0000","last_peered":"2024-04-26T07:57:47.943739+0000","last_clean":"2024-04-26T07:57:47.943739+0000","last_became_active":"2024-04-26T07:54:23.035521+0000","last_became_peered":"2024-04-26T07:54:23.035521+0000","last_unstale":"2024-04-26T07:57:47.943739+0000","last_undegraded":"2024-04-26T07:57:47.943739+0000","last_fullsized":"2024-04-26T07:57:47.943739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.943578+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.943578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:52.735911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.851905+0000","last_change":"2024-04-26T07:58:02.851935+0000","last_active":"2024-04-26T07:58:02.851905+0000","last_peered":"2024-04-26T07:58:02.851905+0000","last_clean":"2024-04-26T07:58:02.851905+0000","last_became_active":"2024-04-26T07:54:25.026835+0000","last_became_peered":"2024-04-26T07:54:25.026835+0000","last_unstale":"2024-04-26T07:58:02.851905+0000","last_undegraded":"2024-04-26T07:58:02.851905+0000","last_fullsized":"2024-04-26T07:58:02.851905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:02.851809+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:02.851809+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.851809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:48.141417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'6","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.391865+0000","last_change":"2024-04-26T07:58:28.391912+0000","last_active":"2024-04-26T07:58:28.391865+0000","last_peered":"2024-04-26T07:58:28.391865+0000","last_clean":"2024-04-26T07:58:28.391865+0000","last_became_active":"2024-04-26T07:55:02.058102+0000","last_became_peered":"2024-04-26T07:55:02.058102+0000","last_unstale":"2024-04-26T07:58:28.391865+0000","last_undegraded":"2024-04-26T07:58:28.391865+0000","last_fullsized":"2024-04-26T07:58:28.391865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-26T07:58:28.391758+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-26T07:58:28.391758+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.391758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:11:14.773701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.123115+0000","last_change":"2024-04-26T07:58:31.123115+0000","last_active":"2024-04-26T07:58:31.123115+0000","last_peered":"2024-04-26T07:58:31.123115+0000","last_clean":"2024-04-26T07:58:31.123115+0000","last_became_active":"2024-04-26T07:54:15.028011+0000","last_became_peered":"2024-04-26T07:54:15.028011+0000","last_unstale":"2024-04-26T07:58:31.123115+0000","last_undegraded":"2024-04-26T07:58:31.123115+0000","last_fullsized":"2024-04-26T07:58:31.123115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:31.122960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:31.122960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.122960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:13.159615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.038594+0000","last_change":"2024-04-26T07:57:53.038594+0000","last_active":"2024-04-26T07:57:53.038594+0000","last_peered":"2024-04-26T07:57:53.038594+0000","last_clean":"2024-04-26T07:57:53.038594+0000","last_became_active":"2024-04-26T07:54:19.013613+0000","last_became_peered":"2024-04-26T07:54:19.013613+0000","last_unstale":"2024-04-26T07:57:53.038594+0000","last_undegraded":"2024-04-26T07:57:53.038594+0000","last_fullsized":"2024-04-26T07:57:53.038594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:53.038477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:53.038477+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.038477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.214477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.282677+0000","last_change":"2024-04-26T07:57:38.282677+0000","last_active":"2024-04-26T07:57:38.282677+0000","last_peered":"2024-04-26T07:57:38.282677+0000","last_clean":"2024-04-26T07:57:38.282677+0000","last_became_active":"2024-04-26T07:54:21.023718+0000","last_became_peered":"2024-04-26T07:54:21.023718+0000","last_unstale":"2024-04-26T07:57:38.282677+0000","last_undegraded":"2024-04-26T07:57:38.282677+0000","last_fullsized":"2024-04-26T07:57:38.282677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:57:38.282530+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.282530+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:49.848037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":399,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.033968+0000","last_change":"2024-04-26T07:58:07.033968+0000","last_active":"2024-04-26T07:58:07.033968+0000","last_peered":"2024-04-26T07:58:07.033968+0000","last_clean":"2024-04-26T07:58:07.033968+0000","last_became_active":"2024-04-26T07:54:23.035848+0000","last_became_peered":"2024-04-26T07:54:23.035848+0000","last_unstale":"2024-04-26T07:58:07.033968+0000","last_undegraded":"2024-04-26T07:58:07.033968+0000","last_fullsized":"2024-04-26T07:58:07.033968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-04-26T07:58:07.033790+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-04-26T07:58:07.033790+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.033790+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:29.381421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.433072+0000","last_change":"2024-04-26T07:58:24.433119+0000","last_active":"2024-04-26T07:58:24.433072+0000","last_peered":"2024-04-26T07:58:24.433072+0000","last_clean":"2024-04-26T07:58:24.433072+0000","last_became_active":"2024-04-26T07:54:25.027489+0000","last_became_peered":"2024-04-26T07:54:25.027489+0000","last_unstale":"2024-04-26T07:58:24.433072+0000","last_undegraded":"2024-04-26T07:58:24.433072+0000","last_fullsized":"2024-04-26T07:58:24.433072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:24.432965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:24.432965+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.432965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:52.546312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.819106+0000","last_change":"2024-04-26T07:58:10.819106+0000","last_active":"2024-04-26T07:58:10.819106+0000","last_peered":"2024-04-26T07:58:10.819106+0000","last_clean":"2024-04-26T07:58:10.819106+0000","last_became_active":"2024-04-26T07:54:17.006298+0000","last_became_peered":"2024-04-26T07:54:17.006298+0000","last_unstale":"2024-04-26T07:58:10.819106+0000","last_undegraded":"2024-04-26T07:58:10.819106+0000","last_fullsized":"2024-04-26T07:58:10.819106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-04-26T07:58:10.818989+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-04-26T07:58:10.818989+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.818989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:35.002825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.221263+0000","last_change":"2024-04-26T07:58:11.221263+0000","last_active":"2024-04-26T07:58:11.221263+0000","last_peered":"2024-04-26T07:58:11.221263+0000","last_clean":"2024-04-26T07:58:11.221263+0000","last_became_active":"2024-04-26T07:54:15.017139+0000","last_became_peered":"2024-04-26T07:54:15.017139+0000","last_unstale":"2024-04-26T07:58:11.221263+0000","last_undegraded":"2024-04-26T07:58:11.221263+0000","last_fullsized":"2024-04-26T07:58:11.221263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.221148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.221148+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.221148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:50.550625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:59:00.084786+0000","last_change":"2024-04-26T07:59:00.084786+0000","last_active":"2024-04-26T07:59:00.084786+0000","last_peered":"2024-04-26T07:59:00.084786+0000","last_clean":"2024-04-26T07:59:00.084786+0000","last_became_active":"2024-04-26T07:55:02.058589+0000","last_became_peered":"2024-04-26T07:55:02.058589+0000","last_unstale":"2024-04-26T07:59:00.084786+0000","last_undegraded":"2024-04-26T07:59:00.084786+0000","last_fullsized":"2024-04-26T07:59:00.084786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:59:00.084657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:59:00.084657+0000","last_clean_scrub_stamp":"2024-04-26T07:59:00.084657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:13.969365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.304062+0000","last_change":"2024-04-26T07:57:41.304062+0000","last_active":"2024-04-26T07:57:41.304062+0000","last_peered":"2024-04-26T07:57:41.304062+0000","last_clean":"2024-04-26T07:57:41.304062+0000","last_became_active":"2024-04-26T07:54:21.022167+0000","last_became_peered":"2024-04-26T07:54:21.022167+0000","last_unstale":"2024-04-26T07:57:41.304062+0000","last_undegraded":"2024-04-26T07:57:41.304062+0000","last_fullsized":"2024-04-26T07:57:41.304062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:41.303924+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.303924+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:58.630899+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":414,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.961896+0000","last_change":"2024-04-26T07:57:50.961896+0000","last_active":"2024-04-26T07:57:50.961896+0000","last_peered":"2024-04-26T07:57:50.961896+0000","last_clean":"2024-04-26T07:57:50.961896+0000","last_became_active":"2024-04-26T07:54:23.028697+0000","last_became_peered":"2024-04-26T07:54:23.028697+0000","last_unstale":"2024-04-26T07:57:50.961896+0000","last_undegraded":"2024-04-26T07:57:50.961896+0000","last_fullsized":"2024-04-26T07:57:50.961896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:50.961766+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:50.961766+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.961766+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:57.082089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'3","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.066607+0000","last_change":"2024-04-26T07:57:54.066607+0000","last_active":"2024-04-26T07:57:54.066607+0000","last_peered":"2024-04-26T07:57:54.066607+0000","last_clean":"2024-04-26T07:57:54.066607+0000","last_became_active":"2024-04-26T07:54:17.017427+0000","last_became_peered":"2024-04-26T07:54:17.017427+0000","last_unstale":"2024-04-26T07:57:54.066607+0000","last_undegraded":"2024-04-26T07:57:54.066607+0000","last_fullsized":"2024-04-26T07:57:54.066607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:54.066484+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:54.066484+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.066484+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:39.845246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.397690+0000","last_change":"2024-04-26T07:58:20.397690+0000","last_active":"2024-04-26T07:58:20.397690+0000","last_peered":"2024-04-26T07:58:20.397690+0000","last_clean":"2024-04-26T07:58:20.397690+0000","last_became_active":"2024-04-26T07:54:15.017957+0000","last_became_peered":"2024-04-26T07:54:15.017957+0000","last_unstale":"2024-04-26T07:58:20.397690+0000","last_undegraded":"2024-04-26T07:58:20.397690+0000","last_fullsized":"2024-04-26T07:58:20.397690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:20.397558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:20.397558+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.397558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:08.786482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.928630+0000","last_change":"2024-04-26T07:57:46.928630+0000","last_active":"2024-04-26T07:57:46.928630+0000","last_peered":"2024-04-26T07:57:46.928630+0000","last_clean":"2024-04-26T07:57:46.928630+0000","last_became_active":"2024-04-26T07:54:19.017007+0000","last_became_peered":"2024-04-26T07:54:19.017007+0000","last_unstale":"2024-04-26T07:57:46.928630+0000","last_undegraded":"2024-04-26T07:57:46.928630+0000","last_fullsized":"2024-04-26T07:57:46.928630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:46.928512+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.928512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:13.316943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.275674+0000","last_change":"2024-04-26T07:57:46.275674+0000","last_active":"2024-04-26T07:57:46.275674+0000","last_peered":"2024-04-26T07:57:46.275674+0000","last_clean":"2024-04-26T07:57:46.275674+0000","last_became_active":"2024-04-26T07:54:21.016805+0000","last_became_peered":"2024-04-26T07:54:21.016805+0000","last_unstale":"2024-04-26T07:57:46.275674+0000","last_undegraded":"2024-04-26T07:57:46.275674+0000","last_fullsized":"2024-04-26T07:57:46.275674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-04-26T07:57:46.275508+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.275508+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:20.381725+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.014970+0000","last_change":"2024-04-26T07:57:43.014970+0000","last_active":"2024-04-26T07:57:43.014970+0000","last_peered":"2024-04-26T07:57:43.014970+0000","last_clean":"2024-04-26T07:57:43.014970+0000","last_became_active":"2024-04-26T07:54:23.027855+0000","last_became_peered":"2024-04-26T07:54:23.027855+0000","last_unstale":"2024-04-26T07:57:43.014970+0000","last_undegraded":"2024-04-26T07:57:43.014970+0000","last_fullsized":"2024-04-26T07:57:43.014970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.014858+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.014858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:09.403289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.451681+0000","last_change":"2024-04-26T07:58:26.451681+0000","last_active":"2024-04-26T07:58:26.451681+0000","last_peered":"2024-04-26T07:58:26.451681+0000","last_clean":"2024-04-26T07:58:26.451681+0000","last_became_active":"2024-04-26T07:54:25.037852+0000","last_became_peered":"2024-04-26T07:54:25.037852+0000","last_unstale":"2024-04-26T07:58:26.451681+0000","last_undegraded":"2024-04-26T07:58:26.451681+0000","last_fullsized":"2024-04-26T07:58:26.451681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:26.451562+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:26.451562+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.451562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:43.304584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.153649+0000","last_change":"2024-04-26T07:58:07.153649+0000","last_active":"2024-04-26T07:58:07.153649+0000","last_peered":"2024-04-26T07:58:07.153649+0000","last_clean":"2024-04-26T07:58:07.153649+0000","last_became_active":"2024-04-26T07:54:16.999043+0000","last_became_peered":"2024-04-26T07:54:16.999043+0000","last_unstale":"2024-04-26T07:58:07.153649+0000","last_undegraded":"2024-04-26T07:58:07.153649+0000","last_fullsized":"2024-04-26T07:58:07.153649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:07.153468+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:07.153468+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.153468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:52.443076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.260299+0000","last_change":"2024-04-26T07:58:12.260299+0000","last_active":"2024-04-26T07:58:12.260299+0000","last_peered":"2024-04-26T07:58:12.260299+0000","last_clean":"2024-04-26T07:58:12.260299+0000","last_became_active":"2024-04-26T07:54:15.017950+0000","last_became_peered":"2024-04-26T07:54:15.017950+0000","last_unstale":"2024-04-26T07:58:12.260299+0000","last_undegraded":"2024-04-26T07:58:12.260299+0000","last_fullsized":"2024-04-26T07:58:12.260299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:12.260175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:12.260175+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.260175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:01.160714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.938537+0000","last_change":"2024-04-26T07:57:55.938537+0000","last_active":"2024-04-26T07:57:55.938537+0000","last_peered":"2024-04-26T07:57:55.938537+0000","last_clean":"2024-04-26T07:57:55.938537+0000","last_became_active":"2024-04-26T07:54:19.013355+0000","last_became_peered":"2024-04-26T07:54:19.013355+0000","last_unstale":"2024-04-26T07:57:55.938537+0000","last_undegraded":"2024-04-26T07:57:55.938537+0000","last_fullsized":"2024-04-26T07:57:55.938537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:55.938404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:55.938404+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.938404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:35.339181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'37","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.018207+0000","last_change":"2024-04-26T07:57:51.018207+0000","last_active":"2024-04-26T07:57:51.018207+0000","last_peered":"2024-04-26T07:57:51.018207+0000","last_clean":"2024-04-26T07:57:51.018207+0000","last_became_active":"2024-04-26T07:54:21.020912+0000","last_became_peered":"2024-04-26T07:54:21.020912+0000","last_unstale":"2024-04-26T07:57:51.018207+0000","last_undegraded":"2024-04-26T07:57:51.018207+0000","last_fullsized":"2024-04-26T07:57:51.018207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:51.017960+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:51.017960+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.017960+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:39.406884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.026951+0000","last_change":"2024-04-26T07:57:47.026951+0000","last_active":"2024-04-26T07:57:47.026951+0000","last_peered":"2024-04-26T07:57:47.026951+0000","last_clean":"2024-04-26T07:57:47.026951+0000","last_became_active":"2024-04-26T07:54:23.027874+0000","last_became_peered":"2024-04-26T07:54:23.027874+0000","last_unstale":"2024-04-26T07:57:47.026951+0000","last_undegraded":"2024-04-26T07:57:47.026951+0000","last_fullsized":"2024-04-26T07:57:47.026951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.026813+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.026813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:06.280145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.155890+0000","last_change":"2024-04-26T07:58:31.155890+0000","last_active":"2024-04-26T07:58:31.155890+0000","last_peered":"2024-04-26T07:58:31.155890+0000","last_clean":"2024-04-26T07:58:31.155890+0000","last_became_active":"2024-04-26T07:54:25.029568+0000","last_became_peered":"2024-04-26T07:54:25.029568+0000","last_unstale":"2024-04-26T07:58:31.155890+0000","last_undegraded":"2024-04-26T07:58:31.155890+0000","last_fullsized":"2024-04-26T07:58:31.155890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:31.155771+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:31.155771+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.155771+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:49.092021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.269801+0000","last_change":"2024-04-26T07:58:11.269801+0000","last_active":"2024-04-26T07:58:11.269801+0000","last_peered":"2024-04-26T07:58:11.269801+0000","last_clean":"2024-04-26T07:58:11.269801+0000","last_became_active":"2024-04-26T07:54:17.014758+0000","last_became_peered":"2024-04-26T07:54:17.014758+0000","last_unstale":"2024-04-26T07:58:11.269801+0000","last_undegraded":"2024-04-26T07:58:11.269801+0000","last_fullsized":"2024-04-26T07:58:11.269801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:11.269608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:11.269608+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.269608+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:59.561335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.154985+0000","last_change":"2024-04-26T07:58:34.154985+0000","last_active":"2024-04-26T07:58:34.154985+0000","last_peered":"2024-04-26T07:58:34.154985+0000","last_clean":"2024-04-26T07:58:34.154985+0000","last_became_active":"2024-04-26T07:54:15.025339+0000","last_became_peered":"2024-04-26T07:54:15.025339+0000","last_unstale":"2024-04-26T07:58:34.154985+0000","last_undegraded":"2024-04-26T07:58:34.154985+0000","last_fullsized":"2024-04-26T07:58:34.154985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:34.154871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:34.154871+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.154871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:48.785587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.020138+0000","last_change":"2024-04-26T07:57:54.020138+0000","last_active":"2024-04-26T07:57:54.020138+0000","last_peered":"2024-04-26T07:57:54.020138+0000","last_clean":"2024-04-26T07:57:54.020138+0000","last_became_active":"2024-04-26T07:54:19.013277+0000","last_became_peered":"2024-04-26T07:54:19.013277+0000","last_unstale":"2024-04-26T07:57:54.020138+0000","last_undegraded":"2024-04-26T07:57:54.020138+0000","last_fullsized":"2024-04-26T07:57:54.020138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.020020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.020020+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.020020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:45.728783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.025939+0000","last_change":"2024-04-26T07:57:55.025939+0000","last_active":"2024-04-26T07:57:55.025939+0000","last_peered":"2024-04-26T07:57:55.025939+0000","last_clean":"2024-04-26T07:57:55.025939+0000","last_became_active":"2024-04-26T07:54:21.021458+0000","last_became_peered":"2024-04-26T07:54:21.021458+0000","last_unstale":"2024-04-26T07:57:55.025939+0000","last_undegraded":"2024-04-26T07:57:55.025939+0000","last_fullsized":"2024-04-26T07:57:55.025939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-04-26T07:57:55.025801+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-04-26T07:57:55.025801+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.025801+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:23.139148+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":361,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.078544+0000","last_change":"2024-04-26T07:57:36.078544+0000","last_active":"2024-04-26T07:57:36.078544+0000","last_peered":"2024-04-26T07:57:36.078544+0000","last_clean":"2024-04-26T07:57:36.078544+0000","last_became_active":"2024-04-26T07:54:23.023163+0000","last_became_peered":"2024-04-26T07:54:23.023163+0000","last_unstale":"2024-04-26T07:57:36.078544+0000","last_undegraded":"2024-04-26T07:57:36.078544+0000","last_fullsized":"2024-04-26T07:57:36.078544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.078443+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.078443+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:00.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.687186+0000","last_change":"2024-04-26T07:58:32.687186+0000","last_active":"2024-04-26T07:58:32.687186+0000","last_peered":"2024-04-26T07:58:32.687186+0000","last_clean":"2024-04-26T07:58:32.687186+0000","last_became_active":"2024-04-26T07:54:25.030571+0000","last_became_peered":"2024-04-26T07:54:25.030571+0000","last_unstale":"2024-04-26T07:58:32.687186+0000","last_undegraded":"2024-04-26T07:58:32.687186+0000","last_fullsized":"2024-04-26T07:58:32.687186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:32.687042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:32.687042+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.687042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:57:56.973895+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.194805+0000","last_change":"2024-04-26T07:57:58.194805+0000","last_active":"2024-04-26T07:57:58.194805+0000","last_peered":"2024-04-26T07:57:58.194805+0000","last_clean":"2024-04-26T07:57:58.194805+0000","last_became_active":"2024-04-26T07:54:17.002200+0000","last_became_peered":"2024-04-26T07:54:17.002200+0000","last_unstale":"2024-04-26T07:57:58.194805+0000","last_undegraded":"2024-04-26T07:57:58.194805+0000","last_fullsized":"2024-04-26T07:57:58.194805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:58.194676+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:58.194676+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.194676+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:17.448008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:41.088455+0000","last_change":"2024-04-26T07:58:41.088455+0000","last_active":"2024-04-26T07:58:41.088455+0000","last_peered":"2024-04-26T07:58:41.088455+0000","last_clean":"2024-04-26T07:58:41.088455+0000","last_became_active":"2024-04-26T07:54:15.029006+0000","last_became_peered":"2024-04-26T07:54:15.029006+0000","last_unstale":"2024-04-26T07:58:41.088455+0000","last_undegraded":"2024-04-26T07:58:41.088455+0000","last_fullsized":"2024-04-26T07:58:41.088455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:41.088330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:41.088330+0000","last_clean_scrub_stamp":"2024-04-26T07:58:41.088330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:02.104536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.868520+0000","last_change":"2024-04-26T07:57:57.868520+0000","last_active":"2024-04-26T07:57:57.868520+0000","last_peered":"2024-04-26T07:57:57.868520+0000","last_clean":"2024-04-26T07:57:57.868520+0000","last_became_active":"2024-04-26T07:54:19.011527+0000","last_became_peered":"2024-04-26T07:54:19.011527+0000","last_unstale":"2024-04-26T07:57:57.868520+0000","last_undegraded":"2024-04-26T07:57:57.868520+0000","last_fullsized":"2024-04-26T07:57:57.868520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:57.868394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:57.868394+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.868394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.157429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'64","reported_seq":138,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.962369+0000","last_change":"2024-04-26T07:57:46.962369+0000","last_active":"2024-04-26T07:57:46.962369+0000","last_peered":"2024-04-26T07:57:46.962369+0000","last_clean":"2024-04-26T07:57:46.962369+0000","last_became_active":"2024-04-26T07:54:21.020792+0000","last_became_peered":"2024-04-26T07:54:21.020792+0000","last_unstale":"2024-04-26T07:57:46.962369+0000","last_undegraded":"2024-04-26T07:57:46.962369+0000","last_fullsized":"2024-04-26T07:57:46.962369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'64","last_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_deep_scrub":"29'64","last_deep_scrub_stamp":"2024-04-26T07:57:46.962228+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.962228+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:34.331613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.099115+0000","last_change":"2024-04-26T07:57:35.099115+0000","last_active":"2024-04-26T07:57:35.099115+0000","last_peered":"2024-04-26T07:57:35.099115+0000","last_clean":"2024-04-26T07:57:35.099115+0000","last_became_active":"2024-04-26T07:54:23.024949+0000","last_became_peered":"2024-04-26T07:54:23.024949+0000","last_unstale":"2024-04-26T07:57:35.099115+0000","last_undegraded":"2024-04-26T07:57:35.099115+0000","last_fullsized":"2024-04-26T07:57:35.099115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.098977+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.098977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:27.568866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.665873+0000","last_change":"2024-04-26T07:58:33.665873+0000","last_active":"2024-04-26T07:58:33.665873+0000","last_peered":"2024-04-26T07:58:33.665873+0000","last_clean":"2024-04-26T07:58:33.665873+0000","last_became_active":"2024-04-26T07:54:25.034034+0000","last_became_peered":"2024-04-26T07:54:25.034034+0000","last_unstale":"2024-04-26T07:58:33.665873+0000","last_undegraded":"2024-04-26T07:58:33.665873+0000","last_fullsized":"2024-04-26T07:58:33.665873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-04-26T07:58:33.665731+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-04-26T07:58:33.665731+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.665731+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:32.080803+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.163967+0000","last_change":"2024-04-26T07:57:57.163967+0000","last_active":"2024-04-26T07:57:57.163967+0000","last_peered":"2024-04-26T07:57:57.163967+0000","last_clean":"2024-04-26T07:57:57.163967+0000","last_became_active":"2024-04-26T07:54:17.012751+0000","last_became_peered":"2024-04-26T07:54:17.012751+0000","last_unstale":"2024-04-26T07:57:57.163967+0000","last_undegraded":"2024-04-26T07:57:57.163967+0000","last_fullsized":"2024-04-26T07:57:57.163967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:57.163800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:57.163800+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.163800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:45.732682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.759703+0000","last_change":"2024-04-26T07:58:23.759703+0000","last_active":"2024-04-26T07:58:23.759703+0000","last_peered":"2024-04-26T07:58:23.759703+0000","last_clean":"2024-04-26T07:58:23.759703+0000","last_became_active":"2024-04-26T07:54:15.001143+0000","last_became_peered":"2024-04-26T07:54:15.001143+0000","last_unstale":"2024-04-26T07:58:23.759703+0000","last_undegraded":"2024-04-26T07:58:23.759703+0000","last_fullsized":"2024-04-26T07:58:23.759703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:23.759573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:23.759573+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.759573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:14.550610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.292998+0000","last_change":"2024-04-26T07:57:48.292998+0000","last_active":"2024-04-26T07:57:48.292998+0000","last_peered":"2024-04-26T07:57:48.292998+0000","last_clean":"2024-04-26T07:57:48.292998+0000","last_became_active":"2024-04-26T07:54:19.015729+0000","last_became_peered":"2024-04-26T07:54:19.015729+0000","last_unstale":"2024-04-26T07:57:48.292998+0000","last_undegraded":"2024-04-26T07:57:48.292998+0000","last_fullsized":"2024-04-26T07:57:48.292998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.292808+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.292808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:10.416826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.928755+0000","last_change":"2024-04-26T07:57:44.928755+0000","last_active":"2024-04-26T07:57:44.928755+0000","last_peered":"2024-04-26T07:57:44.928755+0000","last_clean":"2024-04-26T07:57:44.928755+0000","last_became_active":"2024-04-26T07:54:21.015385+0000","last_became_peered":"2024-04-26T07:54:21.015385+0000","last_unstale":"2024-04-26T07:57:44.928755+0000","last_undegraded":"2024-04-26T07:57:44.928755+0000","last_fullsized":"2024-04-26T07:57:44.928755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:44.928570+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.928570+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.353478+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.037367+0000","last_change":"2024-04-26T07:58:00.037367+0000","last_active":"2024-04-26T07:58:00.037367+0000","last_peered":"2024-04-26T07:58:00.037367+0000","last_clean":"2024-04-26T07:58:00.037367+0000","last_became_active":"2024-04-26T07:54:23.029583+0000","last_became_peered":"2024-04-26T07:54:23.029583+0000","last_unstale":"2024-04-26T07:58:00.037367+0000","last_undegraded":"2024-04-26T07:58:00.037367+0000","last_fullsized":"2024-04-26T07:58:00.037367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:00.037251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:00.037251+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.037251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:24.628418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.158421+0000","last_change":"2024-04-26T07:58:27.158448+0000","last_active":"2024-04-26T07:58:27.158421+0000","last_peered":"2024-04-26T07:58:27.158421+0000","last_clean":"2024-04-26T07:58:27.158421+0000","last_became_active":"2024-04-26T07:54:25.037598+0000","last_became_peered":"2024-04-26T07:54:25.037598+0000","last_unstale":"2024-04-26T07:58:27.158421+0000","last_undegraded":"2024-04-26T07:58:27.158421+0000","last_fullsized":"2024-04-26T07:58:27.158421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:27.158330+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:27.158330+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.158330+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:12.762499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.008175+0000","last_change":"2024-04-26T07:57:52.008175+0000","last_active":"2024-04-26T07:57:52.008175+0000","last_peered":"2024-04-26T07:57:52.008175+0000","last_clean":"2024-04-26T07:57:52.008175+0000","last_became_active":"2024-04-26T07:54:17.017347+0000","last_became_peered":"2024-04-26T07:54:17.017347+0000","last_unstale":"2024-04-26T07:57:52.008175+0000","last_undegraded":"2024-04-26T07:57:52.008175+0000","last_fullsized":"2024-04-26T07:57:52.008175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:52.008051+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:52.008051+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.008051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:54.902871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:44.123274+0000","last_change":"2024-04-26T07:58:44.123307+0000","last_active":"2024-04-26T07:58:44.123274+0000","last_peered":"2024-04-26T07:58:44.123274+0000","last_clean":"2024-04-26T07:58:44.123274+0000","last_became_active":"2024-04-26T07:54:15.022757+0000","last_became_peered":"2024-04-26T07:54:15.022757+0000","last_unstale":"2024-04-26T07:58:44.123274+0000","last_undegraded":"2024-04-26T07:58:44.123274+0000","last_fullsized":"2024-04-26T07:58:44.123274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:44.123166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:44.123166+0000","last_clean_scrub_stamp":"2024-04-26T07:58:44.123166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:59.254077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.893157+0000","last_change":"2024-04-26T07:57:56.893157+0000","last_active":"2024-04-26T07:57:56.893157+0000","last_peered":"2024-04-26T07:57:56.893157+0000","last_clean":"2024-04-26T07:57:56.893157+0000","last_became_active":"2024-04-26T07:54:19.013342+0000","last_became_peered":"2024-04-26T07:54:19.013342+0000","last_unstale":"2024-04-26T07:57:56.893157+0000","last_undegraded":"2024-04-26T07:57:56.893157+0000","last_fullsized":"2024-04-26T07:57:56.893157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:56.892989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:56.892989+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.892989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:19.992014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.289709+0000","last_change":"2024-04-26T07:57:45.289709+0000","last_active":"2024-04-26T07:57:45.289709+0000","last_peered":"2024-04-26T07:57:45.289709+0000","last_clean":"2024-04-26T07:57:45.289709+0000","last_became_active":"2024-04-26T07:54:21.018950+0000","last_became_peered":"2024-04-26T07:54:21.018950+0000","last_unstale":"2024-04-26T07:57:45.289709+0000","last_undegraded":"2024-04-26T07:57:45.289709+0000","last_fullsized":"2024-04-26T07:57:45.289709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:45.289560+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.289560+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:24.532087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":416,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.293682+0000","last_change":"2024-04-26T07:57:39.293682+0000","last_active":"2024-04-26T07:57:39.293682+0000","last_peered":"2024-04-26T07:57:39.293682+0000","last_clean":"2024-04-26T07:57:39.293682+0000","last_became_active":"2024-04-26T07:54:23.029260+0000","last_became_peered":"2024-04-26T07:54:23.029260+0000","last_unstale":"2024-04-26T07:57:39.293682+0000","last_undegraded":"2024-04-26T07:57:39.293682+0000","last_fullsized":"2024-04-26T07:57:39.293682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.293505+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.293505+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.009568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'13","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.649805+0000","last_change":"2024-04-26T07:58:29.649805+0000","last_active":"2024-04-26T07:58:29.649805+0000","last_peered":"2024-04-26T07:58:29.649805+0000","last_clean":"2024-04-26T07:58:29.649805+0000","last_became_active":"2024-04-26T07:54:25.028855+0000","last_became_peered":"2024-04-26T07:54:25.028855+0000","last_unstale":"2024-04-26T07:58:29.649805+0000","last_undegraded":"2024-04-26T07:58:29.649805+0000","last_fullsized":"2024-04-26T07:58:29.649805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-04-26T07:58:29.649659+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-04-26T07:58:29.649659+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.649659+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:41:47.366919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.432613+0000","last_change":"2024-04-26T07:58:21.432613+0000","last_active":"2024-04-26T07:58:21.432613+0000","last_peered":"2024-04-26T07:58:21.432613+0000","last_clean":"2024-04-26T07:58:21.432613+0000","last_became_active":"2024-04-26T07:54:17.014978+0000","last_became_peered":"2024-04-26T07:54:17.014978+0000","last_unstale":"2024-04-26T07:58:21.432613+0000","last_undegraded":"2024-04-26T07:58:21.432613+0000","last_fullsized":"2024-04-26T07:58:21.432613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-26T07:58:21.432427+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-26T07:58:21.432427+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.432427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:24.327247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:35.155723+0000","last_change":"2024-04-26T07:58:35.155752+0000","last_active":"2024-04-26T07:58:35.155723+0000","last_peered":"2024-04-26T07:58:35.155723+0000","last_clean":"2024-04-26T07:58:35.155723+0000","last_became_active":"2024-04-26T07:54:15.028095+0000","last_became_peered":"2024-04-26T07:54:15.028095+0000","last_unstale":"2024-04-26T07:58:35.155723+0000","last_undegraded":"2024-04-26T07:58:35.155723+0000","last_fullsized":"2024-04-26T07:58:35.155723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:35.155623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:35.155623+0000","last_clean_scrub_stamp":"2024-04-26T07:58:35.155623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:08.488980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":440,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:36.130796+0000","last_change":"2024-04-26T07:58:36.130796+0000","last_active":"2024-04-26T07:58:36.130796+0000","last_peered":"2024-04-26T07:58:36.130796+0000","last_clean":"2024-04-26T07:58:36.130796+0000","last_became_active":"2024-04-26T07:55:02.059410+0000","last_became_peered":"2024-04-26T07:55:02.059410+0000","last_unstale":"2024-04-26T07:58:36.130796+0000","last_undegraded":"2024-04-26T07:58:36.130796+0000","last_fullsized":"2024-04-26T07:58:36.130796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:36.130657+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:36.130657+0000","last_clean_scrub_stamp":"2024-04-26T07:58:36.130657+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:55.378641+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.098164+0000","last_change":"2024-04-26T07:58:02.098164+0000","last_active":"2024-04-26T07:58:02.098164+0000","last_peered":"2024-04-26T07:58:02.098164+0000","last_clean":"2024-04-26T07:58:02.098164+0000","last_became_active":"2024-04-26T07:54:21.020989+0000","last_became_peered":"2024-04-26T07:54:21.020989+0000","last_unstale":"2024-04-26T07:58:02.098164+0000","last_undegraded":"2024-04-26T07:58:02.098164+0000","last_fullsized":"2024-04-26T07:58:02.098164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-04-26T07:58:02.098032+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-04-26T07:58:02.098032+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.098032+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:12.785928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":478,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.160522+0000","last_change":"2024-04-26T07:57:36.160522+0000","last_active":"2024-04-26T07:57:36.160522+0000","last_peered":"2024-04-26T07:57:36.160522+0000","last_clean":"2024-04-26T07:57:36.160522+0000","last_became_active":"2024-04-26T07:54:23.024265+0000","last_became_peered":"2024-04-26T07:54:23.024265+0000","last_unstale":"2024-04-26T07:57:36.160522+0000","last_undegraded":"2024-04-26T07:57:36.160522+0000","last_fullsized":"2024-04-26T07:57:36.160522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:36.160401+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.160401+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:38.276301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:55.200716+0000","last_change":"2024-04-26T07:57:55.200716+0000","last_active":"2024-04-26T07:57:55.200716+0000","last_peered":"2024-04-26T07:57:55.200716+0000","last_clean":"2024-04-26T07:57:55.200716+0000","last_became_active":"2024-04-26T07:54:25.024310+0000","last_became_peered":"2024-04-26T07:54:25.024310+0000","last_unstale":"2024-04-26T07:57:55.200716+0000","last_undegraded":"2024-04-26T07:57:55.200716+0000","last_fullsized":"2024-04-26T07:57:55.200716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:57:55.200595+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:57:55.200595+0000","last_clean_scrub_stamp":"2024-04-26T07:57:55.200595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:09.542065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.093446+0000","last_change":"2024-04-26T07:58:18.093446+0000","last_active":"2024-04-26T07:58:18.093446+0000","last_peered":"2024-04-26T07:58:18.093446+0000","last_clean":"2024-04-26T07:58:18.093446+0000","last_became_active":"2024-04-26T07:54:17.003629+0000","last_became_peered":"2024-04-26T07:54:17.003629+0000","last_unstale":"2024-04-26T07:58:18.093446+0000","last_undegraded":"2024-04-26T07:58:18.093446+0000","last_fullsized":"2024-04-26T07:58:18.093446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:18.093308+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:18.093308+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.093308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:46.206655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.131168+0000","last_change":"2024-04-26T07:58:28.131168+0000","last_active":"2024-04-26T07:58:28.131168+0000","last_peered":"2024-04-26T07:58:28.131168+0000","last_clean":"2024-04-26T07:58:28.131168+0000","last_became_active":"2024-04-26T07:54:15.029398+0000","last_became_peered":"2024-04-26T07:54:15.029398+0000","last_unstale":"2024-04-26T07:58:28.131168+0000","last_undegraded":"2024-04-26T07:58:28.131168+0000","last_fullsized":"2024-04-26T07:58:28.131168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:28.131035+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:28.131035+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.131035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.736994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.958217+0000","last_change":"2024-04-26T07:57:39.958217+0000","last_active":"2024-04-26T07:57:39.958217+0000","last_peered":"2024-04-26T07:57:39.958217+0000","last_clean":"2024-04-26T07:57:39.958217+0000","last_became_active":"2024-04-26T07:54:19.012724+0000","last_became_peered":"2024-04-26T07:54:19.012724+0000","last_unstale":"2024-04-26T07:57:39.958217+0000","last_undegraded":"2024-04-26T07:57:39.958217+0000","last_fullsized":"2024-04-26T07:57:39.958217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:39.958089+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.958089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.571578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'50","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.994938+0000","last_change":"2024-04-26T07:57:40.994938+0000","last_active":"2024-04-26T07:57:40.994938+0000","last_peered":"2024-04-26T07:57:40.994938+0000","last_clean":"2024-04-26T07:57:40.994938+0000","last_became_active":"2024-04-26T07:54:21.016758+0000","last_became_peered":"2024-04-26T07:54:21.016758+0000","last_unstale":"2024-04-26T07:57:40.994938+0000","last_undegraded":"2024-04-26T07:57:40.994938+0000","last_fullsized":"2024-04-26T07:57:40.994938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-04-26T07:57:40.994806+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.994806+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:36.917229+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.265003+0000","last_change":"2024-04-26T07:57:51.265003+0000","last_active":"2024-04-26T07:57:51.265003+0000","last_peered":"2024-04-26T07:57:51.265003+0000","last_clean":"2024-04-26T07:57:51.265003+0000","last_became_active":"2024-04-26T07:54:23.031361+0000","last_became_peered":"2024-04-26T07:54:23.031361+0000","last_unstale":"2024-04-26T07:57:51.265003+0000","last_undegraded":"2024-04-26T07:57:51.265003+0000","last_fullsized":"2024-04-26T07:57:51.265003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:51.264883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:51.264883+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.264883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.713422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.068192+0000","last_change":"2024-04-26T07:57:52.068192+0000","last_active":"2024-04-26T07:57:52.068192+0000","last_peered":"2024-04-26T07:57:52.068192+0000","last_clean":"2024-04-26T07:57:52.068192+0000","last_became_active":"2024-04-26T07:54:25.025205+0000","last_became_peered":"2024-04-26T07:54:25.025205+0000","last_unstale":"2024-04-26T07:57:52.068192+0000","last_undegraded":"2024-04-26T07:57:52.068192+0000","last_fullsized":"2024-04-26T07:57:52.068192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:52.068074+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:52.068074+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.068074+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:08.194548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.091526+0000","last_change":"2024-04-26T07:58:12.091526+0000","last_active":"2024-04-26T07:58:12.091526+0000","last_peered":"2024-04-26T07:58:12.091526+0000","last_clean":"2024-04-26T07:58:12.091526+0000","last_became_active":"2024-04-26T07:54:17.016357+0000","last_became_peered":"2024-04-26T07:54:17.016357+0000","last_unstale":"2024-04-26T07:58:12.091526+0000","last_undegraded":"2024-04-26T07:58:12.091526+0000","last_fullsized":"2024-04-26T07:58:12.091526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:12.091376+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:12.091376+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.091376+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:28.508324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.210467+0000","last_change":"2024-04-26T07:58:22.210499+0000","last_active":"2024-04-26T07:58:22.210467+0000","last_peered":"2024-04-26T07:58:22.210467+0000","last_clean":"2024-04-26T07:58:22.210467+0000","last_became_active":"2024-04-26T07:54:06.675007+0000","last_became_peered":"2024-04-26T07:54:06.675007+0000","last_unstale":"2024-04-26T07:58:22.210467+0000","last_undegraded":"2024-04-26T07:58:22.210467+0000","last_fullsized":"2024-04-26T07:58:22.210467+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-04-26T07:58:22.210379+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-04-26T07:58:22.210379+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.210379+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:11:08.592322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:49.179872+0000","last_change":"2024-04-26T07:58:49.179902+0000","last_active":"2024-04-26T07:58:49.179872+0000","last_peered":"2024-04-26T07:58:49.179872+0000","last_clean":"2024-04-26T07:58:49.179872+0000","last_became_active":"2024-04-26T07:54:06.676414+0000","last_became_peered":"2024-04-26T07:54:06.676414+0000","last_unstale":"2024-04-26T07:58:49.179872+0000","last_undegraded":"2024-04-26T07:58:49.179872+0000","last_fullsized":"2024-04-26T07:58:49.179872+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:49.179772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:49.179772+0000","last_clean_scrub_stamp":"2024-04-26T07:58:49.179772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:26.078699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:39.142697+0000","last_change":"2024-04-26T07:58:39.142723+0000","last_active":"2024-04-26T07:58:39.142697+0000","last_peered":"2024-04-26T07:58:39.142697+0000","last_clean":"2024-04-26T07:58:39.142697+0000","last_became_active":"2024-04-26T07:54:15.028708+0000","last_became_peered":"2024-04-26T07:54:15.028708+0000","last_unstale":"2024-04-26T07:58:39.142697+0000","last_undegraded":"2024-04-26T07:58:39.142697+0000","last_fullsized":"2024-04-26T07:58:39.142697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:39.142593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:39.142593+0000","last_clean_scrub_stamp":"2024-04-26T07:58:39.142593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:15.338832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"29'2","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.019436+0000","last_change":"2024-04-26T07:57:51.019436+0000","last_active":"2024-04-26T07:57:51.019436+0000","last_peered":"2024-04-26T07:57:51.019436+0000","last_clean":"2024-04-26T07:57:51.019436+0000","last_became_active":"2024-04-26T07:54:19.011282+0000","last_became_peered":"2024-04-26T07:54:19.011282+0000","last_unstale":"2024-04-26T07:57:51.019436+0000","last_undegraded":"2024-04-26T07:57:51.019436+0000","last_fullsized":"2024-04-26T07:57:51.019436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:51.019305+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:51.019305+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.019305+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:10.272637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":179,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.023139+0000","last_change":"2024-04-26T07:57:43.023139+0000","last_active":"2024-04-26T07:57:43.023139+0000","last_peered":"2024-04-26T07:57:43.023139+0000","last_clean":"2024-04-26T07:57:43.023139+0000","last_became_active":"2024-04-26T07:54:21.020467+0000","last_became_peered":"2024-04-26T07:54:21.020467+0000","last_unstale":"2024-04-26T07:57:43.023139+0000","last_undegraded":"2024-04-26T07:57:43.023139+0000","last_fullsized":"2024-04-26T07:57:43.023139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-04-26T07:57:43.022950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.022950+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:31.923488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.045637+0000","last_change":"2024-04-26T07:57:38.045637+0000","last_active":"2024-04-26T07:57:38.045637+0000","last_peered":"2024-04-26T07:57:38.045637+0000","last_clean":"2024-04-26T07:57:38.045637+0000","last_became_active":"2024-04-26T07:54:23.021625+0000","last_became_peered":"2024-04-26T07:54:23.021625+0000","last_unstale":"2024-04-26T07:57:38.045637+0000","last_undegraded":"2024-04-26T07:57:38.045637+0000","last_fullsized":"2024-04-26T07:57:38.045637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:38.045507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.045507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:26.957086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.449465+0000","last_change":"2024-04-26T07:58:23.449465+0000","last_active":"2024-04-26T07:58:23.449465+0000","last_peered":"2024-04-26T07:58:23.449465+0000","last_clean":"2024-04-26T07:58:23.449465+0000","last_became_active":"2024-04-26T07:54:25.026786+0000","last_became_peered":"2024-04-26T07:54:25.026786+0000","last_unstale":"2024-04-26T07:58:23.449465+0000","last_undegraded":"2024-04-26T07:58:23.449465+0000","last_fullsized":"2024-04-26T07:58:23.449465+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'81","last_scrub_stamp":"2024-04-26T07:58:23.449328+0000","last_deep_scrub":"29'81","last_deep_scrub_stamp":"2024-04-26T07:58:23.449328+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.449328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:09.228090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.172908+0000","last_change":"2024-04-26T07:58:16.172908+0000","last_active":"2024-04-26T07:58:16.172908+0000","last_peered":"2024-04-26T07:58:16.172908+0000","last_clean":"2024-04-26T07:58:16.172908+0000","last_became_active":"2024-04-26T07:54:17.011616+0000","last_became_peered":"2024-04-26T07:54:17.011616+0000","last_unstale":"2024-04-26T07:58:16.172908+0000","last_undegraded":"2024-04-26T07:58:16.172908+0000","last_fullsized":"2024-04-26T07:58:16.172908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:16.172787+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:16.172787+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.172787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:16.279358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:46.116556+0000","last_change":"2024-04-26T07:58:46.116582+0000","last_active":"2024-04-26T07:58:46.116556+0000","last_peered":"2024-04-26T07:58:46.116556+0000","last_clean":"2024-04-26T07:58:46.116556+0000","last_became_active":"2024-04-26T07:54:06.674568+0000","last_became_peered":"2024-04-26T07:54:06.674568+0000","last_unstale":"2024-04-26T07:58:46.116556+0000","last_undegraded":"2024-04-26T07:58:46.116556+0000","last_fullsized":"2024-04-26T07:58:46.116556+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:46.116454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:46.116454+0000","last_clean_scrub_stamp":"2024-04-26T07:58:46.116454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:21.300974+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.793998+0000","last_change":"2024-04-26T07:58:19.793998+0000","last_active":"2024-04-26T07:58:19.793998+0000","last_peered":"2024-04-26T07:58:19.793998+0000","last_clean":"2024-04-26T07:58:19.793998+0000","last_became_active":"2024-04-26T07:54:15.006669+0000","last_became_peered":"2024-04-26T07:54:15.006669+0000","last_unstale":"2024-04-26T07:58:19.793998+0000","last_undegraded":"2024-04-26T07:58:19.793998+0000","last_fullsized":"2024-04-26T07:58:19.793998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:19.793877+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:19.793877+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.793877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:27.595245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.922184+0000","last_change":"2024-04-26T07:57:37.922184+0000","last_active":"2024-04-26T07:57:37.922184+0000","last_peered":"2024-04-26T07:57:37.922184+0000","last_clean":"2024-04-26T07:57:37.922184+0000","last_became_active":"2024-04-26T07:54:19.012759+0000","last_became_peered":"2024-04-26T07:54:19.012759+0000","last_unstale":"2024-04-26T07:57:37.922184+0000","last_undegraded":"2024-04-26T07:57:37.922184+0000","last_fullsized":"2024-04-26T07:57:37.922184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.922054+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.922054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:17.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.125161+0000","last_change":"2024-04-26T07:57:38.125161+0000","last_active":"2024-04-26T07:57:38.125161+0000","last_peered":"2024-04-26T07:57:38.125161+0000","last_clean":"2024-04-26T07:57:38.125161+0000","last_became_active":"2024-04-26T07:54:21.024269+0000","last_became_peered":"2024-04-26T07:54:21.024269+0000","last_unstale":"2024-04-26T07:57:38.125161+0000","last_undegraded":"2024-04-26T07:57:38.125161+0000","last_fullsized":"2024-04-26T07:57:38.125161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-04-26T07:57:38.125031+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.125031+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:12.231248+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.031627+0000","last_change":"2024-04-26T07:57:58.031627+0000","last_active":"2024-04-26T07:57:58.031627+0000","last_peered":"2024-04-26T07:57:58.031627+0000","last_clean":"2024-04-26T07:57:58.031627+0000","last_became_active":"2024-04-26T07:54:23.029615+0000","last_became_peered":"2024-04-26T07:54:23.029615+0000","last_unstale":"2024-04-26T07:57:58.031627+0000","last_undegraded":"2024-04-26T07:57:58.031627+0000","last_fullsized":"2024-04-26T07:57:58.031627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:58.031507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:58.031507+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.031507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:50.696106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.218474+0000","last_change":"2024-04-26T07:58:04.218474+0000","last_active":"2024-04-26T07:58:04.218474+0000","last_peered":"2024-04-26T07:58:04.218474+0000","last_clean":"2024-04-26T07:58:04.218474+0000","last_became_active":"2024-04-26T07:54:25.029816+0000","last_became_peered":"2024-04-26T07:54:25.029816+0000","last_unstale":"2024-04-26T07:58:04.218474+0000","last_undegraded":"2024-04-26T07:58:04.218474+0000","last_fullsized":"2024-04-26T07:58:04.218474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:04.218304+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:04.218304+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.218304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:25.813231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'16","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.817842+0000","last_change":"2024-04-26T07:58:14.817842+0000","last_active":"2024-04-26T07:58:14.817842+0000","last_peered":"2024-04-26T07:58:14.817842+0000","last_clean":"2024-04-26T07:58:14.817842+0000","last_became_active":"2024-04-26T07:54:17.006229+0000","last_became_peered":"2024-04-26T07:54:17.006229+0000","last_unstale":"2024-04-26T07:58:14.817842+0000","last_undegraded":"2024-04-26T07:58:14.817842+0000","last_fullsized":"2024-04-26T07:58:14.817842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:58:14.817630+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:58:14.817630+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.817630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:31.670652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.234012+0000","last_change":"2024-04-26T07:58:13.234012+0000","last_active":"2024-04-26T07:58:13.234012+0000","last_peered":"2024-04-26T07:58:13.234012+0000","last_clean":"2024-04-26T07:58:13.234012+0000","last_became_active":"2024-04-26T07:54:06.674475+0000","last_became_peered":"2024-04-26T07:54:06.674475+0000","last_unstale":"2024-04-26T07:58:13.234012+0000","last_undegraded":"2024-04-26T07:58:13.234012+0000","last_fullsized":"2024-04-26T07:58:13.234012+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:13.233897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:13.233897+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.233897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:31.834744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.783978+0000","last_change":"2024-04-26T07:58:07.783978+0000","last_active":"2024-04-26T07:58:07.783978+0000","last_peered":"2024-04-26T07:58:07.783978+0000","last_clean":"2024-04-26T07:58:07.783978+0000","last_became_active":"2024-04-26T07:54:15.008613+0000","last_became_peered":"2024-04-26T07:54:15.008613+0000","last_unstale":"2024-04-26T07:58:07.783978+0000","last_undegraded":"2024-04-26T07:58:07.783978+0000","last_fullsized":"2024-04-26T07:58:07.783978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:07.783854+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:07.783854+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.783854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:58.598461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.191428+0000","last_change":"2024-04-26T07:57:53.191428+0000","last_active":"2024-04-26T07:57:53.191428+0000","last_peered":"2024-04-26T07:57:53.191428+0000","last_clean":"2024-04-26T07:57:53.191428+0000","last_became_active":"2024-04-26T07:54:19.009648+0000","last_became_peered":"2024-04-26T07:54:19.009648+0000","last_unstale":"2024-04-26T07:57:53.191428+0000","last_undegraded":"2024-04-26T07:57:53.191428+0000","last_fullsized":"2024-04-26T07:57:53.191428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:53.191310+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:53.191310+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.191310+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:50.616218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.312009+0000","last_change":"2024-04-26T07:57:42.312009+0000","last_active":"2024-04-26T07:57:42.312009+0000","last_peered":"2024-04-26T07:57:42.312009+0000","last_clean":"2024-04-26T07:57:42.312009+0000","last_became_active":"2024-04-26T07:54:21.019540+0000","last_became_peered":"2024-04-26T07:54:21.019540+0000","last_unstale":"2024-04-26T07:57:42.312009+0000","last_undegraded":"2024-04-26T07:57:42.312009+0000","last_fullsized":"2024-04-26T07:57:42.312009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-04-26T07:57:42.311876+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.311876+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:19:59.304320+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.073448+0000","last_change":"2024-04-26T07:57:37.073448+0000","last_active":"2024-04-26T07:57:37.073448+0000","last_peered":"2024-04-26T07:57:37.073448+0000","last_clean":"2024-04-26T07:57:37.073448+0000","last_became_active":"2024-04-26T07:54:23.023147+0000","last_became_peered":"2024-04-26T07:54:23.023147+0000","last_unstale":"2024-04-26T07:57:37.073448+0000","last_undegraded":"2024-04-26T07:57:37.073448+0000","last_fullsized":"2024-04-26T07:57:37.073448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.073329+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.073329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:12.794354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:54.126393+0000","last_change":"2024-04-26T07:58:54.126393+0000","last_active":"2024-04-26T07:58:54.126393+0000","last_peered":"2024-04-26T07:58:54.126393+0000","last_clean":"2024-04-26T07:58:54.126393+0000","last_became_active":"2024-04-26T07:54:25.038457+0000","last_became_peered":"2024-04-26T07:54:25.038457+0000","last_unstale":"2024-04-26T07:58:54.126393+0000","last_undegraded":"2024-04-26T07:58:54.126393+0000","last_fullsized":"2024-04-26T07:58:54.126393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:54.126254+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:54.126254+0000","last_clean_scrub_stamp":"2024-04-26T07:58:54.126254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:05.193343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.775067+0000","last_change":"2024-04-26T07:58:16.775067+0000","last_active":"2024-04-26T07:58:16.775067+0000","last_peered":"2024-04-26T07:58:16.775067+0000","last_clean":"2024-04-26T07:58:16.775067+0000","last_became_active":"2024-04-26T07:54:17.009200+0000","last_became_peered":"2024-04-26T07:54:17.009200+0000","last_unstale":"2024-04-26T07:58:16.775067+0000","last_undegraded":"2024-04-26T07:58:16.775067+0000","last_fullsized":"2024-04-26T07:58:16.775067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:16.774960+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:16.774960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.774960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:22:18.154848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:48.159078+0000","last_change":"2024-04-26T07:58:48.159103+0000","last_active":"2024-04-26T07:58:48.159078+0000","last_peered":"2024-04-26T07:58:48.159078+0000","last_clean":"2024-04-26T07:58:48.159078+0000","last_became_active":"2024-04-26T07:54:06.675115+0000","last_became_peered":"2024-04-26T07:54:06.675115+0000","last_unstale":"2024-04-26T07:58:48.159078+0000","last_undegraded":"2024-04-26T07:58:48.159078+0000","last_fullsized":"2024-04-26T07:58:48.159078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:48.158974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:48.158974+0000","last_clean_scrub_stamp":"2024-04-26T07:58:48.158974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:15.565863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.260678+0000","last_change":"2024-04-26T07:58:15.260678+0000","last_active":"2024-04-26T07:58:15.260678+0000","last_peered":"2024-04-26T07:58:15.260678+0000","last_clean":"2024-04-26T07:58:15.260678+0000","last_became_active":"2024-04-26T07:54:15.006437+0000","last_became_peered":"2024-04-26T07:54:15.006437+0000","last_unstale":"2024-04-26T07:58:15.260678+0000","last_undegraded":"2024-04-26T07:58:15.260678+0000","last_fullsized":"2024-04-26T07:58:15.260678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.260556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.260556+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.260556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:37.478244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.004825+0000","last_change":"2024-04-26T07:57:50.004825+0000","last_active":"2024-04-26T07:57:50.004825+0000","last_peered":"2024-04-26T07:57:50.004825+0000","last_clean":"2024-04-26T07:57:50.004825+0000","last_became_active":"2024-04-26T07:54:19.014252+0000","last_became_peered":"2024-04-26T07:54:19.014252+0000","last_unstale":"2024-04-26T07:57:50.004825+0000","last_undegraded":"2024-04-26T07:57:50.004825+0000","last_fullsized":"2024-04-26T07:57:50.004825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:50.004662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:50.004662+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.004662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:57.926317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.047055+0000","last_change":"2024-04-26T07:58:06.047055+0000","last_active":"2024-04-26T07:58:06.047055+0000","last_peered":"2024-04-26T07:58:06.047055+0000","last_clean":"2024-04-26T07:58:06.047055+0000","last_became_active":"2024-04-26T07:54:21.022135+0000","last_became_peered":"2024-04-26T07:54:21.022135+0000","last_unstale":"2024-04-26T07:58:06.047055+0000","last_undegraded":"2024-04-26T07:58:06.047055+0000","last_fullsized":"2024-04-26T07:58:06.047055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:06.046909+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:06.046909+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.046909+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:20.722729+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:56.989200+0000","last_change":"2024-04-26T07:57:56.989200+0000","last_active":"2024-04-26T07:57:56.989200+0000","last_peered":"2024-04-26T07:57:56.989200+0000","last_clean":"2024-04-26T07:57:56.989200+0000","last_became_active":"2024-04-26T07:54:23.030469+0000","last_became_peered":"2024-04-26T07:54:23.030469+0000","last_unstale":"2024-04-26T07:57:56.989200+0000","last_undegraded":"2024-04-26T07:57:56.989200+0000","last_fullsized":"2024-04-26T07:57:56.989200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:56.989067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:56.989067+0000","last_clean_scrub_stamp":"2024-04-26T07:57:56.989067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:13.842088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'12","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.160947+0000","last_change":"2024-04-26T07:58:34.160947+0000","last_active":"2024-04-26T07:58:34.160947+0000","last_peered":"2024-04-26T07:58:34.160947+0000","last_clean":"2024-04-26T07:58:34.160947+0000","last_became_active":"2024-04-26T07:54:25.037967+0000","last_became_peered":"2024-04-26T07:54:25.037967+0000","last_unstale":"2024-04-26T07:58:34.160947+0000","last_undegraded":"2024-04-26T07:58:34.160947+0000","last_fullsized":"2024-04-26T07:58:34.160947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:34.160829+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:34.160829+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.160829+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:50.498180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.199146+0000","last_change":"2024-04-26T07:57:59.199146+0000","last_active":"2024-04-26T07:57:59.199146+0000","last_peered":"2024-04-26T07:57:59.199146+0000","last_clean":"2024-04-26T07:57:59.199146+0000","last_became_active":"2024-04-26T07:54:17.010803+0000","last_became_peered":"2024-04-26T07:54:17.010803+0000","last_unstale":"2024-04-26T07:57:59.199146+0000","last_undegraded":"2024-04-26T07:57:59.199146+0000","last_fullsized":"2024-04-26T07:57:59.199146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:57:59.199017+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:57:59.199017+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.199017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:50.799925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.278734+0000","last_change":"2024-04-26T07:58:14.278734+0000","last_active":"2024-04-26T07:58:14.278734+0000","last_peered":"2024-04-26T07:58:14.278734+0000","last_clean":"2024-04-26T07:58:14.278734+0000","last_became_active":"2024-04-26T07:54:15.004271+0000","last_became_peered":"2024-04-26T07:54:15.004271+0000","last_unstale":"2024-04-26T07:58:14.278734+0000","last_undegraded":"2024-04-26T07:58:14.278734+0000","last_fullsized":"2024-04-26T07:58:14.278734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:14.278592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:14.278592+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.278592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:59.568200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.823453+0000","last_change":"2024-04-26T07:58:20.823477+0000","last_active":"2024-04-26T07:58:20.823453+0000","last_peered":"2024-04-26T07:58:20.823453+0000","last_clean":"2024-04-26T07:58:20.823453+0000","last_became_active":"2024-04-26T07:54:06.676166+0000","last_became_peered":"2024-04-26T07:54:06.676166+0000","last_unstale":"2024-04-26T07:58:20.823453+0000","last_undegraded":"2024-04-26T07:58:20.823453+0000","last_fullsized":"2024-04-26T07:58:20.823453+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:20.823362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:20.823362+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.823362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:22.325865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.898013+0000","last_change":"2024-04-26T07:57:59.898013+0000","last_active":"2024-04-26T07:57:59.898013+0000","last_peered":"2024-04-26T07:57:59.898013+0000","last_clean":"2024-04-26T07:57:59.898013+0000","last_became_active":"2024-04-26T07:54:19.009831+0000","last_became_peered":"2024-04-26T07:54:19.009831+0000","last_unstale":"2024-04-26T07:57:59.898013+0000","last_undegraded":"2024-04-26T07:57:59.898013+0000","last_fullsized":"2024-04-26T07:57:59.898013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:57:59.897890+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:57:59.897890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.897890+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:48.189618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'76","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.090487+0000","last_change":"2024-04-26T07:57:45.090487+0000","last_active":"2024-04-26T07:57:45.090487+0000","last_peered":"2024-04-26T07:57:45.090487+0000","last_clean":"2024-04-26T07:57:45.090487+0000","last_became_active":"2024-04-26T07:54:21.020926+0000","last_became_peered":"2024-04-26T07:54:21.020926+0000","last_unstale":"2024-04-26T07:57:45.090487+0000","last_undegraded":"2024-04-26T07:57:45.090487+0000","last_fullsized":"2024-04-26T07:57:45.090487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'76","last_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_deep_scrub":"29'76","last_deep_scrub_stamp":"2024-04-26T07:57:45.090359+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.090359+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:43.280370+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.248747+0000","last_change":"2024-04-26T07:57:37.248747+0000","last_active":"2024-04-26T07:57:37.248747+0000","last_peered":"2024-04-26T07:57:37.248747+0000","last_clean":"2024-04-26T07:57:37.248747+0000","last_became_active":"2024-04-26T07:54:23.026496+0000","last_became_peered":"2024-04-26T07:54:23.026496+0000","last_unstale":"2024-04-26T07:57:37.248747+0000","last_undegraded":"2024-04-26T07:57:37.248747+0000","last_fullsized":"2024-04-26T07:57:37.248747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.248591+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.248591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:12.550136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.905929+0000","last_change":"2024-04-26T07:57:58.905929+0000","last_active":"2024-04-26T07:57:58.905929+0000","last_peered":"2024-04-26T07:57:58.905929+0000","last_clean":"2024-04-26T07:57:58.905929+0000","last_became_active":"2024-04-26T07:54:25.024321+0000","last_became_peered":"2024-04-26T07:54:25.024321+0000","last_unstale":"2024-04-26T07:57:58.905929+0000","last_undegraded":"2024-04-26T07:57:58.905929+0000","last_fullsized":"2024-04-26T07:57:58.905929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-04-26T07:57:58.905750+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-04-26T07:57:58.905750+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.905750+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:46.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'18","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:35.162546+0000","last_change":"2024-04-26T07:58:35.162573+0000","last_active":"2024-04-26T07:58:35.162546+0000","last_peered":"2024-04-26T07:58:35.162546+0000","last_clean":"2024-04-26T07:58:35.162546+0000","last_became_active":"2024-04-26T07:55:02.055580+0000","last_became_peered":"2024-04-26T07:55:02.055580+0000","last_unstale":"2024-04-26T07:58:35.162546+0000","last_undegraded":"2024-04-26T07:58:35.162546+0000","last_fullsized":"2024-04-26T07:58:35.162546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-04-26T07:58:35.162449+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-04-26T07:58:35.162449+0000","last_clean_scrub_stamp":"2024-04-26T07:58:35.162449+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:51.579398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.737929+0000","last_change":"2024-04-26T07:58:26.737959+0000","last_active":"2024-04-26T07:58:26.737929+0000","last_peered":"2024-04-26T07:58:26.737929+0000","last_clean":"2024-04-26T07:58:26.737929+0000","last_became_active":"2024-04-26T07:54:15.005111+0000","last_became_peered":"2024-04-26T07:54:15.005111+0000","last_unstale":"2024-04-26T07:58:26.737929+0000","last_undegraded":"2024-04-26T07:58:26.737929+0000","last_fullsized":"2024-04-26T07:58:26.737929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:26.737834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:26.737834+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.737834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:16.237516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:45.159438+0000","last_change":"2024-04-26T07:58:45.159483+0000","last_active":"2024-04-26T07:58:45.159438+0000","last_peered":"2024-04-26T07:58:45.159438+0000","last_clean":"2024-04-26T07:58:45.159438+0000","last_became_active":"2024-04-26T07:54:06.674529+0000","last_became_peered":"2024-04-26T07:54:06.674529+0000","last_unstale":"2024-04-26T07:58:45.159438+0000","last_undegraded":"2024-04-26T07:58:45.159438+0000","last_fullsized":"2024-04-26T07:58:45.159438+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:45.159342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:45.159342+0000","last_clean_scrub_stamp":"2024-04-26T07:58:45.159342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:13:34.290550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.945054+0000","last_change":"2024-04-26T07:57:44.945054+0000","last_active":"2024-04-26T07:57:44.945054+0000","last_peered":"2024-04-26T07:57:44.945054+0000","last_clean":"2024-04-26T07:57:44.945054+0000","last_became_active":"2024-04-26T07:54:19.008833+0000","last_became_peered":"2024-04-26T07:54:19.008833+0000","last_unstale":"2024-04-26T07:57:44.945054+0000","last_undegraded":"2024-04-26T07:57:44.945054+0000","last_fullsized":"2024-04-26T07:57:44.945054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:44.944890+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.944890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:30.234498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.075367+0000","last_change":"2024-04-26T07:57:39.075367+0000","last_active":"2024-04-26T07:57:39.075367+0000","last_peered":"2024-04-26T07:57:39.075367+0000","last_clean":"2024-04-26T07:57:39.075367+0000","last_became_active":"2024-04-26T07:54:21.022150+0000","last_became_peered":"2024-04-26T07:54:21.022150+0000","last_unstale":"2024-04-26T07:57:39.075367+0000","last_undegraded":"2024-04-26T07:57:39.075367+0000","last_fullsized":"2024-04-26T07:57:39.075367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-04-26T07:57:39.075180+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.075180+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:53.257286+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":368,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.140074+0000","last_change":"2024-04-26T07:57:35.140074+0000","last_active":"2024-04-26T07:57:35.140074+0000","last_peered":"2024-04-26T07:57:35.140074+0000","last_clean":"2024-04-26T07:57:35.140074+0000","last_became_active":"2024-04-26T07:54:23.024187+0000","last_became_peered":"2024-04-26T07:54:23.024187+0000","last_unstale":"2024-04-26T07:57:35.140074+0000","last_undegraded":"2024-04-26T07:57:35.140074+0000","last_fullsized":"2024-04-26T07:57:35.140074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:35.139950+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.139950+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:52.425998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:19.144773+0000","last_change":"2024-04-26T07:58:19.144773+0000","last_active":"2024-04-26T07:58:19.144773+0000","last_peered":"2024-04-26T07:58:19.144773+0000","last_clean":"2024-04-26T07:58:19.144773+0000","last_became_active":"2024-04-26T07:54:25.035707+0000","last_became_peered":"2024-04-26T07:54:25.035707+0000","last_unstale":"2024-04-26T07:58:19.144773+0000","last_undegraded":"2024-04-26T07:58:19.144773+0000","last_fullsized":"2024-04-26T07:58:19.144773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:19.144629+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:19.144629+0000","last_clean_scrub_stamp":"2024-04-26T07:58:19.144629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:47.863551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:10.070209+0000","last_change":"2024-04-26T07:58:10.070209+0000","last_active":"2024-04-26T07:58:10.070209+0000","last_peered":"2024-04-26T07:58:10.070209+0000","last_clean":"2024-04-26T07:58:10.070209+0000","last_became_active":"2024-04-26T07:54:17.016900+0000","last_became_peered":"2024-04-26T07:54:17.016900+0000","last_unstale":"2024-04-26T07:58:10.070209+0000","last_undegraded":"2024-04-26T07:58:10.070209+0000","last_fullsized":"2024-04-26T07:58:10.070209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:10.070084+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:10.070084+0000","last_clean_scrub_stamp":"2024-04-26T07:58:10.070084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:47.245235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:42.073241+0000","last_change":"2024-04-26T07:58:42.073272+0000","last_active":"2024-04-26T07:58:42.073241+0000","last_peered":"2024-04-26T07:58:42.073241+0000","last_clean":"2024-04-26T07:58:42.073241+0000","last_became_active":"2024-04-26T07:54:15.023568+0000","last_became_peered":"2024-04-26T07:54:15.023568+0000","last_unstale":"2024-04-26T07:58:42.073241+0000","last_undegraded":"2024-04-26T07:58:42.073241+0000","last_fullsized":"2024-04-26T07:58:42.073241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:42.073141+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:42.073141+0000","last_clean_scrub_stamp":"2024-04-26T07:58:42.073141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:48.800068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.774140+0000","last_change":"2024-04-26T07:58:21.774140+0000","last_active":"2024-04-26T07:58:21.774140+0000","last_peered":"2024-04-26T07:58:21.774140+0000","last_clean":"2024-04-26T07:58:21.774140+0000","last_became_active":"2024-04-26T07:54:06.676582+0000","last_became_peered":"2024-04-26T07:54:06.676582+0000","last_unstale":"2024-04-26T07:58:21.774140+0000","last_undegraded":"2024-04-26T07:58:21.774140+0000","last_fullsized":"2024-04-26T07:58:21.774140+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:21.774021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:21.774021+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.774021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:49.274483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.927279+0000","last_change":"2024-04-26T07:57:35.927279+0000","last_active":"2024-04-26T07:57:35.927279+0000","last_peered":"2024-04-26T07:57:35.927279+0000","last_clean":"2024-04-26T07:57:35.927279+0000","last_became_active":"2024-04-26T07:54:19.014957+0000","last_became_peered":"2024-04-26T07:54:19.014957+0000","last_unstale":"2024-04-26T07:57:35.927279+0000","last_undegraded":"2024-04-26T07:57:35.927279+0000","last_fullsized":"2024-04-26T07:57:35.927279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.927147+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.927147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:35.660610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.109570+0000","last_change":"2024-04-26T07:58:04.109570+0000","last_active":"2024-04-26T07:58:04.109570+0000","last_peered":"2024-04-26T07:58:04.109570+0000","last_clean":"2024-04-26T07:58:04.109570+0000","last_became_active":"2024-04-26T07:54:21.020581+0000","last_became_peered":"2024-04-26T07:54:21.020581+0000","last_unstale":"2024-04-26T07:58:04.109570+0000","last_undegraded":"2024-04-26T07:58:04.109570+0000","last_fullsized":"2024-04-26T07:58:04.109570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-04-26T07:58:04.109417+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-04-26T07:58:04.109417+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.109417+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:41:43.464915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:39.023125+0000","last_change":"2024-04-26T07:57:39.023125+0000","last_active":"2024-04-26T07:57:39.023125+0000","last_peered":"2024-04-26T07:57:39.023125+0000","last_clean":"2024-04-26T07:57:39.023125+0000","last_became_active":"2024-04-26T07:54:23.027722+0000","last_became_peered":"2024-04-26T07:54:23.027722+0000","last_unstale":"2024-04-26T07:57:39.023125+0000","last_undegraded":"2024-04-26T07:57:39.023125+0000","last_fullsized":"2024-04-26T07:57:39.023125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:39.023000+0000","last_clean_scrub_stamp":"2024-04-26T07:57:39.023000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:21.471539+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:32.141975+0000","last_change":"2024-04-26T07:58:32.141975+0000","last_active":"2024-04-26T07:58:32.141975+0000","last_peered":"2024-04-26T07:58:32.141975+0000","last_clean":"2024-04-26T07:58:32.141975+0000","last_became_active":"2024-04-26T07:54:25.036680+0000","last_became_peered":"2024-04-26T07:54:25.036680+0000","last_unstale":"2024-04-26T07:58:32.141975+0000","last_undegraded":"2024-04-26T07:58:32.141975+0000","last_fullsized":"2024-04-26T07:58:32.141975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-26T07:58:32.141831+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-26T07:58:32.141831+0000","last_clean_scrub_stamp":"2024-04-26T07:58:32.141831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:07.275715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.223158+0000","last_change":"2024-04-26T07:58:03.223158+0000","last_active":"2024-04-26T07:58:03.223158+0000","last_peered":"2024-04-26T07:58:03.223158+0000","last_clean":"2024-04-26T07:58:03.223158+0000","last_became_active":"2024-04-26T07:54:17.009445+0000","last_became_peered":"2024-04-26T07:54:17.009445+0000","last_unstale":"2024-04-26T07:58:03.223158+0000","last_undegraded":"2024-04-26T07:58:03.223158+0000","last_fullsized":"2024-04-26T07:58:03.223158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:03.223053+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:03.223053+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.223053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:51.791934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.150682+0000","last_change":"2024-04-26T07:58:25.150682+0000","last_active":"2024-04-26T07:58:25.150682+0000","last_peered":"2024-04-26T07:58:25.150682+0000","last_clean":"2024-04-26T07:58:25.150682+0000","last_became_active":"2024-04-26T07:54:15.009456+0000","last_became_peered":"2024-04-26T07:54:15.009456+0000","last_unstale":"2024-04-26T07:58:25.150682+0000","last_undegraded":"2024-04-26T07:58:25.150682+0000","last_fullsized":"2024-04-26T07:58:25.150682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:25.150561+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:25.150561+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.150561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:35.838457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:47.121882+0000","last_change":"2024-04-26T07:58:47.121924+0000","last_active":"2024-04-26T07:58:47.121882+0000","last_peered":"2024-04-26T07:58:47.121882+0000","last_clean":"2024-04-26T07:58:47.121882+0000","last_became_active":"2024-04-26T07:54:06.674603+0000","last_became_peered":"2024-04-26T07:54:06.674603+0000","last_unstale":"2024-04-26T07:58:47.121882+0000","last_undegraded":"2024-04-26T07:58:47.121882+0000","last_fullsized":"2024-04-26T07:58:47.121882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:47.121775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:47.121775+0000","last_clean_scrub_stamp":"2024-04-26T07:58:47.121775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:43.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.983919+0000","last_change":"2024-04-26T07:57:43.983919+0000","last_active":"2024-04-26T07:57:43.983919+0000","last_peered":"2024-04-26T07:57:43.983919+0000","last_clean":"2024-04-26T07:57:43.983919+0000","last_became_active":"2024-04-26T07:54:19.009337+0000","last_became_peered":"2024-04-26T07:54:19.009337+0000","last_unstale":"2024-04-26T07:57:43.983919+0000","last_undegraded":"2024-04-26T07:57:43.983919+0000","last_fullsized":"2024-04-26T07:57:43.983919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.983811+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.983811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:02.584658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.313398+0000","last_change":"2024-04-26T07:57:40.313398+0000","last_active":"2024-04-26T07:57:40.313398+0000","last_peered":"2024-04-26T07:57:40.313398+0000","last_clean":"2024-04-26T07:57:40.313398+0000","last_became_active":"2024-04-26T07:54:21.021914+0000","last_became_peered":"2024-04-26T07:54:21.021914+0000","last_unstale":"2024-04-26T07:57:40.313398+0000","last_undegraded":"2024-04-26T07:57:40.313398+0000","last_fullsized":"2024-04-26T07:57:40.313398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-04-26T07:57:40.313247+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.313247+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:44.555766+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:34.130608+0000","last_change":"2024-04-26T07:57:34.130608+0000","last_active":"2024-04-26T07:57:34.130608+0000","last_peered":"2024-04-26T07:57:34.130608+0000","last_clean":"2024-04-26T07:57:34.130608+0000","last_became_active":"2024-04-26T07:54:23.023810+0000","last_became_peered":"2024-04-26T07:54:23.023810+0000","last_unstale":"2024-04-26T07:57:34.130608+0000","last_undegraded":"2024-04-26T07:57:34.130608+0000","last_fullsized":"2024-04-26T07:57:34.130608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:34.130497+0000","last_clean_scrub_stamp":"2024-04-26T07:57:34.130497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:01.130219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.483303+0000","last_change":"2024-04-26T07:58:25.483303+0000","last_active":"2024-04-26T07:58:25.483303+0000","last_peered":"2024-04-26T07:58:25.483303+0000","last_clean":"2024-04-26T07:58:25.483303+0000","last_became_active":"2024-04-26T07:54:25.027251+0000","last_became_peered":"2024-04-26T07:54:25.027251+0000","last_unstale":"2024-04-26T07:58:25.483303+0000","last_undegraded":"2024-04-26T07:58:25.483303+0000","last_fullsized":"2024-04-26T07:58:25.483303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.483179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.483179+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.483179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:12.197354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.417868+0000","last_change":"2024-04-26T07:58:22.417868+0000","last_active":"2024-04-26T07:58:22.417868+0000","last_peered":"2024-04-26T07:58:22.417868+0000","last_clean":"2024-04-26T07:58:22.417868+0000","last_became_active":"2024-04-26T07:54:25.026639+0000","last_became_peered":"2024-04-26T07:54:25.026639+0000","last_unstale":"2024-04-26T07:58:22.417868+0000","last_undegraded":"2024-04-26T07:58:22.417868+0000","last_fullsized":"2024-04-26T07:58:22.417868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:22.417750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:22.417750+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.417750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:46.601587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:07.246815+0000","last_change":"2024-04-26T07:58:07.246815+0000","last_active":"2024-04-26T07:58:07.246815+0000","last_peered":"2024-04-26T07:58:07.246815+0000","last_clean":"2024-04-26T07:58:07.246815+0000","last_became_active":"2024-04-26T07:54:17.012013+0000","last_became_peered":"2024-04-26T07:54:17.012013+0000","last_unstale":"2024-04-26T07:58:07.246815+0000","last_undegraded":"2024-04-26T07:58:07.246815+0000","last_fullsized":"2024-04-26T07:58:07.246815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:07.246695+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:07.246695+0000","last_clean_scrub_stamp":"2024-04-26T07:58:07.246695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.647472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.155042+0000","last_change":"2024-04-26T07:58:26.155042+0000","last_active":"2024-04-26T07:58:26.155042+0000","last_peered":"2024-04-26T07:58:26.155042+0000","last_clean":"2024-04-26T07:58:26.155042+0000","last_became_active":"2024-04-26T07:54:15.030120+0000","last_became_peered":"2024-04-26T07:54:15.030120+0000","last_unstale":"2024-04-26T07:58:26.155042+0000","last_undegraded":"2024-04-26T07:58:26.155042+0000","last_fullsized":"2024-04-26T07:58:26.155042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:26.154907+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:26.154907+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.154907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:13.155009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.997522+0000","last_change":"2024-04-26T07:57:49.997522+0000","last_active":"2024-04-26T07:57:49.997522+0000","last_peered":"2024-04-26T07:57:49.997522+0000","last_clean":"2024-04-26T07:57:49.997522+0000","last_became_active":"2024-04-26T07:54:19.011456+0000","last_became_peered":"2024-04-26T07:54:19.011456+0000","last_unstale":"2024-04-26T07:57:49.997522+0000","last_undegraded":"2024-04-26T07:57:49.997522+0000","last_fullsized":"2024-04-26T07:57:49.997522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.997377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.997377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.997377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:50.303288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:38.959627+0000","last_change":"2024-04-26T07:57:38.959627+0000","last_active":"2024-04-26T07:57:38.959627+0000","last_peered":"2024-04-26T07:57:38.959627+0000","last_clean":"2024-04-26T07:57:38.959627+0000","last_became_active":"2024-04-26T07:54:21.019327+0000","last_became_peered":"2024-04-26T07:54:21.019327+0000","last_unstale":"2024-04-26T07:57:38.959627+0000","last_undegraded":"2024-04-26T07:57:38.959627+0000","last_fullsized":"2024-04-26T07:57:38.959627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-04-26T07:57:38.959495+0000","last_clean_scrub_stamp":"2024-04-26T07:57:38.959495+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:02.058520+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.004319+0000","last_change":"2024-04-26T07:57:59.004319+0000","last_active":"2024-04-26T07:57:59.004319+0000","last_peered":"2024-04-26T07:57:59.004319+0000","last_clean":"2024-04-26T07:57:59.004319+0000","last_became_active":"2024-04-26T07:54:23.032433+0000","last_became_peered":"2024-04-26T07:54:23.032433+0000","last_unstale":"2024-04-26T07:57:59.004319+0000","last_undegraded":"2024-04-26T07:57:59.004319+0000","last_fullsized":"2024-04-26T07:57:59.004319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:59.004197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:59.004197+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.004197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.386140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:34.711972+0000","last_change":"2024-04-26T07:58:34.712003+0000","last_active":"2024-04-26T07:58:34.711972+0000","last_peered":"2024-04-26T07:58:34.711972+0000","last_clean":"2024-04-26T07:58:34.711972+0000","last_became_active":"2024-04-26T07:54:25.036481+0000","last_became_peered":"2024-04-26T07:54:25.036481+0000","last_unstale":"2024-04-26T07:58:34.711972+0000","last_undegraded":"2024-04-26T07:58:34.711972+0000","last_fullsized":"2024-04-26T07:58:34.711972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:34.711869+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:34.711869+0000","last_clean_scrub_stamp":"2024-04-26T07:58:34.711869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:20.724124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'10","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:58.212898+0000","last_change":"2024-04-26T07:57:58.212898+0000","last_active":"2024-04-26T07:57:58.212898+0000","last_peered":"2024-04-26T07:57:58.212898+0000","last_clean":"2024-04-26T07:57:58.212898+0000","last_became_active":"2024-04-26T07:54:17.011058+0000","last_became_peered":"2024-04-26T07:54:17.011058+0000","last_unstale":"2024-04-26T07:57:58.212898+0000","last_undegraded":"2024-04-26T07:57:58.212898+0000","last_fullsized":"2024-04-26T07:57:58.212898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:57:58.212714+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:57:58.212714+0000","last_clean_scrub_stamp":"2024-04-26T07:57:58.212714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:57.946177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.269076+0000","last_change":"2024-04-26T07:58:16.269076+0000","last_active":"2024-04-26T07:58:16.269076+0000","last_peered":"2024-04-26T07:58:16.269076+0000","last_clean":"2024-04-26T07:58:16.269076+0000","last_became_active":"2024-04-26T07:54:15.016581+0000","last_became_peered":"2024-04-26T07:54:15.016581+0000","last_unstale":"2024-04-26T07:58:16.269076+0000","last_undegraded":"2024-04-26T07:58:16.269076+0000","last_fullsized":"2024-04-26T07:58:16.269076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:16.268935+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:16.268935+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.268935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:03.638319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.982384+0000","last_change":"2024-04-26T07:57:45.982384+0000","last_active":"2024-04-26T07:57:45.982384+0000","last_peered":"2024-04-26T07:57:45.982384+0000","last_clean":"2024-04-26T07:57:45.982384+0000","last_became_active":"2024-04-26T07:54:19.008806+0000","last_became_peered":"2024-04-26T07:54:19.008806+0000","last_unstale":"2024-04-26T07:57:45.982384+0000","last_undegraded":"2024-04-26T07:57:45.982384+0000","last_fullsized":"2024-04-26T07:57:45.982384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:45.982268+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.982268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:08.199956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.056205+0000","last_change":"2024-04-26T07:57:49.056205+0000","last_active":"2024-04-26T07:57:49.056205+0000","last_peered":"2024-04-26T07:57:49.056205+0000","last_clean":"2024-04-26T07:57:49.056205+0000","last_became_active":"2024-04-26T07:54:21.017657+0000","last_became_peered":"2024-04-26T07:54:21.017657+0000","last_unstale":"2024-04-26T07:57:49.056205+0000","last_undegraded":"2024-04-26T07:57:49.056205+0000","last_fullsized":"2024-04-26T07:57:49.056205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:57:49.056026+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.056026+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:29.927433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:47.282688+0000","last_change":"2024-04-26T07:57:47.282688+0000","last_active":"2024-04-26T07:57:47.282688+0000","last_peered":"2024-04-26T07:57:47.282688+0000","last_clean":"2024-04-26T07:57:47.282688+0000","last_became_active":"2024-04-26T07:54:23.031338+0000","last_became_peered":"2024-04-26T07:54:23.031338+0000","last_unstale":"2024-04-26T07:57:47.282688+0000","last_undegraded":"2024-04-26T07:57:47.282688+0000","last_fullsized":"2024-04-26T07:57:47.282688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:47.282574+0000","last_clean_scrub_stamp":"2024-04-26T07:57:47.282574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.631333+0000","last_change":"2024-04-26T07:58:30.631360+0000","last_active":"2024-04-26T07:58:30.631333+0000","last_peered":"2024-04-26T07:58:30.631333+0000","last_clean":"2024-04-26T07:58:30.631333+0000","last_became_active":"2024-04-26T07:54:25.029045+0000","last_became_peered":"2024-04-26T07:54:25.029045+0000","last_unstale":"2024-04-26T07:58:30.631333+0000","last_undegraded":"2024-04-26T07:58:30.631333+0000","last_fullsized":"2024-04-26T07:58:30.631333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:30.631242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:30.631242+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.631242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:44.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:35.742570+0000","last_change":"2024-04-26T07:58:35.742570+0000","last_active":"2024-04-26T07:58:35.742570+0000","last_peered":"2024-04-26T07:58:35.742570+0000","last_clean":"2024-04-26T07:58:35.742570+0000","last_became_active":"2024-04-26T07:55:02.054708+0000","last_became_peered":"2024-04-26T07:55:02.054708+0000","last_unstale":"2024-04-26T07:58:35.742570+0000","last_undegraded":"2024-04-26T07:58:35.742570+0000","last_fullsized":"2024-04-26T07:58:35.742570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:35.742453+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:35.742453+0000","last_clean_scrub_stamp":"2024-04-26T07:58:35.742453+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:03.349486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.238368+0000","last_change":"2024-04-26T07:58:08.238368+0000","last_active":"2024-04-26T07:58:08.238368+0000","last_peered":"2024-04-26T07:58:08.238368+0000","last_clean":"2024-04-26T07:58:08.238368+0000","last_became_active":"2024-04-26T07:54:15.018355+0000","last_became_peered":"2024-04-26T07:54:15.018355+0000","last_unstale":"2024-04-26T07:58:08.238368+0000","last_undegraded":"2024-04-26T07:58:08.238368+0000","last_fullsized":"2024-04-26T07:58:08.238368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:08.238248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:08.238248+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.238248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:31.337273+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:50.302582+0000","last_change":"2024-04-26T07:57:50.302582+0000","last_active":"2024-04-26T07:57:50.302582+0000","last_peered":"2024-04-26T07:57:50.302582+0000","last_clean":"2024-04-26T07:57:50.302582+0000","last_became_active":"2024-04-26T07:54:19.013680+0000","last_became_peered":"2024-04-26T07:54:19.013680+0000","last_unstale":"2024-04-26T07:57:50.302582+0000","last_undegraded":"2024-04-26T07:57:50.302582+0000","last_fullsized":"2024-04-26T07:57:50.302582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:50.302445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:50.302445+0000","last_clean_scrub_stamp":"2024-04-26T07:57:50.302445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:36.538951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.027568+0000","last_change":"2024-04-26T07:57:48.027568+0000","last_active":"2024-04-26T07:57:48.027568+0000","last_peered":"2024-04-26T07:57:48.027568+0000","last_clean":"2024-04-26T07:57:48.027568+0000","last_became_active":"2024-04-26T07:54:21.018735+0000","last_became_peered":"2024-04-26T07:54:21.018735+0000","last_unstale":"2024-04-26T07:57:48.027568+0000","last_undegraded":"2024-04-26T07:57:48.027568+0000","last_fullsized":"2024-04-26T07:57:48.027568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-04-26T07:57:48.027433+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.027433+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:59.750634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:37.116071+0000","last_change":"2024-04-26T07:57:37.116071+0000","last_active":"2024-04-26T07:57:37.116071+0000","last_peered":"2024-04-26T07:57:37.116071+0000","last_clean":"2024-04-26T07:57:37.116071+0000","last_became_active":"2024-04-26T07:54:23.024047+0000","last_became_peered":"2024-04-26T07:54:23.024047+0000","last_unstale":"2024-04-26T07:57:37.116071+0000","last_undegraded":"2024-04-26T07:57:37.116071+0000","last_fullsized":"2024-04-26T07:57:37.116071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:37.115909+0000","last_clean_scrub_stamp":"2024-04-26T07:57:37.115909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:16.358436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:58.093443+0000","last_change":"2024-04-26T07:58:58.093474+0000","last_active":"2024-04-26T07:58:58.093443+0000","last_peered":"2024-04-26T07:58:58.093443+0000","last_clean":"2024-04-26T07:58:58.093443+0000","last_became_active":"2024-04-26T07:54:25.040080+0000","last_became_peered":"2024-04-26T07:54:25.040080+0000","last_unstale":"2024-04-26T07:58:58.093443+0000","last_undegraded":"2024-04-26T07:58:58.093443+0000","last_fullsized":"2024-04-26T07:58:58.093443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:58.093344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:58.093344+0000","last_clean_scrub_stamp":"2024-04-26T07:58:58.093344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:38.013333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:09.087254+0000","last_change":"2024-04-26T07:58:09.087254+0000","last_active":"2024-04-26T07:58:09.087254+0000","last_peered":"2024-04-26T07:58:09.087254+0000","last_clean":"2024-04-26T07:58:09.087254+0000","last_became_active":"2024-04-26T07:54:17.016952+0000","last_became_peered":"2024-04-26T07:54:17.016952+0000","last_unstale":"2024-04-26T07:58:09.087254+0000","last_undegraded":"2024-04-26T07:58:09.087254+0000","last_fullsized":"2024-04-26T07:58:09.087254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:09.087056+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:09.087056+0000","last_clean_scrub_stamp":"2024-04-26T07:58:09.087056+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:44.220939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.182175+0000","last_change":"2024-04-26T07:58:27.182175+0000","last_active":"2024-04-26T07:58:27.182175+0000","last_peered":"2024-04-26T07:58:27.182175+0000","last_clean":"2024-04-26T07:58:27.182175+0000","last_became_active":"2024-04-26T07:54:15.016292+0000","last_became_peered":"2024-04-26T07:54:15.016292+0000","last_unstale":"2024-04-26T07:58:27.182175+0000","last_undegraded":"2024-04-26T07:58:27.182175+0000","last_fullsized":"2024-04-26T07:58:27.182175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:27.182060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:27.182060+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.182060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:06.537558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.947105+0000","last_change":"2024-04-26T07:57:36.947105+0000","last_active":"2024-04-26T07:57:36.947105+0000","last_peered":"2024-04-26T07:57:36.947105+0000","last_clean":"2024-04-26T07:57:36.947105+0000","last_became_active":"2024-04-26T07:54:19.012854+0000","last_became_peered":"2024-04-26T07:54:19.012854+0000","last_unstale":"2024-04-26T07:57:36.947105+0000","last_undegraded":"2024-04-26T07:57:36.947105+0000","last_fullsized":"2024-04-26T07:57:36.947105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.946930+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.946930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.547838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'37","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.306091+0000","last_change":"2024-04-26T07:57:44.306091+0000","last_active":"2024-04-26T07:57:44.306091+0000","last_peered":"2024-04-26T07:57:44.306091+0000","last_clean":"2024-04-26T07:57:44.306091+0000","last_became_active":"2024-04-26T07:54:21.019165+0000","last_became_peered":"2024-04-26T07:54:21.019165+0000","last_unstale":"2024-04-26T07:57:44.306091+0000","last_undegraded":"2024-04-26T07:57:44.306091+0000","last_fullsized":"2024-04-26T07:57:44.306091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-04-26T07:57:44.305938+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.305938+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:46.421838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:36.210716+0000","last_change":"2024-04-26T07:57:36.210716+0000","last_active":"2024-04-26T07:57:36.210716+0000","last_peered":"2024-04-26T07:57:36.210716+0000","last_clean":"2024-04-26T07:57:36.210716+0000","last_became_active":"2024-04-26T07:54:23.027651+0000","last_became_peered":"2024-04-26T07:54:23.027651+0000","last_unstale":"2024-04-26T07:57:36.210716+0000","last_undegraded":"2024-04-26T07:57:36.210716+0000","last_fullsized":"2024-04-26T07:57:36.210716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:36.210600+0000","last_clean_scrub_stamp":"2024-04-26T07:57:36.210600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:49.401154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.081951+0000","last_change":"2024-04-26T07:58:24.081951+0000","last_active":"2024-04-26T07:58:24.081951+0000","last_peered":"2024-04-26T07:58:24.081951+0000","last_clean":"2024-04-26T07:58:24.081951+0000","last_became_active":"2024-04-26T07:54:17.009186+0000","last_became_peered":"2024-04-26T07:54:17.009186+0000","last_unstale":"2024-04-26T07:58:24.081951+0000","last_undegraded":"2024-04-26T07:58:24.081951+0000","last_fullsized":"2024-04-26T07:58:24.081951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:24.081820+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:24.081820+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.081820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:51.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.109930+0000","last_change":"2024-04-26T07:58:25.109930+0000","last_active":"2024-04-26T07:58:25.109930+0000","last_peered":"2024-04-26T07:58:25.109930+0000","last_clean":"2024-04-26T07:58:25.109930+0000","last_became_active":"2024-04-26T07:54:15.029307+0000","last_became_peered":"2024-04-26T07:54:15.029307+0000","last_unstale":"2024-04-26T07:58:25.109930+0000","last_undegraded":"2024-04-26T07:58:25.109930+0000","last_fullsized":"2024-04-26T07:58:25.109930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.109768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.109768+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.109768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:24.193718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:51.995801+0000","last_change":"2024-04-26T07:57:51.995801+0000","last_active":"2024-04-26T07:57:51.995801+0000","last_peered":"2024-04-26T07:57:51.995801+0000","last_clean":"2024-04-26T07:57:51.995801+0000","last_became_active":"2024-04-26T07:54:19.014190+0000","last_became_peered":"2024-04-26T07:54:19.014190+0000","last_unstale":"2024-04-26T07:57:51.995801+0000","last_undegraded":"2024-04-26T07:57:51.995801+0000","last_fullsized":"2024-04-26T07:57:51.995801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:51.995599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:51.995599+0000","last_clean_scrub_stamp":"2024-04-26T07:57:51.995599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:04:40.564480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:46.077254+0000","last_change":"2024-04-26T07:57:46.077293+0000","last_active":"2024-04-26T07:57:46.077254+0000","last_peered":"2024-04-26T07:57:46.077254+0000","last_clean":"2024-04-26T07:57:46.077254+0000","last_became_active":"2024-04-26T07:54:21.020324+0000","last_became_peered":"2024-04-26T07:54:21.020324+0000","last_unstale":"2024-04-26T07:57:46.077254+0000","last_undegraded":"2024-04-26T07:57:46.077254+0000","last_fullsized":"2024-04-26T07:57:46.077254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-04-26T07:57:46.077156+0000","last_clean_scrub_stamp":"2024-04-26T07:57:46.077156+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:26.087961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:35.249784+0000","last_change":"2024-04-26T07:57:35.249823+0000","last_active":"2024-04-26T07:57:35.249784+0000","last_peered":"2024-04-26T07:57:35.249784+0000","last_clean":"2024-04-26T07:57:35.249784+0000","last_became_active":"2024-04-26T07:54:23.027541+0000","last_became_peered":"2024-04-26T07:54:23.027541+0000","last_unstale":"2024-04-26T07:57:35.249784+0000","last_undegraded":"2024-04-26T07:57:35.249784+0000","last_fullsized":"2024-04-26T07:57:35.249784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:35.249689+0000","last_clean_scrub_stamp":"2024-04-26T07:57:35.249689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:56.788608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'20","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:31.639045+0000","last_change":"2024-04-26T07:58:31.639045+0000","last_active":"2024-04-26T07:58:31.639045+0000","last_peered":"2024-04-26T07:58:31.639045+0000","last_clean":"2024-04-26T07:58:31.639045+0000","last_became_active":"2024-04-26T07:54:25.029058+0000","last_became_peered":"2024-04-26T07:54:25.029058+0000","last_unstale":"2024-04-26T07:58:31.639045+0000","last_undegraded":"2024-04-26T07:58:31.639045+0000","last_fullsized":"2024-04-26T07:58:31.639045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:31.638915+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:31.638915+0000","last_clean_scrub_stamp":"2024-04-26T07:58:31.638915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:19.555087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.880431+0000","last_change":"2024-04-26T07:58:12.880431+0000","last_active":"2024-04-26T07:58:12.880431+0000","last_peered":"2024-04-26T07:58:12.880431+0000","last_clean":"2024-04-26T07:58:12.880431+0000","last_became_active":"2024-04-26T07:54:17.006395+0000","last_became_peered":"2024-04-26T07:54:17.006395+0000","last_unstale":"2024-04-26T07:58:12.880431+0000","last_undegraded":"2024-04-26T07:58:12.880431+0000","last_fullsized":"2024-04-26T07:58:12.880431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:12.880313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:12.880313+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.880313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:40.993660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:26.139498+0000","last_change":"2024-04-26T07:58:26.139498+0000","last_active":"2024-04-26T07:58:26.139498+0000","last_peered":"2024-04-26T07:58:26.139498+0000","last_clean":"2024-04-26T07:58:26.139498+0000","last_became_active":"2024-04-26T07:54:15.016109+0000","last_became_peered":"2024-04-26T07:54:15.016109+0000","last_unstale":"2024-04-26T07:58:26.139498+0000","last_undegraded":"2024-04-26T07:58:26.139498+0000","last_fullsized":"2024-04-26T07:58:26.139498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:26.139349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:26.139349+0000","last_clean_scrub_stamp":"2024-04-26T07:58:26.139349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:17.105942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:52.221980+0000","last_change":"2024-04-26T07:57:52.221980+0000","last_active":"2024-04-26T07:57:52.221980+0000","last_peered":"2024-04-26T07:57:52.221980+0000","last_clean":"2024-04-26T07:57:52.221980+0000","last_became_active":"2024-04-26T07:54:19.010134+0000","last_became_peered":"2024-04-26T07:54:19.010134+0000","last_unstale":"2024-04-26T07:57:52.221980+0000","last_undegraded":"2024-04-26T07:57:52.221980+0000","last_fullsized":"2024-04-26T07:57:52.221980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:52.221848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:52.221848+0000","last_clean_scrub_stamp":"2024-04-26T07:57:52.221848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.404236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.958887+0000","last_change":"2024-04-26T07:57:48.958926+0000","last_active":"2024-04-26T07:57:48.958887+0000","last_peered":"2024-04-26T07:57:48.958887+0000","last_clean":"2024-04-26T07:57:48.958887+0000","last_became_active":"2024-04-26T07:54:21.020771+0000","last_became_peered":"2024-04-26T07:54:21.020771+0000","last_unstale":"2024-04-26T07:57:48.958887+0000","last_undegraded":"2024-04-26T07:57:48.958887+0000","last_fullsized":"2024-04-26T07:57:48.958887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:48.958790+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.958790+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:19.997051+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.961696+0000","last_change":"2024-04-26T07:57:43.961722+0000","last_active":"2024-04-26T07:57:43.961696+0000","last_peered":"2024-04-26T07:57:43.961696+0000","last_clean":"2024-04-26T07:57:43.961696+0000","last_became_active":"2024-04-26T07:54:23.032836+0000","last_became_peered":"2024-04-26T07:54:23.032836+0000","last_unstale":"2024-04-26T07:57:43.961696+0000","last_undegraded":"2024-04-26T07:57:43.961696+0000","last_fullsized":"2024-04-26T07:57:43.961696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:43.961597+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.961597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:55.126179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:57.079948+0000","last_change":"2024-04-26T07:58:57.079948+0000","last_active":"2024-04-26T07:58:57.079948+0000","last_peered":"2024-04-26T07:58:57.079948+0000","last_clean":"2024-04-26T07:58:57.079948+0000","last_became_active":"2024-04-26T07:54:25.039698+0000","last_became_peered":"2024-04-26T07:54:25.039698+0000","last_unstale":"2024-04-26T07:58:57.079948+0000","last_undegraded":"2024-04-26T07:58:57.079948+0000","last_fullsized":"2024-04-26T07:58:57.079948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:57.079814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:57.079814+0000","last_clean_scrub_stamp":"2024-04-26T07:58:57.079814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:34.918468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.423150+0000","last_change":"2024-04-26T07:58:27.423177+0000","last_active":"2024-04-26T07:58:27.423150+0000","last_peered":"2024-04-26T07:58:27.423150+0000","last_clean":"2024-04-26T07:58:27.423150+0000","last_became_active":"2024-04-26T07:55:02.057854+0000","last_became_peered":"2024-04-26T07:55:02.057854+0000","last_unstale":"2024-04-26T07:58:27.423150+0000","last_undegraded":"2024-04-26T07:58:27.423150+0000","last_fullsized":"2024-04-26T07:58:27.423150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:27.423063+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:27.423063+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.423063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:20.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.180306+0000","last_change":"2024-04-26T07:58:24.180306+0000","last_active":"2024-04-26T07:58:24.180306+0000","last_peered":"2024-04-26T07:58:24.180306+0000","last_clean":"2024-04-26T07:58:24.180306+0000","last_became_active":"2024-04-26T07:54:15.008627+0000","last_became_peered":"2024-04-26T07:54:15.008627+0000","last_unstale":"2024-04-26T07:58:24.180306+0000","last_undegraded":"2024-04-26T07:58:24.180306+0000","last_fullsized":"2024-04-26T07:58:24.180306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:24.180151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:24.180151+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.180151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:00.943258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.182373+0000","last_change":"2024-04-26T07:57:54.182399+0000","last_active":"2024-04-26T07:57:54.182373+0000","last_peered":"2024-04-26T07:57:54.182373+0000","last_clean":"2024-04-26T07:57:54.182373+0000","last_became_active":"2024-04-26T07:54:19.005780+0000","last_became_peered":"2024-04-26T07:54:19.005780+0000","last_unstale":"2024-04-26T07:57:54.182373+0000","last_undegraded":"2024-04-26T07:57:54.182373+0000","last_fullsized":"2024-04-26T07:57:54.182373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.182281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.182281+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.182281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:41.982170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:42.036534+0000","last_change":"2024-04-26T07:57:42.036534+0000","last_active":"2024-04-26T07:57:42.036534+0000","last_peered":"2024-04-26T07:57:42.036534+0000","last_clean":"2024-04-26T07:57:42.036534+0000","last_became_active":"2024-04-26T07:54:21.020900+0000","last_became_peered":"2024-04-26T07:54:21.020900+0000","last_unstale":"2024-04-26T07:57:42.036534+0000","last_undegraded":"2024-04-26T07:57:42.036534+0000","last_fullsized":"2024-04-26T07:57:42.036534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-04-26T07:57:42.036391+0000","last_clean_scrub_stamp":"2024-04-26T07:57:42.036391+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:51.097848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.970937+0000","last_change":"2024-04-26T07:57:54.970937+0000","last_active":"2024-04-26T07:57:54.970937+0000","last_peered":"2024-04-26T07:57:54.970937+0000","last_clean":"2024-04-26T07:57:54.970937+0000","last_became_active":"2024-04-26T07:54:23.035453+0000","last_became_peered":"2024-04-26T07:54:23.035453+0000","last_unstale":"2024-04-26T07:57:54.970937+0000","last_undegraded":"2024-04-26T07:57:54.970937+0000","last_fullsized":"2024-04-26T07:57:54.970937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.970780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.970780+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.970780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:03.765699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:55.150586+0000","last_change":"2024-04-26T07:58:55.150586+0000","last_active":"2024-04-26T07:58:55.150586+0000","last_peered":"2024-04-26T07:58:55.150586+0000","last_clean":"2024-04-26T07:58:55.150586+0000","last_became_active":"2024-04-26T07:54:25.039467+0000","last_became_peered":"2024-04-26T07:54:25.039467+0000","last_unstale":"2024-04-26T07:58:55.150586+0000","last_undegraded":"2024-04-26T07:58:55.150586+0000","last_fullsized":"2024-04-26T07:58:55.150586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:58:55.150442+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:58:55.150442+0000","last_clean_scrub_stamp":"2024-04-26T07:58:55.150442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:29.702583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.689461+0000","last_change":"2024-04-26T07:58:28.689488+0000","last_active":"2024-04-26T07:58:28.689461+0000","last_peered":"2024-04-26T07:58:28.689461+0000","last_clean":"2024-04-26T07:58:28.689461+0000","last_became_active":"2024-04-26T07:54:17.009641+0000","last_became_peered":"2024-04-26T07:54:17.009641+0000","last_unstale":"2024-04-26T07:58:28.689461+0000","last_undegraded":"2024-04-26T07:58:28.689461+0000","last_fullsized":"2024-04-26T07:58:28.689461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:28.689372+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:28.689372+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.689372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.555413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:33.115459+0000","last_change":"2024-04-26T07:58:33.115459+0000","last_active":"2024-04-26T07:58:33.115459+0000","last_peered":"2024-04-26T07:58:33.115459+0000","last_clean":"2024-04-26T07:58:33.115459+0000","last_became_active":"2024-04-26T07:54:15.027915+0000","last_became_peered":"2024-04-26T07:54:15.027915+0000","last_unstale":"2024-04-26T07:58:33.115459+0000","last_undegraded":"2024-04-26T07:58:33.115459+0000","last_fullsized":"2024-04-26T07:58:33.115459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:33.115339+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:33.115339+0000","last_clean_scrub_stamp":"2024-04-26T07:58:33.115339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:08.868947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.053008+0000","last_change":"2024-04-26T07:57:53.053059+0000","last_active":"2024-04-26T07:57:53.053008+0000","last_peered":"2024-04-26T07:57:53.053008+0000","last_clean":"2024-04-26T07:57:53.053008+0000","last_became_active":"2024-04-26T07:54:19.010819+0000","last_became_peered":"2024-04-26T07:54:19.010819+0000","last_unstale":"2024-04-26T07:57:53.053008+0000","last_undegraded":"2024-04-26T07:57:53.053008+0000","last_fullsized":"2024-04-26T07:57:53.053008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:53.052892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:53.052892+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.052892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:33.924298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.067489+0000","last_change":"2024-04-26T07:58:01.067489+0000","last_active":"2024-04-26T07:58:01.067489+0000","last_peered":"2024-04-26T07:58:01.067489+0000","last_clean":"2024-04-26T07:58:01.067489+0000","last_became_active":"2024-04-26T07:54:21.024457+0000","last_became_peered":"2024-04-26T07:54:21.024457+0000","last_unstale":"2024-04-26T07:58:01.067489+0000","last_undegraded":"2024-04-26T07:58:01.067489+0000","last_fullsized":"2024-04-26T07:58:01.067489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-04-26T07:58:01.067368+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-04-26T07:58:01.067368+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.067368+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:37.830475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:43.315390+0000","last_change":"2024-04-26T07:57:43.315390+0000","last_active":"2024-04-26T07:57:43.315390+0000","last_peered":"2024-04-26T07:57:43.315390+0000","last_clean":"2024-04-26T07:57:43.315390+0000","last_became_active":"2024-04-26T07:54:23.031205+0000","last_became_peered":"2024-04-26T07:54:23.031205+0000","last_unstale":"2024-04-26T07:57:43.315390+0000","last_undegraded":"2024-04-26T07:57:43.315390+0000","last_fullsized":"2024-04-26T07:57:43.315390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-04-26T07:57:43.315236+0000","last_clean_scrub_stamp":"2024-04-26T07:57:43.315236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:00.601284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.066548+0000","last_change":"2024-04-26T07:58:23.066548+0000","last_active":"2024-04-26T07:58:23.066548+0000","last_peered":"2024-04-26T07:58:23.066548+0000","last_clean":"2024-04-26T07:58:23.066548+0000","last_became_active":"2024-04-26T07:54:25.037327+0000","last_became_peered":"2024-04-26T07:54:25.037327+0000","last_unstale":"2024-04-26T07:58:23.066548+0000","last_undegraded":"2024-04-26T07:58:23.066548+0000","last_fullsized":"2024-04-26T07:58:23.066548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:23.066431+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:23.066431+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.066431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:58.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.180634+0000","last_change":"2024-04-26T07:58:01.180680+0000","last_active":"2024-04-26T07:58:01.180634+0000","last_peered":"2024-04-26T07:58:01.180634+0000","last_clean":"2024-04-26T07:58:01.180634+0000","last_became_active":"2024-04-26T07:54:17.008996+0000","last_became_peered":"2024-04-26T07:54:17.008996+0000","last_unstale":"2024-04-26T07:58:01.180634+0000","last_undegraded":"2024-04-26T07:58:01.180634+0000","last_fullsized":"2024-04-26T07:58:01.180634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:01.180506+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:01.180506+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.180506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:09.102162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:21.193377+0000","last_change":"2024-04-26T07:58:21.193377+0000","last_active":"2024-04-26T07:58:21.193377+0000","last_peered":"2024-04-26T07:58:21.193377+0000","last_clean":"2024-04-26T07:58:21.193377+0000","last_became_active":"2024-04-26T07:54:15.016049+0000","last_became_peered":"2024-04-26T07:54:15.016049+0000","last_unstale":"2024-04-26T07:58:21.193377+0000","last_undegraded":"2024-04-26T07:58:21.193377+0000","last_fullsized":"2024-04-26T07:58:21.193377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-26T07:58:21.193259+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-26T07:58:21.193259+0000","last_clean_scrub_stamp":"2024-04-26T07:58:21.193259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:13.857858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:48.947474+0000","last_change":"2024-04-26T07:57:48.947503+0000","last_active":"2024-04-26T07:57:48.947474+0000","last_peered":"2024-04-26T07:57:48.947474+0000","last_clean":"2024-04-26T07:57:48.947474+0000","last_became_active":"2024-04-26T07:54:19.011627+0000","last_became_peered":"2024-04-26T07:54:19.011627+0000","last_unstale":"2024-04-26T07:57:48.947474+0000","last_undegraded":"2024-04-26T07:57:48.947474+0000","last_fullsized":"2024-04-26T07:57:48.947474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:48.947377+0000","last_clean_scrub_stamp":"2024-04-26T07:57:48.947377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:11.025758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.943262+0000","last_change":"2024-04-26T07:57:41.943262+0000","last_active":"2024-04-26T07:57:41.943262+0000","last_peered":"2024-04-26T07:57:41.943262+0000","last_clean":"2024-04-26T07:57:41.943262+0000","last_became_active":"2024-04-26T07:54:21.016109+0000","last_became_peered":"2024-04-26T07:54:21.016109+0000","last_unstale":"2024-04-26T07:57:41.943262+0000","last_undegraded":"2024-04-26T07:57:41.943262+0000","last_fullsized":"2024-04-26T07:57:41.943262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-04-26T07:57:41.943141+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.943141+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:28.179647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:41.021136+0000","last_change":"2024-04-26T07:57:41.021136+0000","last_active":"2024-04-26T07:57:41.021136+0000","last_peered":"2024-04-26T07:57:41.021136+0000","last_clean":"2024-04-26T07:57:41.021136+0000","last_became_active":"2024-04-26T07:54:23.020537+0000","last_became_peered":"2024-04-26T07:54:23.020537+0000","last_unstale":"2024-04-26T07:57:41.021136+0000","last_undegraded":"2024-04-26T07:57:41.021136+0000","last_fullsized":"2024-04-26T07:57:41.021136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:41.021008+0000","last_clean_scrub_stamp":"2024-04-26T07:57:41.021008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.165117+0000","last_change":"2024-04-26T07:58:00.165117+0000","last_active":"2024-04-26T07:58:00.165117+0000","last_peered":"2024-04-26T07:58:00.165117+0000","last_clean":"2024-04-26T07:58:00.165117+0000","last_became_active":"2024-04-26T07:54:25.029792+0000","last_became_peered":"2024-04-26T07:54:25.029792+0000","last_unstale":"2024-04-26T07:58:00.165117+0000","last_undegraded":"2024-04-26T07:58:00.165117+0000","last_fullsized":"2024-04-26T07:58:00.165117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:00.164987+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:00.164987+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.164987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:08.922542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'20","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:59.149371+0000","last_change":"2024-04-26T07:57:59.149404+0000","last_active":"2024-04-26T07:57:59.149371+0000","last_peered":"2024-04-26T07:57:59.149371+0000","last_clean":"2024-04-26T07:57:59.149371+0000","last_became_active":"2024-04-26T07:54:17.004295+0000","last_became_peered":"2024-04-26T07:54:17.004295+0000","last_unstale":"2024-04-26T07:57:59.149371+0000","last_undegraded":"2024-04-26T07:57:59.149371+0000","last_fullsized":"2024-04-26T07:57:59.149371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:57:59.149277+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:57:59.149277+0000","last_clean_scrub_stamp":"2024-04-26T07:57:59.149277+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:10.872478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.164884+0000","last_change":"2024-04-26T07:58:29.164884+0000","last_active":"2024-04-26T07:58:29.164884+0000","last_peered":"2024-04-26T07:58:29.164884+0000","last_clean":"2024-04-26T07:58:29.164884+0000","last_became_active":"2024-04-26T07:54:15.027910+0000","last_became_peered":"2024-04-26T07:54:15.027910+0000","last_unstale":"2024-04-26T07:58:29.164884+0000","last_undegraded":"2024-04-26T07:58:29.164884+0000","last_fullsized":"2024-04-26T07:58:29.164884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:29.164766+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:29.164766+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.164766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:45.599435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:49.256297+0000","last_change":"2024-04-26T07:57:49.256322+0000","last_active":"2024-04-26T07:57:49.256297+0000","last_peered":"2024-04-26T07:57:49.256297+0000","last_clean":"2024-04-26T07:57:49.256297+0000","last_became_active":"2024-04-26T07:54:19.015741+0000","last_became_peered":"2024-04-26T07:54:19.015741+0000","last_unstale":"2024-04-26T07:57:49.256297+0000","last_undegraded":"2024-04-26T07:57:49.256297+0000","last_fullsized":"2024-04-26T07:57:49.256297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:49.256204+0000","last_clean_scrub_stamp":"2024-04-26T07:57:49.256204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:45.178627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:44.053621+0000","last_change":"2024-04-26T07:57:44.053621+0000","last_active":"2024-04-26T07:57:44.053621+0000","last_peered":"2024-04-26T07:57:44.053621+0000","last_clean":"2024-04-26T07:57:44.053621+0000","last_became_active":"2024-04-26T07:54:21.020976+0000","last_became_peered":"2024-04-26T07:54:21.020976+0000","last_unstale":"2024-04-26T07:57:44.053621+0000","last_undegraded":"2024-04-26T07:57:44.053621+0000","last_fullsized":"2024-04-26T07:57:44.053621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-04-26T07:57:44.053488+0000","last_clean_scrub_stamp":"2024-04-26T07:57:44.053488+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:48.845821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.141983+0000","last_change":"2024-04-26T07:58:03.141983+0000","last_active":"2024-04-26T07:58:03.141983+0000","last_peered":"2024-04-26T07:58:03.141983+0000","last_clean":"2024-04-26T07:58:03.141983+0000","last_became_active":"2024-04-26T07:54:23.035372+0000","last_became_peered":"2024-04-26T07:54:23.035372+0000","last_unstale":"2024-04-26T07:58:03.141983+0000","last_undegraded":"2024-04-26T07:58:03.141983+0000","last_fullsized":"2024-04-26T07:58:03.141983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:03.141810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:03.141810+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.141810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:54.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.140931+0000","last_change":"2024-04-26T07:58:15.140931+0000","last_active":"2024-04-26T07:58:15.140931+0000","last_peered":"2024-04-26T07:58:15.140931+0000","last_clean":"2024-04-26T07:58:15.140931+0000","last_became_active":"2024-04-26T07:54:25.035640+0000","last_became_peered":"2024-04-26T07:54:25.035640+0000","last_unstale":"2024-04-26T07:58:15.140931+0000","last_undegraded":"2024-04-26T07:58:15.140931+0000","last_fullsized":"2024-04-26T07:58:15.140931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:15.140763+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:15.140763+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.140763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.744811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'12","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.149431+0000","last_change":"2024-04-26T07:58:18.149431+0000","last_active":"2024-04-26T07:58:18.149431+0000","last_peered":"2024-04-26T07:58:18.149431+0000","last_clean":"2024-04-26T07:58:18.149431+0000","last_became_active":"2024-04-26T07:54:17.010075+0000","last_became_peered":"2024-04-26T07:54:17.010075+0000","last_unstale":"2024-04-26T07:58:18.149431+0000","last_undegraded":"2024-04-26T07:58:18.149431+0000","last_fullsized":"2024-04-26T07:58:18.149431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:18.149315+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:18.149315+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.149315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:54.653554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:05.763673+0000","last_change":"2024-04-26T07:58:05.763673+0000","last_active":"2024-04-26T07:58:05.763673+0000","last_peered":"2024-04-26T07:58:05.763673+0000","last_clean":"2024-04-26T07:58:05.763673+0000","last_became_active":"2024-04-26T07:54:15.008699+0000","last_became_peered":"2024-04-26T07:54:15.008699+0000","last_unstale":"2024-04-26T07:58:05.763673+0000","last_undegraded":"2024-04-26T07:58:05.763673+0000","last_fullsized":"2024-04-26T07:58:05.763673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:05.763543+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:05.763543+0000","last_clean_scrub_stamp":"2024-04-26T07:58:05.763543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:46:45.093021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:54.087902+0000","last_change":"2024-04-26T07:57:54.087902+0000","last_active":"2024-04-26T07:57:54.087902+0000","last_peered":"2024-04-26T07:57:54.087902+0000","last_clean":"2024-04-26T07:57:54.087902+0000","last_became_active":"2024-04-26T07:54:19.010383+0000","last_became_peered":"2024-04-26T07:54:19.010383+0000","last_unstale":"2024-04-26T07:57:54.087902+0000","last_undegraded":"2024-04-26T07:57:54.087902+0000","last_fullsized":"2024-04-26T07:57:54.087902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:54.087782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:54.087782+0000","last_clean_scrub_stamp":"2024-04-26T07:57:54.087782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:11.296546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.976695+0000","last_change":"2024-04-26T07:57:40.976750+0000","last_active":"2024-04-26T07:57:40.976695+0000","last_peered":"2024-04-26T07:57:40.976695+0000","last_clean":"2024-04-26T07:57:40.976695+0000","last_became_active":"2024-04-26T07:54:21.019860+0000","last_became_peered":"2024-04-26T07:54:21.019860+0000","last_unstale":"2024-04-26T07:57:40.976695+0000","last_undegraded":"2024-04-26T07:57:40.976695+0000","last_fullsized":"2024-04-26T07:57:40.976695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-04-26T07:57:40.976569+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.976569+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:47.248039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:11.081910+0000","last_change":"2024-04-26T07:58:11.081938+0000","last_active":"2024-04-26T07:58:11.081910+0000","last_peered":"2024-04-26T07:58:11.081910+0000","last_clean":"2024-04-26T07:58:11.081910+0000","last_became_active":"2024-04-26T07:54:23.035962+0000","last_became_peered":"2024-04-26T07:54:23.035962+0000","last_unstale":"2024-04-26T07:58:11.081910+0000","last_undegraded":"2024-04-26T07:58:11.081910+0000","last_fullsized":"2024-04-26T07:58:11.081910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:11.081811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:11.081811+0000","last_clean_scrub_stamp":"2024-04-26T07:58:11.081811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.419163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'10","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:56.119287+0000","last_change":"2024-04-26T07:58:56.119287+0000","last_active":"2024-04-26T07:58:56.119287+0000","last_peered":"2024-04-26T07:58:56.119287+0000","last_clean":"2024-04-26T07:58:56.119287+0000","last_became_active":"2024-04-26T07:54:25.039670+0000","last_became_peered":"2024-04-26T07:54:25.039670+0000","last_unstale":"2024-04-26T07:58:56.119287+0000","last_undegraded":"2024-04-26T07:58:56.119287+0000","last_fullsized":"2024-04-26T07:58:56.119287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:56.119151+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:56.119151+0000","last_clean_scrub_stamp":"2024-04-26T07:58:56.119151+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:48.091999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:57.198497+0000","last_change":"2024-04-26T07:57:57.198497+0000","last_active":"2024-04-26T07:57:57.198497+0000","last_peered":"2024-04-26T07:57:57.198497+0000","last_clean":"2024-04-26T07:57:57.198497+0000","last_became_active":"2024-04-26T07:54:17.003464+0000","last_became_peered":"2024-04-26T07:54:17.003464+0000","last_unstale":"2024-04-26T07:57:57.198497+0000","last_undegraded":"2024-04-26T07:57:57.198497+0000","last_fullsized":"2024-04-26T07:57:57.198497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:57:57.198375+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:57:57.198375+0000","last_clean_scrub_stamp":"2024-04-26T07:57:57.198375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:37.209180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.127003+0000","last_change":"2024-04-26T07:58:15.127003+0000","last_active":"2024-04-26T07:58:15.127003+0000","last_peered":"2024-04-26T07:58:15.127003+0000","last_clean":"2024-04-26T07:58:15.127003+0000","last_became_active":"2024-04-26T07:54:15.018428+0000","last_became_peered":"2024-04-26T07:54:15.018428+0000","last_unstale":"2024-04-26T07:58:15.127003+0000","last_undegraded":"2024-04-26T07:58:15.127003+0000","last_fullsized":"2024-04-26T07:58:15.127003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.126867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.126867+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.126867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:18.021688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:45.971199+0000","last_change":"2024-04-26T07:57:45.971199+0000","last_active":"2024-04-26T07:57:45.971199+0000","last_peered":"2024-04-26T07:57:45.971199+0000","last_clean":"2024-04-26T07:57:45.971199+0000","last_became_active":"2024-04-26T07:54:19.017113+0000","last_became_peered":"2024-04-26T07:54:19.017113+0000","last_unstale":"2024-04-26T07:57:45.971199+0000","last_undegraded":"2024-04-26T07:57:45.971199+0000","last_fullsized":"2024-04-26T07:57:45.971199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-26T07:57:45.971081+0000","last_clean_scrub_stamp":"2024-04-26T07:57:45.971081+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.019853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'42","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.079461+0000","last_change":"2024-04-26T07:58:08.079511+0000","last_active":"2024-04-26T07:58:08.079461+0000","last_peered":"2024-04-26T07:58:08.079461+0000","last_clean":"2024-04-26T07:58:08.079461+0000","last_became_active":"2024-04-26T07:54:21.021560+0000","last_became_peered":"2024-04-26T07:54:21.021560+0000","last_unstale":"2024-04-26T07:58:08.079461+0000","last_undegraded":"2024-04-26T07:58:08.079461+0000","last_fullsized":"2024-04-26T07:58:08.079461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-04-26T07:58:08.079369+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-04-26T07:58:08.079369+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.079369+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:26.015619+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:40.018075+0000","last_change":"2024-04-26T07:57:40.018100+0000","last_active":"2024-04-26T07:57:40.018075+0000","last_peered":"2024-04-26T07:57:40.018075+0000","last_clean":"2024-04-26T07:57:40.018075+0000","last_became_active":"2024-04-26T07:54:23.021574+0000","last_became_peered":"2024-04-26T07:54:23.021574+0000","last_unstale":"2024-04-26T07:57:40.018075+0000","last_undegraded":"2024-04-26T07:57:40.018075+0000","last_fullsized":"2024-04-26T07:57:40.018075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:57:40.017985+0000","last_clean_scrub_stamp":"2024-04-26T07:57:40.017985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:33.200374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:59.115130+0000","last_change":"2024-04-26T07:58:59.115130+0000","last_active":"2024-04-26T07:58:59.115130+0000","last_peered":"2024-04-26T07:58:59.115130+0000","last_clean":"2024-04-26T07:58:59.115130+0000","last_became_active":"2024-04-26T07:54:25.039893+0000","last_became_peered":"2024-04-26T07:54:25.039893+0000","last_unstale":"2024-04-26T07:58:59.115130+0000","last_undegraded":"2024-04-26T07:58:59.115130+0000","last_fullsized":"2024-04-26T07:58:59.115130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:59.114981+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:59.114981+0000","last_clean_scrub_stamp":"2024-04-26T07:58:59.114981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:14.219470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:20.168674+0000","last_change":"2024-04-26T07:58:20.168674+0000","last_active":"2024-04-26T07:58:20.168674+0000","last_peered":"2024-04-26T07:58:20.168674+0000","last_clean":"2024-04-26T07:58:20.168674+0000","last_became_active":"2024-04-26T07:54:17.003983+0000","last_became_peered":"2024-04-26T07:54:17.003983+0000","last_unstale":"2024-04-26T07:58:20.168674+0000","last_undegraded":"2024-04-26T07:58:20.168674+0000","last_fullsized":"2024-04-26T07:58:20.168674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-04-26T07:58:20.168478+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-04-26T07:58:20.168478+0000","last_clean_scrub_stamp":"2024-04-26T07:58:20.168478+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:08:37.021499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.175200+0000","last_change":"2024-04-26T07:58:02.175200+0000","last_active":"2024-04-26T07:58:02.175200+0000","last_peered":"2024-04-26T07:58:02.175200+0000","last_clean":"2024-04-26T07:58:02.175200+0000","last_became_active":"2024-04-26T07:54:15.021944+0000","last_became_peered":"2024-04-26T07:54:15.021944+0000","last_unstale":"2024-04-26T07:58:02.175200+0000","last_undegraded":"2024-04-26T07:58:02.175200+0000","last_fullsized":"2024-04-26T07:58:02.175200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:02.175070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:02.175070+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.175070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:01:08.295392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:00.910862+0000","last_change":"2024-04-26T07:58:00.910862+0000","last_active":"2024-04-26T07:58:00.910862+0000","last_peered":"2024-04-26T07:58:00.910862+0000","last_clean":"2024-04-26T07:58:00.910862+0000","last_became_active":"2024-04-26T07:54:17.015085+0000","last_became_peered":"2024-04-26T07:54:17.015085+0000","last_unstale":"2024-04-26T07:58:00.910862+0000","last_undegraded":"2024-04-26T07:58:00.910862+0000","last_fullsized":"2024-04-26T07:58:00.910862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:58:00.910724+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:58:00.910724+0000","last_clean_scrub_stamp":"2024-04-26T07:58:00.910724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:49.811262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"29'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.749080+0000","last_change":"2024-04-26T07:58:22.749080+0000","last_active":"2024-04-26T07:58:22.749080+0000","last_peered":"2024-04-26T07:58:22.749080+0000","last_clean":"2024-04-26T07:58:22.749080+0000","last_became_active":"2024-04-26T07:54:15.001190+0000","last_became_peered":"2024-04-26T07:54:15.001190+0000","last_unstale":"2024-04-26T07:58:22.749080+0000","last_undegraded":"2024-04-26T07:58:22.749080+0000","last_fullsized":"2024-04-26T07:58:22.749080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:22.748961+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:22.748961+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.748961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:34.686493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:22.093555+0000","last_change":"2024-04-26T07:58:22.093555+0000","last_active":"2024-04-26T07:58:22.093555+0000","last_peered":"2024-04-26T07:58:22.093555+0000","last_clean":"2024-04-26T07:58:22.093555+0000","last_became_active":"2024-04-26T07:54:17.009840+0000","last_became_peered":"2024-04-26T07:54:17.009840+0000","last_unstale":"2024-04-26T07:58:22.093555+0000","last_undegraded":"2024-04-26T07:58:22.093555+0000","last_fullsized":"2024-04-26T07:58:22.093555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:22.093436+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:22.093436+0000","last_clean_scrub_stamp":"2024-04-26T07:58:22.093436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:40.796077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:38.188696+0000","last_change":"2024-04-26T07:58:38.188723+0000","last_active":"2024-04-26T07:58:38.188696+0000","last_peered":"2024-04-26T07:58:38.188696+0000","last_clean":"2024-04-26T07:58:38.188696+0000","last_became_active":"2024-04-26T07:54:15.025061+0000","last_became_peered":"2024-04-26T07:54:15.025061+0000","last_unstale":"2024-04-26T07:58:38.188696+0000","last_undegraded":"2024-04-26T07:58:38.188696+0000","last_fullsized":"2024-04-26T07:58:38.188696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:38.188591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:38.188591+0000","last_clean_scrub_stamp":"2024-04-26T07:58:38.188591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:26.600526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'6","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:18.759392+0000","last_change":"2024-04-26T07:58:18.759392+0000","last_active":"2024-04-26T07:58:18.759392+0000","last_peered":"2024-04-26T07:58:18.759392+0000","last_clean":"2024-04-26T07:58:18.759392+0000","last_became_active":"2024-04-26T07:54:17.009225+0000","last_became_peered":"2024-04-26T07:54:17.009225+0000","last_unstale":"2024-04-26T07:58:18.759392+0000","last_undegraded":"2024-04-26T07:58:18.759392+0000","last_fullsized":"2024-04-26T07:58:18.759392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:18.759273+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:18.759273+0000","last_clean_scrub_stamp":"2024-04-26T07:58:18.759273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:55.522380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:27.713666+0000","last_change":"2024-04-26T07:58:27.713720+0000","last_active":"2024-04-26T07:58:27.713666+0000","last_peered":"2024-04-26T07:58:27.713666+0000","last_clean":"2024-04-26T07:58:27.713666+0000","last_became_active":"2024-04-26T07:54:15.005232+0000","last_became_peered":"2024-04-26T07:54:15.005232+0000","last_unstale":"2024-04-26T07:58:27.713666+0000","last_undegraded":"2024-04-26T07:58:27.713666+0000","last_fullsized":"2024-04-26T07:58:27.713666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:27.713552+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:27.713552+0000","last_clean_scrub_stamp":"2024-04-26T07:58:27.713552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:07.914993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.793079+0000","last_change":"2024-04-26T07:58:04.793079+0000","last_active":"2024-04-26T07:58:04.793079+0000","last_peered":"2024-04-26T07:58:04.793079+0000","last_clean":"2024-04-26T07:58:04.793079+0000","last_became_active":"2024-04-26T07:54:16.999434+0000","last_became_peered":"2024-04-26T07:54:16.999434+0000","last_unstale":"2024-04-26T07:58:04.793079+0000","last_undegraded":"2024-04-26T07:58:04.793079+0000","last_fullsized":"2024-04-26T07:58:04.793079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:04.792960+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:04.792960+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.792960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:52.162345+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:24.790981+0000","last_change":"2024-04-26T07:58:24.790981+0000","last_active":"2024-04-26T07:58:24.790981+0000","last_peered":"2024-04-26T07:58:24.790981+0000","last_clean":"2024-04-26T07:58:24.790981+0000","last_became_active":"2024-04-26T07:54:15.002903+0000","last_became_peered":"2024-04-26T07:54:15.002903+0000","last_unstale":"2024-04-26T07:58:24.790981+0000","last_undegraded":"2024-04-26T07:58:24.790981+0000","last_fullsized":"2024-04-26T07:58:24.790981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:24.790843+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:24.790843+0000","last_clean_scrub_stamp":"2024-04-26T07:58:24.790843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:25.245426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:16.134728+0000","last_change":"2024-04-26T07:58:16.134728+0000","last_active":"2024-04-26T07:58:16.134728+0000","last_peered":"2024-04-26T07:58:16.134728+0000","last_clean":"2024-04-26T07:58:16.134728+0000","last_became_active":"2024-04-26T07:54:17.003659+0000","last_became_peered":"2024-04-26T07:54:17.003659+0000","last_unstale":"2024-04-26T07:58:16.134728+0000","last_undegraded":"2024-04-26T07:58:16.134728+0000","last_fullsized":"2024-04-26T07:58:16.134728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:16.134605+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:16.134605+0000","last_clean_scrub_stamp":"2024-04-26T07:58:16.134605+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:40.318441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:29.133764+0000","last_change":"2024-04-26T07:58:29.133764+0000","last_active":"2024-04-26T07:58:29.133764+0000","last_peered":"2024-04-26T07:58:29.133764+0000","last_clean":"2024-04-26T07:58:29.133764+0000","last_became_active":"2024-04-26T07:54:15.016891+0000","last_became_peered":"2024-04-26T07:54:15.016891+0000","last_unstale":"2024-04-26T07:58:29.133764+0000","last_undegraded":"2024-04-26T07:58:29.133764+0000","last_fullsized":"2024-04-26T07:58:29.133764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:29.133607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:29.133607+0000","last_clean_scrub_stamp":"2024-04-26T07:58:29.133607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:43.809427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.829934+0000","last_change":"2024-04-26T07:58:08.829934+0000","last_active":"2024-04-26T07:58:08.829934+0000","last_peered":"2024-04-26T07:58:08.829934+0000","last_clean":"2024-04-26T07:58:08.829934+0000","last_became_active":"2024-04-26T07:54:17.006325+0000","last_became_peered":"2024-04-26T07:54:17.006325+0000","last_unstale":"2024-04-26T07:58:08.829934+0000","last_undegraded":"2024-04-26T07:58:08.829934+0000","last_fullsized":"2024-04-26T07:58:08.829934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:08.829797+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:08.829797+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.829797+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:57.218721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.246522+0000","last_change":"2024-04-26T07:58:06.246522+0000","last_active":"2024-04-26T07:58:06.246522+0000","last_peered":"2024-04-26T07:58:06.246522+0000","last_clean":"2024-04-26T07:58:06.246522+0000","last_became_active":"2024-04-26T07:54:15.020731+0000","last_became_peered":"2024-04-26T07:54:15.020731+0000","last_unstale":"2024-04-26T07:58:06.246522+0000","last_undegraded":"2024-04-26T07:58:06.246522+0000","last_fullsized":"2024-04-26T07:58:06.246522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:06.246402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:06.246402+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.246402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:15.041321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.144982+0000","last_change":"2024-04-26T07:58:06.144982+0000","last_active":"2024-04-26T07:58:06.144982+0000","last_peered":"2024-04-26T07:58:06.144982+0000","last_clean":"2024-04-26T07:58:06.144982+0000","last_became_active":"2024-04-26T07:54:16.999006+0000","last_became_peered":"2024-04-26T07:54:16.999006+0000","last_unstale":"2024-04-26T07:58:06.144982+0000","last_undegraded":"2024-04-26T07:58:06.144982+0000","last_fullsized":"2024-04-26T07:58:06.144982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-26T07:58:06.144859+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-26T07:58:06.144859+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.144859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:24.745706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:25.759373+0000","last_change":"2024-04-26T07:58:25.759373+0000","last_active":"2024-04-26T07:58:25.759373+0000","last_peered":"2024-04-26T07:58:25.759373+0000","last_clean":"2024-04-26T07:58:25.759373+0000","last_became_active":"2024-04-26T07:54:15.005105+0000","last_became_peered":"2024-04-26T07:54:15.005105+0000","last_unstale":"2024-04-26T07:58:25.759373+0000","last_undegraded":"2024-04-26T07:58:25.759373+0000","last_fullsized":"2024-04-26T07:58:25.759373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:25.759257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:25.759257+0000","last_clean_scrub_stamp":"2024-04-26T07:58:25.759257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:16.220235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'12","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.113446+0000","last_change":"2024-04-26T07:58:30.113446+0000","last_active":"2024-04-26T07:58:30.113446+0000","last_peered":"2024-04-26T07:58:30.113446+0000","last_clean":"2024-04-26T07:58:30.113446+0000","last_became_active":"2024-04-26T07:54:17.006116+0000","last_became_peered":"2024-04-26T07:54:17.006116+0000","last_unstale":"2024-04-26T07:58:30.113446+0000","last_undegraded":"2024-04-26T07:58:30.113446+0000","last_fullsized":"2024-04-26T07:58:30.113446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:30.113312+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:30.113312+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.113312+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:52.460942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:53.152461+0000","last_change":"2024-04-26T07:58:53.152489+0000","last_active":"2024-04-26T07:58:53.152461+0000","last_peered":"2024-04-26T07:58:53.152461+0000","last_clean":"2024-04-26T07:58:53.152461+0000","last_became_active":"2024-04-26T07:54:15.028820+0000","last_became_peered":"2024-04-26T07:54:15.028820+0000","last_unstale":"2024-04-26T07:58:53.152461+0000","last_undegraded":"2024-04-26T07:58:53.152461+0000","last_fullsized":"2024-04-26T07:58:53.152461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:53.152359+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:53.152359+0000","last_clean_scrub_stamp":"2024-04-26T07:58:53.152359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:43.203261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:57:53.034344+0000","last_change":"2024-04-26T07:57:53.034344+0000","last_active":"2024-04-26T07:57:53.034344+0000","last_peered":"2024-04-26T07:57:53.034344+0000","last_clean":"2024-04-26T07:57:53.034344+0000","last_became_active":"2024-04-26T07:54:17.017818+0000","last_became_peered":"2024-04-26T07:54:17.017818+0000","last_unstale":"2024-04-26T07:57:53.034344+0000","last_undegraded":"2024-04-26T07:57:53.034344+0000","last_fullsized":"2024-04-26T07:57:53.034344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-26T07:57:53.034175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-26T07:57:53.034175+0000","last_clean_scrub_stamp":"2024-04-26T07:57:53.034175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:17.218011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:15.822410+0000","last_change":"2024-04-26T07:58:15.822410+0000","last_active":"2024-04-26T07:58:15.822410+0000","last_peered":"2024-04-26T07:58:15.822410+0000","last_clean":"2024-04-26T07:58:15.822410+0000","last_became_active":"2024-04-26T07:54:15.006745+0000","last_became_peered":"2024-04-26T07:54:15.006745+0000","last_unstale":"2024-04-26T07:58:15.822410+0000","last_undegraded":"2024-04-26T07:58:15.822410+0000","last_fullsized":"2024-04-26T07:58:15.822410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:15.822233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:15.822233+0000","last_clean_scrub_stamp":"2024-04-26T07:58:15.822233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:08.486833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:03.832314+0000","last_change":"2024-04-26T07:58:03.832314+0000","last_active":"2024-04-26T07:58:03.832314+0000","last_peered":"2024-04-26T07:58:03.832314+0000","last_clean":"2024-04-26T07:58:03.832314+0000","last_became_active":"2024-04-26T07:54:17.010977+0000","last_became_peered":"2024-04-26T07:54:17.010977+0000","last_unstale":"2024-04-26T07:58:03.832314+0000","last_undegraded":"2024-04-26T07:58:03.832314+0000","last_fullsized":"2024-04-26T07:58:03.832314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:03.832203+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:03.832203+0000","last_clean_scrub_stamp":"2024-04-26T07:58:03.832203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:26.049891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:28.138745+0000","last_change":"2024-04-26T07:58:28.138745+0000","last_active":"2024-04-26T07:58:28.138745+0000","last_peered":"2024-04-26T07:58:28.138745+0000","last_clean":"2024-04-26T07:58:28.138745+0000","last_became_active":"2024-04-26T07:54:15.017120+0000","last_became_peered":"2024-04-26T07:54:15.017120+0000","last_unstale":"2024-04-26T07:58:28.138745+0000","last_undegraded":"2024-04-26T07:58:28.138745+0000","last_fullsized":"2024-04-26T07:58:28.138745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:28.138628+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:28.138628+0000","last_clean_scrub_stamp":"2024-04-26T07:58:28.138628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:40.076160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'20","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:14.174553+0000","last_change":"2024-04-26T07:58:14.174553+0000","last_active":"2024-04-26T07:58:14.174553+0000","last_peered":"2024-04-26T07:58:14.174553+0000","last_clean":"2024-04-26T07:58:14.174553+0000","last_became_active":"2024-04-26T07:54:17.002869+0000","last_became_peered":"2024-04-26T07:54:17.002869+0000","last_unstale":"2024-04-26T07:58:14.174553+0000","last_undegraded":"2024-04-26T07:58:14.174553+0000","last_fullsized":"2024-04-26T07:58:14.174553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-04-26T07:58:14.174439+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-04-26T07:58:14.174439+0000","last_clean_scrub_stamp":"2024-04-26T07:58:14.174439+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:02.563364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:23.195915+0000","last_change":"2024-04-26T07:58:23.195915+0000","last_active":"2024-04-26T07:58:23.195915+0000","last_peered":"2024-04-26T07:58:23.195915+0000","last_clean":"2024-04-26T07:58:23.195915+0000","last_became_active":"2024-04-26T07:54:15.008414+0000","last_became_peered":"2024-04-26T07:54:15.008414+0000","last_unstale":"2024-04-26T07:58:23.195915+0000","last_undegraded":"2024-04-26T07:58:23.195915+0000","last_fullsized":"2024-04-26T07:58:23.195915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-26T07:58:23.195793+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-26T07:58:23.195793+0000","last_clean_scrub_stamp":"2024-04-26T07:58:23.195793+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:47.786960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'12","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:01.177126+0000","last_change":"2024-04-26T07:58:01.177126+0000","last_active":"2024-04-26T07:58:01.177126+0000","last_peered":"2024-04-26T07:58:01.177126+0000","last_clean":"2024-04-26T07:58:01.177126+0000","last_became_active":"2024-04-26T07:54:17.009233+0000","last_became_peered":"2024-04-26T07:54:17.009233+0000","last_unstale":"2024-04-26T07:58:01.177126+0000","last_undegraded":"2024-04-26T07:58:01.177126+0000","last_fullsized":"2024-04-26T07:58:01.177126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:01.176988+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:01.176988+0000","last_clean_scrub_stamp":"2024-04-26T07:58:01.176988+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:36.360339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:52.182275+0000","last_change":"2024-04-26T07:58:52.182314+0000","last_active":"2024-04-26T07:58:52.182275+0000","last_peered":"2024-04-26T07:58:52.182275+0000","last_clean":"2024-04-26T07:58:52.182275+0000","last_became_active":"2024-04-26T07:54:15.022662+0000","last_became_peered":"2024-04-26T07:54:15.022662+0000","last_unstale":"2024-04-26T07:58:52.182275+0000","last_undegraded":"2024-04-26T07:58:52.182275+0000","last_fullsized":"2024-04-26T07:58:52.182275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:52.182177+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:52.182177+0000","last_clean_scrub_stamp":"2024-04-26T07:58:52.182177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:06.821044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:02.216774+0000","last_change":"2024-04-26T07:58:02.216774+0000","last_active":"2024-04-26T07:58:02.216774+0000","last_peered":"2024-04-26T07:58:02.216774+0000","last_clean":"2024-04-26T07:58:02.216774+0000","last_became_active":"2024-04-26T07:54:17.007542+0000","last_became_peered":"2024-04-26T07:54:17.007542+0000","last_unstale":"2024-04-26T07:58:02.216774+0000","last_undegraded":"2024-04-26T07:58:02.216774+0000","last_fullsized":"2024-04-26T07:58:02.216774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:02.216654+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:02.216654+0000","last_clean_scrub_stamp":"2024-04-26T07:58:02.216654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:46.409764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:30.147970+0000","last_change":"2024-04-26T07:58:30.147970+0000","last_active":"2024-04-26T07:58:30.147970+0000","last_peered":"2024-04-26T07:58:30.147970+0000","last_clean":"2024-04-26T07:58:30.147970+0000","last_became_active":"2024-04-26T07:54:15.026005+0000","last_became_peered":"2024-04-26T07:54:15.026005+0000","last_unstale":"2024-04-26T07:58:30.147970+0000","last_undegraded":"2024-04-26T07:58:30.147970+0000","last_fullsized":"2024-04-26T07:58:30.147970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:30.147857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:30.147857+0000","last_clean_scrub_stamp":"2024-04-26T07:58:30.147857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:43.465610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:13.104189+0000","last_change":"2024-04-26T07:58:13.104189+0000","last_active":"2024-04-26T07:58:13.104189+0000","last_peered":"2024-04-26T07:58:13.104189+0000","last_clean":"2024-04-26T07:58:13.104189+0000","last_became_active":"2024-04-26T07:54:17.015950+0000","last_became_peered":"2024-04-26T07:54:17.015950+0000","last_unstale":"2024-04-26T07:58:13.104189+0000","last_undegraded":"2024-04-26T07:58:13.104189+0000","last_fullsized":"2024-04-26T07:58:13.104189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-26T07:58:13.104056+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-26T07:58:13.104056+0000","last_clean_scrub_stamp":"2024-04-26T07:58:13.104056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:55.412463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:04.250596+0000","last_change":"2024-04-26T07:58:04.250596+0000","last_active":"2024-04-26T07:58:04.250596+0000","last_peered":"2024-04-26T07:58:04.250596+0000","last_clean":"2024-04-26T07:58:04.250596+0000","last_became_active":"2024-04-26T07:54:15.020855+0000","last_became_peered":"2024-04-26T07:54:15.020855+0000","last_unstale":"2024-04-26T07:58:04.250596+0000","last_undegraded":"2024-04-26T07:58:04.250596+0000","last_fullsized":"2024-04-26T07:58:04.250596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:04.250456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:04.250456+0000","last_clean_scrub_stamp":"2024-04-26T07:58:04.250456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:58.426456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:08.175308+0000","last_change":"2024-04-26T07:58:08.175308+0000","last_active":"2024-04-26T07:58:08.175308+0000","last_peered":"2024-04-26T07:58:08.175308+0000","last_clean":"2024-04-26T07:58:08.175308+0000","last_became_active":"2024-04-26T07:54:16.999827+0000","last_became_peered":"2024-04-26T07:54:16.999827+0000","last_unstale":"2024-04-26T07:58:08.175308+0000","last_undegraded":"2024-04-26T07:58:08.175308+0000","last_fullsized":"2024-04-26T07:58:08.175308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-04-26T07:58:08.175191+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-04-26T07:58:08.175191+0000","last_clean_scrub_stamp":"2024-04-26T07:58:08.175191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:55.772232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:36.205744+0000","last_change":"2024-04-26T07:58:36.205744+0000","last_active":"2024-04-26T07:58:36.205744+0000","last_peered":"2024-04-26T07:58:36.205744+0000","last_clean":"2024-04-26T07:58:36.205744+0000","last_became_active":"2024-04-26T07:54:15.025117+0000","last_became_peered":"2024-04-26T07:54:15.025117+0000","last_unstale":"2024-04-26T07:58:36.205744+0000","last_undegraded":"2024-04-26T07:58:36.205744+0000","last_fullsized":"2024-04-26T07:58:36.205744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:36.205563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:36.205563+0000","last_clean_scrub_stamp":"2024-04-26T07:58:36.205563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:20.477717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:43.086837+0000","last_change":"2024-04-26T07:58:43.086837+0000","last_active":"2024-04-26T07:58:43.086837+0000","last_peered":"2024-04-26T07:58:43.086837+0000","last_clean":"2024-04-26T07:58:43.086837+0000","last_became_active":"2024-04-26T07:54:15.028808+0000","last_became_peered":"2024-04-26T07:54:15.028808+0000","last_unstale":"2024-04-26T07:58:43.086837+0000","last_undegraded":"2024-04-26T07:58:43.086837+0000","last_fullsized":"2024-04-26T07:58:43.086837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:58:43.086717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:58:43.086717+0000","last_clean_scrub_stamp":"2024-04-26T07:58:43.086717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:03.131377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:06.778152+0000","last_change":"2024-04-26T07:58:06.778152+0000","last_active":"2024-04-26T07:58:06.778152+0000","last_peered":"2024-04-26T07:58:06.778152+0000","last_clean":"2024-04-26T07:58:06.778152+0000","last_became_active":"2024-04-26T07:54:17.001096+0000","last_became_peered":"2024-04-26T07:54:17.001096+0000","last_unstale":"2024-04-26T07:58:06.778152+0000","last_undegraded":"2024-04-26T07:58:06.778152+0000","last_fullsized":"2024-04-26T07:58:06.778152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-26T07:58:06.778032+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-26T07:58:06.778032+0000","last_clean_scrub_stamp":"2024-04-26T07:58:06.778032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:37.816293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:17.768230+0000","last_change":"2024-04-26T07:58:17.768230+0000","last_active":"2024-04-26T07:58:17.768230+0000","last_peered":"2024-04-26T07:58:17.768230+0000","last_clean":"2024-04-26T07:58:17.768230+0000","last_became_active":"2024-04-26T07:54:15.007099+0000","last_became_peered":"2024-04-26T07:54:15.007099+0000","last_unstale":"2024-04-26T07:58:17.768230+0000","last_undegraded":"2024-04-26T07:58:17.768230+0000","last_fullsized":"2024-04-26T07:58:17.768230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-26T07:58:17.768099+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-26T07:58:17.768099+0000","last_clean_scrub_stamp":"2024-04-26T07:58:17.768099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:42.359267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'10","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:58:12.179748+0000","last_change":"2024-04-26T07:58:12.179748+0000","last_active":"2024-04-26T07:58:12.179748+0000","last_peered":"2024-04-26T07:58:12.179748+0000","last_clean":"2024-04-26T07:58:12.179748+0000","last_became_active":"2024-04-26T07:54:17.002687+0000","last_became_peered":"2024-04-26T07:54:17.002687+0000","last_unstale":"2024-04-26T07:58:12.179748+0000","last_undegraded":"2024-04-26T07:58:12.179748+0000","last_fullsized":"2024-04-26T07:58:12.179748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-04-26T07:58:12.179635+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-04-26T07:58:12.179635+0000","last_clean_scrub_stamp":"2024-04-26T07:58:12.179635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:43.217896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1615,"num_read_kb":1505,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705729,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705728,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":974848,"data_stored":723975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":999424,"data_stored":725076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":134133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:59:17.697 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T07:59:17.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.824+0000 7fc64490d640 1 Processor -- start 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.824+0000 7fc64490d640 1 -- start start 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc64490d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc6400954e0 0x7fc6400958c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc64490d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc640099260 con 0x7fc640095e00 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc64490d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fc64006d510 con 0x7fc6400954e0 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc63e59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc6400954e0 0x7fc6400958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc63dd9b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc640095e00 0x7fc640093040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59376/0 (socket says 172.21.15.1:59376) 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc63dd9b640 1 -- 172.21.15.1:0/495943134 learned_addr learned my addr 172.21.15.1:0/495943134 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc63e59c640 1 -- 172.21.15.1:0/495943134 >> v1:172.21.15.1:6789/0 conn(0x7fc640095e00 legacy=0x7fc640093040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc63e59c640 1 -- 172.21.15.1:0/495943134 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64006cdf0 con 0x7fc6400954e0 2024-04-26T07:59:17.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.825+0000 7fc63d59a640 1 -- 172.21.15.1:0/495943134 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667158164 0 0) 0x7fc640099260 con 0x7fc640095e00 2024-04-26T07:59:17.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.826+0000 7fc63e59c640 1 --2- 172.21.15.1:0/495943134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6400958c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc630009d90 tx=0x7fc63002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7877d6c3258be2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:59:17.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.826+0000 7fc63d59a640 1 -- 172.21.15.1:0/495943134 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc630039070 con 0x7fc6400954e0 2024-04-26T07:59:17.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.826+0000 7fc63d59a640 1 -- 172.21.15.1:0/495943134 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63002cb10 con 0x7fc6400954e0 2024-04-26T07:59:17.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.826+0000 7fc63d59a640 1 -- 172.21.15.1:0/495943134 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc63002ce10 con 0x7fc6400954e0 2024-04-26T07:59:17.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.826+0000 7fc64490d640 1 -- 172.21.15.1:0/495943134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 msgr2=0x7fc6400958c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.826+0000 7fc64490d640 1 --2- 172.21.15.1:0/495943134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6400958c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc630009d90 tx=0x7fc63002beb0 comp rx=0 tx=0).stop 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.827+0000 7fc64490d640 1 -- 172.21.15.1:0/495943134 shutdown_connections 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.827+0000 7fc64490d640 1 --2- 172.21.15.1:0/495943134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6400958c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.827+0000 7fc64490d640 1 -- 172.21.15.1:0/495943134 >> 172.21.15.1:0/495943134 conn(0x7fc64009a000 msgr2=0x7fc6400978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.827+0000 7fc64490d640 1 -- 172.21.15.1:0/495943134 shutdown_connections 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.827+0000 7fc64490d640 1 -- 172.21.15.1:0/495943134 wait complete. 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc64490d640 1 Processor -- start 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc64490d640 1 -- start start 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc64490d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6401b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc64490d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc640096210 con 0x7fc6400954e0 2024-04-26T07:59:17.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc63e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6401b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc63e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6401b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38422/0 (socket says 172.21.15.1:38422) 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc63e59c640 1 -- 172.21.15.1:0/2769542183 learned_addr learned my addr 172.21.15.1:0/2769542183 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc63e59c640 1 -- 172.21.15.1:0/2769542183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6401b4360 con 0x7fc6400954e0 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.828+0000 7fc63e59c640 1 --2- 172.21.15.1:0/2769542183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6401b3440 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc630037040 tx=0x7fc630004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.829+0000 7fc636ffd640 1 -- 172.21.15.1:0/2769542183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc630044070 con 0x7fc6400954e0 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.829+0000 7fc636ffd640 1 -- 172.21.15.1:0/2769542183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc630034e10 con 0x7fc6400954e0 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.829+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64006e590 con 0x7fc6400954e0 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.829+0000 7fc636ffd640 1 -- 172.21.15.1:0/2769542183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc630039040 con 0x7fc6400954e0 2024-04-26T07:59:17.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.829+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6401b4b60 con 0x7fc6400954e0 2024-04-26T07:59:17.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.829+0000 7fc636ffd640 1 -- 172.21.15.1:0/2769542183 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc63003f640 con 0x7fc6400954e0 2024-04-26T07:59:17.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.830+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6400636f0 con 0x7fc6400954e0 2024-04-26T07:59:17.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.830+0000 7fc636ffd640 1 --2- 172.21.15.1:0/2769542183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc620038570 0x7fc62003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T07:59:17.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.830+0000 7fc636ffd640 1 -- 172.21.15.1:0/2769542183 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6313+0+0 (secure 0 0 0) 0x7fc63006e640 con 0x7fc6400954e0 2024-04-26T07:59:17.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.830+0000 7fc63dd9b640 1 --2- 172.21.15.1:0/2769542183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc620038570 0x7fc62003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T07:59:17.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.831+0000 7fc63dd9b640 1 --2- 172.21.15.1:0/2769542183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc620038570 0x7fc62003aa30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc628000c00 tx=0x7fc628007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:59:17.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:17.834+0000 7fc636ffd640 1 -- 172.21.15.1:0/2769542183 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc63002caa0 con 0x7fc6400954e0 2024-04-26T07:59:18.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.018+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc64006b6f0 con 0x7fc6400954e0 2024-04-26T07:59:18.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.020+0000 7fc636ffd640 1 -- 172.21.15.1:0/2769542183 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fc63003f930 con 0x7fc6400954e0 2024-04-26T07:59:18.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.021+0000 7fc636ffd640 1 -- 172.21.15.1:0/2769542183 <== mon.0 v2:172.21.15.1:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc630032340 con 0x7fc6400954e0 2024-04-26T07:59:18.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.022+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc620038570 msgr2=0x7fc62003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:59:18.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.022+0000 7fc64490d640 1 --2- 172.21.15.1:0/2769542183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc620038570 0x7fc62003aa30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc628000c00 tx=0x7fc628007910 comp rx=0 tx=0).stop 2024-04-26T07:59:18.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.022+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 msgr2=0x7fc6401b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:59:18.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.022+0000 7fc64490d640 1 --2- 172.21.15.1:0/2769542183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6401b3440 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc630037040 tx=0x7fc630004a40 comp rx=0 tx=0).stop 2024-04-26T07:59:18.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.023+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 shutdown_connections 2024-04-26T07:59:18.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.023+0000 7fc64490d640 1 --2- 172.21.15.1:0/2769542183 >> [v2:172.21.15.62:6824/3728486338,v1:172.21.15.62:6825/3728486338] conn(0x7fc620038570 0x7fc62003aa30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:59:18.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.023+0000 7fc64490d640 1 --2- 172.21.15.1:0/2769542183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6400954e0 0x7fc6401b3440 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T07:59:18.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.023+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 >> 172.21.15.1:0/2769542183 conn(0x7fc64009a000 msgr2=0x7fc6400943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:59:18.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.023+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 shutdown_connections 2024-04-26T07:59:18.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-04-26T07:59:18.023+0000 7fc64490d640 1 -- 172.21.15.1:0/2769542183 wait complete. 2024-04-26T07:59:18.028 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T07:59:18.028 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T07:59:18.029 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T07:59:18.029 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:59:18.061 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T07:59:18.061 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T07:59:18.061 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:59:18.100 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T07:59:18.100 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T07:59:18.100 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:59:18.168 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T07:59:18.168 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T07:59:18.168 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:59:18.241 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T07:59:18.241 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T07:59:18.241 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T07:59:18.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:59:18.310 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T07:59:18.311 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T07:59:18.311 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T07:59:18.311 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:59:18.322 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T07:59:18.322 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T07:59:18.322 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-26T07:59:18.391 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi001.front.sepia.ceph.com 2024-04-26T07:59:18.391 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T07:59:18.527 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:59:18.528 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T07:59:18.627 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:59:18.627 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T07:59:18.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:59:18.708 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T07:59:18.767 INFO:tasks.ceph:Archiving mon data... 2024-04-26T07:59:18.768 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640/data/mon.a.tgz 2024-04-26T07:59:18.769 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-04-26T07:59:18.784 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.4lmqCF2KtZ 2024-04-26T07:59:18.785 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4lmqCF2KtZ 2024-04-26T07:59:18.917 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.4lmqCF2KtZ 2024-04-26T07:59:18.999 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.4lmqCF2KtZ is 266KB 2024-04-26T07:59:19.093 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.4lmqCF2KtZ 2024-04-26T07:59:19.108 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T07:59:19.109 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T07:59:19.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T07:59:19.227 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T07:59:19.245 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T07:59:19.245 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T07:59:19.247 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/crash to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640/remote/smithi001/crash 2024-04-26T07:59:19.248 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T07:59:19.292 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640/remote/smithi062/crash 2024-04-26T07:59:19.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T07:59:19.348 INFO:tasks.ceph:Compressing logs... 2024-04-26T07:59:19.348 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T07:59:19.351 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30133.log 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29553.log 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29215.log 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30133.log.gz 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29113.log 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29553.log.gz 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29071.log 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29113.log: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.29215.log.gz -5 2024-04-26T07:59:19.395 INFO:teuthology.orchestra.run.smithi001.stderr: --verbose -- /var/log/ceph/ceph.log 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29113.log.gz 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr:gzip/var/log/ceph/ceph-client.admin.29071.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30385.log 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29071.log.gz 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27802.log 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30385.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.30385.log.gz 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29491.log 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.27802.log.gz 2024-04-26T07:59:19.396 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29013.log 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29212.log 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29013.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29491.log.gz 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30217.log 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29013.log.gz 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29382.log 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30217.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29212.log.gz 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27920.log 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30217.log.gz 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29382.log.gz 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30259.log 2024-04-26T07:59:19.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.27920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27960.log 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.27920.log.gz 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29213.log 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30259.log.gz 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:gzip/var/log/ceph/ceph-client.admin.27960.log: -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26098.log 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29213.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.27960.log.gz 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29383.log 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29213.log.gz 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.tmp-client.admin.26098.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26098.log.gz 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29797.log 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28873.log 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29383.log.gz/var/log/ceph/ceph-client.admin.29797.log: 2024-04-26T07:59:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.29797.log.gz 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28929.log 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28873.log.gz 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29552.log 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29381.log 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29552.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28929.log.gz 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30301.log 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29552.log.gz 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30091.log 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29381.log.gz 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30552.log 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30301.log.gz 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29659.log 2024-04-26T07:59:19.399 INFO:teuthology.orchestra.run.smithi001.stderr: 85.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.30091.log.gz -5 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr: --verbose -- /var/log/ceph/ceph-client.admin.29511.log 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30552.log: /var/log/ceph/ceph-client.admin.29659.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30552.log.gz 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30049.log 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29839.log 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr: 85.5%/var/log/ceph/ceph-client.admin.29511.log: -- replaced with /var/log/ceph/ceph-client.admin.29659.log.gz 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30049.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29511.log.gz 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29380.log 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30469.log 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29839.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30049.log.gz 2024-04-26T07:59:19.400 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29743.log 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.29839.log.gz 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30343.log 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30469.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29380.log.gz 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29743.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.30469.log.gz 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30512.log 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28971.log 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29743.log.gz 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30343.log: /var/log/ceph/ceph-client.admin.30512.log: 85.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.30343.log.gz 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29701.log 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30512.log.gz 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30007.log 2024-04-26T07:59:19.401 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28971.log: /var/log/ceph/ceph-client.admin.29701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29923.log 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.28971.log.gz 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30007.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29701.log.gz 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29881.log 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30007.log.gz 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29965.log 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29923.log.gz 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30175.log 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.29881.log.gz 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30427.log 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29965.log: /var/log/ceph/ceph-client.admin.30175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29214.log 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29965.log.gz 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.30427.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.30175.log.gz 2024-04-26T07:59:19.402 INFO:teuthology.orchestra.run.smithi001.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30427.log.gz 2024-04-26T07:59:19.403 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.29214.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29214.log.gz 2024-04-26T07:59:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89123.log 2024-04-26T07:59:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63743.log 2024-04-26T07:59:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30056.log 2024-04-26T07:59:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.89123.log: /var/log/ceph/ceph-client.0.63743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71608.log 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84906.log 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.30056.log.gz 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.71608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45593.log 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.84906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61323.log 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.89123.log.gz 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.45593.log: 91.1%gzip -- replaced with /var/log/ceph/ceph-client.0.63743.log.gz -5 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.0.67373.log 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.0.84906.log.gz 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.61323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88518.log 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.71608.log.gz 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.67373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34521.log 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.88518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66163.log 2024-04-26T07:59:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61928.log 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45593.log.gz 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34521.log.gz 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.66163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79473.log 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61323.log.gz 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.61928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69793.log 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.79473.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88518.log.gz 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75238.log 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36524.log 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.69793.log: 92.5% -- replaced with /var/log/ceph/ceph-client.0.67373.log.gz 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.75238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44383.log 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.66163.log.gz 2024-04-26T07:59:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.36524.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79473.log.gz 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61928.log.gz 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.44383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76448.log 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.69793.log.gz 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55273.log 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.76448.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.75238.log.gz 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46803.log 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.55273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54668.log 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.44383.log.gz 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36524.log.gz 2024-04-26T07:59:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.46803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82498.log 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.54668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83708.log 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76448.log.gz 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.82498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34401.log 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.83708.log: gzip -5 --verbose -- 91.4% -- replaced with /var/log/ceph/ceph-client.0.55273.log.gz 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.0.71003.log 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34401.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.46803.log.gz 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.83708.log.gz 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54668.log.gz 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49223.log 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.34401.log.gz 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.71003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60718.log 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.49223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54063.log 2024-04-26T07:59:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.60718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81893.log 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82498.log.gz 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.54063.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.81893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72213.log 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49223.log.gz 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91543.log 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60718.log.gz 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.72213.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54063.log.gz 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71003.log.gz 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83103.log 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81893.log.gz 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49828.log 2024-04-26T07:59:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.91543.log: /var/log/ceph/ceph-client.0.83103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77053.log 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.49828.log: gzip -5 --verbose -- 91.1% /var/log/ceph/ceph-client.0.41358.log 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.72213.log.gz 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.77053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34441.log 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91543.log.gz 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2%/var/log/ceph/ceph-client.0.41358.log: -- replaced with /var/log/ceph/ceph-client.0.83103.log.gz 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41963.log 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34441.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.49828.log.gz 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.34441.log.gz 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77053.log.gz 2024-04-26T07:59:19.470 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.41963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73423.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51643.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41358.log.gz 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.73423.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8%/var/log/ceph/ceph-client.0.51643.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.41963.log.gz 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92753.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40148.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.92753.log: 91.6% 91.3% -- replaced with /var/log/ceph/ceph-client.0.51643.log.gzgzip 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.81288.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.73423.log.gz 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.40148.log: -- /var/log/ceph/ceph-client.0.37129.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.81288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43778.log 2024-04-26T07:59:19.471 INFO:teuthology.orchestra.run.smithi062.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.92753.log.gz 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.37129.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.40148.log.gz 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.81288.log.gz 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56483.log 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.43778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30016.log 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37129.log.gz 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.56483.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34361.log 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.30016.log.gz 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.43778.log.gz 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29936.log 2024-04-26T07:59:19.472 INFO:teuthology.orchestra.run.smithi062.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.56483.log.gz 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39543.log 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 85.5% -- replaced with /var/log/ceph/ceph-client.admin.34361.log.gz -5 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.0.38339.log 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29936.log: gzip -5 --verbose/var/log/ceph/ceph-client.0.39543.log: -- /var/log/ceph/ceph-client.0.58903.log 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.38339.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29936.log.gz 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 90.1% -- replaced with /var/log/ceph/ceph-client.0.38339.log.gz 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.78868.log 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.58903.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.39543.log.gz 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58298.log 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63138.log 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.78868.log: /var/log/ceph/ceph-client.0.58298.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58903.log.gz 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78868.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.48013.log 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.58298.log.gz 2024-04-26T07:59:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.63138.log: 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55878.log 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.48013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62533.log 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.55878.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.63138.log.gz 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48013.log.gz 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59508.log 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.62533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35314.log 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.59508.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55878.log.gz 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43173.log 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.35314.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62533.log.gz 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67978.log 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.59508.log.gz 2024-04-26T07:59:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.43173.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.35314.log.gz 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29976.log 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43173.log.gz/var/log/ceph/ceph-client.0.67978.log: 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65558.log 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34481.log 85.3% -- replaced with /var/log/ceph/ceph-client.admin.29976.log.gz 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90938.log 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.34481.log: /var/log/ceph/ceph-client.0.65558.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.34481.log.gz 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.65558.log.gz 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.67978.log.gz 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78263.log 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.90938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64348.log 2024-04-26T07:59:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.78263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57088.log 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.64348.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.90938.log.gz 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70398.log 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.57088.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78263.log.gz 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64348.log.gz 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87308.log 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.57088.log.gz/var/log/ceph/ceph-client.0.70398.log: 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80683.log 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.87308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74633.log 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.80683.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.70398.log.gz 2024-04-26T07:59:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- 91.0% -- replaced with /var/log/ceph/ceph-client.0.87308.log.gz 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.0.93358.log 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.74633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38938.log 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.93358.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.74633.log.gz 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80683.log.gz 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose 90.9% -- replaced with /var/log/ceph/ceph-client.0.93358.log.gz 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.0.95225.log 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.38938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60113.log 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.95225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86104.log 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.60113.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.38938.log.gz 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68583.log 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.86104.log: 90.9% 90.3% -- replaced with /var/log/ceph/ceph-client.0.60113.log.gz 2024-04-26T07:59:19.477 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.86104.log.gz 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51038.log 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.68583.log: 93.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46198.log 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.95225.log.gz 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.51038.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.51038.log.gz 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr: 92.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77658.log 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.68583.log.gz 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.46198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53458.log 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69188.log 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.77658.log: /var/log/ceph/ceph-client.0.53458.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46198.log.gz 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.77658.log.gz 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.53458.log.gz 2024-04-26T07:59:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94568.log 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.0.69188.log: -5 --verbose -- /var/log/ceph/ceph-client.0.42568.log 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.94568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93963.log 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.42568.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69188.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.0.94568.log.gz 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84307.log 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.42568.log.gz 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.93963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48618.log 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72818.log 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.48618.log: /var/log/ceph/ceph-client.0.84307.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.93963.log.gz 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84307.log.gz 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66768.log 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.72818.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48618.log.gz 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92148.log 2024-04-26T07:59:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.66768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50433.log 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.92148.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72818.log.gz 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.66768.log.gz 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86703.log 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.50433.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92148.log.gz 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57693.log 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40753.log 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.86703.log: /var/log/ceph/ceph-client.0.57693.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.50433.log.gz 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52853.log 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.40753.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.57693.log.gz 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.86703.log.gz 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37734.log 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44988.log 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.40753.log.gz 2024-04-26T07:59:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.52853.log: /var/log/ceph/ceph-client.0.37734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52248.log 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.44988.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52853.log.gz 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47408.log 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.37734.log.gz 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.44988.log.gz 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.52248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87913.log 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.47408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89728.log 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.87913.log: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52248.log.gz 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.47408.log.gz 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74028.log 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87913.log.gz 2024-04-26T07:59:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5/var/log/ceph/ceph-client.0.89728.log: --verbose -- /var/log/ceph/ceph-client.0.80078.log 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.74028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85505.log 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.80078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35919.log 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.85505.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89728.log.gz 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74028.log.gz 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.85505.log.gz 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75843.log 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.35919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90333.log 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.75843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64953.log 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80078.log.gz/var/log/ceph/ceph-client.0.90333.log: 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.75843.log.gz 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35919.log.gz 2024-04-26T07:59:19.482 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90333.log.gz 2024-04-26T07:59:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.64953.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64953.log.gz 2024-04-26T07:59:19.483 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T07:59:19.554 INFO:teuthology.orchestra.run.smithi001.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T07:59:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T07:59:20.390 INFO:teuthology.orchestra.run.smithi001.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T07:59:20.392 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-04-26T07:59:20.392 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m1.029s 2024-04-26T07:59:20.392 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m1.186s 2024-04-26T07:59:20.392 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m0.064s 2024-04-26T07:59:20.433 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T07:59:20.475 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T07:59:20.476 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-26T07:59:20.476 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m1.109s 2024-04-26T07:59:20.476 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m3.169s 2024-04-26T07:59:20.477 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.204s 2024-04-26T07:59:20.477 INFO:tasks.ceph:Archiving logs... 2024-04-26T07:59:20.477 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640/remote/smithi001/log 2024-04-26T07:59:20.478 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T07:59:20.726 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640/remote/smithi062/log 2024-04-26T07:59:20.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T07:59:21.295 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T07:59:21.307 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T07:59:21.307 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T07:59:21.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T07:59:21.387 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T07:59:21.396 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T07:59:21.397 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:59:21.400 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:59:21.413 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-04-26T07:59:21.414 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +372us[ +347us] +/- 48ms 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -1057us[-1082us] +/- 50ms 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +881us[ +881us] +/- 72ms 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +307us[ +321us] +/- 48ms 2024-04-26T07:59:21.419 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -1117us[-1117us] +/- 50ms 2024-04-26T07:59:21.420 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +812us[ +826us] +/- 72ms 2024-04-26T07:59:21.420 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:59:21.420 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T07:59:21.442 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T07:59:21.443 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T07:59:21.474 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T07:59:21.537 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T07:59:21.596 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T07:59:21.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:59:21.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T07:59:21.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:59:21.651 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T07:59:21.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T07:59:21.682 INFO:teuthology.task.internal:Duration was 694.847638 seconds 2024-04-26T07:59:21.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T07:59:21.715 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T07:59:21.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T07:59:21.718 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T07:59:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:59:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:59:22.069 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T07:59:22.069 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-04-26T07:59:22.069 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T07:59:22.123 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-04-26T07:59:22.123 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T07:59:22.150 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T07:59:22.150 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:59:22.165 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:59:22.216 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T07:59:22.217 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T07:59:22.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T07:59:22.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T07:59:22.362 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T07:59:22.362 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T07:59:22.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T07:59:22.411 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T07:59:22.421 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:59:22.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:59:22.448 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-04-26T07:59:22.474 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-04-26T07:59:22.508 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:59:22.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:59:22.527 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:59:22.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:59:22.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T07:59:22.573 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T07:59:22.574 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640/remote/smithi001 2024-04-26T07:59:22.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T07:59:22.608 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674640/remote/smithi062 2024-04-26T07:59:22.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T07:59:22.643 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T07:59:22.644 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T07:59:22.646 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T07:59:22.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T07:59:22.706 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T07:59:22.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T07:59:22.725 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T07:59:22.725 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T07:59:22.727 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T07:59:22.740 INFO:teuthology.orchestra.run.smithi001.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 07:59 /home/ubuntu/cephtest 2024-04-26T07:59:22.747 INFO:teuthology.orchestra.run.smithi062.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 07:59 /home/ubuntu/cephtest 2024-04-26T07:59:22.749 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T07:59:22.759 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T07:59:22.827 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 694.847638130188 flavor: default owner: scheduled_gsalomon@teuthology success: true 2024-04-26T07:59:22.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T07:59:22.905 INFO:teuthology.run:pass